2023-10-06T05:12:22.780 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T05:12:22.780 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332 --owner scheduled_yuriw@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --verbose -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/orig.config.yaml 2023-10-06T05:12:22.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:12:22.905 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} email: yweinste@redhat.com first_in_suite: false job_id: '7412332' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T05:12:22.905 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T05:12:22.906 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T05:12:22.906 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T05:12:22.908 INFO:teuthology.task.internal:Checking packages... 2023-10-06T05:12:22.931 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T05:12:22.931 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T05:12:22.931 INFO:teuthology.packaging:ref: None 2023-10-06T05:12:22.931 INFO:teuthology.packaging:tag: None 2023-10-06T05:12:22.931 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T05:12:22.931 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T05:12:22.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T05:12:23.149 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274-g68e53a4a-1focal 2023-10-06T05:12:23.149 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T05:12:23.155 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T05:12:23.156 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T05:12:23.193 INFO:teuthology.task.internal:Saving configuration 2023-10-06T05:12:23.210 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T05:12:23.227 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T05:12:23.245 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 05:04:17.514767', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T05:12:23.265 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 05:04:17.513396', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T05:12:23.266 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T05:12:23.272 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T05:12:23.273 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T05:12:23.273 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T05:12:23.358 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f63c4f3e040>, signals=[15]) 2023-10-06T05:12:23.358 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T05:12:23.364 INFO:teuthology.task.internal:Opening connections... 2023-10-06T05:12:23.364 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:12:23.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:12:23.407 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:12:23.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:12:23.455 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T05:12:23.462 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-10-06T05:12:23.484 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-10-06T05:12:23.485 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-10-06T05:12:23.534 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu" 2023-10-06T05:12:23.534 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T05:12:23.534 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu 2023-10-06T05:12:23.534 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian 2023-10-06T05:12:23.534 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T05:12:23.534 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="20.04" 2023-10-06T05:12:23.535 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T05:12:23.535 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T05:12:23.535 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T05:12:23.535 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T05:12:23.535 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=focal 2023-10-06T05:12:23.535 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=focal 2023-10-06T05:12:23.535 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-10-06T05:12:23.561 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-10-06T05:12:23.568 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-10-06T05:12:23.568 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-10-06T05:12:23.575 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2023-10-06T05:12:23.575 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T05:12:23.575 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2023-10-06T05:12:23.575 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2023-10-06T05:12:23.575 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T05:12:23.575 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="20.04" 2023-10-06T05:12:23.575 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T05:12:23.575 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T05:12:23.576 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T05:12:23.576 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T05:12:23.576 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=focal 2023-10-06T05:12:23.576 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=focal 2023-10-06T05:12:23.576 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-10-06T05:12:23.594 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T05:12:23.604 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T05:12:23.629 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T05:12:23.629 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2023-10-06T05:12:23.631 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2023-10-06T05:12:23.637 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T05:12:23.652 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T05:12:23.652 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2023-10-06T05:12:23.678 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2023-10-06T05:12:23.696 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T05:12:23.751 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T05:12:23.766 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T05:12:23.766 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T05:12:23.766 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T05:12:23.767 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T05:12:23.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:12:23.772 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-10-06T05:12:23.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:12:23.773 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2023-10-06T05:12:23.779 INFO:teuthology.orchestra.run.smithi029.stdout:5.4.0-124-generic 2023-10-06T05:12:23.779 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.4.0-124-generic 2023-10-06T05:12:23.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get clean 2023-10-06T05:12:23.821 INFO:teuthology.orchestra.run.smithi173.stdout:5.4.0-124-generic 2023-10-06T05:12:23.821 INFO:teuthology.task.kernel:Running kernel on smithi173: 5.4.0-124-generic 2023-10-06T05:12:23.821 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get clean 2023-10-06T05:12:23.933 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2023-10-06T05:12:23.935 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2023-10-06T05:12:24.117 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T05:12:24.124 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T05:12:24.125 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T05:12:24.125 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T05:12:24.133 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T05:12:24.177 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T05:12:24.193 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T05:12:24.227 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T05:12:24.517 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T05:12:24.518 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T05:12:24.667 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T05:12:24.678 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T05:12:24.683 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T05:12:24.683 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T05:12:24.689 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T05:12:24.693 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T05:12:24.698 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T05:12:24.699 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T05:12:24.701 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T05:12:24.702 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T05:12:24.709 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T05:12:24.710 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T05:12:24.713 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T05:12:24.713 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T05:12:24.715 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T05:12:24.717 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T05:12:24.717 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T05:12:24.717 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T05:12:24.718 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T05:12:24.718 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T05:12:24.731 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T05:12:24.731 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T05:12:24.733 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T05:12:24.734 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T05:12:24.734 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T05:12:24.734 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T05:12:24.735 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T05:12:24.735 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T05:12:24.738 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T05:12:24.746 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T05:12:24.747 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T05:12:24.750 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T05:12:24.751 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T05:12:24.751 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T05:12:24.751 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T05:12:24.756 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T05:12:24.770 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T05:12:24.771 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T05:12:24.794 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T05:12:24.797 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T05:12:24.797 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T05:12:24.797 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T05:12:24.813 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T05:12:24.816 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T05:12:24.816 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T05:12:24.821 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T05:12:24.829 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T05:12:24.831 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T05:12:24.831 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T05:12:24.831 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T05:12:24.832 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T05:12:24.841 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T05:12:24.844 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T05:12:24.845 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T05:12:24.845 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T05:12:24.845 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T05:12:24.861 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T05:12:24.921 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T05:12:24.922 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T05:12:25.320 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T05:12:25.335 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T05:12:25.344 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T05:12:25.344 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T05:12:25.419 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T05:12:25.419 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T05:12:25.426 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T05:12:25.426 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T05:12:25.447 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T05:12:25.624 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T05:12:26.040 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T05:12:26.046 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T05:12:26.048 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T05:12:26.056 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T05:12:26.058 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T05:12:28.548 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 17.6 MB in 3s (6,826 kB/s) 2023-10-06T05:12:28.849 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 17.6 MB in 3s (6,450 kB/s) 2023-10-06T05:12:29.955 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2023-10-06T05:12:29.980 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T05:12:30.066 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2023-10-06T05:12:30.267 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2023-10-06T05:12:30.268 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2023-10-06T05:12:30.458 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2023-10-06T05:12:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T05:12:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T05:12:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T05:12:30.460 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2023-10-06T05:12:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T05:12:30.460 INFO:teuthology.orchestra.run.smithi173.stdout:Recommended packages: 2023-10-06T05:12:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: thermald 2023-10-06T05:12:30.507 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2023-10-06T05:12:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T05:12:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T05:12:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T05:12:30.508 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2023-10-06T05:12:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T05:12:30.690 INFO:teuthology.orchestra.run.smithi173.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T05:12:30.690 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 77.0 MB of archives. 2023-10-06T05:12:30.691 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T05:12:30.691 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T05:12:30.931 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2023-10-06T05:12:30.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T05:12:31.033 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2023-10-06T05:12:31.239 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2023-10-06T05:12:31.239 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2023-10-06T05:12:31.424 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2023-10-06T05:12:31.424 INFO:teuthology.orchestra.run.smithi029.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T05:12:31.424 INFO:teuthology.orchestra.run.smithi029.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T05:12:31.424 INFO:teuthology.orchestra.run.smithi029.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T05:12:31.425 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2023-10-06T05:12:31.425 INFO:teuthology.orchestra.run.smithi029.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T05:12:31.425 INFO:teuthology.orchestra.run.smithi029.stdout:Recommended packages: 2023-10-06T05:12:31.425 INFO:teuthology.orchestra.run.smithi029.stdout: thermald 2023-10-06T05:12:31.481 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2023-10-06T05:12:31.481 INFO:teuthology.orchestra.run.smithi029.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T05:12:31.481 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T05:12:31.482 INFO:teuthology.orchestra.run.smithi029.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T05:12:31.482 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2023-10-06T05:12:31.483 INFO:teuthology.orchestra.run.smithi029.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T05:12:31.665 INFO:teuthology.orchestra.run.smithi029.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T05:12:31.665 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 77.0 MB of archives. 2023-10-06T05:12:31.666 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T05:12:31.666 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T05:12:31.841 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T05:12:32.168 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T05:12:32.788 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T05:12:33.055 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T05:12:33.454 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T05:12:33.454 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T05:12:33.454 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T05:12:33.831 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T05:12:33.873 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T05:12:34.547 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 77.0 MB in 3s (22.9 MB/s) 2023-10-06T05:12:34.596 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T05:12:34.596 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T05:12:34.597 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T05:12:34.742 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T05:12:35.731 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T05:12:35.834 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T05:12:36.549 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 77.0 MB in 4s (17.7 MB/s) 2023-10-06T05:12:36.553 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T05:12:36.558 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T05:12:36.665 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:36.786 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T05:12:38.625 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T05:12:38.640 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T05:12:38.737 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:39.263 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T05:12:39.268 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T05:12:39.366 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:39.845 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T05:12:39.859 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T05:12:39.903 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:41.753 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T05:12:41.769 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T05:12:41.878 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:43.102 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T05:12:43.117 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T05:12:43.152 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:45.049 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T05:12:45.173 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T05:12:45.524 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T05:12:45.651 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T05:12:45.996 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T05:12:46.014 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T05:12:46.054 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T05:12:47.999 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T05:12:48.141 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T05:12:48.521 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T05:12:48.648 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T05:12:49.038 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T05:12:49.056 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T05:12:49.105 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T05:12:51.425 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T05:12:51.448 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T05:12:51.492 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:54.233 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T05:12:54.353 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T05:12:54.730 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T05:12:54.859 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:54.985 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:55.219 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T05:12:55.240 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T05:12:55.277 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:56.204 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:57.615 INFO:teuthology.orchestra.run.smithi173.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T05:12:57.616 INFO:teuthology.orchestra.run.smithi173.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T05:12:57.774 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T05:12:57.900 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:59.118 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T05:12:59.246 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T05:12:59.371 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:12:59.445 INFO:teuthology.orchestra.run.smithi173.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T05:12:59.445 INFO:teuthology.orchestra.run.smithi173.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T05:12:59.577 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T05:12:59.737 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T05:13:00.079 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T05:13:00.182 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:13:00.300 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:13:01.558 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:13:03.375 INFO:teuthology.orchestra.run.smithi029.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T05:13:03.375 INFO:teuthology.orchestra.run.smithi029.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T05:13:04.345 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T05:13:04.464 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:13:05.677 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T05:13:06.189 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T05:13:06.189 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T05:13:06.190 INFO:teuthology.orchestra.run.smithi029.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T05:13:06.190 INFO:teuthology.orchestra.run.smithi029.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T05:13:21.328 INFO:teuthology.orchestra.run.smithi173.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T05:13:21.329 INFO:teuthology.orchestra.run.smithi173.stdout:Sourcing file `/etc/default/grub' 2023-10-06T05:13:21.340 INFO:teuthology.orchestra.run.smithi173.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T05:13:21.372 INFO:teuthology.orchestra.run.smithi173.stdout:Generating grub configuration file ... 2023-10-06T05:13:21.646 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T05:13:21.670 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T05:13:22.057 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T05:13:22.069 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T05:13:24.100 INFO:teuthology.orchestra.run.smithi173.stdout:done 2023-10-06T05:13:24.540 DEBUG:teuthology.orchestra.run.smithi173:> dpkg -s linux-image-generic 2023-10-06T05:13:24.593 INFO:teuthology.orchestra.run.smithi173.stdout:Package: linux-image-generic 2023-10-06T05:13:24.593 INFO:teuthology.orchestra.run.smithi173.stdout:Status: install ok installed 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Priority: optional 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Section: kernel 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Installed-Size: 20 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: amd64 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Source: linux-meta 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Version: 5.4.0.164.161 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Recommends: thermald 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout:Description: Generic Linux kernel image 2023-10-06T05:13:24.594 INFO:teuthology.orchestra.run.smithi173.stdout: This package will always depend on the latest generic kernel image 2023-10-06T05:13:24.595 INFO:teuthology.orchestra.run.smithi173.stdout: available. 2023-10-06T05:13:24.595 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T05:13:24.595 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T05:13:24.595 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T05:13:24.595 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T05:13:24.595 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T05:13:24.595 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get clean 2023-10-06T05:13:24.672 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2023-10-06T05:13:24.820 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T05:13:24.820 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T05:13:24.825 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T05:13:24.842 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T05:13:26.555 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2023-10-06T05:13:26.579 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T05:13:26.649 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2023-10-06T05:13:26.828 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2023-10-06T05:13:26.829 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2023-10-06T05:13:27.037 INFO:teuthology.orchestra.run.smithi173.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T05:13:27.038 INFO:teuthology.orchestra.run.smithi173.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T05:13:27.039 DEBUG:teuthology.orchestra.run.smithi173:> dpkg -s linux-image-generic 2023-10-06T05:13:27.057 INFO:teuthology.orchestra.run.smithi173.stdout:Package: linux-image-generic 2023-10-06T05:13:27.057 INFO:teuthology.orchestra.run.smithi173.stdout:Status: install ok installed 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Priority: optional 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Section: kernel 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Installed-Size: 20 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: amd64 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Source: linux-meta 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Version: 5.4.0.164.161 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Recommends: thermald 2023-10-06T05:13:27.058 INFO:teuthology.orchestra.run.smithi173.stdout:Description: Generic Linux kernel image 2023-10-06T05:13:27.059 INFO:teuthology.orchestra.run.smithi173.stdout: This package will always depend on the latest generic kernel image 2023-10-06T05:13:27.059 INFO:teuthology.orchestra.run.smithi173.stdout: available. 2023-10-06T05:13:27.059 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2023-10-06T05:13:27.065 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.hSRBZjOZV1 2023-10-06T05:13:27.066 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hSRBZjOZV1 2023-10-06T05:13:27.079 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.hSRBZjOZV1 2023-10-06T05:13:27.163 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.hSRBZjOZV1 is 9KB 2023-10-06T05:13:27.177 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.hSRBZjOZV1 2023-10-06T05:13:27.184 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T05:13:27.242 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:13:27.242 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T05:13:27.242 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T05:13:27.277 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T05:13:27.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo update-grub 2023-10-06T05:13:28.626 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub' 2023-10-06T05:13:28.631 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T05:13:28.646 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2023-10-06T05:13:28.891 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T05:13:28.903 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T05:13:29.303 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T05:13:29.315 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T05:13:29.339 INFO:teuthology.orchestra.run.smithi029.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T05:13:29.339 INFO:teuthology.orchestra.run.smithi029.stdout:Sourcing file `/etc/default/grub' 2023-10-06T05:13:29.356 INFO:teuthology.orchestra.run.smithi029.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T05:13:29.386 INFO:teuthology.orchestra.run.smithi029.stdout:Generating grub configuration file ... 2023-10-06T05:13:29.792 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T05:13:29.828 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T05:13:30.208 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T05:13:30.220 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T05:13:30.240 INFO:teuthology.orchestra.run.smithi173.stderr:done 2023-10-06T05:13:30.242 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2023-10-06T05:13:32.433 INFO:teuthology.orchestra.run.smithi029.stdout:done 2023-10-06T05:13:32.899 DEBUG:teuthology.orchestra.run.smithi029:> dpkg -s linux-image-generic 2023-10-06T05:13:32.947 INFO:teuthology.orchestra.run.smithi029.stdout:Package: linux-image-generic 2023-10-06T05:13:32.947 INFO:teuthology.orchestra.run.smithi029.stdout:Status: install ok installed 2023-10-06T05:13:32.947 INFO:teuthology.orchestra.run.smithi029.stdout:Priority: optional 2023-10-06T05:13:32.947 INFO:teuthology.orchestra.run.smithi029.stdout:Section: kernel 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout:Installed-Size: 20 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: amd64 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout:Source: linux-meta 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout:Version: 5.4.0.164.161 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout:Recommends: thermald 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout:Description: Generic Linux kernel image 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout: This package will always depend on the latest generic kernel image 2023-10-06T05:13:32.948 INFO:teuthology.orchestra.run.smithi029.stdout: available. 2023-10-06T05:13:32.949 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T05:13:32.949 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T05:13:32.949 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T05:13:32.949 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T05:13:32.949 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T05:13:32.949 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get clean 2023-10-06T05:13:33.115 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2023-10-06T05:13:33.249 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T05:13:33.254 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T05:13:33.275 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T05:13:33.739 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T05:13:35.104 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2023-10-06T05:13:35.135 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T05:13:35.206 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2023-10-06T05:13:35.391 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2023-10-06T05:13:35.391 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2023-10-06T05:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T05:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T05:13:35.609 DEBUG:teuthology.orchestra.run.smithi029:> dpkg -s linux-image-generic 2023-10-06T05:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout:Package: linux-image-generic 2023-10-06T05:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout:Status: install ok installed 2023-10-06T05:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout:Priority: optional 2023-10-06T05:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout:Section: kernel 2023-10-06T05:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout:Installed-Size: 20 2023-10-06T05:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T05:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: amd64 2023-10-06T05:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout:Source: linux-meta 2023-10-06T05:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout:Version: 5.4.0.164.161 2023-10-06T05:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T05:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T05:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout:Recommends: thermald 2023-10-06T05:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout:Description: Generic Linux kernel image 2023-10-06T05:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: This package will always depend on the latest generic kernel image 2023-10-06T05:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: available. 2023-10-06T05:13:35.633 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2023-10-06T05:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.xDHcPrWMRw 2023-10-06T05:13:35.638 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub/grub.cfg /tmp/tmp.xDHcPrWMRw 2023-10-06T05:13:35.654 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.xDHcPrWMRw 2023-10-06T05:13:35.702 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.xDHcPrWMRw is 9KB 2023-10-06T05:13:35.714 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.xDHcPrWMRw 2023-10-06T05:13:35.720 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T05:13:35.774 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:13:35.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T05:13:35.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T05:13:35.804 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T05:13:35.804 DEBUG:teuthology.orchestra.run.smithi029:> sudo update-grub 2023-10-06T05:13:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub' 2023-10-06T05:13:38.101 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T05:13:38.126 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2023-10-06T05:13:38.419 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T05:13:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T05:13:38.795 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T05:13:38.807 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T05:13:39.780 INFO:teuthology.orchestra.run.smithi029.stderr:done 2023-10-06T05:13:39.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2023-10-06T05:14:00.265 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T05:14:00.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-10-06T05:14:00.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:14:09.794 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T05:14:09.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-06T05:14:09.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:14:18.618 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-10-06T05:14:27.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-10-06T05:14:27.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:14:28.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-10-06T05:14:30.682 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-10-06T05:14:37.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-06T05:14:37.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:14:42.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-10-06T05:14:42.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:15:01.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-10-06T05:15:16.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-10-06T05:15:16.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:15:16.339 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-10-06T05:15:16.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-10-06T05:15:16.897 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-164-generic"... 2023-10-06T05:15:16.897 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2023-10-06T05:15:16.903 INFO:teuthology.orchestra.run.smithi173.stdout:5.4.0-164-generic 2023-10-06T05:15:16.903 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T05:15:16.903 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T05:15:16.903 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T05:15:17.904 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T05:15:17.905 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T05:15:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2023-10-06T05:15:18.011 DEBUG:teuthology.parallel:result is None 2023-10-06T05:15:37.353 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T05:15:49.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-06T05:15:49.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:15:49.628 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-10-06T05:15:50.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-06T05:15:50.320 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-164-generic"... 2023-10-06T05:15:50.320 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-10-06T05:15:50.326 INFO:teuthology.orchestra.run.smithi029.stdout:5.4.0-164-generic 2023-10-06T05:15:50.326 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T05:15:50.327 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T05:15:50.327 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T05:15:51.328 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T05:15:51.328 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T05:15:51.435 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2023-10-06T05:15:51.461 DEBUG:teuthology.parallel:result is None 2023-10-06T05:15:51.461 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T05:15:51.471 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T05:15:51.471 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T05:15:51.474 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T05:15:51.481 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T05:15:51.506 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T05:15:51.540 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T05:15:51.540 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T05:15:51.542 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T05:15:51.569 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T05:15:51.576 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T05:15:51.577 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T05:15:51.608 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T05:15:51.626 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T05:15:51.637 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T05:15:51.645 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T05:15:51.656 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T05:15:51.657 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T05:15:51.667 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T05:15:51.667 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T05:15:51.669 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T05:15:51.683 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T05:15:51.691 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T05:15:51.691 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T05:15:51.728 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T05:15:51.734 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T05:15:51.741 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T05:15:51.748 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:15:51.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T05:15:51.812 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T05:15:51.819 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T05:15:51.826 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:15:51.826 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T05:15:51.894 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2023-10-06T05:15:51.896 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2023-10-06T05:15:51.946 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T05:15:51.953 INFO:teuthology.task.internal:Starting timer... 2023-10-06T05:15:51.953 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T05:15:51.978 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T05:15:52.011 DEBUG:teuthology.task.selinux:Excluding smithi029: OS 'ubuntu' does not support SELinux 2023-10-06T05:15:52.011 DEBUG:teuthology.task.selinux:Excluding smithi173: OS 'ubuntu' does not support SELinux 2023-10-06T05:15:52.011 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T05:15:52.011 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-06T05:15:52.011 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T05:15:52.012 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T05:15:52.041 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T05:15:52.042 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T05:15:52.058 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T05:15:52.059 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T05:21:41.529 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2023-10-06T05:21:41.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-06T05:21:41.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:21:41.579 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-10-06T05:21:41.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-06T05:21:41.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-10-06T05:21:41.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T05:21:41.750 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-10-06T05:21:41.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-10-06T05:21:41.872 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T05:21:41.888 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T05:21:41.888 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T05:21:41.889 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T05:21:41.891 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T05:21:41.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T05:21:41.924 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T05:21:41.924 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: Command line: ntpd -gq 2023-10-06T05:21:41.924 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T05:21:41.924 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: Command line: ntpd -gq 2023-10-06T05:21:41.925 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: proto: precision = 0.084 usec (-23) 2023-10-06T05:21:41.925 INFO:teuthology.orchestra.run.smithi029.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T05:21:41.925 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T05:21:41.926 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T05:21:41.926 INFO:teuthology.orchestra.run.smithi029.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T05:21:41.927 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T05:21:41.927 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T05:21:41.927 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T05:21:41.927 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: Listen normally on 3 ens1f0 172.21.15.29:123 2023-10-06T05:21:41.927 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: Listen normally on 4 lo [::1]:123 2023-10-06T05:21:41.927 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:125a%4]:123 2023-10-06T05:21:41.927 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:41 ntpd[22821]: Listening on routing socket on fd #22 for interface updates 2023-10-06T05:21:41.928 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: proto: precision = 0.100 usec (-23) 2023-10-06T05:21:41.928 INFO:teuthology.orchestra.run.smithi173.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T05:21:41.928 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T05:21:41.928 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T05:21:41.929 INFO:teuthology.orchestra.run.smithi173.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T05:21:41.930 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T05:21:41.930 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T05:21:41.930 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T05:21:41.930 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: Listen normally on 3 enp3s0f1 172.21.15.173:123 2023-10-06T05:21:41.930 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: Listen normally on 4 lo [::1]:123 2023-10-06T05:21:41.930 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7259%5]:123 2023-10-06T05:21:41.930 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:41 ntpd[22824]: Listening on routing socket on fd #22 for interface updates 2023-10-06T05:21:42.924 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:42 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:42.924 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:42 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:44.924 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:44 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:44.925 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:44 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.928 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.928 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.928 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.928 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.928 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.928 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:45 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:45.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:45.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:45.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:45.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:45.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:45.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:45 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:47.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:47.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:47 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:47.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:47.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:47.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:47.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:47 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:49.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:49.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:49 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:49.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:49.930 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:49.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:49.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:49.931 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:49 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:51.925 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:51.925 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:51.925 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:51.925 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:51.925 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:51.925 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:51.925 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:51.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:51.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:51.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: 6 Oct 05:21:51 ntpd[22821]: ntpd: time slew +0.001084 s 2023-10-06T05:21:51.926 INFO:teuthology.orchestra.run.smithi029.stdout:ntpd: time slew +0.001084s 2023-10-06T05:21:51.926 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T05:21:51.927 INFO:teuthology.orchestra.run.smithi029.stderr: 6 Oct 05:21:51 ntpd[22821]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T05:21:51.928 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T05:21:51.929 INFO:teuthology.orchestra.run.smithi173.stdout: 6 Oct 05:21:51 ntpd[22824]: ntpd: time slew +0.000052 s 2023-10-06T05:21:51.929 INFO:teuthology.orchestra.run.smithi173.stdout:ntpd: time slew +0.000052s 2023-10-06T05:21:51.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T05:21:51.929 INFO:teuthology.orchestra.run.smithi173.stderr: 6 Oct 05:21:51 ntpd[22824]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T05:21:52.000 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T05:21:52.000 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2023-10-06T05:21:52.001 INFO:teuthology.orchestra.run.smithi173.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:21:52.001 INFO:teuthology.orchestra.run.smithi173.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:21:52.001 INFO:teuthology.orchestra.run.smithi173.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:21:52.001 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:21:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T05:21:52.007 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2023-10-06T05:21:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:21:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:21:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:21:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:21:52.008 INFO:teuthology.run_tasks:Running task install... 2023-10-06T05:21:52.017 DEBUG:teuthology.task.install:project ceph 2023-10-06T05:21:52.017 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T05:21:52.017 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T05:21:52.017 INFO:teuthology.task.install:Using flavor: default 2023-10-06T05:21:52.023 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T05:21:52.023 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T05:21:52.023 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-key list | grep Ceph 2023-10-06T05:21:52.024 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-key list | grep Ceph 2023-10-06T05:21:52.129 INFO:teuthology.orchestra.run.smithi029.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T05:21:52.143 INFO:teuthology.orchestra.run.smithi173.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T05:21:52.189 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T05:21:52.189 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T05:21:52.190 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T05:21:52.190 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T05:21:52.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T05:21:52.206 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T05:21:52.207 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T05:21:52.208 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T05:21:52.208 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T05:21:52.208 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T05:21:52.416 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default/ 2023-10-06T05:21:52.416 INFO:teuthology.task.install.deb:Package version is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T05:21:52.434 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default/ 2023-10-06T05:21:52.434 INFO:teuthology.task.install.deb:Package version is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T05:21:52.540 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:21:52.540 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T05:21:52.557 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2023-10-06T05:21:52.599 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:21:52.600 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T05:21:52.616 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2023-10-06T05:21:52.746 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T05:21:52.746 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T05:21:52.755 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T05:21:52.775 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T05:21:52.805 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T05:21:52.815 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T05:21:52.835 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T05:21:52.857 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal InRelease 2023-10-06T05:21:52.894 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T05:21:52.916 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal InRelease 2023-10-06T05:21:52.916 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T05:21:52.933 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T05:21:52.955 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T05:21:52.970 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T05:21:52.993 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T05:21:53.028 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main i386 Packages [3,391 B] 2023-10-06T05:21:53.030 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main i386 Packages [3,391 B] 2023-10-06T05:21:53.084 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T05:21:53.413 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 28.4 kB in 1s (44.0 kB/s) 2023-10-06T05:21:53.450 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 28.4 kB in 1s (45.4 kB/s) 2023-10-06T05:21:54.491 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2023-10-06T05:21:54.497 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2023-10-06T05:21:54.518 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1274-g68e53a4a-1focal cephadm=17.2.6-1274-g68e53a4a-1focal ceph-mds=17.2.6-1274-g68e53a4a-1focal ceph-mgr=17.2.6-1274-g68e53a4a-1focal ceph-common=17.2.6-1274-g68e53a4a-1focal ceph-fuse=17.2.6-1274-g68e53a4a-1focal ceph-test=17.2.6-1274-g68e53a4a-1focal ceph-volume=17.2.6-1274-g68e53a4a-1focal radosgw=17.2.6-1274-g68e53a4a-1focal python3-rados=17.2.6-1274-g68e53a4a-1focal python3-rgw=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal python3-rbd=17.2.6-1274-g68e53a4a-1focal libcephfs2=17.2.6-1274-g68e53a4a-1focal libcephfs-dev=17.2.6-1274-g68e53a4a-1focal librados2=17.2.6-1274-g68e53a4a-1focal librbd1=17.2.6-1274-g68e53a4a-1focal rbd-fuse=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal cephfs-shell=17.2.6-1274-g68e53a4a-1focal cephfs-top=17.2.6-1274-g68e53a4a-1focal cephfs-mirror=17.2.6-1274-g68e53a4a-1focal 2023-10-06T05:21:54.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1274-g68e53a4a-1focal cephadm=17.2.6-1274-g68e53a4a-1focal ceph-mds=17.2.6-1274-g68e53a4a-1focal ceph-mgr=17.2.6-1274-g68e53a4a-1focal ceph-common=17.2.6-1274-g68e53a4a-1focal ceph-fuse=17.2.6-1274-g68e53a4a-1focal ceph-test=17.2.6-1274-g68e53a4a-1focal ceph-volume=17.2.6-1274-g68e53a4a-1focal radosgw=17.2.6-1274-g68e53a4a-1focal python3-rados=17.2.6-1274-g68e53a4a-1focal python3-rgw=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal python3-rbd=17.2.6-1274-g68e53a4a-1focal libcephfs2=17.2.6-1274-g68e53a4a-1focal libcephfs-dev=17.2.6-1274-g68e53a4a-1focal librados2=17.2.6-1274-g68e53a4a-1focal librbd1=17.2.6-1274-g68e53a4a-1focal rbd-fuse=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal cephfs-shell=17.2.6-1274-g68e53a4a-1focal cephfs-top=17.2.6-1274-g68e53a4a-1focal cephfs-mirror=17.2.6-1274-g68e53a4a-1focal 2023-10-06T05:21:54.589 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2023-10-06T05:21:54.595 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2023-10-06T05:21:54.767 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2023-10-06T05:21:54.768 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2023-10-06T05:21:54.780 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2023-10-06T05:21:54.780 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2023-10-06T05:21:54.939 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T05:21:54.940 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T05:21:54.940 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T05:21:54.940 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2023-10-06T05:21:54.940 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T05:21:54.940 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T05:21:54.940 INFO:teuthology.orchestra.run.smithi173.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T05:21:54.941 INFO:teuthology.orchestra.run.smithi173.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T05:21:54.941 INFO:teuthology.orchestra.run.smithi173.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T05:21:54.941 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T05:21:54.941 INFO:teuthology.orchestra.run.smithi173.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T05:21:54.942 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T05:21:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T05:21:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T05:21:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T05:21:54.943 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2023-10-06T05:21:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T05:21:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T05:21:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T05:21:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T05:21:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T05:21:54.944 INFO:teuthology.orchestra.run.smithi173.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T05:21:54.944 INFO:teuthology.orchestra.run.smithi173.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T05:21:54.944 INFO:teuthology.orchestra.run.smithi173.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T05:21:54.944 INFO:teuthology.orchestra.run.smithi173.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T05:21:54.944 INFO:teuthology.orchestra.run.smithi173.stdout:Recommended packages: 2023-10-06T05:21:54.944 INFO:teuthology.orchestra.run.smithi173.stdout: btrfs-tools 2023-10-06T05:21:54.963 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T05:21:54.964 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T05:21:54.964 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T05:21:54.964 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2023-10-06T05:21:54.964 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T05:21:54.964 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T05:21:54.964 INFO:teuthology.orchestra.run.smithi029.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T05:21:54.964 INFO:teuthology.orchestra.run.smithi029.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T05:21:54.964 INFO:teuthology.orchestra.run.smithi029.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T05:21:54.965 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T05:21:54.965 INFO:teuthology.orchestra.run.smithi029.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T05:21:54.965 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T05:21:54.965 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T05:21:54.966 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T05:21:54.967 INFO:teuthology.orchestra.run.smithi029.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T05:21:54.967 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2023-10-06T05:21:54.967 INFO:teuthology.orchestra.run.smithi029.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T05:21:54.967 INFO:teuthology.orchestra.run.smithi029.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T05:21:54.967 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T05:21:54.967 INFO:teuthology.orchestra.run.smithi029.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T05:21:54.967 INFO:teuthology.orchestra.run.smithi029.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T05:21:54.967 INFO:teuthology.orchestra.run.smithi029.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T05:21:54.967 INFO:teuthology.orchestra.run.smithi029.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T05:21:54.968 INFO:teuthology.orchestra.run.smithi029.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T05:21:54.968 INFO:teuthology.orchestra.run.smithi029.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T05:21:54.968 INFO:teuthology.orchestra.run.smithi029.stdout:Recommended packages: 2023-10-06T05:21:54.968 INFO:teuthology.orchestra.run.smithi029.stdout: btrfs-tools 2023-10-06T05:21:55.067 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2023-10-06T05:21:55.067 INFO:teuthology.orchestra.run.smithi173.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T05:21:55.067 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T05:21:55.067 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T05:21:55.067 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T05:21:55.067 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T05:21:55.067 INFO:teuthology.orchestra.run.smithi173.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T05:21:55.067 INFO:teuthology.orchestra.run.smithi173.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T05:21:55.068 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T05:21:55.069 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T05:21:55.070 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T05:21:55.070 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T05:21:55.070 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T05:21:55.070 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T05:21:55.070 INFO:teuthology.orchestra.run.smithi173.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T05:21:55.070 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2023-10-06T05:21:55.070 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 librbd1 2023-10-06T05:21:55.090 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2023-10-06T05:21:55.090 INFO:teuthology.orchestra.run.smithi029.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T05:21:55.090 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T05:21:55.090 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T05:21:55.090 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T05:21:55.090 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T05:21:55.090 INFO:teuthology.orchestra.run.smithi029.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T05:21:55.090 INFO:teuthology.orchestra.run.smithi029.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T05:21:55.091 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T05:21:55.091 INFO:teuthology.orchestra.run.smithi029.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T05:21:55.091 INFO:teuthology.orchestra.run.smithi029.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T05:21:55.092 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T05:21:55.093 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T05:21:55.093 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T05:21:55.093 INFO:teuthology.orchestra.run.smithi029.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T05:21:55.093 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2023-10-06T05:21:55.093 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 librbd1 2023-10-06T05:21:55.243 INFO:teuthology.orchestra.run.smithi029.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T05:21:55.243 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 210 MB of archives. 2023-10-06T05:21:55.243 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T05:21:55.243 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1274-g68e53a4a-1focal [3,501 kB] 2023-10-06T05:21:55.261 INFO:teuthology.orchestra.run.smithi173.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T05:21:55.261 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 210 MB of archives. 2023-10-06T05:21:55.261 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T05:21:55.261 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T05:21:55.285 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T05:21:55.292 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1274-g68e53a4a-1focal [3,501 kB] 2023-10-06T05:21:55.344 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T05:21:55.368 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T05:21:55.379 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T05:21:55.403 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T05:21:55.491 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1274-g68e53a4a-1focal [3,551 kB] 2023-10-06T05:21:55.502 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T05:21:55.526 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T05:21:55.641 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T05:21:55.650 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T05:21:55.665 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T05:21:55.671 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1274-g68e53a4a-1focal [760 kB] 2023-10-06T05:21:55.674 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T05:21:55.695 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T05:21:55.695 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1274-g68e53a4a-1focal [413 kB] 2023-10-06T05:21:55.706 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T05:21:55.709 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1274-g68e53a4a-1focal [22.5 kB] 2023-10-06T05:21:55.710 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1274-g68e53a4a-1focal [200 kB] 2023-10-06T05:21:55.719 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T05:21:55.726 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1274-g68e53a4a-1focal [3,551 kB] 2023-10-06T05:21:55.731 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T05:21:55.747 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1274-g68e53a4a-1focal [47.1 kB] 2023-10-06T05:21:55.748 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1274-g68e53a4a-1focal [386 kB] 2023-10-06T05:21:55.761 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1274-g68e53a4a-1focal [5,567 kB] 2023-10-06T05:21:55.789 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T05:21:55.793 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T05:21:55.814 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T05:21:55.816 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T05:21:55.818 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T05:21:55.841 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T05:21:55.987 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1274-g68e53a4a-1focal [760 kB] 2023-10-06T05:21:56.054 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1274-g68e53a4a-1focal [413 kB] 2023-10-06T05:21:56.068 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1274-g68e53a4a-1focal [116 kB] 2023-10-06T05:21:56.074 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1274-g68e53a4a-1focal [479 kB] 2023-10-06T05:21:56.086 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1274-g68e53a4a-1focal [22.5 kB] 2023-10-06T05:21:56.088 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1274-g68e53a4a-1focal [200 kB] 2023-10-06T05:21:56.094 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1274-g68e53a4a-1focal [27.7 MB] 2023-10-06T05:21:56.106 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T05:21:56.131 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T05:21:56.211 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1274-g68e53a4a-1focal [47.1 kB] 2023-10-06T05:21:56.212 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1274-g68e53a4a-1focal [386 kB] 2023-10-06T05:21:56.221 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1274-g68e53a4a-1focal [5,567 kB] 2023-10-06T05:21:56.538 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T05:21:56.564 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T05:21:56.637 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1274-g68e53a4a-1focal [116 kB] 2023-10-06T05:21:56.647 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1274-g68e53a4a-1focal [479 kB] 2023-10-06T05:21:56.690 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1274-g68e53a4a-1focal [27.7 MB] 2023-10-06T05:21:56.720 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T05:21:56.746 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T05:21:56.752 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T05:21:56.757 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T05:21:56.778 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T05:21:56.782 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T05:21:56.783 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T05:21:56.787 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T05:21:56.790 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T05:21:56.802 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T05:21:56.805 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T05:21:56.806 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T05:21:56.809 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T05:21:56.813 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T05:21:56.816 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T05:21:56.829 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T05:21:56.834 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T05:21:56.834 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T05:21:56.972 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T05:21:56.997 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T05:21:57.136 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T05:21:57.162 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T05:21:57.277 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T05:21:57.296 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T05:21:57.302 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T05:21:57.308 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T05:21:57.321 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T05:21:57.333 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T05:21:57.384 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T05:21:57.406 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T05:21:57.409 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T05:21:57.431 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T05:21:57.447 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T05:21:57.471 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T05:21:57.476 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T05:21:57.481 INFO:teuthology.orchestra.run.smithi173.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T05:21:57.501 INFO:teuthology.orchestra.run.smithi029.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T05:21:57.505 INFO:teuthology.orchestra.run.smithi029.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T05:21:57.576 INFO:teuthology.orchestra.run.smithi173.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T05:21:57.638 INFO:teuthology.orchestra.run.smithi029.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T05:21:57.641 INFO:teuthology.orchestra.run.smithi029.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1274-g68e53a4a-1focal [6,449 kB] 2023-10-06T05:21:57.740 INFO:teuthology.orchestra.run.smithi173.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T05:21:57.802 INFO:teuthology.orchestra.run.smithi029.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T05:21:57.904 INFO:teuthology.orchestra.run.smithi029.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1274-g68e53a4a-1focal [221 kB] 2023-10-06T05:21:57.914 INFO:teuthology.orchestra.run.smithi029.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1274-g68e53a4a-1focal [152 kB] 2023-10-06T05:21:57.921 INFO:teuthology.orchestra.run.smithi029.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1274-g68e53a4a-1focal [1,590 kB] 2023-10-06T05:21:57.924 INFO:teuthology.orchestra.run.smithi173.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T05:21:57.973 INFO:teuthology.orchestra.run.smithi173.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T05:21:57.986 INFO:teuthology.orchestra.run.smithi029.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T05:21:58.007 INFO:teuthology.orchestra.run.smithi029.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1274-g68e53a4a-1focal [7,846 kB] 2023-10-06T05:21:58.036 INFO:teuthology.orchestra.run.smithi029.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T05:21:58.104 INFO:teuthology.orchestra.run.smithi173.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T05:21:58.167 INFO:teuthology.orchestra.run.smithi029.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T05:21:58.209 INFO:teuthology.orchestra.run.smithi173.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T05:21:58.238 INFO:teuthology.orchestra.run.smithi173.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T05:21:58.242 INFO:teuthology.orchestra.run.smithi173.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T05:21:58.266 INFO:teuthology.orchestra.run.smithi173.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T05:21:58.272 INFO:teuthology.orchestra.run.smithi029.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T05:21:58.287 INFO:teuthology.orchestra.run.smithi173.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T05:21:58.302 INFO:teuthology.orchestra.run.smithi029.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T05:21:58.303 INFO:teuthology.orchestra.run.smithi173.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T05:21:58.305 INFO:teuthology.orchestra.run.smithi029.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T05:21:58.305 INFO:teuthology.orchestra.run.smithi173.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T05:21:58.329 INFO:teuthology.orchestra.run.smithi029.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T05:21:58.350 INFO:teuthology.orchestra.run.smithi029.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T05:21:58.367 INFO:teuthology.orchestra.run.smithi029.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T05:21:58.369 INFO:teuthology.orchestra.run.smithi029.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T05:21:58.425 INFO:teuthology.orchestra.run.smithi029.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1274-g68e53a4a-1focal [28.7 MB] 2023-10-06T05:21:58.473 INFO:teuthology.orchestra.run.smithi173.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T05:21:58.537 INFO:teuthology.orchestra.run.smithi029.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T05:21:59.179 INFO:teuthology.orchestra.run.smithi173.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1274-g68e53a4a-1focal [6,449 kB] 2023-10-06T05:21:59.457 INFO:teuthology.orchestra.run.smithi173.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T05:21:59.480 INFO:teuthology.orchestra.run.smithi173.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T05:21:59.482 INFO:teuthology.orchestra.run.smithi173.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T05:21:59.517 INFO:teuthology.orchestra.run.smithi029.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T05:21:59.541 INFO:teuthology.orchestra.run.smithi029.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T05:21:59.542 INFO:teuthology.orchestra.run.smithi029.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T05:21:59.559 INFO:teuthology.orchestra.run.smithi173.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T05:21:59.559 INFO:teuthology.orchestra.run.smithi173.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T05:21:59.559 INFO:teuthology.orchestra.run.smithi173.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T05:21:59.559 INFO:teuthology.orchestra.run.smithi173.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T05:21:59.559 INFO:teuthology.orchestra.run.smithi173.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T05:21:59.559 INFO:teuthology.orchestra.run.smithi173.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T05:21:59.559 INFO:teuthology.orchestra.run.smithi173.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T05:21:59.566 INFO:teuthology.orchestra.run.smithi173.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1274-g68e53a4a-1focal [221 kB] 2023-10-06T05:21:59.579 INFO:teuthology.orchestra.run.smithi173.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1274-g68e53a4a-1focal [152 kB] 2023-10-06T05:21:59.593 INFO:teuthology.orchestra.run.smithi173.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1274-g68e53a4a-1focal [1,590 kB] 2023-10-06T05:21:59.616 INFO:teuthology.orchestra.run.smithi029.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T05:21:59.616 INFO:teuthology.orchestra.run.smithi029.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T05:21:59.617 INFO:teuthology.orchestra.run.smithi029.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T05:21:59.617 INFO:teuthology.orchestra.run.smithi029.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T05:21:59.617 INFO:teuthology.orchestra.run.smithi029.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T05:21:59.618 INFO:teuthology.orchestra.run.smithi029.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T05:21:59.618 INFO:teuthology.orchestra.run.smithi029.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T05:21:59.705 INFO:teuthology.orchestra.run.smithi173.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1274-g68e53a4a-1focal [7,846 kB] 2023-10-06T05:21:59.737 INFO:teuthology.orchestra.run.smithi173.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T05:21:59.783 INFO:teuthology.orchestra.run.smithi029.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T05:21:59.888 INFO:teuthology.orchestra.run.smithi173.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T05:21:59.950 INFO:teuthology.orchestra.run.smithi029.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T05:21:59.969 INFO:teuthology.orchestra.run.smithi173.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T05:22:00.031 INFO:teuthology.orchestra.run.smithi029.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T05:22:00.203 INFO:teuthology.orchestra.run.smithi173.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T05:22:00.238 INFO:teuthology.orchestra.run.smithi173.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1274-g68e53a4a-1focal [28.7 MB] 2023-10-06T05:22:00.247 INFO:teuthology.orchestra.run.smithi173.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T05:22:00.277 INFO:teuthology.orchestra.run.smithi173.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T05:22:00.282 INFO:teuthology.orchestra.run.smithi029.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T05:22:00.282 INFO:teuthology.orchestra.run.smithi029.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1274-g68e53a4a-1focal [3,928 B] 2023-10-06T05:22:00.283 INFO:teuthology.orchestra.run.smithi029.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1274-g68e53a4a-1focal [870 kB] 2023-10-06T05:22:00.287 INFO:teuthology.orchestra.run.smithi173.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T05:22:00.297 INFO:teuthology.orchestra.run.smithi029.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1274-g68e53a4a-1focal [2,406 kB] 2023-10-06T05:22:00.309 INFO:teuthology.orchestra.run.smithi029.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T05:22:00.314 INFO:teuthology.orchestra.run.smithi029.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1274-g68e53a4a-1focal [79.1 kB] 2023-10-06T05:22:00.315 INFO:teuthology.orchestra.run.smithi029.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1274-g68e53a4a-1focal [117 kB] 2023-10-06T05:22:00.316 INFO:teuthology.orchestra.run.smithi029.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1274-g68e53a4a-1focal [1,760 kB] 2023-10-06T05:22:00.334 INFO:teuthology.orchestra.run.smithi173.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T05:22:00.338 INFO:teuthology.orchestra.run.smithi029.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T05:22:00.363 INFO:teuthology.orchestra.run.smithi173.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T05:22:00.366 INFO:teuthology.orchestra.run.smithi173.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T05:22:00.400 INFO:teuthology.orchestra.run.smithi029.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T05:22:00.403 INFO:teuthology.orchestra.run.smithi029.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1274-g68e53a4a-1focal [7,886 kB] 2023-10-06T05:22:00.407 INFO:teuthology.orchestra.run.smithi029.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T05:22:00.425 INFO:teuthology.orchestra.run.smithi029.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T05:22:00.428 INFO:teuthology.orchestra.run.smithi029.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T05:22:00.485 INFO:teuthology.orchestra.run.smithi173.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T05:22:00.584 INFO:teuthology.orchestra.run.smithi029.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T05:22:00.658 INFO:teuthology.orchestra.run.smithi173.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T05:22:00.757 INFO:teuthology.orchestra.run.smithi029.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T05:22:00.877 INFO:teuthology.orchestra.run.smithi029.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1274-g68e53a4a-1focal [4,040 B] 2023-10-06T05:22:00.878 INFO:teuthology.orchestra.run.smithi029.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1274-g68e53a4a-1focal [56.3 MB] 2023-10-06T05:22:01.483 INFO:teuthology.orchestra.run.smithi173.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T05:22:01.485 INFO:teuthology.orchestra.run.smithi173.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T05:22:01.485 INFO:teuthology.orchestra.run.smithi173.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T05:22:01.487 INFO:teuthology.orchestra.run.smithi173.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T05:22:01.487 INFO:teuthology.orchestra.run.smithi173.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T05:22:01.489 INFO:teuthology.orchestra.run.smithi173.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T05:22:01.507 INFO:teuthology.orchestra.run.smithi173.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T05:22:01.507 INFO:teuthology.orchestra.run.smithi173.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T05:22:01.507 INFO:teuthology.orchestra.run.smithi173.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T05:22:01.564 INFO:teuthology.orchestra.run.smithi173.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T05:22:01.580 INFO:teuthology.orchestra.run.smithi029.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T05:22:01.582 INFO:teuthology.orchestra.run.smithi029.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T05:22:01.582 INFO:teuthology.orchestra.run.smithi029.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T05:22:01.583 INFO:teuthology.orchestra.run.smithi029.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T05:22:01.584 INFO:teuthology.orchestra.run.smithi029.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T05:22:01.586 INFO:teuthology.orchestra.run.smithi029.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T05:22:01.604 INFO:teuthology.orchestra.run.smithi029.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T05:22:01.604 INFO:teuthology.orchestra.run.smithi029.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T05:22:01.604 INFO:teuthology.orchestra.run.smithi029.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T05:22:01.662 INFO:teuthology.orchestra.run.smithi029.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T05:22:01.731 INFO:teuthology.orchestra.run.smithi173.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T05:22:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T05:22:02.019 INFO:teuthology.orchestra.run.smithi173.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T05:22:02.041 INFO:teuthology.orchestra.run.smithi173.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T05:22:02.114 INFO:teuthology.orchestra.run.smithi029.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T05:22:02.136 INFO:teuthology.orchestra.run.smithi029.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T05:22:02.191 INFO:teuthology.orchestra.run.smithi173.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T05:22:02.209 INFO:teuthology.orchestra.run.smithi173.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T05:22:02.287 INFO:teuthology.orchestra.run.smithi029.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T05:22:02.305 INFO:teuthology.orchestra.run.smithi029.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T05:22:02.367 INFO:teuthology.orchestra.run.smithi173.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1274-g68e53a4a-1focal [3,928 B] 2023-10-06T05:22:02.444 INFO:teuthology.orchestra.run.smithi173.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1274-g68e53a4a-1focal [870 kB] 2023-10-06T05:22:02.460 INFO:teuthology.orchestra.run.smithi173.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1274-g68e53a4a-1focal [2,406 kB] 2023-10-06T05:22:02.531 INFO:teuthology.orchestra.run.smithi173.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1274-g68e53a4a-1focal [79.1 kB] 2023-10-06T05:22:02.536 INFO:teuthology.orchestra.run.smithi173.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1274-g68e53a4a-1focal [117 kB] 2023-10-06T05:22:02.546 INFO:teuthology.orchestra.run.smithi173.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1274-g68e53a4a-1focal [1,760 kB] 2023-10-06T05:22:02.676 INFO:teuthology.orchestra.run.smithi173.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1274-g68e53a4a-1focal [7,886 kB] 2023-10-06T05:22:03.262 INFO:teuthology.orchestra.run.smithi173.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1274-g68e53a4a-1focal [4,040 B] 2023-10-06T05:22:03.425 INFO:teuthology.orchestra.run.smithi173.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1274-g68e53a4a-1focal [56.3 MB] 2023-10-06T05:22:04.851 INFO:teuthology.orchestra.run.smithi029.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1274-g68e53a4a-1focal [229 kB] 2023-10-06T05:22:04.855 INFO:teuthology.orchestra.run.smithi029.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1274-g68e53a4a-1focal [239 kB] 2023-10-06T05:22:04.860 INFO:teuthology.orchestra.run.smithi029.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1274-g68e53a4a-1focal [22.0 kB] 2023-10-06T05:22:04.861 INFO:teuthology.orchestra.run.smithi029.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1274-g68e53a4a-1focal [12.8 kB] 2023-10-06T05:22:04.862 INFO:teuthology.orchestra.run.smithi029.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1274-g68e53a4a-1focal [21.9 kB] 2023-10-06T05:22:04.862 INFO:teuthology.orchestra.run.smithi029.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1274-g68e53a4a-1focal [17.0 MB] 2023-10-06T05:22:05.735 INFO:teuthology.orchestra.run.smithi029.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1274-g68e53a4a-1focal [79.4 kB] 2023-10-06T05:22:06.433 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 210 MB in 11s (19.6 MB/s) 2023-10-06T05:22:06.572 INFO:teuthology.orchestra.run.smithi173.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1274-g68e53a4a-1focal [229 kB] 2023-10-06T05:22:06.577 INFO:teuthology.orchestra.run.smithi173.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1274-g68e53a4a-1focal [239 kB] 2023-10-06T05:22:06.582 INFO:teuthology.orchestra.run.smithi173.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1274-g68e53a4a-1focal [22.0 kB] 2023-10-06T05:22:06.583 INFO:teuthology.orchestra.run.smithi173.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1274-g68e53a4a-1focal [12.8 kB] 2023-10-06T05:22:06.583 INFO:teuthology.orchestra.run.smithi173.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1274-g68e53a4a-1focal [21.9 kB] 2023-10-06T05:22:06.584 INFO:teuthology.orchestra.run.smithi173.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1274-g68e53a4a-1focal [17.0 MB] 2023-10-06T05:22:06.590 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T05:22:06.647 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T05:22:06.651 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T05:22:06.697 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T05:22:07.036 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T05:22:07.052 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T05:22:07.094 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T05:22:07.120 INFO:teuthology.orchestra.run.smithi173.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1274-g68e53a4a-1focal [79.4 kB] 2023-10-06T05:22:07.401 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T05:22:07.418 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T05:22:07.459 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T05:22:07.736 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 210 MB in 12s (17.4 MB/s) 2023-10-06T05:22:07.808 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T05:22:07.824 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T05:22:07.904 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T05:22:07.910 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T05:22:07.959 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T05:22:07.964 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T05:22:08.003 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T05:22:08.322 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T05:22:08.331 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../004-librbd1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:08.338 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T05:22:08.377 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T05:22:08.459 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librbd1 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T05:22:08.675 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T05:22:08.693 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T05:22:08.753 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T05:22:09.145 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T05:22:09.161 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T05:22:09.245 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T05:22:09.293 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../005-librados2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:09.418 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librados2 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T05:22:09.624 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../004-librbd1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:09.758 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librbd1 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T05:22:10.491 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../005-librados2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:10.517 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T05:22:10.535 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:10.577 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:10.613 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librados2 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T05:22:10.923 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rados. 2023-10-06T05:22:10.942 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:10.990 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:11.317 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T05:22:11.334 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:11.392 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:11.413 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T05:22:11.430 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:11.472 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:11.726 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T05:22:11.742 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:11.745 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rados. 2023-10-06T05:22:11.761 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:11.784 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:11.803 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:12.116 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T05:22:12.132 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:12.174 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:12.189 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T05:22:12.207 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:12.248 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:12.508 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T05:22:12.522 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T05:22:12.527 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:12.541 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T05:22:12.575 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:12.580 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T05:22:12.836 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T05:22:12.852 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:12.894 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:12.913 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T05:22:12.930 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:12.992 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:13.255 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T05:22:13.274 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T05:22:13.321 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T05:22:13.351 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T05:22:13.368 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T05:22:13.410 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T05:22:13.682 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T05:22:13.700 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:13.711 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T05:22:13.730 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T05:22:13.743 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:13.780 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T05:22:14.105 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T05:22:14.121 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T05:22:14.131 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T05:22:14.147 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T05:22:14.155 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T05:22:14.189 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T05:22:14.566 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T05:22:14.587 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T05:22:14.621 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T05:22:14.625 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T05:22:14.637 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T05:22:14.679 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T05:22:14.972 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T05:22:14.989 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T05:22:15.028 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T05:22:15.030 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T05:22:15.044 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T05:22:15.105 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T05:22:15.444 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T05:22:15.458 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T05:22:15.534 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T05:22:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T05:22:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T05:22:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:22:15.878 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T05:22:15.896 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T05:22:15.936 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T05:22:16.201 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T05:22:16.218 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T05:22:16.259 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:22:16.399 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T05:22:16.419 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T05:22:16.501 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:22:16.675 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T05:22:16.691 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T05:22:16.741 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:22:16.976 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T05:22:16.992 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T05:22:17.026 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:22:17.166 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T05:22:17.183 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T05:22:17.224 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T05:22:17.446 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T05:22:17.464 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T05:22:17.504 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:22:17.588 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librgw2. 2023-10-06T05:22:17.604 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../022-librgw2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:17.646 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T05:22:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T05:22:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T05:22:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librgw2. 2023-10-06T05:22:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../022-librgw2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:18.552 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T05:22:18.571 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:18.619 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:19.007 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liboath0. 2023-10-06T05:22:19.025 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T05:22:19.067 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T05:22:19.229 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T05:22:19.246 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:19.287 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:19.397 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T05:22:19.413 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:19.455 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:19.607 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liboath0. 2023-10-06T05:22:19.626 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T05:22:19.657 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T05:22:19.988 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-common. 2023-10-06T05:22:19.994 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T05:22:20.004 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:20.010 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:20.046 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:20.068 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:20.563 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-common. 2023-10-06T05:22:20.581 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:20.622 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:22.901 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-base. 2023-10-06T05:22:22.919 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:22.978 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:23.352 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-base. 2023-10-06T05:22:23.369 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:23.421 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:24.228 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T05:22:24.244 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T05:22:24.288 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T05:22:24.481 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T05:22:24.498 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T05:22:24.539 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T05:22:24.670 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T05:22:24.687 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T05:22:24.728 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T05:22:24.984 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T05:22:24.993 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T05:22:25.003 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:25.009 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T05:22:25.051 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:25.051 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T05:22:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T05:22:25.388 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:25.429 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:25.503 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T05:22:25.519 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T05:22:25.570 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T05:22:25.884 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T05:22:25.903 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T05:22:25.942 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T05:22:26.270 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T05:22:26.286 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T05:22:26.328 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T05:22:26.657 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T05:22:26.673 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T05:22:26.715 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T05:22:27.060 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T05:22:27.077 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T05:22:27.118 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T05:22:27.317 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T05:22:27.333 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T05:22:27.377 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T05:22:27.496 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T05:22:27.513 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T05:22:27.554 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T05:22:27.742 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T05:22:27.761 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T05:22:27.801 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T05:22:27.866 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T05:22:27.884 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T05:22:28.091 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T05:22:28.110 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T05:22:28.157 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T05:22:28.166 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T05:22:28.481 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T05:22:28.497 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T05:22:28.540 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T05:22:28.880 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T05:22:28.897 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T05:22:28.945 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T05:22:29.010 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-mako. 2023-10-06T05:22:29.028 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T05:22:29.068 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T05:22:29.268 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-mako. 2023-10-06T05:22:29.286 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T05:22:29.327 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T05:22:29.405 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T05:22:29.421 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T05:22:29.463 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T05:22:29.651 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T05:22:29.667 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T05:22:29.709 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T05:22:29.799 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T05:22:29.815 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T05:22:29.883 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T05:22:30.072 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T05:22:30.093 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T05:22:30.131 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T05:22:30.219 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webob. 2023-10-06T05:22:30.238 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T05:22:30.277 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T05:22:30.479 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webob. 2023-10-06T05:22:30.495 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T05:22:30.546 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T05:22:30.638 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T05:22:30.654 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T05:22:30.696 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T05:22:30.951 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T05:22:30.967 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T05:22:30.982 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T05:22:31.001 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T05:22:31.019 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T05:22:31.041 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T05:22:31.332 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T05:22:31.352 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T05:22:31.399 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T05:22:31.402 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T05:22:31.420 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T05:22:31.488 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T05:22:31.773 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T05:22:31.793 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T05:22:31.805 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T05:22:31.822 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T05:22:31.843 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T05:22:31.872 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T05:22:32.200 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-paste. 2023-10-06T05:22:32.216 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T05:22:32.220 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T05:22:32.236 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T05:22:32.258 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T05:22:32.280 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T05:22:32.578 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T05:22:32.593 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T05:22:32.594 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-paste. 2023-10-06T05:22:32.611 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T05:22:32.635 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T05:22:32.652 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T05:22:32.947 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T05:22:32.962 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T05:22:32.984 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T05:22:33.002 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T05:22:33.030 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T05:22:33.076 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T05:22:33.383 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T05:22:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T05:22:33.403 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T05:22:33.409 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T05:22:33.441 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T05:22:33.456 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T05:22:33.754 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T05:22:33.761 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T05:22:33.773 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T05:22:33.779 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T05:22:33.819 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T05:22:33.821 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T05:22:34.186 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T05:22:34.205 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T05:22:34.215 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T05:22:34.233 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T05:22:34.244 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T05:22:34.273 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T05:22:34.596 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T05:22:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T05:22:34.663 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T05:22:34.677 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T05:22:34.693 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:34.752 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:35.044 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T05:22:35.062 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:35.110 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:35.138 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T05:22:35.154 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:35.196 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:35.517 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T05:22:35.535 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:35.584 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T05:22:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:36.133 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T05:22:36.149 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:36.191 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:36.936 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T05:22:36.953 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:36.994 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:37.558 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T05:22:37.577 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:37.625 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:39.889 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph. 2023-10-06T05:22:39.908 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../055-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:39.964 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:40.249 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T05:22:40.268 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:40.308 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:40.753 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T05:22:40.769 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:40.811 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:40.997 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph. 2023-10-06T05:22:41.015 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../055-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:41.063 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:41.364 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephadm. 2023-10-06T05:22:41.381 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../058-cephadm_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:41.395 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T05:22:41.411 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:41.422 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:41.453 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:41.775 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T05:22:41.792 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T05:22:41.866 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T05:22:42.018 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T05:22:42.035 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:42.077 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:42.219 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T05:22:42.237 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:42.277 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:42.656 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T05:22:42.673 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T05:22:42.714 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T05:22:43.001 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T05:22:43.017 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T05:22:43.024 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephadm. 2023-10-06T05:22:43.042 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../058-cephadm_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:43.059 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T05:22:43.082 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:43.369 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T05:22:43.388 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T05:22:43.405 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T05:22:43.423 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T05:22:43.452 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T05:22:43.464 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T05:22:43.713 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-routes. 2023-10-06T05:22:43.732 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T05:22:43.796 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T05:22:43.802 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T05:22:43.819 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:43.902 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:44.149 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T05:22:44.166 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:44.199 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:44.234 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T05:22:44.253 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T05:22:44.293 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T05:22:44.565 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T05:22:44.585 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T05:22:44.632 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T05:22:44.722 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T05:22:44.740 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T05:22:44.786 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T05:22:44.928 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T05:22:44.944 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T05:22:45.011 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T05:22:45.072 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T05:22:45.092 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T05:22:45.130 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T05:22:45.334 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-routes. 2023-10-06T05:22:45.351 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T05:22:45.392 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T05:22:45.441 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T05:22:45.458 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T05:22:45.491 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T05:22:45.706 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T05:22:45.725 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:45.764 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:46.322 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T05:22:46.342 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T05:22:46.389 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T05:22:46.728 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T05:22:46.744 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T05:22:46.787 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T05:22:46.866 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T05:22:46.885 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T05:22:46.925 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T05:22:47.141 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T05:22:47.161 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T05:22:47.208 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T05:22:47.486 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T05:22:47.507 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T05:22:47.544 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T05:22:47.990 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T05:22:48.006 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T05:22:48.048 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T05:22:48.527 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T05:22:48.546 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T05:22:48.594 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T05:22:48.834 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T05:22:48.849 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:48.890 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:49.177 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T05:22:49.195 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T05:22:49.285 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T05:22:49.676 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T05:22:49.692 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T05:22:49.743 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T05:22:50.067 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T05:22:50.083 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T05:22:50.126 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T05:22:50.419 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T05:22:50.439 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T05:22:50.470 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T05:22:50.518 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T05:22:50.535 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:50.577 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:50.814 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T05:22:50.831 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T05:22:50.872 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T05:22:51.217 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T05:22:51.236 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T05:22:51.291 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T05:22:51.628 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T05:22:51.645 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T05:22:51.686 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T05:22:52.031 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T05:22:52.049 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T05:22:52.089 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T05:22:52.199 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T05:22:52.216 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T05:22:52.258 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T05:22:52.392 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T05:22:52.411 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T05:22:52.450 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T05:22:52.614 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T05:22:52.634 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T05:22:52.681 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T05:22:52.812 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T05:22:52.829 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T05:22:52.895 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T05:22:52.997 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T05:22:53.014 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T05:22:53.061 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T05:22:53.367 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T05:22:53.384 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T05:22:53.385 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T05:22:53.401 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T05:22:53.425 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T05:22:53.443 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T05:22:53.770 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T05:22:53.788 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T05:22:53.808 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T05:22:53.826 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T05:22:53.853 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T05:22:53.866 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T05:22:54.189 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T05:22:54.207 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T05:22:54.247 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T05:22:54.401 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T05:22:54.420 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:54.484 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:54.570 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T05:22:54.590 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T05:22:54.670 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T05:22:54.820 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T05:22:54.837 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T05:22:54.878 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T05:22:55.020 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T05:22:55.038 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T05:22:55.078 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T05:22:55.290 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T05:22:55.306 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T05:22:55.348 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T05:22:55.481 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T05:22:55.497 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T05:22:55.539 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T05:22:55.661 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package jq. 2023-10-06T05:22:55.675 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T05:22:55.742 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T05:22:55.914 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T05:22:55.931 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T05:22:55.980 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T05:22:55.994 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package socat. 2023-10-06T05:22:56.012 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T05:22:56.077 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T05:22:56.405 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T05:22:56.423 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T05:22:56.463 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T05:22:56.587 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T05:22:56.603 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:22:56.642 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:56.809 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-test. 2023-10-06T05:22:56.826 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:56.867 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:22:57.006 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T05:22:57.023 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T05:22:57.057 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T05:22:57.388 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T05:22:57.407 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T05:22:57.446 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T05:22:57.719 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package jq. 2023-10-06T05:22:57.739 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T05:22:57.777 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T05:22:58.074 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package socat. 2023-10-06T05:22:58.094 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T05:22:58.132 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T05:22:58.440 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T05:22:58.456 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T05:22:58.498 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T05:22:58.849 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-test. 2023-10-06T05:22:58.869 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:22:58.915 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:01.938 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T05:23:01.956 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:23:01.996 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:02.393 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T05:23:02.410 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:23:02.443 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:02.796 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T05:23:02.816 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T05:23:02.887 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T05:23:03.150 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T05:23:03.165 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:23:03.233 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:03.471 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T05:23:03.489 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:23:03.554 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:03.829 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T05:23:03.848 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T05:23:03.898 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T05:23:04.418 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T05:23:04.436 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:23:04.500 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:04.619 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T05:23:04.636 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:23:04.677 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:04.937 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T05:23:04.954 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T05:23:05.013 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T05:23:05.080 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T05:23:05.099 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:23:05.146 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:05.375 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T05:23:05.391 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T05:23:05.458 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T05:23:05.511 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T05:23:05.528 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T05:23:05.570 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T05:23:05.866 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T05:23:05.883 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:23:05.924 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:06.197 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T05:23:06.218 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T05:23:06.255 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:06.518 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T05:23:07.127 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T05:23:07.127 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T05:23:07.153 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T05:23:07.750 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T05:23:07.750 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T05:23:07.750 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T05:23:07.751 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:23:07.751 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:07.751 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T05:23:07.751 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T05:23:07.782 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T05:23:07.906 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T05:23:07.922 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T05:23:07.963 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T05:23:08.111 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T05:23:08.235 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T05:23:08.235 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T05:23:08.300 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-attr. 2023-10-06T05:23:08.342 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T05:23:08.391 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T05:23:08.753 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T05:23:08.770 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T05:23:08.819 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T05:23:09.122 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T05:23:09.139 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T05:23:09.172 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T05:23:09.534 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T05:23:09.550 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T05:23:09.591 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T05:23:10.000 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T05:23:10.021 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T05:23:10.067 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T05:23:10.095 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T05:23:10.112 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T05:23:10.153 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T05:23:10.423 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T05:23:10.442 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T05:23:10.490 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T05:23:10.490 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T05:23:10.509 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T05:23:10.548 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T05:23:10.786 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-attr. 2023-10-06T05:23:10.804 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T05:23:10.844 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T05:23:10.893 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T05:23:10.910 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T05:23:10.976 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T05:23:11.251 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T05:23:11.269 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T05:23:11.304 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T05:23:11.309 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T05:23:11.324 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T05:23:11.362 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T05:23:11.622 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T05:23:11.640 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T05:23:11.691 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T05:23:11.717 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-py. 2023-10-06T05:23:11.734 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T05:23:11.777 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T05:23:12.115 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T05:23:12.131 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T05:23:12.135 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T05:23:12.149 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T05:23:12.187 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T05:23:12.212 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T05:23:12.533 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T05:23:12.553 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T05:23:12.599 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T05:23:12.653 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T05:23:12.670 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T05:23:12.720 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T05:23:12.944 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T05:23:12.964 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T05:23:13.002 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T05:23:13.033 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T05:23:13.050 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T05:23:13.091 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T05:23:13.297 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T05:23:13.314 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T05:23:13.355 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T05:23:13.492 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T05:23:13.510 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T05:23:13.846 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T05:23:14.184 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package radosgw. 2023-10-06T05:23:14.202 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../114-radosgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:23:14.242 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:14.474 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T05:23:14.495 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T05:23:14.541 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T05:23:14.864 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-py. 2023-10-06T05:23:14.883 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T05:23:14.930 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T05:23:15.279 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T05:23:15.297 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T05:23:15.387 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T05:23:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T05:23:15.728 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T05:23:15.777 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T05:23:16.004 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T05:23:16.021 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:23:16.087 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:16.151 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T05:23:16.169 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T05:23:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T05:23:16.423 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T05:23:16.522 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T05:23:16.540 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T05:23:16.586 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T05:23:16.730 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T05:23:16.839 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T05:23:16.940 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T05:23:17.174 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:17.281 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package radosgw. 2023-10-06T05:23:17.302 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../114-radosgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:23:17.348 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user cephadm....done 2023-10-06T05:23:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T05:23:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T05:23:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T05:23:18.786 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T05:23:18.937 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T05:23:19.071 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T05:23:19.288 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T05:23:19.308 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T05:23:19.355 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:19.423 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T05:23:19.738 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T05:23:19.833 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T05:23:20.024 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T05:23:20.151 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T05:23:20.152 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T05:23:20.280 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T05:23:20.469 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T05:23:20.492 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:20.795 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T05:23:21.113 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T05:23:21.186 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user cephadm....done 2023-10-06T05:23:21.358 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T05:23:21.431 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:21.485 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T05:23:21.774 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T05:23:21.857 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T05:23:21.933 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T05:23:22.159 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T05:23:22.217 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T05:23:22.283 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T05:23:22.415 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T05:23:22.502 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T05:23:22.804 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T05:23:22.804 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T05:23:22.905 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T05:23:23.254 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T05:23:23.274 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T05:23:23.565 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T05:23:23.567 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T05:23:23.860 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T05:23:23.908 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T05:23:24.210 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T05:23:24.212 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T05:23:24.488 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T05:23:24.506 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T05:23:24.814 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T05:23:24.815 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:25.107 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T05:23:25.184 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T05:23:25.319 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T05:23:25.395 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T05:23:25.496 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T05:23:25.597 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T05:23:25.615 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T05:23:25.908 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T05:23:25.932 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T05:23:26.260 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T05:23:26.349 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T05:23:26.387 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T05:23:26.659 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T05:23:26.758 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T05:23:27.018 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T05:23:27.110 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T05:23:27.372 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T05:23:27.395 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T05:23:27.498 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:27.756 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T05:23:27.841 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:23:28.001 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T05:23:28.042 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T05:23:28.369 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T05:23:28.436 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T05:23:28.489 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T05:23:28.648 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T05:23:28.730 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T05:23:28.932 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T05:23:29.015 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T05:23:29.144 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T05:23:29.250 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:23:29.329 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T05:23:29.376 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T05:23:29.527 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T05:23:29.624 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T05:23:29.846 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T05:23:30.027 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T05:23:30.181 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T05:23:30.326 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T05:23:30.490 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T05:23:30.616 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T05:23:30.698 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T05:23:30.909 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T05:23:31.060 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T05:23:31.210 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T05:23:31.211 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:31.512 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T05:23:31.541 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:23:31.684 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T05:23:31.886 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T05:23:32.036 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T05:23:32.148 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T05:23:32.179 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T05:23:32.274 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T05:23:32.306 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T05:23:32.633 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T05:23:32.635 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T05:23:32.962 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:23:33.052 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T05:23:33.097 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T05:23:33.177 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T05:23:33.224 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T05:23:33.295 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T05:23:33.558 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T05:23:33.697 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T05:23:33.843 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T05:23:34.006 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librados2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:34.141 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T05:23:34.147 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T05:23:34.290 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T05:23:34.601 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T05:23:34.894 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T05:23:35.198 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T05:23:35.587 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T05:23:35.614 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T05:23:35.866 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T05:23:35.878 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T05:23:36.005 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T05:23:36.267 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T05:23:36.318 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T05:23:36.577 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T05:23:36.678 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T05:23:36.846 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T05:23:36.878 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:23:36.973 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T05:23:36.996 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T05:23:37.310 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T05:23:37.339 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:37.440 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T05:23:37.621 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librados2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:37.748 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T05:23:37.784 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:37.935 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T05:23:38.253 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T05:23:39.284 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librbd1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:39.329 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:39.452 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T05:23:39.455 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T05:23:39.561 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T05:23:39.582 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T05:23:39.687 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T05:23:39.855 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T05:23:39.993 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T05:23:40.140 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T05:23:40.266 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T05:23:40.338 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T05:23:40.632 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T05:23:40.720 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:40.759 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T05:23:40.837 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:41.064 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T05:23:41.064 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T05:23:41.111 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:41.256 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T05:23:41.522 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:41.585 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:41.682 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T05:23:41.720 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T05:23:42.000 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T05:23:42.098 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T05:23:42.327 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T05:23:42.716 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:42.842 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:42.993 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:43.119 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:43.168 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librbd1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:43.249 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:43.312 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T05:23:43.380 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T05:23:43.455 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T05:23:43.582 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T05:23:43.690 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T05:23:43.711 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T05:23:43.983 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:44.021 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T05:23:44.109 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:44.198 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T05:23:44.268 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:44.394 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T05:23:44.597 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:44.724 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:45.324 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:45.361 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T05:23:45.361 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T05:23:45.836 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:45.929 INFO:teuthology.orchestra.run.smithi173.stdout:Adding group ceph....done 2023-10-06T05:23:45.964 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T05:23:46.258 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T05:23:46.323 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user ceph....done 2023-10-06T05:23:46.516 INFO:teuthology.orchestra.run.smithi173.stdout:Setting system user ceph properties....done 2023-10-06T05:23:46.534 INFO:teuthology.orchestra.run.smithi173.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T05:23:46.636 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T05:23:46.683 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T05:23:46.979 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T05:23:46.992 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:47.128 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:47.255 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:47.383 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:47.454 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:47.560 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:47.685 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T05:23:47.685 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T05:23:47.712 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T05:23:48.006 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T05:23:48.113 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:48.250 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:48.335 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:48.487 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:48.559 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T05:23:48.559 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T05:23:48.655 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:48.782 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T05:23:49.152 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:49.553 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T05:23:49.757 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:50.012 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:50.230 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T05:23:50.230 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T05:23:50.331 INFO:teuthology.orchestra.run.smithi029.stdout:Adding group ceph....done 2023-10-06T05:23:50.827 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user ceph....done 2023-10-06T05:23:50.898 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:51.014 INFO:teuthology.orchestra.run.smithi029.stdout:Setting system user ceph properties....done 2023-10-06T05:23:51.039 INFO:teuthology.orchestra.run.smithi029.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T05:23:51.190 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T05:23:51.356 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T05:23:51.356 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T05:23:51.513 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T05:23:51.767 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:51.978 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:52.217 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T05:23:52.217 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T05:23:52.262 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T05:23:52.262 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T05:23:52.663 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:52.685 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:52.795 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:52.842 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:52.971 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:53.115 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T05:23:53.116 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T05:23:53.198 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T05:23:53.199 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T05:23:53.631 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:53.762 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:53.773 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:53.908 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:54.042 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:54.169 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T05:23:54.195 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T05:23:54.305 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T05:23:54.573 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T05:23:54.630 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:54.871 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T05:23:54.871 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T05:23:55.316 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:55.548 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T05:23:55.549 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T05:23:56.063 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:56.558 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T05:23:56.558 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T05:23:56.975 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:57.152 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:57.297 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:57.409 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T05:23:57.524 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T05:23:57.524 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T05:23:57.967 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T05:23:58.007 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T05:23:58.078 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2023-10-06T05:23:58.111 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:58.281 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2023-10-06T05:23:58.282 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2023-10-06T05:23:58.290 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:58.435 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T05:23:58.484 INFO:teuthology.orchestra.run.smithi173.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T05:23:58.484 INFO:teuthology.orchestra.run.smithi173.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T05:23:58.484 INFO:teuthology.orchestra.run.smithi173.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T05:23:58.485 INFO:teuthology.orchestra.run.smithi173.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T05:23:58.485 INFO:teuthology.orchestra.run.smithi173.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T05:23:58.485 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T05:23:58.485 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T05:23:58.485 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T05:23:58.486 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2023-10-06T05:23:58.486 INFO:teuthology.orchestra.run.smithi173.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T05:23:58.486 INFO:teuthology.orchestra.run.smithi173.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T05:23:58.487 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T05:23:58.487 INFO:teuthology.orchestra.run.smithi173.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T05:23:58.488 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2023-10-06T05:23:58.488 INFO:teuthology.orchestra.run.smithi173.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T05:23:58.488 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T05:23:58.536 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2023-10-06T05:23:58.536 INFO:teuthology.orchestra.run.smithi173.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T05:23:58.536 INFO:teuthology.orchestra.run.smithi173.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T05:23:58.537 INFO:teuthology.orchestra.run.smithi173.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T05:23:58.537 INFO:teuthology.orchestra.run.smithi173.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T05:23:58.538 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2023-10-06T05:23:58.539 INFO:teuthology.orchestra.run.smithi173.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T05:23:58.570 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T05:23:58.617 INFO:teuthology.orchestra.run.smithi173.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T05:23:58.618 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 10.4 MB of archives. 2023-10-06T05:23:58.618 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T05:23:58.618 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T05:23:58.750 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T05:23:58.767 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T05:23:58.769 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T05:23:58.770 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T05:23:58.775 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T05:23:58.776 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T05:23:58.796 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T05:23:58.796 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T05:23:58.798 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T05:23:58.799 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T05:23:58.799 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T05:23:58.806 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T05:23:58.807 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T05:23:58.809 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T05:23:58.809 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T05:23:58.826 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T05:23:58.826 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T05:23:58.831 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T05:23:58.841 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T05:23:58.841 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T05:23:58.855 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T05:23:58.855 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T05:23:58.863 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T05:23:58.873 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T05:23:58.893 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T05:23:58.897 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T05:23:58.897 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T05:23:58.898 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T05:23:58.898 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T05:23:59.027 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T05:23:59.207 INFO:teuthology.orchestra.run.smithi173.stdout:Preconfiguring packages ... 2023-10-06T05:23:59.363 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 10.4 MB in 0s (29.6 MB/s) 2023-10-06T05:23:59.598 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T05:23:59.603 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T05:23:59.737 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T05:24:00.962 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T05:24:01.941 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T05:24:02.374 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T05:24:02.378 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T05:24:02.529 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T05:24:02.546 INFO:teuthology.orchestra.run.smithi029.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T05:24:02.549 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T05:24:02.620 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2023-10-06T05:24:02.830 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2023-10-06T05:24:02.831 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2023-10-06T05:24:02.929 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T05:24:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T05:24:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T05:24:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T05:24:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T05:24:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T05:24:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T05:24:03.045 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T05:24:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T05:24:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2023-10-06T05:24:03.045 INFO:teuthology.orchestra.run.smithi029.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T05:24:03.045 INFO:teuthology.orchestra.run.smithi029.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T05:24:03.045 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T05:24:03.045 INFO:teuthology.orchestra.run.smithi029.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T05:24:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2023-10-06T05:24:03.047 INFO:teuthology.orchestra.run.smithi029.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T05:24:03.047 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T05:24:03.100 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2023-10-06T05:24:03.100 INFO:teuthology.orchestra.run.smithi029.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T05:24:03.101 INFO:teuthology.orchestra.run.smithi029.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T05:24:03.101 INFO:teuthology.orchestra.run.smithi029.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T05:24:03.101 INFO:teuthology.orchestra.run.smithi029.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T05:24:03.103 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2023-10-06T05:24:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T05:24:03.135 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T05:24:03.159 INFO:teuthology.orchestra.run.smithi029.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T05:24:03.159 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 10.4 MB of archives. 2023-10-06T05:24:03.159 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T05:24:03.159 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T05:24:03.287 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T05:24:03.288 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T05:24:03.290 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T05:24:03.296 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T05:24:03.297 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T05:24:03.311 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T05:24:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T05:24:03.313 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T05:24:03.314 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T05:24:03.315 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T05:24:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T05:24:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T05:24:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T05:24:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T05:24:03.337 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T05:24:03.337 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T05:24:03.342 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T05:24:03.350 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T05:24:03.351 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T05:24:03.365 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T05:24:03.365 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T05:24:03.372 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T05:24:03.382 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T05:24:03.398 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T05:24:03.400 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T05:24:03.401 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T05:24:03.401 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T05:24:03.401 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T05:24:03.497 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T05:24:03.733 INFO:teuthology.orchestra.run.smithi029.stdout:Preconfiguring packages ... 2023-10-06T05:24:03.895 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 10.4 MB in 0s (35.9 MB/s) 2023-10-06T05:24:03.898 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T05:24:03.903 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T05:24:04.086 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T05:24:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T05:24:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T05:24:04.360 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T05:24:04.569 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T05:24:04.733 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T05:24:05.246 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T05:24:05.397 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T05:24:05.556 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T05:24:05.893 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T05:24:05.913 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T05:24:05.972 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T05:24:06.338 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package dump. 2023-10-06T05:24:06.357 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T05:24:06.396 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T05:24:06.777 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package indent. 2023-10-06T05:24:06.798 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T05:24:07.039 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T05:24:07.079 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T05:24:07.084 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T05:24:07.215 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T05:24:07.662 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T05:24:07.871 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T05:24:08.172 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T05:24:08.189 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T05:24:08.236 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T05:24:08.238 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T05:24:08.601 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T05:24:08.618 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T05:24:08.684 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T05:24:08.727 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T05:24:08.732 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T05:24:08.922 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T05:24:08.945 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T05:24:08.962 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T05:24:09.020 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T05:24:09.374 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T05:24:09.393 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:09.400 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T05:24:09.432 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T05:24:09.550 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T05:24:09.752 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T05:24:09.770 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:09.810 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T05:24:10.126 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T05:24:10.171 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T05:24:10.189 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:10.229 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T05:24:10.285 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T05:24:10.633 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T05:24:10.650 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T05:24:10.691 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T05:24:10.861 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T05:24:10.881 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T05:24:10.928 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T05:24:11.044 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T05:24:11.064 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T05:24:11.102 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T05:24:11.514 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T05:24:11.530 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:11.589 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T05:24:11.942 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T05:24:11.961 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:12.000 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T05:24:12.108 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package dump. 2023-10-06T05:24:12.127 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T05:24:12.261 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T05:24:12.279 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T05:24:12.280 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T05:24:12.319 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T05:24:12.561 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package indent. 2023-10-06T05:24:12.578 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T05:24:12.629 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T05:24:12.865 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T05:24:12.882 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T05:24:12.923 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T05:24:12.976 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T05:24:12.995 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T05:24:13.034 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T05:24:13.409 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T05:24:13.426 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T05:24:13.467 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T05:24:13.738 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T05:24:13.759 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T05:24:13.807 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T05:24:13.861 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package modemmanager. 2023-10-06T05:24:13.881 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:14.143 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T05:24:14.179 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T05:24:14.196 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:14.237 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T05:24:14.577 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T05:24:14.598 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:14.644 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T05:24:14.894 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T05:24:14.913 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T05:24:14.952 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T05:24:14.965 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T05:24:14.986 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:15.032 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T05:24:15.456 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T05:24:15.473 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T05:24:15.514 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T05:24:15.533 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package network-manager. 2023-10-06T05:24:15.551 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T05:24:15.616 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T05:24:15.879 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T05:24:15.897 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T05:24:15.937 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T05:24:16.343 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T05:24:16.349 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ppp. 2023-10-06T05:24:16.360 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:16.368 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T05:24:16.409 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T05:24:16.620 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T05:24:16.808 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T05:24:16.827 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:16.874 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T05:24:16.938 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T05:24:16.955 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T05:24:16.988 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T05:24:17.137 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T05:24:17.154 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T05:24:17.195 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T05:24:17.384 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T05:24:17.401 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T05:24:17.484 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T05:24:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T05:24:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T05:24:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T05:24:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T05:24:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T05:24:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T05:24:18.408 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T05:24:18.425 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T05:24:18.475 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T05:24:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T05:24:18.905 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package modemmanager. 2023-10-06T05:24:18.923 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T05:24:18.972 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T05:24:18.975 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T05:24:19.098 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T05:24:19.208 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T05:24:19.662 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T05:24:19.679 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T05:24:19.729 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T05:24:20.370 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T05:24:20.371 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T05:24:20.398 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package network-manager. 2023-10-06T05:24:20.415 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T05:24:20.481 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T05:24:20.846 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T05:24:20.972 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T05:24:21.123 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T05:24:21.232 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T05:24:21.358 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T05:24:21.387 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ppp. 2023-10-06T05:24:21.405 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T05:24:21.518 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T05:24:21.685 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T05:24:22.025 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T05:24:22.045 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T05:24:22.134 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T05:24:22.481 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T05:24:22.500 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T05:24:22.503 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T05:24:22.556 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T05:24:22.748 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T05:24:22.813 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T05:24:22.832 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T05:24:22.843 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T05:24:22.879 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T05:24:22.908 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T05:24:23.068 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T05:24:23.194 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T05:24:23.320 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T05:24:23.506 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T05:24:23.513 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T05:24:23.524 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T05:24:23.575 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T05:24:23.639 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T05:24:23.790 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T05:24:23.883 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T05:24:23.916 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T05:24:24.117 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T05:24:24.226 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T05:24:24.243 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T05:24:24.403 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T05:24:24.523 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T05:24:24.947 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T05:24:24.948 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T05:24:24.958 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:24.958 INFO:teuthology.orchestra.run.smithi173.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T05:24:24.958 INFO:teuthology.orchestra.run.smithi173.stdout:which means they are currently configured by ifupdown: 2023-10-06T05:24:24.958 INFO:teuthology.orchestra.run.smithi173.stdout:- enp3s0f1 2023-10-06T05:24:24.958 INFO:teuthology.orchestra.run.smithi173.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T05:24:24.959 INFO:teuthology.orchestra.run.smithi173.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T05:24:24.959 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:25.111 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T05:24:25.420 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T05:24:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T05:24:25.558 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T05:24:25.693 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T05:24:25.845 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T05:24:25.962 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T05:24:25.972 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T05:24:26.101 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T05:24:26.430 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T05:24:26.573 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T05:24:26.741 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T05:24:26.867 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T05:24:27.010 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T05:24:27.135 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T05:24:27.174 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T05:24:27.437 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T05:24:27.437 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T05:24:27.441 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T05:24:27.543 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T05:24:27.625 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T05:24:27.762 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T05:24:27.889 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T05:24:27.989 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T05:24:28.016 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T05:24:28.081 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T05:24:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T05:24:28.257 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T05:24:28.349 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T05:24:28.383 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T05:24:28.474 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T05:24:28.676 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T05:24:28.876 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T05:24:29.054 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T05:24:29.182 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T05:24:29.951 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:29.952 INFO:teuthology.orchestra.run.smithi029.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T05:24:29.952 INFO:teuthology.orchestra.run.smithi029.stdout:which means they are currently configured by ifupdown: 2023-10-06T05:24:29.952 INFO:teuthology.orchestra.run.smithi029.stdout:- ens1f0 2023-10-06T05:24:29.952 INFO:teuthology.orchestra.run.smithi029.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T05:24:29.952 INFO:teuthology.orchestra.run.smithi029.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T05:24:29.952 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:30.121 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T05:24:30.437 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T05:24:30.940 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T05:24:31.441 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T05:24:31.568 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T05:24:31.754 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T05:24:31.880 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T05:24:32.009 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T05:24:32.136 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T05:24:32.417 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T05:24:32.417 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T05:24:32.546 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T05:24:32.646 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T05:24:32.965 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T05:24:33.075 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T05:24:33.212 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T05:24:33.374 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T05:24:33.479 INFO:teuthology.orchestra.run.smithi173.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T05:24:33.482 DEBUG:teuthology.parallel:result is None 2023-10-06T05:24:33.684 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T05:24:37.557 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T05:24:37.675 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T05:24:38.628 INFO:teuthology.orchestra.run.smithi029.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T05:24:38.631 DEBUG:teuthology.parallel:result is None 2023-10-06T05:24:38.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T05:24:38.848 DEBUG:teuthology.orchestra.run.smithi029:> dpkg-query -W -f '${Version}' ceph 2023-10-06T05:24:38.873 INFO:teuthology.orchestra.run.smithi029.stdout:17.2.6-1274-g68e53a4a-1focal 2023-10-06T05:24:38.874 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T05:24:38.874 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274-g68e53a4a-1focal is installed. 2023-10-06T05:24:38.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T05:24:39.018 DEBUG:teuthology.orchestra.run.smithi173:> dpkg-query -W -f '${Version}' ceph 2023-10-06T05:24:39.043 INFO:teuthology.orchestra.run.smithi173.stdout:17.2.6-1274-g68e53a4a-1focal 2023-10-06T05:24:39.043 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T05:24:39.044 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274-g68e53a4a-1focal is installed. 2023-10-06T05:24:39.044 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T05:24:39.044 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:39.044 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T05:24:39.061 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:24:39.061 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T05:24:39.101 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T05:24:39.101 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:39.102 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T05:24:39.123 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T05:24:39.135 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:24:39.135 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T05:24:39.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T05:24:39.208 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T05:24:39.209 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:39.209 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T05:24:39.225 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T05:24:39.284 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:24:39.284 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T05:24:39.300 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T05:24:39.309 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T05:24:39.309 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:39.309 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T05:24:39.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T05:24:39.383 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:24:39.383 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T05:24:39.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T05:24:39.457 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T05:24:39.519 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T05:24:39.519 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2023-10-06T05:24:39.522 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2023-10-06T05:24:39.537 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T05:24:39.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T05:24:39.540 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T05:24:39.550 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T05:24:39.551 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T05:24:39.594 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T05:24:39.614 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T05:24:39.615 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T05:24:39.615 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T05:24:39.615 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:39.615 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T05:24:39.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T05:24:39.703 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:24:39.703 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T05:24:39.710 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T05:24:39.756 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T05:24:39.756 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T05:24:39.756 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412332', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi173.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T05:24:39.757 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T05:24:39.759 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T05:24:39.765 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T05:24:39.767 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T05:24:39.825 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:39.826 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T05:24:39.832 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T05:24:39.833 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2023-10-06T05:24:39.840 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T05:24:39.840 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T05:24:39.840 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-10-06T05:24:39.840 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T05:24:39.841 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-06 05:20:10.190969447 +0000 2023-10-06T05:24:39.841 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-06 05:20:09.894976260 +0000 2023-10-06T05:24:39.841 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-06 05:20:09.894976260 +0000 2023-10-06T05:24:39.841 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-06T05:24:39.841 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T05:24:39.898 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-06T05:24:39.898 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-06T05:24:39.899 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.00030131 s, 1.7 MB/s 2023-10-06T05:24:39.899 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T05:24:39.908 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2023-10-06T05:24:39.914 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T05:24:39.914 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T05:24:39.914 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-10-06T05:24:39.914 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T05:24:39.914 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-06 05:20:10.666958490 +0000 2023-10-06T05:24:39.914 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-06 05:20:10.410964383 +0000 2023-10-06T05:24:39.914 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-06 05:20:10.410964383 +0000 2023-10-06T05:24:39.915 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-06T05:24:39.915 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T05:24:39.970 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-06T05:24:39.971 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-06T05:24:39.971 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000291574 s, 1.8 MB/s 2023-10-06T05:24:39.972 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T05:24:39.980 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2023-10-06T05:24:39.987 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T05:24:39.987 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T05:24:39.987 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-10-06T05:24:39.987 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T05:24:39.987 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-06 05:20:11.166946981 +0000 2023-10-06T05:24:39.987 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-06 05:20:10.886953426 +0000 2023-10-06T05:24:39.987 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-06 05:20:10.886953426 +0000 2023-10-06T05:24:39.987 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-06T05:24:39.987 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T05:24:40.001 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-06T05:24:40.001 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-06T05:24:40.001 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000288661 s, 1.8 MB/s 2023-10-06T05:24:40.002 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T05:24:40.052 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2023-10-06T05:24:40.059 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T05:24:40.060 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T05:24:40.060 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 376 Links: 1 2023-10-06T05:24:40.060 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T05:24:40.060 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-06 05:20:11.686935013 +0000 2023-10-06T05:24:40.060 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-06 05:20:11.386941917 +0000 2023-10-06T05:24:40.060 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-06 05:20:11.386941917 +0000 2023-10-06T05:24:40.060 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-06T05:24:40.060 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T05:24:40.075 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-06T05:24:40.075 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-06T05:24:40.075 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000305877 s, 1.7 MB/s 2023-10-06T05:24:40.076 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T05:24:40.129 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:40.129 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:24:40.129 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T05:24:40.136 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T05:24:40.136 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2023-10-06T05:24:40.144 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T05:24:40.144 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T05:24:40.144 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-10-06T05:24:40.144 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T05:24:40.144 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-10-06 05:20:05.368648480 +0000 2023-10-06T05:24:40.144 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-10-06 05:20:05.084655159 +0000 2023-10-06T05:24:40.144 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-10-06 05:20:05.084655159 +0000 2023-10-06T05:24:40.144 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-10-06T05:24:40.145 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T05:24:40.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-10-06T05:24:40.156 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-10-06T05:24:40.156 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000312166 s, 1.6 MB/s 2023-10-06T05:24:40.157 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T05:24:40.206 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2023-10-06T05:24:40.213 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T05:24:40.213 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T05:24:40.214 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-10-06T05:24:40.214 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T05:24:40.214 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-10-06 05:20:05.868636722 +0000 2023-10-06T05:24:40.214 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-10-06 05:20:05.572643682 +0000 2023-10-06T05:24:40.214 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-10-06 05:20:05.572643682 +0000 2023-10-06T05:24:40.214 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-10-06T05:24:40.214 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T05:24:40.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-10-06T05:24:40.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-10-06T05:24:40.226 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000406569 s, 1.3 MB/s 2023-10-06T05:24:40.227 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T05:24:40.282 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2023-10-06T05:24:40.289 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T05:24:40.290 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T05:24:40.290 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-10-06T05:24:40.290 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T05:24:40.290 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-10-06 05:20:06.348625433 +0000 2023-10-06T05:24:40.290 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-10-06 05:20:06.080631735 +0000 2023-10-06T05:24:40.290 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-10-06 05:20:06.080631735 +0000 2023-10-06T05:24:40.290 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-10-06T05:24:40.290 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T05:24:40.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-10-06T05:24:40.304 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-10-06T05:24:40.304 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000325413 s, 1.6 MB/s 2023-10-06T05:24:40.306 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T05:24:40.313 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2023-10-06T05:24:40.364 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T05:24:40.364 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T05:24:40.364 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-10-06T05:24:40.364 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T05:24:40.365 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-10-06 05:20:06.872613110 +0000 2023-10-06T05:24:40.365 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-10-06 05:20:06.592619695 +0000 2023-10-06T05:24:40.365 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-10-06 05:20:06.592619695 +0000 2023-10-06T05:24:40.365 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-10-06T05:24:40.365 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T05:24:40.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-10-06T05:24:40.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-10-06T05:24:40.377 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000416181 s, 1.2 MB/s 2023-10-06T05:24:40.378 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T05:24:40.386 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:40.386 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T05:24:40.386 INFO:tasks.ceph:Generating config... 2023-10-06T05:24:40.387 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T05:24:40.387 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T05:24:40.388 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T05:24:40.388 INFO:tasks.ceph:[client] pid file = 2023-10-06T05:24:40.388 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T05:24:40.388 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T05:24:40.388 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T05:24:40.388 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T05:24:40.388 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T05:24:40.388 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T05:24:40.388 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T05:24:40.388 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T05:24:40.388 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T05:24:40.389 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T05:24:40.389 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T05:24:40.389 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T05:24:40.389 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T05:24:40.389 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T05:24:40.389 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T05:24:40.389 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T05:24:40.389 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T05:24:40.389 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T05:24:40.389 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T05:24:40.389 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T05:24:40.389 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T05:24:40.389 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T05:24:40.390 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T05:24:40.391 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T05:24:40.391 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T05:24:40.425 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T05:24:40.428 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T05:24:40.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T05:24:40.514 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '172.21.15.173'), ('mon.c', '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]')] 2023-10-06T05:24:40.515 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T05:24:40.516 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:40.516 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T05:24:40.522 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --add b 172.21.15.173 --addv c '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:24:40.559 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:24:40.559 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:24:40.559 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = octopus 2023-10-06T05:24:40.559 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2023-10-06T05:24:40.559 INFO:teuthology.orchestra.run.smithi029.stdout:fsid bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:24:40.559 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2023-10-06T05:24:40.556540+0000 2023-10-06T05:24:40.560 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-10-06T05:24:40.556540+0000 2023-10-06T05:24:40.560 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 15 (octopus) 2023-10-06T05:24:40.560 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2023-10-06T05:24:40.560 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2023-10-06T05:24:40.560 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2023-10-06T05:24:40.560 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] mon.c 2023-10-06T05:24:40.560 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T05:24:40.562 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T05:24:40.568 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bd99696d-d9bf-47c8-93f5-f978334ae590... 2023-10-06T05:24:40.570 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:24:40.614 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:24:40.648 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-10-06T05:24:40.648 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2023-10-06T05:24:40.648 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:24:40.648 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2023-10-06T05:24:40.648 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.648 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.649 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:24:40.650 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2023-10-06T05:24:40.651 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2023-10-06T05:24:40.652 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2023-10-06T05:24:40.653 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2023-10-06T05:24:40.654 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2023-10-06T05:24:40.655 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2023-10-06T05:24:40.656 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:24:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:24:40.658 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:24:40.659 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2023-10-06T05:24:40.659 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-06T05:24:40.659 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:24:40.659 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = "" 2023-10-06T05:24:40.659 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:24:40.659 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:24:40.659 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2023-10-06T05:24:40.659 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2023-10-06T05:24:40.659 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2023-10-06T05:24:40.660 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2023-10-06T05:24:40.661 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2023-10-06T05:24:40.661 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:24:40.661 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:24:40.661 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:24:40.663 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2023-10-06T05:24:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2023-10-06T05:24:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:24:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2023-10-06T05:24:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2023-10-06T05:24:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2023-10-06T05:24:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2023-10-06T05:24:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2023-10-06T05:24:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2023-10-06T05:24:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2023-10-06T05:24:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:24:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2023-10-06T05:24:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:24:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:24:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2023-10-06T05:24:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2023-10-06T05:24:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2023-10-06T05:24:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:24:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:24:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2023-10-06T05:24:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:24:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2023-10-06T05:24:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:24:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:24:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2023-10-06T05:24:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:24:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2023-10-06T05:24:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2023-10-06T05:24:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2023-10-06T05:24:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2023-10-06T05:24:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2023-10-06T05:24:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:24:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:24:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.669 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2023-10-06T05:24:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2023-10-06T05:24:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2023-10-06T05:24:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2023-10-06T05:24:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:24:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2023-10-06T05:24:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2023-10-06T05:24:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2023-10-06T05:24:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2023-10-06T05:24:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2023-10-06T05:24:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2023-10-06T05:24:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2023-10-06T05:24:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:24:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2023-10-06T05:24:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2023-10-06T05:24:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:24:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2023-10-06T05:24:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2023-10-06T05:24:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2023-10-06T05:24:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: bdev async discard = True 2023-10-06T05:24:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: bdev enable discard = True 2023-10-06T05:24:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore allocator = bitmap 2023-10-06T05:24:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2023-10-06T05:24:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2023-10-06T05:24:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 1/20 2023-10-06T05:24:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 1/20 2023-10-06T05:24:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:24:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2023-10-06T05:24:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 4/10 2023-10-06T05:24:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:24:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2023-10-06T05:24:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:24:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:24:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2023-10-06T05:24:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:24:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.675 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2023-10-06T05:24:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:24:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2023-10-06T05:24:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:24:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2023-10-06T05:24:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: mon op complaint time = 120 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:24:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: client mount timeout = 600 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: debug client = 20 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = "" 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-10-06T05:24:40.679 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout:[mds] 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds = 20 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug frag = True 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug scatterstat = True 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: mds op complaint time = 180 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: mds verify scatter = True 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:24:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:24:40.680 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T05:24:40.681 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T05:24:40.729 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T05:24:40.730 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:40.730 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T05:24:40.735 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:40.735 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T05:24:40.740 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:24:40.740 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:40.740 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T05:24:40.741 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T05:24:40.764 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:24:40.765 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:24:40.770 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:24:40.771 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:24:40.771 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T05:24:40.771 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T05:24:40.797 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:24:40.797 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:24:40.802 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T05:24:40.802 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T05:24:40.803 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T05:24:40.847 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T05:24:40.850 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T05:24:40.896 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T05:24:40.898 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T05:24:40.899 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T05:24:40.945 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T05:24:40.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T05:24:40.963 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T05:24:41.005 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T05:24:41.007 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T05:24:41.065 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T05:24:41.114 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T05:24:41.116 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T05:24:41.131 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T05:24:41.170 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T05:24:41.172 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T05:24:41.182 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T05:24:41.183 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T05:24:41.219 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T05:24:41.231 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T05:24:41.266 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T05:24:41.279 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T05:24:41.315 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T05:24:41.328 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T05:24:41.358 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T05:24:41.370 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T05:24:41.370 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T05:24:41.371 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T05:24:41.388 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:41.388 INFO:tasks.ceph:role: osd.0 2023-10-06T05:24:41.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:24:41.389 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T05:24:41.433 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T05:24:41.434 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T05:24:41.437 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T05:24:41.437 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-06T05:24:41.437 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T05:24:41.437 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-06T05:24:41.437 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T05:24:41.437 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T05:24:41.437 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T05:24:41.437 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T05:24:41.438 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-06T05:24:41.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T05:24:41.506 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T05:24:41.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:24:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T05:24:41.516 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T05:24:41.527 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:41.527 INFO:tasks.ceph:role: osd.1 2023-10-06T05:24:41.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:24:41.528 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T05:24:41.572 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T05:24:41.574 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-06T05:24:41.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T05:24:41.637 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T05:24:41.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:24:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T05:24:41.647 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T05:24:41.657 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:41.657 INFO:tasks.ceph:role: osd.2 2023-10-06T05:24:41.658 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:24:41.658 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T05:24:41.700 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T05:24:41.701 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T05:24:41.701 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T05:24:41.701 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-06T05:24:41.701 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T05:24:41.701 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-06T05:24:41.701 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T05:24:41.701 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T05:24:41.701 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T05:24:41.701 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T05:24:41.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-06T05:24:41.702 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T05:24:41.717 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T05:24:41.724 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T05:24:41.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:24:41.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T05:24:41.784 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:41.785 INFO:tasks.ceph:role: osd.3 2023-10-06T05:24:41.785 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:24:41.785 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T05:24:41.825 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T05:24:41.825 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T05:24:41.825 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T05:24:41.825 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-06T05:24:41.825 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T05:24:41.825 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-06T05:24:41.826 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T05:24:41.826 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T05:24:41.826 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T05:24:41.826 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T05:24:41.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-06T05:24:41.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T05:24:41.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T05:24:41.900 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T05:24:41.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:24:41.901 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:24:41.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:41.973+0000 7f06090213c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T05:24:41.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:41.973+0000 7f06090213c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T05:24:41.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:41.973+0000 7f06090213c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T05:24:41.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:41.973+0000 7f06090213c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T05:24:41.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:41.973+0000 7f06090213c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T05:24:41.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:41.973+0000 7f06090213c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T05:24:42.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:42.533+0000 7f06090213c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:43.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:43.313+0000 7f06090213c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:44.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:44.097+0000 7f06090213c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:44.958 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T05:24:44.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:24:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:45.005+0000 7f6076a5e3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T05:24:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:45.005+0000 7f6076a5e3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T05:24:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:45.005+0000 7f6076a5e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T05:24:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:45.005+0000 7f6076a5e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T05:24:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:45.005+0000 7f6076a5e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T05:24:45.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:45.009+0000 7f6076a5e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T05:24:45.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:45.569+0000 7f6076a5e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:46.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:46.369+0000 7f6076a5e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:47.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:47.149+0000 7f6076a5e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:48.021 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T05:24:48.080 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:24:48.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:48.113+0000 7f299e8ee3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T05:24:48.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:48.113+0000 7f299e8ee3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T05:24:48.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:48.113+0000 7f299e8ee3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T05:24:48.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:48.113+0000 7f299e8ee3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T05:24:48.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:48.113+0000 7f299e8ee3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T05:24:48.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:48.113+0000 7f299e8ee3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T05:24:48.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:48.669+0000 7f299e8ee3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:49.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:49.461+0000 7f299e8ee3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:50.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:50.245+0000 7f299e8ee3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:51.121 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T05:24:51.137 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:24:51.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:51.213+0000 7efce906d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T05:24:51.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:51.213+0000 7efce906d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T05:24:51.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:51.213+0000 7efce906d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T05:24:51.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:51.213+0000 7efce906d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T05:24:51.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:51.213+0000 7efce906d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T05:24:51.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:51.213+0000 7efce906d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T05:24:51.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:51.773+0000 7efce906d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:52.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:52.553+0000 7efce906d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:53.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:24:53.337+0000 7efce906d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:54.209 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T05:24:54.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T05:24:54.242 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:54.243 INFO:tasks.ceph:role: osd.4 2023-10-06T05:24:54.243 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:24:54.243 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T05:24:54.816 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T05:24:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T05:24:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T05:24:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2023-10-06T05:24:54.816 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T05:24:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-10-06T05:24:54.816 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T05:24:54.816 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T05:24:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T05:24:54.817 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T05:24:54.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-10-06T05:24:54.818 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T05:24:54.924 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T05:24:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T05:24:54.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:24:54.936 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T05:24:54.945 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:54.945 INFO:tasks.ceph:role: osd.5 2023-10-06T05:24:54.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:24:54.946 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T05:24:55.467 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T05:24:55.469 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-10-06T05:24:55.469 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T05:24:55.513 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T05:24:55.524 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T05:24:55.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:24:55.525 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T05:24:55.536 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:55.536 INFO:tasks.ceph:role: osd.6 2023-10-06T05:24:55.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:24:55.536 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T05:24:56.066 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T05:24:56.066 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T05:24:56.066 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T05:24:56.066 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2023-10-06T05:24:56.066 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T05:24:56.066 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-10-06T05:24:56.067 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T05:24:56.067 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T05:24:56.067 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T05:24:56.067 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T05:24:56.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-10-06T05:24:56.068 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T05:24:56.128 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T05:24:56.139 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T05:24:56.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:24:56.140 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T05:24:56.152 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T05:24:56.152 INFO:tasks.ceph:role: osd.7 2023-10-06T05:24:56.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:24:56.152 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T05:24:56.664 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T05:24:56.664 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T05:24:56.664 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T05:24:56.664 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2023-10-06T05:24:56.665 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T05:24:56.665 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-10-06T05:24:56.665 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T05:24:56.665 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T05:24:56.665 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T05:24:56.665 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T05:24:56.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-10-06T05:24:56.667 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T05:24:56.722 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T05:24:56.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:24:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T05:24:56.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:24:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:24:56.833+0000 7f6e3e4663c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T05:24:56.840 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:24:56.833+0000 7f6e3e4663c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T05:24:56.840 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:24:56.833+0000 7f6e3e4663c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T05:24:56.840 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:24:56.833+0000 7f6e3e4663c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T05:24:56.840 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:24:56.833+0000 7f6e3e4663c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T05:24:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:24:56.845+0000 7f6e3e4663c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T05:24:57.670 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:24:57.665+0000 7f6e3e4663c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:58.456 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:24:58.449+0000 7f6e3e4663c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:24:59.242 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:24:59.237+0000 7f6e3e4663c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:00.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T05:25:00.119 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:25:00.154 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:00.145+0000 7f01b8a253c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T05:25:00.154 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:00.149+0000 7f01b8a253c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T05:25:00.154 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:00.149+0000 7f01b8a253c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T05:25:00.154 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:00.149+0000 7f01b8a253c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T05:25:00.154 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:00.149+0000 7f01b8a253c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T05:25:00.155 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:00.149+0000 7f01b8a253c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T05:25:00.715 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:00.709+0000 7f01b8a253c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:01.493+0000 7f01b8a253c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:02.290 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:02.285+0000 7f01b8a253c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:03.146 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T05:25:03.204 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:25:03.246 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:03.237+0000 7feb646423c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T05:25:03.246 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:03.237+0000 7feb646423c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T05:25:03.246 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:03.241+0000 7feb646423c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T05:25:03.246 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:03.241+0000 7feb646423c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T05:25:03.246 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:03.241+0000 7feb646423c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T05:25:03.247 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:03.241+0000 7feb646423c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T05:25:03.803 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:03.797+0000 7feb646423c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:04.588 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:04.581+0000 7feb646423c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:05.365 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:05.357+0000 7feb646423c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:06.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T05:25:06.243 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:25:06.329 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:06.321+0000 7f8f3aa083c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T05:25:06.329 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:06.321+0000 7f8f3aa083c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T05:25:06.329 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:06.321+0000 7f8f3aa083c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T05:25:06.329 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:06.321+0000 7f8f3aa083c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T05:25:06.329 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:06.321+0000 7f8f3aa083c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T05:25:06.329 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:06.321+0000 7f8f3aa083c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T05:25:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:06.881+0000 7f8f3aa083c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:07.680 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:07.673+0000 7f8f3aa083c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:08.460 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:08.453+0000 7f8f3aa083c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T05:25:09.317 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T05:25:09.332 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T05:25:09.332 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:09.332 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T05:25:09.348 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:09.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T05:25:09.408 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:09.408 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T05:25:09.419 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:09.419 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T05:25:09.433 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:09.433 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T05:25:09.444 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:09.446 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T05:25:09.456 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:09.456 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T05:25:09.518 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:09.518 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T05:25:09.534 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:09.534 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T05:25:09.596 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:09.596 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T05:25:09.606 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:09.607 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T05:25:09.622 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:09.622 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T05:25:09.636 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:09.637 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T05:25:09.647 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:09.647 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T05:25:09.660 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:09.660 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T05:25:09.667 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:09.667 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T05:25:09.674 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:09.674 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T05:25:09.680 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:09.680 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T05:25:09.728 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T05:25:09.728 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T05:25:09.730 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T05:25:09.741 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2023-10-06T05:25:09.741 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAYmh9lCDNrMhAA/2ymYL+jXTRPLjyoHbWzPg== 2023-10-06T05:25:09.741 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-06T05:25:09.741 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAYmh9lmmo6OBAAQpP+gZa78MNtTT1c5tK+vw== 2023-10-06T05:25:09.742 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-06T05:25:09.742 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAZmh9lLN0yABAAa4pRtt5i1VwRUls37iQ6Ng== 2023-10-06T05:25:09.742 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2023-10-06T05:25:09.742 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAZmh9liLI7OhAA2q9u7NoYTihYVqDD6feWqg== 2023-10-06T05:25:09.742 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2023-10-06T05:25:09.742 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAdmh9lVgGUABAAT+KgCiblIExCBVOWaW1KTQ== 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAgmh9lTun5BhAAhxhwULNJol5kiIMd6cr4EQ== 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAjmh9lJRz4DBAAPs7JW7cj58uGIh0CXjTPOA== 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAYmh9l0ABYNRAAjZ6Ji5Q1o0HKn3oDYZaZ+w== 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAZmh9lOCLABhAA38TEJqLAC+ccT54rGKcRHQ== 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAZmh9l/IkZChAAA0KqF/fQdw+Lvfgt3G7D1Q== 2023-10-06T05:25:09.743 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAomh9lF4v2MRAA6d30MwZe8jaJE2/KZ2v2fg== 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAsmh9lLsIbCRAAW0z6kOmd/cRdSMyGXB43cA== 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAvmh9lBdCTDhAACXtGHMjlSZ4mDObzP73SCw== 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAymh9lpfyEExAAKfZ7994WtblLHuzw9X2CjA== 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAZmh9l/dfwDBAAyd4qv0io8GSbP8ukYr6WaQ== 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout:[client.2] 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAZmh9lLAPFDxAA0M9C3WbeOYjQvGGIqPRrSw== 2023-10-06T05:25:09.744 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2023-10-06T05:25:09.745 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAZmh9lhSm7EhAA//AImYYn3pBpCmwsOv9X8g== 2023-10-06T05:25:09.745 INFO:teuthology.orchestra.run.smithi029.stdout:[client.3] 2023-10-06T05:25:09.745 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAZmh9lYEpMFRAAgFoS4+VPWcjT0TgyNTDFFA== 2023-10-06T05:25:09.746 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.y] 2023-10-06T05:25:09.746 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAYmh9lCDNrMhAA/2ymYL+jXTRPLjyoHbWzPg== 2023-10-06T05:25:09.746 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-10-06T05:25:09.746 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAYmh9lmmo6OBAAQpP+gZa78MNtTT1c5tK+vw== 2023-10-06T05:25:09.746 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZmh9lLN0yABAAa4pRtt5i1VwRUls37iQ6Ng== 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZmh9liLI7OhAA2q9u7NoYTihYVqDD6feWqg== 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAdmh9lVgGUABAAT+KgCiblIExCBVOWaW1KTQ== 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAgmh9lTun5BhAAhxhwULNJol5kiIMd6cr4EQ== 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.3] 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAjmh9lJRz4DBAAPs7JW7cj58uGIh0CXjTPOA== 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAYmh9l0ABYNRAAjZ6Ji5Q1o0HKn3oDYZaZ+w== 2023-10-06T05:25:09.747 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZmh9lOCLABhAA38TEJqLAC+ccT54rGKcRHQ== 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZmh9l/IkZChAAA0KqF/fQdw+Lvfgt3G7D1Q== 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.4] 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAomh9lF4v2MRAA6d30MwZe8jaJE2/KZ2v2fg== 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.5] 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAsmh9lLsIbCRAAW0z6kOmd/cRdSMyGXB43cA== 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.6] 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAvmh9lBdCTDhAACXtGHMjlSZ4mDObzP73SCw== 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.7] 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAymh9lpfyEExAAKfZ7994WtblLHuzw9X2CjA== 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2023-10-06T05:25:09.748 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZmh9l/dfwDBAAyd4qv0io8GSbP8ukYr6WaQ== 2023-10-06T05:25:09.749 INFO:teuthology.orchestra.run.smithi173.stdout:[client.2] 2023-10-06T05:25:09.749 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZmh9lLAPFDxAA0M9C3WbeOYjQvGGIqPRrSw== 2023-10-06T05:25:09.749 INFO:teuthology.orchestra.run.smithi173.stdout:[client.1] 2023-10-06T05:25:09.749 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZmh9lhSm7EhAA//AImYYn3pBpCmwsOv9X8g== 2023-10-06T05:25:09.749 INFO:teuthology.orchestra.run.smithi173.stdout:[client.3] 2023-10-06T05:25:09.749 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZmh9lYEpMFRAAgFoS4+VPWcjT0TgyNTDFFA== 2023-10-06T05:25:09.749 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T05:25:09.751 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T05:25:09.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:25:09.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:25:09.836 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T05:25:09.838 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T05:25:09.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T05:25:09.888 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T05:25:09.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:09.974 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.020 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.022 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.066 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.068 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.111 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.113 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.156 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T05:25:10.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T05:25:10.201 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T05:25:10.242 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T05:25:10.295 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T05:25:10.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T05:25:10.346 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.348 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.431 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.477 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.479 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.522 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.525 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T05:25:10.568 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T05:25:10.610 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T05:25:10.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T05:25:10.661 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T05:25:10.705 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T05:25:10.708 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T05:25:10.752 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T05:25:10.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T05:25:10.840 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T05:25:10.840 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T05:25:10.856 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T05:25:10.960 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T05:25:10.975 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T05:25:10.992 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T05:25:11.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T05:25:11.105 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T05:25:11.116 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T05:25:11.218 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T05:25:11.232 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:25:11.234 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T05:25:11.240 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T05:25:11.241 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T05:25:11.241 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T05:25:11.282 INFO:tasks.ceph.mon.a:Started 2023-10-06T05:25:11.282 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T05:25:11.282 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T05:25:11.284 INFO:tasks.ceph.mon.b:Started 2023-10-06T05:25:11.285 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T05:25:11.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T05:25:11.287 INFO:tasks.ceph.mon.c:Started 2023-10-06T05:25:11.287 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T05:25:11.287 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T05:25:11.287 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T05:25:11.289 INFO:tasks.ceph.mgr.y:Started 2023-10-06T05:25:11.290 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T05:25:11.290 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T05:25:11.292 INFO:tasks.ceph.mgr.x:Started 2023-10-06T05:25:11.292 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T05:25:11.293 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T05:25:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.393+0000 7f3358db7700 1 Processor -- start 2023-10-06T05:25:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.393+0000 7f3358db7700 1 -- start start 2023-10-06T05:25:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3358db7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3358db7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3358db7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540c8060 con 0x7f33540cb8c0 2023-10-06T05:25:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3358db7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33540c8ce0 con 0x7f33540c9c80 2023-10-06T05:25:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3358db7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540c8340 con 0x7f3354155ac0 2023-10-06T05:25:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3353fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f33537fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f334bfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f33540cb8c0 0x7f33540c9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44794/0 (socket says 172.21.15.29:44794) 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3353fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39586/0 (socket says 172.21.15.29:39586) 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f334bfff700 1 -- 172.21.15.29:0/3108766726 learned_addr learned my addr 172.21.15.29:0/3108766726 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f33537fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:57722/0 (socket says 172.21.15.29:57722) 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 msgr2=0x7f33540c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 msgr2=0x7f33540c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3353fff700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 msgr2=0x7f33540c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3353fff700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 msgr2=0x7f33540c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.397+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T05:25:11.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:11.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:11.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f3353fff700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 msgr2=0x7f33540c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T05:25:11.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f3353fff700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 msgr2=0x7f33540c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:11.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:11.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T05:25:11.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 msgr2=0x7f33540c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T05:25:11.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 msgr2=0x7f33540c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:11.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:11.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:11.601+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T05:25:12.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 msgr2=0x7f33540c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T05:25:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 msgr2=0x7f33540c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f3353fff700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 msgr2=0x7f33540c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T05:25:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f3353fff700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 msgr2=0x7f33540c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T05:25:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.005+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T05:25:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f3353fff700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 msgr2=0x7f33540c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T05:25:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f3353fff700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 msgr2=0x7f33540c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 msgr2=0x7f33540c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T05:25:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 msgr2=0x7f33540c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:12.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T05:25:12.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:12.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:12.809+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T05:25:14.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f3351ffb700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 msgr2=0x7f33540c7780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T05:25:14.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f3351ffb700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3354155ac0 0x7f33540c7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:14.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f3351ffb700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 msgr2=0x7f33540c19d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T05:25:14.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f3351ffb700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.29:3300/0 conn(0x7f33540c9c80 0x7f33540c19d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:14.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f3351ffb700 1 -- 172.21.15.29:0/3108766726 >> v1:172.21.15.29:6789/0 conn(0x7f33540cb8c0 legacy=0x7f33540c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:14.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f3351ffb700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:14.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f3351ffb700 1 -- 172.21.15.29:0/3108766726 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540c8620 con 0x7f33340061b0 2023-10-06T05:25:14.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f3351ffb700 1 -- 172.21.15.29:0/3108766726 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33540c8ce0 con 0x7f33340036f0 2023-10-06T05:25:14.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:14.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 msgr2=0x7f3334005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T05:25:14.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 msgr2=0x7f3334005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:14.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:14.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.397+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T05:25:14.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.597+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:14.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.597+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 msgr2=0x7f3334005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T05:25:14.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.597+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 msgr2=0x7f3334005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:14.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.597+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:14.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.597+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T05:25:15.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.997+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:15.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.997+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 msgr2=0x7f3334005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T05:25:15.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.997+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 msgr2=0x7f3334005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:15.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.997+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:15.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:14.997+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T05:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:15.801+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:15.801+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 msgr2=0x7f3334005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T05:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:15.801+0000 7f33537fe700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 msgr2=0x7f3334005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T05:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:15.801+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T05:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:15.801+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T05:25:16.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.477+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212444003 0 0) 0x7f33540c8620 con 0x7f33340061b0 2023-10-06T05:25:16.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.477+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3340003570 con 0x7f33340061b0 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 363601240 0 0) 0x7f3340003570 con 0x7f33340061b0 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 msgr2=0x7f3334005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 --2- 172.21.15.29:0/3108766726 >> v2:172.21.15.173:3300/0 conn(0x7f33340036f0 0x7f3334005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333400af30 con 0x7f33340061b0 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f3344001530 con 0x7f33340061b0 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 >> v1:172.21.15.173:6789/0 conn(0x7f33340061b0 legacy=0x7f3334008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3353fff700 1 -- 172.21.15.29:0/3108766726 reap_dead start 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3340003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 0x7f3340004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 0x7f334000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540c8ce0 con 0x7f33400053c0 2023-10-06T05:25:16.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334000c2f0 con 0x7f3340004810 2023-10-06T05:25:16.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334000c4b0 con 0x7f3340003ab0 2023-10-06T05:25:16.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f334bfff700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 0x7f3340004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f33537fe700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3340003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.481+0000 7f3353fff700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 0x7f334000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.485+0000 7f334bfff700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 msgr2=0x7f3340003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:16.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.485+0000 7f334bfff700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3340003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.485+0000 7f334bfff700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 msgr2=0x7f334000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:16.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.485+0000 7f334bfff700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 0x7f334000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.485+0000 7f334bfff700 1 -- 172.21.15.29:0/3108766726 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340003570 con 0x7f3340004810 2023-10-06T05:25:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.485+0000 7f334bfff700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 0x7f3340004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f334400c2a0 tx=0x7f3344001da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=567c9a18c2e0b58a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:16.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.485+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334400cb70 con 0x7f3340004810 2023-10-06T05:25:16.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.485+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334400ccf0 con 0x7f3340004810 2023-10-06T05:25:16.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.485+0000 7f3352ffd700 1 -- 172.21.15.29:0/3108766726 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344004b40 con 0x7f3340004810 2023-10-06T05:25:16.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.489+0000 7f3358db7700 1 -- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 msgr2=0x7f3340004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.489+0000 7f3358db7700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 0x7f3340004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f334400c2a0 tx=0x7f3344001da0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.489+0000 7f3358db7700 1 -- 172.21.15.29:0/3108766726 shutdown_connections 2023-10-06T05:25:16.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.489+0000 7f3358db7700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 0x7f334000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.489+0000 7f3358db7700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 0x7f3340004c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.489+0000 7f3358db7700 1 --2- 172.21.15.29:0/3108766726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3340003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.489+0000 7f3358db7700 1 -- 172.21.15.29:0/3108766726 >> 172.21.15.29:0/3108766726 conn(0x7f335406ba30 msgr2=0x7f3354095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:16.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.489+0000 7f3358db7700 1 -- 172.21.15.29:0/3108766726 shutdown_connections 2023-10-06T05:25:16.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.489+0000 7f3358db7700 1 -- 172.21.15.29:0/3108766726 wait complete. 2023-10-06T05:25:16.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f3358db7700 1 Processor -- start 2023-10-06T05:25:16.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f3358db7700 1 -- start start 2023-10-06T05:25:16.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f3358db7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3354155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f3358db7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 0x7f33541563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f3358db7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 0x7f3354157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f3358db7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540afe80 con 0x7f33400053c0 2023-10-06T05:25:16.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f3358db7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335414d740 con 0x7f3340004810 2023-10-06T05:25:16.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f3358db7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540b00d0 con 0x7f3340003ab0 2023-10-06T05:25:16.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f33537fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3354155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f33537fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3354155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:43038/0 (socket says 172.21.15.29:43038) 2023-10-06T05:25:16.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f3353fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 0x7f3354157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f33537fe700 1 -- 172.21.15.29:0/107275559 learned_addr learned my addr 172.21.15.29:0/107275559 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:16.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f334bfff700 1 --2- 172.21.15.29:0/107275559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 0x7f33541563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f33537fe700 1 -- 172.21.15.29:0/107275559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 msgr2=0x7f33541563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f33537fe700 1 --2- 172.21.15.29:0/107275559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 0x7f33541563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f33537fe700 1 -- 172.21.15.29:0/107275559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 msgr2=0x7f3354157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f33537fe700 1 --2- 172.21.15.29:0/107275559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 0x7f3354157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f33537fe700 1 -- 172.21.15.29:0/107275559 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540b03b0 con 0x7f3340003ab0 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f33537fe700 1 --2- 172.21.15.29:0/107275559 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3354155e90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f333c010e90 tx=0x7f333c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.493+0000 7f334b7fe700 1 -- 172.21.15.29:0/107275559 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c010ec0 con 0x7f3340003ab0 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.497+0000 7f334b7fe700 1 -- 172.21.15.29:0/107275559 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c017040 con 0x7f3340003ab0 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.497+0000 7f3358db7700 1 -- 172.21.15.29:0/107275559 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33540b0690 con 0x7f3340003ab0 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.497+0000 7f334b7fe700 1 -- 172.21.15.29:0/107275559 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c005a00 con 0x7f3340003ab0 2023-10-06T05:25:16.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.497+0000 7f3358db7700 1 -- 172.21.15.29:0/107275559 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3354158500 con 0x7f3340003ab0 2023-10-06T05:25:16.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.497+0000 7f3358db7700 1 -- 172.21.15.29:0/107275559 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335404be00 con 0x7f3340003ab0 2023-10-06T05:25:16.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.501+0000 7f334b7fe700 1 -- 172.21.15.29:0/107275559 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f333c006030 con 0x7f3340003ab0 2023-10-06T05:25:16.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.501+0000 7f334b7fe700 1 -- 172.21.15.29:0/107275559 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f333c005e30 con 0x7f3340003ab0 2023-10-06T05:25:16.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.505+0000 7f334b7fe700 1 -- 172.21.15.29:0/107275559 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f333c006470 con 0x7f3340003ab0 2023-10-06T05:25:16.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.573+0000 7f3358db7700 1 -- 172.21.15.29:0/107275559 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f33540c8900 con 0x7f3340003ab0 2023-10-06T05:25:16.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f334b7fe700 1 -- 172.21.15.29:0/107275559 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f333c006610 con 0x7f3340003ab0 2023-10-06T05:25:16.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f3358db7700 1 -- 172.21.15.29:0/107275559 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 msgr2=0x7f3354155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f3358db7700 1 --2- 172.21.15.29:0/107275559 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3354155e90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f333c010e90 tx=0x7f333c008040 comp rx=0 tx=0).stop 2023-10-06T05:25:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f3358db7700 1 -- 172.21.15.29:0/107275559 shutdown_connections 2023-10-06T05:25:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f3358db7700 1 --2- 172.21.15.29:0/107275559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33400053c0 0x7f3354157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f3358db7700 1 --2- 172.21.15.29:0/107275559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3340004810 0x7f33541563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f3358db7700 1 --2- 172.21.15.29:0/107275559 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3340003ab0 0x7f3354155e90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f3358db7700 1 -- 172.21.15.29:0/107275559 >> 172.21.15.29:0/107275559 conn(0x7f335406ba30 msgr2=0x7f33540cac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f3358db7700 1 -- 172.21.15.29:0/107275559 shutdown_connections 2023-10-06T05:25:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:16.585+0000 7f3358db7700 1 -- 172.21.15.29:0/107275559 wait complete. 2023-10-06T05:25:16.592 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2023-10-06T05:25:16.604 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T05:25:16.605 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:16.605 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T05:25:16.621 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:16.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T05:25:16.635 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:16.635 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T05:25:16.647 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-06T05:25:16.647 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T05:25:16.677 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:16.669+0000 7fbd1acf6000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T05:25:16.703 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:16.703 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T05:25:16.719 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:16.720 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T05:25:16.723 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:16.717+0000 7fa09fee9000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T05:25:16.776 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:16.776 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T05:25:16.785 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-10-06T05:25:16.785 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T05:25:16.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 173fd818-55ca-4663-aa50-f790d1d4a7ad 0 2023-10-06T05:25:16.902 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 Processor -- start 2023-10-06T05:25:16.902 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 -- start start 2023-10-06T05:25:16.903 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d24157040 0x7f4d240c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.903 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4d2406d6d0 0x7f4d2406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.903 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d240c6b40 con 0x7f4d24156c70 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2406e050 con 0x7f4d24157040 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2406bdd0 con 0x7f4d2406d6d0 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d23fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4d2406d6d0 0x7f4d2406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d23fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4d2406d6d0 0x7f4d2406db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52970/0 (socket says 172.21.15.173:52970) 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d23fff700 1 -- 172.21.15.173:0/713254941 learned_addr learned my addr 172.21.15.173:0/713254941 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d23fff700 1 -- 172.21.15.173:0/713254941 >> v2:172.21.15.29:3300/0 conn(0x7f4d24157040 msgr2=0x7f4d240c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d22ffd700 1 --2- 172.21.15.173:0/713254941 >> v2:172.21.15.29:3300/0 conn(0x7f4d24157040 0x7f4d240c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d23fff700 1 --2- 172.21.15.173:0/713254941 >> v2:172.21.15.29:3300/0 conn(0x7f4d24157040 0x7f4d240c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d23fff700 1 -- 172.21.15.173:0/713254941 >> v1:172.21.15.173:6789/0 conn(0x7f4d24156c70 legacy=0x7f4d2406b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.904 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d23fff700 1 -- 172.21.15.173:0/713254941 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240c6d90 con 0x7f4d2406d6d0 2023-10-06T05:25:16.905 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d23fff700 1 --2- 172.21.15.173:0/713254941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 0x7f4d2406db10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4d240c9de0 tx=0x7f4d1c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6e77f373506a34a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:16.906 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d227fc700 1 -- 172.21.15.173:0/713254941 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00e070 con 0x7f4d2406d6d0 2023-10-06T05:25:16.906 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d227fc700 1 -- 172.21.15.173:0/713254941 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c00ba50 con 0x7f4d2406d6d0 2023-10-06T05:25:16.906 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d227fc700 1 -- 172.21.15.173:0/713254941 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0092e0 con 0x7f4d2406d6d0 2023-10-06T05:25:16.906 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 -- 172.21.15.173:0/713254941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 msgr2=0x7f4d2406db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.906 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 --2- 172.21.15.173:0/713254941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 0x7f4d2406db10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4d240c9de0 tx=0x7f4d1c009840 comp rx=0 tx=0).stop 2023-10-06T05:25:16.906 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 -- 172.21.15.173:0/713254941 shutdown_connections 2023-10-06T05:25:16.907 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 --2- 172.21.15.173:0/713254941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 0x7f4d2406db10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.907 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 --2- 172.21.15.173:0/713254941 >> v2:172.21.15.29:3300/0 conn(0x7f4d24157040 0x7f4d240c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.907 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 -- 172.21.15.173:0/713254941 >> 172.21.15.173:0/713254941 conn(0x7f4d240c9830 msgr2=0x7f4d2406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:16.907 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 -- 172.21.15.173:0/713254941 shutdown_connections 2023-10-06T05:25:16.907 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.897+0000 7f4d28927700 1 -- 172.21.15.173:0/713254941 wait complete. 2023-10-06T05:25:16.907 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 Processor -- start 2023-10-06T05:25:16.907 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 -- start start 2023-10-06T05:25:16.909 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 0x7f4d240c3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.909 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d24156c70 0x7f4d24155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.909 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d24157040 0x7f4d241584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:16.909 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240afa80 con 0x7f4d24156c70 2023-10-06T05:25:16.909 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d241564e0 con 0x7f4d2406d6d0 2023-10-06T05:25:16.909 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240c62e0 con 0x7f4d24157040 2023-10-06T05:25:16.909 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d23fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d24157040 0x7f4d241584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.909 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d23fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d24157040 0x7f4d241584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:49542/0 (socket says 172.21.15.173:49542) 2023-10-06T05:25:16.910 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d23fff700 1 -- 172.21.15.173:0/3701140404 learned_addr learned my addr 172.21.15.173:0/3701140404 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:16.910 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d237fe700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 0x7f4d240c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.910 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d22ffd700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d24156c70 0x7f4d24155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:16.910 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d23fff700 1 -- 172.21.15.173:0/3701140404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 msgr2=0x7f4d240c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.910 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d23fff700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 0x7f4d240c3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.910 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d23fff700 1 -- 172.21.15.173:0/3701140404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d24156c70 msgr2=0x7f4d24155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.910 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d23fff700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d24156c70 0x7f4d24155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.910 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d23fff700 1 -- 172.21.15.173:0/3701140404 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c009ae0 con 0x7f4d24157040 2023-10-06T05:25:16.911 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d237fe700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 0x7f4d240c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:16.911 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d23fff700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d24157040 0x7f4d241584c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4d2406bf10 tx=0x7f4d1c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:16.911 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d0b7fe700 1 -- 172.21.15.173:0/3701140404 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00be60 con 0x7f4d24157040 2023-10-06T05:25:16.911 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d0b7fe700 1 -- 172.21.15.173:0/3701140404 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c008dd0 con 0x7f4d24157040 2023-10-06T05:25:16.911 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 -- 172.21.15.173:0/3701140404 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d240c65c0 con 0x7f4d24157040 2023-10-06T05:25:16.911 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d0b7fe700 1 -- 172.21.15.173:0/3701140404 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0266b0 con 0x7f4d24157040 2023-10-06T05:25:16.911 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d28927700 1 -- 172.21.15.173:0/3701140404 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d240af710 con 0x7f4d24157040 2023-10-06T05:25:16.911 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d0b7fe700 1 -- 172.21.15.173:0/3701140404 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4d1c003040 con 0x7f4d24157040 2023-10-06T05:25:16.911 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.901+0000 7f4d0b7fe700 1 -- 172.21.15.173:0/3701140404 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4d1c01d770 con 0x7f4d24157040 2023-10-06T05:25:16.912 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.905+0000 7f4d28927700 1 -- 172.21.15.173:0/3701140404 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d240afbf0 con 0x7f4d24157040 2023-10-06T05:25:16.912 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.905+0000 7f4d0b7fe700 1 -- 172.21.15.173:0/3701140404 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4d1c02b020 con 0x7f4d24157040 2023-10-06T05:25:16.987 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.981+0000 7f4d28927700 1 -- 172.21.15.173:0/3701140404 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "173fd818-55ca-4663-aa50-f790d1d4a7ad", "id": 0} v 0) v1 -- 0x7f4d2404be00 con 0x7f4d24157040 2023-10-06T05:25:16.995 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d0b7fe700 1 -- 172.21.15.173:0/3701140404 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "173fd818-55ca-4663-aa50-f790d1d4a7ad", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d1c021070 con 0x7f4d24157040 2023-10-06T05:25:16.996 INFO:teuthology.orchestra.run.smithi173.stdout:0 2023-10-06T05:25:16.997 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d28927700 1 -- 172.21.15.173:0/3701140404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d24157040 msgr2=0x7f4d241584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:16.998 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d28927700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d24157040 0x7f4d241584c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4d2406bf10 tx=0x7f4d1c018000 comp rx=0 tx=0).stop 2023-10-06T05:25:16.998 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d28927700 1 -- 172.21.15.173:0/3701140404 shutdown_connections 2023-10-06T05:25:16.998 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d28927700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d24157040 0x7f4d241584c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.998 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d28927700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d24156c70 0x7f4d24155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.998 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d28927700 1 --2- 172.21.15.173:0/3701140404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2406d6d0 0x7f4d240c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:16.999 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d28927700 1 -- 172.21.15.173:0/3701140404 >> 172.21.15.173:0/3701140404 conn(0x7f4d240c9830 msgr2=0x7f4d2415a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:16.999 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d28927700 1 -- 172.21.15.173:0/3701140404 shutdown_connections 2023-10-06T05:25:16.999 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:16.989+0000 7f4d28927700 1 -- 172.21.15.173:0/3701140404 wait complete. 2023-10-06T05:25:17.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new c542c63a-d8e3-4801-bf14-463fe97f2050 1 2023-10-06T05:25:17.120 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30d90d700 1 Processor -- start 2023-10-06T05:25:17.120 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30d90d700 1 -- start start 2023-10-06T05:25:17.121 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30d90d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd308158f10 0x7fd3080ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.121 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30d90d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd30815d730 0x7fd30806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.121 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30d90d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30806d040 con 0x7fd30806cc00 2023-10-06T05:25:17.121 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30d90d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30806a600 con 0x7fd308158f10 2023-10-06T05:25:17.122 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30d90d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3080cacd0 con 0x7fd30815d730 2023-10-06T05:25:17.122 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd307fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd30815d730 0x7fd30806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.122 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30d10c700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fd30806cc00 0x7fd3080cfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45014/0 (socket says 172.21.15.173:45014) 2023-10-06T05:25:17.122 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30d10c700 1 -- 172.21.15.173:0/1917901491 learned_addr learned my addr 172.21.15.173:0/1917901491 (peer_addr_for_me v1:172.21.15.173:0/0) 2023-10-06T05:25:17.122 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd30c90b700 1 --2- 172.21.15.173:0/1917901491 >> v2:172.21.15.29:3300/0 conn(0x7fd308158f10 0x7fd3080ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.122 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd3077fe700 1 -- 172.21.15.173:0/1917901491 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915122858 0 0) 0x7fd30806d040 con 0x7fd30806cc00 2023-10-06T05:25:17.122 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.113+0000 7fd3077fe700 1 -- 172.21.15.173:0/1917901491 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f0003570 con 0x7fd30806cc00 2023-10-06T05:25:17.123 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd307fff700 1 -- 172.21.15.173:0/1917901491 >> v2:172.21.15.29:3300/0 conn(0x7fd308158f10 msgr2=0x7fd3080ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd307fff700 1 --2- 172.21.15.173:0/1917901491 >> v2:172.21.15.29:3300/0 conn(0x7fd308158f10 0x7fd3080ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd307fff700 1 -- 172.21.15.173:0/1917901491 >> v1:172.21.15.173:6789/0 conn(0x7fd30806cc00 legacy=0x7fd3080cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd307fff700 1 -- 172.21.15.173:0/1917901491 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3080cafb0 con 0x7fd30815d730 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd307fff700 1 --2- 172.21.15.173:0/1917901491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 0x7fd30806c6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd3080c3600 tx=0x7fd2fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc90c6031767bd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd3077fe700 1 -- 172.21.15.173:0/1917901491 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc011630 con 0x7fd30815d730 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd3077fe700 1 -- 172.21.15.173:0/1917901491 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc0117b0 con 0x7fd30815d730 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd3077fe700 1 -- 172.21.15.173:0/1917901491 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc011b70 con 0x7fd30815d730 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 -- 172.21.15.173:0/1917901491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 msgr2=0x7fd30806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 --2- 172.21.15.173:0/1917901491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 0x7fd30806c6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd3080c3600 tx=0x7fd2fc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 -- 172.21.15.173:0/1917901491 shutdown_connections 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 --2- 172.21.15.173:0/1917901491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 0x7fd30806c6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.124 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 --2- 172.21.15.173:0/1917901491 >> v2:172.21.15.29:3300/0 conn(0x7fd308158f10 0x7fd3080ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.125 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 -- 172.21.15.173:0/1917901491 >> 172.21.15.173:0/1917901491 conn(0x7fd308062b60 msgr2=0x7fd308062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:17.125 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 -- 172.21.15.173:0/1917901491 shutdown_connections 2023-10-06T05:25:17.125 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 -- 172.21.15.173:0/1917901491 wait complete. 2023-10-06T05:25:17.125 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 Processor -- start 2023-10-06T05:25:17.125 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.117+0000 7fd30d90d700 1 -- start start 2023-10-06T05:25:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d90d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30806cc00 0x7fd3081555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d90d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd308158f10 0x7fd30815a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.128 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d90d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 0x7fd30815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d90d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080b2da0 con 0x7fd30806cc00 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d90d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080b3640 con 0x7fd30815d730 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d90d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080c6950 con 0x7fd308158f10 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d10c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 0x7fd30815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd307fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd308158f10 0x7fd30815a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d10c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 0x7fd30815a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52994/0 (socket says 172.21.15.173:52994) 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d10c700 1 -- 172.21.15.173:0/1050841921 learned_addr learned my addr 172.21.15.173:0/1050841921 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30c90b700 1 --2- 172.21.15.173:0/1050841921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30806cc00 0x7fd3081555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d10c700 1 -- 172.21.15.173:0/1050841921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd308158f10 msgr2=0x7fd30815a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d10c700 1 --2- 172.21.15.173:0/1050841921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd308158f10 0x7fd30815a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d10c700 1 -- 172.21.15.173:0/1050841921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30806cc00 msgr2=0x7fd3081555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.129 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d10c700 1 --2- 172.21.15.173:0/1050841921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30806cc00 0x7fd3081555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d10c700 1 -- 172.21.15.173:0/1050841921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc009420 con 0x7fd30815d730 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd307fff700 1 --2- 172.21.15.173:0/1050841921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd308158f10 0x7fd30815a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d10c700 1 --2- 172.21.15.173:0/1050841921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 0x7fd30815a7f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd30000cbc0 tx=0x7fd300001a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd304ff9700 1 -- 172.21.15.173:0/1050841921 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000a7e0 con 0x7fd30815d730 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd304ff9700 1 -- 172.21.15.173:0/1050841921 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30000a940 con 0x7fd30815d730 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d90d700 1 -- 172.21.15.173:0/1050841921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3080b2ff0 con 0x7fd30815d730 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd304ff9700 1 -- 172.21.15.173:0/1050841921 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000ace0 con 0x7fd30815d730 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d90d700 1 -- 172.21.15.173:0/1050841921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3080b5980 con 0x7fd30815d730 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd304ff9700 1 -- 172.21.15.173:0/1050841921 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd300007300 con 0x7fd30815d730 2023-10-06T05:25:17.130 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd304ff9700 1 -- 172.21.15.173:0/1050841921 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fd30001b7c0 con 0x7fd30815d730 2023-10-06T05:25:17.131 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.121+0000 7fd30d90d700 1 -- 172.21.15.173:0/1050841921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3080b3470 con 0x7fd30815d730 2023-10-06T05:25:17.131 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.125+0000 7fd304ff9700 1 -- 172.21.15.173:0/1050841921 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd300007790 con 0x7fd30815d730 2023-10-06T05:25:17.204 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.197+0000 7fd30d90d700 1 -- 172.21.15.173:0/1050841921 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c542c63a-d8e3-4801-bf14-463fe97f2050", "id": 1} v 0) v1 -- 0x7fd3080b37b0 con 0x7fd30815d730 2023-10-06T05:25:17.211 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd304ff9700 1 -- 172.21.15.173:0/1050841921 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c542c63a-d8e3-4801-bf14-463fe97f2050", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd300007930 con 0x7fd30815d730 2023-10-06T05:25:17.212 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-10-06T05:25:17.213 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd30d90d700 1 -- 172.21.15.173:0/1050841921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 msgr2=0x7fd30815a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.213 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd30d90d700 1 --2- 172.21.15.173:0/1050841921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 0x7fd30815a7f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd30000cbc0 tx=0x7fd300001a00 comp rx=0 tx=0).stop 2023-10-06T05:25:17.213 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd30d90d700 1 -- 172.21.15.173:0/1050841921 shutdown_connections 2023-10-06T05:25:17.214 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd30d90d700 1 --2- 172.21.15.173:0/1050841921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30815d730 0x7fd30815a7f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.214 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd30d90d700 1 --2- 172.21.15.173:0/1050841921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd308158f10 0x7fd30815a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.214 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd30d90d700 1 --2- 172.21.15.173:0/1050841921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30806cc00 0x7fd3081555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.214 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd30d90d700 1 -- 172.21.15.173:0/1050841921 >> 172.21.15.173:0/1050841921 conn(0x7fd308062b60 msgr2=0x7fd308156440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:17.214 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd30d90d700 1 -- 172.21.15.173:0/1050841921 shutdown_connections 2023-10-06T05:25:17.214 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.205+0000 7fd30d90d700 1 -- 172.21.15.173:0/1050841921 wait complete. 2023-10-06T05:25:17.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 2c935c18-c609-497e-a1b5-c5466cf7512d 2 2023-10-06T05:25:17.305 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:17.297+0000 7fbd1acf6000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T05:25:17.337 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.329+0000 7f809b569700 1 Processor -- start 2023-10-06T05:25:17.337 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.329+0000 7f809b569700 1 -- start start 2023-10-06T05:25:17.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8094067810 0x7f80940ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f80940ccd20 0x7f80940cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80940af4c0 con 0x7f80940ad720 2023-10-06T05:25:17.342 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80940cd6e0 con 0x7f80940ccd20 2023-10-06T05:25:17.343 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809415ab70 con 0x7f8094067810 2023-10-06T05:25:17.343 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8098b04700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8094067810 0x7f80940ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.343 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8099b06700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f80940ccd20 0x7f80940cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.343 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8098b04700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8094067810 0x7f80940ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:49570/0 (socket says 172.21.15.173:49570) 2023-10-06T05:25:17.343 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8098b04700 1 -- 172.21.15.173:0/2435540160 learned_addr learned my addr 172.21.15.173:0/2435540160 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:17.343 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8098b04700 1 -- 172.21.15.173:0/2435540160 >> v2:172.21.15.173:3300/0 conn(0x7f80940ccd20 msgr2=0x7f80940cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:17.343 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8098b04700 1 --2- 172.21.15.173:0/2435540160 >> v2:172.21.15.173:3300/0 conn(0x7f80940ccd20 0x7f80940cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8098b04700 1 -- 172.21.15.173:0/2435540160 >> v1:172.21.15.29:6789/0 conn(0x7f80940ad720 legacy=0x7f8094157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8098b04700 1 -- 172.21.15.173:0/2435540160 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8094067cf0 con 0x7f8094067810 2023-10-06T05:25:17.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8099b06700 1 --2- 172.21.15.173:0/2435540160 >> v2:172.21.15.173:3300/0 conn(0x7f80940ccd20 0x7f80940cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:17.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f8098b04700 1 --2- 172.21.15.173:0/2435540160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8094067810 0x7f80940ac760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f80840099b0 tx=0x7f8084009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7af11880e976919 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f808bfff700 1 -- 172.21.15.173:0/2435540160 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084009ea0 con 0x7f8094067810 2023-10-06T05:25:17.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f808bfff700 1 -- 172.21.15.173:0/2435540160 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808400b860 con 0x7f8094067810 2023-10-06T05:25:17.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f808bfff700 1 -- 172.21.15.173:0/2435540160 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808400bc00 con 0x7f8094067810 2023-10-06T05:25:17.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 -- 172.21.15.173:0/2435540160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8094067810 msgr2=0x7f80940ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 --2- 172.21.15.173:0/2435540160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8094067810 0x7f80940ac760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f80840099b0 tx=0x7f8084009250 comp rx=0 tx=0).stop 2023-10-06T05:25:17.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 -- 172.21.15.173:0/2435540160 shutdown_connections 2023-10-06T05:25:17.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 --2- 172.21.15.173:0/2435540160 >> v2:172.21.15.173:3300/0 conn(0x7f80940ccd20 0x7f80940cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.345 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 --2- 172.21.15.173:0/2435540160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8094067810 0x7f80940ac760 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 -- 172.21.15.173:0/2435540160 >> 172.21.15.173:0/2435540160 conn(0x7f809406b820 msgr2=0x7f809406bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:17.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 -- 172.21.15.173:0/2435540160 shutdown_connections 2023-10-06T05:25:17.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.333+0000 7f809b569700 1 -- 172.21.15.173:0/2435540160 wait complete. 2023-10-06T05:25:17.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 Processor -- start 2023-10-06T05:25:17.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 -- start start 2023-10-06T05:25:17.350 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8094067810 0x7f8094168380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80940ad720 0x7f8094158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80940ccd20 0x7f809416af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8094167970 con 0x7f8094067810 2023-10-06T05:25:17.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8094167ef0 con 0x7f80940ad720 2023-10-06T05:25:17.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809416b930 con 0x7f80940ccd20 2023-10-06T05:25:17.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8098b04700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80940ad720 0x7f8094158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8099b06700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80940ccd20 0x7f809416af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8098b04700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80940ad720 0x7f8094158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53000/0 (socket says 172.21.15.173:53000) 2023-10-06T05:25:17.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8098b04700 1 -- 172.21.15.173:0/3908206434 learned_addr learned my addr 172.21.15.173:0/3908206434 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:17.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8099305700 1 --2- 172.21.15.173:0/3908206434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8094067810 0x7f8094168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8098b04700 1 -- 172.21.15.173:0/3908206434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80940ccd20 msgr2=0x7f809416af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8098b04700 1 --2- 172.21.15.173:0/3908206434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80940ccd20 0x7f809416af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8098b04700 1 -- 172.21.15.173:0/3908206434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8094067810 msgr2=0x7f8094168380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8098b04700 1 --2- 172.21.15.173:0/3908206434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8094067810 0x7f8094168380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8098b04700 1 -- 172.21.15.173:0/3908206434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c009a20 con 0x7f80940ad720 2023-10-06T05:25:17.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8099b06700 1 --2- 172.21.15.173:0/3908206434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80940ccd20 0x7f809416af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:17.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f8098b04700 1 --2- 172.21.15.173:0/3908206434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80940ad720 0x7f8094158b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f809415acb0 tx=0x7f8084017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f80897fa700 1 -- 172.21.15.173:0/3908206434 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808400bbe0 con 0x7f80940ad720 2023-10-06T05:25:17.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f80897fa700 1 -- 172.21.15.173:0/3908206434 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8084011420 con 0x7f80940ad720 2023-10-06T05:25:17.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 -- 172.21.15.173:0/3908206434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80840094f0 con 0x7f80940ad720 2023-10-06T05:25:17.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f80897fa700 1 -- 172.21.15.173:0/3908206434 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80840117c0 con 0x7f80940ad720 2023-10-06T05:25:17.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f809b569700 1 -- 172.21.15.173:0/3908206434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8094167b80 con 0x7f80940ad720 2023-10-06T05:25:17.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f80897fa700 1 -- 172.21.15.173:0/3908206434 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f808402e3f0 con 0x7f80940ad720 2023-10-06T05:25:17.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.337+0000 7f80897fa700 1 -- 172.21.15.173:0/3908206434 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f8084025820 con 0x7f80940ad720 2023-10-06T05:25:17.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.341+0000 7f809b569700 1 -- 172.21.15.173:0/3908206434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8094071120 con 0x7f80940ad720 2023-10-06T05:25:17.355 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.345+0000 7f80897fa700 1 -- 172.21.15.173:0/3908206434 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8084033060 con 0x7f80940ad720 2023-10-06T05:25:17.364 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:17.357+0000 7fbd1acf6000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T05:25:17.372 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:17.365+0000 7fa09fee9000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T05:25:17.425 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.417+0000 7f809b569700 1 -- 172.21.15.173:0/3908206434 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2c935c18-c609-497e-a1b5-c5466cf7512d", "id": 2} v 0) v1 -- 0x7f8094168920 con 0x7f80940ad720 2023-10-06T05:25:17.431 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:17.425+0000 7fa09fee9000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T05:25:17.433 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.425+0000 7f80897fa700 1 -- 172.21.15.173:0/3908206434 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c935c18-c609-497e-a1b5-c5466cf7512d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8084015020 con 0x7f80940ad720 2023-10-06T05:25:17.433 INFO:teuthology.orchestra.run.smithi173.stdout:2 2023-10-06T05:25:17.435 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.429+0000 7f809b569700 1 -- 172.21.15.173:0/3908206434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80940ad720 msgr2=0x7f8094158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.435 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.429+0000 7f809b569700 1 --2- 172.21.15.173:0/3908206434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80940ad720 0x7f8094158b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f809415acb0 tx=0x7f8084017000 comp rx=0 tx=0).stop 2023-10-06T05:25:17.435 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.429+0000 7f809b569700 1 -- 172.21.15.173:0/3908206434 shutdown_connections 2023-10-06T05:25:17.435 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.429+0000 7f809b569700 1 --2- 172.21.15.173:0/3908206434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80940ccd20 0x7f809416af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.435 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.429+0000 7f809b569700 1 --2- 172.21.15.173:0/3908206434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80940ad720 0x7f8094158b00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.435 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.429+0000 7f809b569700 1 --2- 172.21.15.173:0/3908206434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8094067810 0x7f8094168380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.435 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.429+0000 7f809b569700 1 -- 172.21.15.173:0/3908206434 >> 172.21.15.173:0/3908206434 conn(0x7f809406b820 msgr2=0x7f80941575a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:17.435 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.429+0000 7f809b569700 1 -- 172.21.15.173:0/3908206434 shutdown_connections 2023-10-06T05:25:17.435 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.429+0000 7f809b569700 1 -- 172.21.15.173:0/3908206434 wait complete. 2023-10-06T05:25:17.447 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 82b46cc2-deb2-4edb-8a49-13ede4929823 3 2023-10-06T05:25:17.482 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:17.477+0000 7fbd1acf6000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T05:25:17.550 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:17.545+0000 7fa09fee9000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T05:25:17.555 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc413fff700 1 Processor -- start 2023-10-06T05:25:17.555 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc413fff700 1 -- start start 2023-10-06T05:25:17.556 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc413fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc41406cb30 0x7fc4140b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.556 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc413fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4140cb420 con 0x7fc41406c6c0 2023-10-06T05:25:17.556 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc413fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4140ca810 con 0x7fc414140640 2023-10-06T05:25:17.556 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc413fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4140caaf0 con 0x7fc41406cb30 2023-10-06T05:25:17.556 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc412ffd700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc414140640 0x7fc4140cc1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45018/0 (socket says 172.21.15.173:45018) 2023-10-06T05:25:17.557 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc412ffd700 1 -- 172.21.15.173:0/4110058677 learned_addr learned my addr 172.21.15.173:0/4110058677 (peer_addr_for_me v1:172.21.15.173:0/0) 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4137fe700 1 --2- 172.21.15.173:0/4110058677 >> v2:172.21.15.29:3300/0 conn(0x7fc41406cb30 0x7fc4140b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158322522 0 0) 0x7fc4140ca810 con 0x7fc414140640 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc400003570 con 0x7fc414140640 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3054006801 0 0) 0x7fc400003570 con 0x7fc414140640 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 >> v2:172.21.15.29:3300/0 conn(0x7fc41406cb30 msgr2=0x7fc4140b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 --2- 172.21.15.173:0/4110058677 >> v2:172.21.15.29:3300/0 conn(0x7fc41406cb30 0x7fc4140b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 >> v1:172.21.15.29:6789/0 conn(0x7fc41406c6c0 legacy=0x7fc4140af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4140cadd0 con 0x7fc414140640 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fc4040015f0 con 0x7fc414140640 2023-10-06T05:25:17.559 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4137fe700 1 --2- 172.21.15.173:0/4110058677 >> v2:172.21.15.29:3300/0 conn(0x7fc41406cb30 0x7fc4140b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 >> v1:172.21.15.173:6789/0 conn(0x7fc414140640 legacy=0x7fc4140cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc400003a60 0x7fc400003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc400004810 0x7fc400004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 0x7fc40000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4140caaf0 con 0x7fc400003a60 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40000c0d0 con 0x7fc400004810 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.549+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40000c290 con 0x7fc4000051c0 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4137fe700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 0x7fc40000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc412ffd700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc400003a60 0x7fc400003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc40bfff700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc400004810 0x7fc400004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4137fe700 1 -- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc400004810 msgr2=0x7fc400004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4137fe700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc400004810 0x7fc400004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.560 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4137fe700 1 -- 172.21.15.173:0/4110058677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc400003a60 msgr2=0x7fc400003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:17.561 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4137fe700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc400003a60 0x7fc400003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.561 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4137fe700 1 -- 172.21.15.173:0/4110058677 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc400003570 con 0x7fc4000051c0 2023-10-06T05:25:17.561 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4137fe700 1 -- 172.21.15.173:0/4110058677 reap_dead start 2023-10-06T05:25:17.561 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4137fe700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 0x7fc40000ba60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00e3c0 tx=0x7fc40c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73d1119e7674f25c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.561 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c009c50 con 0x7fc4000051c0 2023-10-06T05:25:17.561 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c00f040 con 0x7fc4000051c0 2023-10-06T05:25:17.561 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc4127fc700 1 -- 172.21.15.173:0/4110058677 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c00eec0 con 0x7fc4000051c0 2023-10-06T05:25:17.563 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc413fff700 1 -- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 msgr2=0x7fc40000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.563 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc413fff700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 0x7fc40000ba60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00e3c0 tx=0x7fc40c00b040 comp rx=0 tx=0).stop 2023-10-06T05:25:17.563 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc413fff700 1 -- 172.21.15.173:0/4110058677 shutdown_connections 2023-10-06T05:25:17.563 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc413fff700 1 --2- 172.21.15.173:0/4110058677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 0x7fc40000ba60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.563 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc413fff700 1 -- 172.21.15.173:0/4110058677 >> 172.21.15.173:0/4110058677 conn(0x7fc41406ba30 msgr2=0x7fc414095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:17.563 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc413fff700 1 -- 172.21.15.173:0/4110058677 shutdown_connections 2023-10-06T05:25:17.563 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.553+0000 7fc413fff700 1 -- 172.21.15.173:0/4110058677 wait complete. 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc413fff700 1 Processor -- start 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc413fff700 1 -- start start 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc413fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 0x7fc4141563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc413fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc41413d4e0 0x7fc414168d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc413fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc414169250 0x7fc4141696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc413fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc414169c30 con 0x7fc41413d4e0 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc413fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4140c2600 con 0x7fc414169250 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc413fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4140c30f0 con 0x7fc4000051c0 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc4137fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc414169250 0x7fc4141696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc4137fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc414169250 0x7fc4141696f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53016/0 (socket says 172.21.15.173:53016) 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc412ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 0x7fc4141563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc4137fe700 1 -- 172.21.15.173:0/3453714276 learned_addr learned my addr 172.21.15.173:0/3453714276 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:17.564 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc40bfff700 1 --2- 172.21.15.173:0/3453714276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc41413d4e0 0x7fc414168d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc4137fe700 1 -- 172.21.15.173:0/3453714276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 msgr2=0x7fc4141563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc4137fe700 1 --2- 172.21.15.173:0/3453714276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 0x7fc4141563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc4137fe700 1 -- 172.21.15.173:0/3453714276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc41413d4e0 msgr2=0x7fc414168d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc4137fe700 1 --2- 172.21.15.173:0/3453714276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc41413d4e0 0x7fc414168d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc4137fe700 1 -- 172.21.15.173:0/3453714276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4140c2850 con 0x7fc414169250 2023-10-06T05:25:17.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.557+0000 7fc4137fe700 1 --2- 172.21.15.173:0/3453714276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc414169250 0x7fc4141696f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00e9b0 tx=0x7fc40c01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.565 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.561+0000 7fc40affd700 1 -- 172.21.15.173:0/3453714276 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c01e640 con 0x7fc414169250 2023-10-06T05:25:17.566 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.561+0000 7fc40affd700 1 -- 172.21.15.173:0/3453714276 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c01e7a0 con 0x7fc414169250 2023-10-06T05:25:17.566 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.561+0000 7fc413fff700 1 -- 172.21.15.173:0/3453714276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4140c2b30 con 0x7fc414169250 2023-10-06T05:25:17.566 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.561+0000 7fc40affd700 1 -- 172.21.15.173:0/3453714276 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c01eb60 con 0x7fc414169250 2023-10-06T05:25:17.567 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.561+0000 7fc413fff700 1 -- 172.21.15.173:0/3453714276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4140c3d80 con 0x7fc414169250 2023-10-06T05:25:17.567 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.561+0000 7fc40affd700 1 -- 172.21.15.173:0/3453714276 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc40c003020 con 0x7fc414169250 2023-10-06T05:25:17.567 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.561+0000 7fc40affd700 1 -- 172.21.15.173:0/3453714276 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fc40c01d8d0 con 0x7fc414169250 2023-10-06T05:25:17.567 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.561+0000 7fc413fff700 1 -- 172.21.15.173:0/3453714276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41404be00 con 0x7fc414169250 2023-10-06T05:25:17.570 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.565+0000 7fc40affd700 1 -- 172.21.15.173:0/3453714276 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc40c018020 con 0x7fc414169250 2023-10-06T05:25:17.645 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.637+0000 7fc413fff700 1 -- 172.21.15.173:0/3453714276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "82b46cc2-deb2-4edb-8a49-13ede4929823", "id": 3} v 0) v1 -- 0x7fc4140cb0b0 con 0x7fc414169250 2023-10-06T05:25:17.652 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.645+0000 7fc40affd700 1 -- 172.21.15.173:0/3453714276 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82b46cc2-deb2-4edb-8a49-13ede4929823", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc40c0097f0 con 0x7fc414169250 2023-10-06T05:25:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:3 2023-10-06T05:25:17.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.645+0000 7fc413fff700 1 -- 172.21.15.173:0/3453714276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc414169250 msgr2=0x7fc4141696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.645+0000 7fc413fff700 1 --2- 172.21.15.173:0/3453714276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc414169250 0x7fc4141696f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00e9b0 tx=0x7fc40c01a000 comp rx=0 tx=0).stop 2023-10-06T05:25:17.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.645+0000 7fc413fff700 1 -- 172.21.15.173:0/3453714276 shutdown_connections 2023-10-06T05:25:17.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.649+0000 7fc413fff700 1 --2- 172.21.15.173:0/3453714276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc414169250 0x7fc4141696f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.649+0000 7fc413fff700 1 --2- 172.21.15.173:0/3453714276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc41413d4e0 0x7fc414168d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.649+0000 7fc413fff700 1 --2- 172.21.15.173:0/3453714276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4000051c0 0x7fc4141563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.649+0000 7fc413fff700 1 -- 172.21.15.173:0/3453714276 >> 172.21.15.173:0/3453714276 conn(0x7fc41406ba30 msgr2=0x7fc41413f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:17.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.649+0000 7fc413fff700 1 -- 172.21.15.173:0/3453714276 shutdown_connections 2023-10-06T05:25:17.654 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.649+0000 7fc413fff700 1 -- 172.21.15.173:0/3453714276 wait complete. 2023-10-06T05:25:17.668 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 65623c1f-2877-4c8a-b98e-971bf3daa989 4 2023-10-06T05:25:17.711 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:17.705+0000 7fbd1acf6000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T05:25:17.761 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:17.753+0000 7fbd1acf6000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T05:25:17.769 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.761+0000 7f878759e700 1 Processor -- start 2023-10-06T05:25:17.769 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.761+0000 7f878759e700 1 -- start start 2023-10-06T05:25:17.771 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8788140640 0x7f87880cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.771 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87880cb420 con 0x7f87880cc700 2023-10-06T05:25:17.771 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87880ca810 con 0x7f878806cdd0 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87880caaf0 con 0x7f8788140640 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f8786d9d700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f878806cdd0 0x7f87880af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44852/0 (socket says 172.21.15.173:44852) 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f8786d9d700 1 -- 172.21.15.173:0/1250837 learned_addr learned my addr 172.21.15.173:0/1250837 (peer_addr_for_me v1:172.21.15.173:0/0) 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878659c700 1 --2- 172.21.15.173:0/1250837 >> v2:172.21.15.29:3300/0 conn(0x7f8788140640 0x7f87880cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878559a700 1 -- 172.21.15.173:0/1250837 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499970151 0 0) 0x7f87880ca810 con 0x7f878806cdd0 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878559a700 1 -- 172.21.15.173:0/1250837 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8770003570 con 0x7f878806cdd0 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878659c700 1 -- 172.21.15.173:0/1250837 >> v1:172.21.15.173:6789/0 conn(0x7f878806cdd0 legacy=0x7f87880af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878659c700 1 -- 172.21.15.173:0/1250837 >> v1:172.21.15.29:6789/0 conn(0x7f87880cc700 legacy=0x7f878806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878659c700 1 -- 172.21.15.173:0/1250837 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880cadd0 con 0x7f8788140640 2023-10-06T05:25:17.772 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878659c700 1 --2- 172.21.15.173:0/1250837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8788140640 0x7f87880cc1c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87780098d0 tx=0x7f8778009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9734090356fac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.773 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878559a700 1 -- 172.21.15.173:0/1250837 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778005c10 con 0x7f8788140640 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878559a700 1 -- 172.21.15.173:0/1250837 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8778005d70 con 0x7f8788140640 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878559a700 1 -- 172.21.15.173:0/1250837 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778006260 con 0x7f8788140640 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 -- 172.21.15.173:0/1250837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8788140640 msgr2=0x7f87880cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 --2- 172.21.15.173:0/1250837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8788140640 0x7f87880cc1c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87780098d0 tx=0x7f8778009120 comp rx=0 tx=0).stop 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 -- 172.21.15.173:0/1250837 shutdown_connections 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 --2- 172.21.15.173:0/1250837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8788140640 0x7f87880cc1c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 -- 172.21.15.173:0/1250837 >> 172.21.15.173:0/1250837 conn(0x7f878806ba30 msgr2=0x7f8788095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 -- 172.21.15.173:0/1250837 shutdown_connections 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.765+0000 7f878759e700 1 -- 172.21.15.173:0/1250837 wait complete. 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 Processor -- start 2023-10-06T05:25:17.774 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 -- start start 2023-10-06T05:25:17.776 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f878806cdd0 0x7f8788156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.776 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87880cc700 0x7f878812c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.776 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8788140640 0x7f878812c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.776 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878812d1b0 con 0x7f8788140640 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878812d490 con 0x7f87880cc700 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878812d770 con 0x7f878806cdd0 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f878806cdd0 0x7f8788156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f878806cdd0 0x7f8788156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:59438/0 (socket says 172.21.15.173:59438) 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878659c700 1 -- 172.21.15.173:0/3303571273 learned_addr learned my addr 172.21.15.173:0/3303571273 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f8786d9d700 1 --2- 172.21.15.173:0/3303571273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8788140640 0x7f878812c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f8785d9b700 1 --2- 172.21.15.173:0/3303571273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87880cc700 0x7f878812c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878659c700 1 -- 172.21.15.173:0/3303571273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87880cc700 msgr2=0x7f878812c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878659c700 1 --2- 172.21.15.173:0/3303571273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87880cc700 0x7f878812c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878659c700 1 -- 172.21.15.173:0/3303571273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8788140640 msgr2=0x7f878812c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878659c700 1 --2- 172.21.15.173:0/3303571273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8788140640 0x7f878812c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.777 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878659c700 1 -- 172.21.15.173:0/3303571273 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780093c0 con 0x7f878806cdd0 2023-10-06T05:25:17.778 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878659c700 1 --2- 172.21.15.173:0/3303571273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f878806cdd0 0x7f8788156290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f878806c450 tx=0x7f8778016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.778 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f87767fc700 1 -- 172.21.15.173:0/3303571273 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877801d6b0 con 0x7f878806cdd0 2023-10-06T05:25:17.778 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f87767fc700 1 -- 172.21.15.173:0/3303571273 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877801d810 con 0x7f878806cdd0 2023-10-06T05:25:17.778 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 -- 172.21.15.173:0/3303571273 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878812da50 con 0x7f878806cdd0 2023-10-06T05:25:17.778 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f87767fc700 1 -- 172.21.15.173:0/3303571273 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877801dbd0 con 0x7f878806cdd0 2023-10-06T05:25:17.778 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 -- 172.21.15.173:0/3303571273 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878812dd30 con 0x7f878806cdd0 2023-10-06T05:25:17.778 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f87767fc700 1 -- 172.21.15.173:0/3303571273 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f877801b700 con 0x7f878806cdd0 2023-10-06T05:25:17.778 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f87767fc700 1 -- 172.21.15.173:0/3303571273 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f8778026950 con 0x7f878806cdd0 2023-10-06T05:25:17.778 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.769+0000 7f878759e700 1 -- 172.21.15.173:0/3303571273 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878804be00 con 0x7f878806cdd0 2023-10-06T05:25:17.779 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.773+0000 7f87767fc700 1 -- 172.21.15.173:0/3303571273 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8778026cb0 con 0x7f878806cdd0 2023-10-06T05:25:17.794 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:17.789+0000 7fa09fee9000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T05:25:17.848 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:17.841+0000 7fa09fee9000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T05:25:17.850 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.845+0000 7f878759e700 1 -- 172.21.15.173:0/3303571273 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "65623c1f-2877-4c8a-b98e-971bf3daa989", "id": 4} v 0) v1 -- 0x7f878812e380 con 0x7f878806cdd0 2023-10-06T05:25:17.858 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f87767fc700 1 -- 172.21.15.173:0/3303571273 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65623c1f-2877-4c8a-b98e-971bf3daa989", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8778026e50 con 0x7f878806cdd0 2023-10-06T05:25:17.858 INFO:teuthology.orchestra.run.smithi173.stdout:4 2023-10-06T05:25:17.859 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f878759e700 1 -- 172.21.15.173:0/3303571273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f878806cdd0 msgr2=0x7f8788156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.859 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f878759e700 1 --2- 172.21.15.173:0/3303571273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f878806cdd0 0x7f8788156290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f878806c450 tx=0x7f8778016000 comp rx=0 tx=0).stop 2023-10-06T05:25:17.860 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f878759e700 1 -- 172.21.15.173:0/3303571273 shutdown_connections 2023-10-06T05:25:17.860 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f878759e700 1 --2- 172.21.15.173:0/3303571273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8788140640 0x7f878812c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.860 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f878759e700 1 --2- 172.21.15.173:0/3303571273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87880cc700 0x7f878812c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.860 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f878759e700 1 --2- 172.21.15.173:0/3303571273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f878806cdd0 0x7f8788156290 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.860 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f878759e700 1 -- 172.21.15.173:0/3303571273 >> 172.21.15.173:0/3303571273 conn(0x7f878806ba30 msgr2=0x7f8788068b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:17.860 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f878759e700 1 -- 172.21.15.173:0/3303571273 shutdown_connections 2023-10-06T05:25:17.860 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.853+0000 7f878759e700 1 -- 172.21.15.173:0/3303571273 wait complete. 2023-10-06T05:25:17.870 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new b85ba67b-ccee-4e35-8511-c0c0e09290e8 5 2023-10-06T05:25:17.937 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:17.929+0000 7fbd1acf6000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T05:25:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.965+0000 7fb73e9e5700 1 Processor -- start 2023-10-06T05:25:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.965+0000 7fb73e9e5700 1 -- start start 2023-10-06T05:25:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7380ad720 0x7fb738157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb738067810 0x7fb7380ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7380af4c0 con 0x7fb7380ccd20 2023-10-06T05:25:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73815ab70 con 0x7fb738067810 2023-10-06T05:25:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb738067cf0 con 0x7fb7380ad720 2023-10-06T05:25:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb737fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7380ad720 0x7fb738157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb737fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7380ad720 0x7fb738157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:59452/0 (socket says 172.21.15.173:59452) 2023-10-06T05:25:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb737fff700 1 -- 172.21.15.173:0/3443138319 learned_addr learned my addr 172.21.15.173:0/3443138319 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb7377fe700 1 --2- 172.21.15.173:0/3443138319 >> v2:172.21.15.29:3300/0 conn(0x7fb738067810 0x7fb7380ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb737fff700 1 -- 172.21.15.173:0/3443138319 >> v2:172.21.15.29:3300/0 conn(0x7fb738067810 msgr2=0x7fb7380ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb737fff700 1 --2- 172.21.15.173:0/3443138319 >> v2:172.21.15.29:3300/0 conn(0x7fb738067810 0x7fb7380ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb737fff700 1 -- 172.21.15.173:0/3443138319 >> v1:172.21.15.29:6789/0 conn(0x7fb7380ccd20 legacy=0x7fb73815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb737fff700 1 -- 172.21.15.173:0/3443138319 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738067fd0 con 0x7fb7380ad720 2023-10-06T05:25:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb737fff700 1 --2- 172.21.15.173:0/3443138319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7380ad720 0x7fb738157f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb7280099b0 tx=0x7fb728009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=951e55cea0afddb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb736ffd700 1 -- 172.21.15.173:0/3443138319 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728009ea0 con 0x7fb7380ad720 2023-10-06T05:25:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb736ffd700 1 -- 172.21.15.173:0/3443138319 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800b860 con 0x7fb7380ad720 2023-10-06T05:25:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb736ffd700 1 -- 172.21.15.173:0/3443138319 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800bc00 con 0x7fb7380ad720 2023-10-06T05:25:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3443138319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7380ad720 msgr2=0x7fb738157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 --2- 172.21.15.173:0/3443138319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7380ad720 0x7fb738157f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb7280099b0 tx=0x7fb728009250 comp rx=0 tx=0).stop 2023-10-06T05:25:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3443138319 shutdown_connections 2023-10-06T05:25:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 --2- 172.21.15.173:0/3443138319 >> v2:172.21.15.29:3300/0 conn(0x7fb738067810 0x7fb7380ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 --2- 172.21.15.173:0/3443138319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7380ad720 0x7fb738157f90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3443138319 >> 172.21.15.173:0/3443138319 conn(0x7fb73806b820 msgr2=0x7fb73806bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3443138319 shutdown_connections 2023-10-06T05:25:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.969+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3443138319 wait complete. 2023-10-06T05:25:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 Processor -- start 2023-10-06T05:25:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 -- start start 2023-10-06T05:25:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb738067810 0x7fb7380c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7380ad720 0x7fb7381513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.985 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7380ccd20 0x7fb7380c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:17.986 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7380c4fd0 con 0x7fb7380ccd20 2023-10-06T05:25:17.986 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7380c2a80 con 0x7fb7380ad720 2023-10-06T05:25:17.986 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb738151900 con 0x7fb738067810 2023-10-06T05:25:17.986 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb737fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb738067810 0x7fb7380c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.986 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb7377fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7380ad720 0x7fb7381513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.986 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb737fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb738067810 0x7fb7380c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:59458/0 (socket says 172.21.15.173:59458) 2023-10-06T05:25:17.987 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb737fff700 1 -- 172.21.15.173:0/3341442177 learned_addr learned my addr 172.21.15.173:0/3341442177 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:17.987 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73cf82700 1 --2- 172.21.15.173:0/3341442177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7380ccd20 0x7fb7380c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:17.987 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb737fff700 1 -- 172.21.15.173:0/3341442177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7380ad720 msgr2=0x7fb7381513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.987 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb737fff700 1 --2- 172.21.15.173:0/3341442177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7380ad720 0x7fb7381513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.987 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb737fff700 1 -- 172.21.15.173:0/3341442177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7380ccd20 msgr2=0x7fb7380c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:17.987 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb737fff700 1 --2- 172.21.15.173:0/3341442177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7380ccd20 0x7fb7380c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb737fff700 1 -- 172.21.15.173:0/3341442177 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280094f0 con 0x7fb738067810 2023-10-06T05:25:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb737fff700 1 --2- 172.21.15.173:0/3341442177 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb738067810 0x7fb7380c2f10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb738067e30 tx=0x7fb728017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb71ffff700 1 -- 172.21.15.173:0/3341442177 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800bbe0 con 0x7fb738067810 2023-10-06T05:25:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb71ffff700 1 -- 172.21.15.173:0/3341442177 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb728011420 con 0x7fb738067810 2023-10-06T05:25:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3341442177 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7380c4cf0 con 0x7fb738067810 2023-10-06T05:25:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb71ffff700 1 -- 172.21.15.173:0/3341442177 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280117c0 con 0x7fb738067810 2023-10-06T05:25:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3341442177 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7380c2710 con 0x7fb738067810 2023-10-06T05:25:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb71ffff700 1 -- 172.21.15.173:0/3341442177 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb72802e3f0 con 0x7fb738067810 2023-10-06T05:25:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.973+0000 7fb71ffff700 1 -- 172.21.15.173:0/3341442177 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fb728025970 con 0x7fb738067810 2023-10-06T05:25:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.977+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3341442177 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb738071120 con 0x7fb738067810 2023-10-06T05:25:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:17.977+0000 7fb71ffff700 1 -- 172.21.15.173:0/3341442177 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb728033060 con 0x7fb738067810 2023-10-06T05:25:18.003 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:17.997+0000 7fbd1acf6000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T05:25:18.049 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:18.045+0000 7fa09fee9000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T05:25:18.055 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.049+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3341442177 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b85ba67b-ccee-4e35-8511-c0c0e09290e8", "id": 5} v 0) v1 -- 0x7fb7380682b0 con 0x7fb738067810 2023-10-06T05:25:18.068 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:18.061+0000 7fbd1acf6000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T05:25:18.069 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.061+0000 7fb71ffff700 1 -- 172.21.15.173:0/3341442177 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b85ba67b-ccee-4e35-8511-c0c0e09290e8", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb728015020 con 0x7fb738067810 2023-10-06T05:25:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:5 2023-10-06T05:25:18.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.065+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3341442177 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb738067810 msgr2=0x7fb7380c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.065+0000 7fb73e9e5700 1 --2- 172.21.15.173:0/3341442177 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb738067810 0x7fb7380c2f10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb738067e30 tx=0x7fb728017000 comp rx=0 tx=0).stop 2023-10-06T05:25:18.070 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.065+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3341442177 shutdown_connections 2023-10-06T05:25:18.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.065+0000 7fb73e9e5700 1 --2- 172.21.15.173:0/3341442177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7380ccd20 0x7fb7380c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.065+0000 7fb73e9e5700 1 --2- 172.21.15.173:0/3341442177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7380ad720 0x7fb7381513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.065+0000 7fb73e9e5700 1 --2- 172.21.15.173:0/3341442177 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb738067810 0x7fb7380c2f10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.065+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3341442177 >> 172.21.15.173:0/3341442177 conn(0x7fb73806b820 msgr2=0x7fb73806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:18.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.065+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3341442177 shutdown_connections 2023-10-06T05:25:18.071 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.065+0000 7fb73e9e5700 1 -- 172.21.15.173:0/3341442177 wait complete. 2023-10-06T05:25:18.084 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new a7812b7e-f82f-46e3-8af9-5795240f1c4f 6 2023-10-06T05:25:18.118 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:18.113+0000 7fa09fee9000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T05:25:18.186 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:18.181+0000 7fa09fee9000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T05:25:18.189 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.181+0000 7fcca58e5700 1 Processor -- start 2023-10-06T05:25:18.189 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.181+0000 7fcca58e5700 1 -- start start 2023-10-06T05:25:18.193 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca015c450 0x7fcca00c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.193 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcca00c3490 0x7fcca006c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.193 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca00c9500 con 0x7fcca006cce0 2023-10-06T05:25:18.193 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00cb880 con 0x7fcca00c3490 2023-10-06T05:25:18.193 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00ca080 con 0x7fcca015c450 2023-10-06T05:25:18.193 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca48e3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca015c450 0x7fcca00c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.194 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcca00c3490 0x7fcca006c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.194 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcca00c3490 0x7fcca006c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36006/0 (socket says 172.21.15.173:36006) 2023-10-06T05:25:18.194 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9ffff700 1 -- 172.21.15.173:0/1211815134 learned_addr learned my addr 172.21.15.173:0/1211815134 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:18.194 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca48e3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca015c450 0x7fcca00c2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:59466/0 (socket says 172.21.15.173:59466) 2023-10-06T05:25:18.194 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9ffff700 1 -- 172.21.15.173:0/1211815134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca015c450 msgr2=0x7fcca00c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:18.194 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9ffff700 1 --2- 172.21.15.173:0/1211815134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca015c450 0x7fcca00c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.194 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9ffff700 1 -- 172.21.15.173:0/1211815134 >> v1:172.21.15.29:6789/0 conn(0x7fcca006cce0 legacy=0x7fcca00c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9ffff700 1 -- 172.21.15.173:0/1211815134 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca00c38e0 con 0x7fcca00c3490 2023-10-06T05:25:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9ffff700 1 --2- 172.21.15.173:0/1211815134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 0x7fcca006c7a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0099b0 tx=0x7fcc8c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=166be594b1abf4b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9f7fe700 1 -- 172.21.15.173:0/1211815134 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c009ea0 con 0x7fcca00c3490 2023-10-06T05:25:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9f7fe700 1 -- 172.21.15.173:0/1211815134 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c00b860 con 0x7fcca00c3490 2023-10-06T05:25:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcc9f7fe700 1 -- 172.21.15.173:0/1211815134 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00bc20 con 0x7fcca00c3490 2023-10-06T05:25:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 -- 172.21.15.173:0/1211815134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 msgr2=0x7fcca006c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 --2- 172.21.15.173:0/1211815134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 0x7fcca006c7a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0099b0 tx=0x7fcc8c009250 comp rx=0 tx=0).stop 2023-10-06T05:25:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 -- 172.21.15.173:0/1211815134 shutdown_connections 2023-10-06T05:25:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 --2- 172.21.15.173:0/1211815134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 0x7fcca006c7a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.196 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 --2- 172.21.15.173:0/1211815134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca015c450 0x7fcca00c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.196 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 -- 172.21.15.173:0/1211815134 >> 172.21.15.173:0/1211815134 conn(0x7fcca006ba30 msgr2=0x7fcca0095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:18.196 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 -- 172.21.15.173:0/1211815134 shutdown_connections 2023-10-06T05:25:18.196 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.185+0000 7fcca58e5700 1 -- 172.21.15.173:0/1211815134 wait complete. 2023-10-06T05:25:18.198 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 Processor -- start 2023-10-06T05:25:18.198 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 -- start start 2023-10-06T05:25:18.198 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca006cce0 0x7fcca015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.198 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 0x7fcca0158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.198 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcca015c450 0x7fcca01589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.199 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015acb0 con 0x7fcca015c450 2023-10-06T05:25:18.199 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015af90 con 0x7fcca00c3490 2023-10-06T05:25:18.199 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015b270 con 0x7fcca006cce0 2023-10-06T05:25:18.199 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca48e3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca006cce0 0x7fcca015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.199 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcc9ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 0x7fcca0158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.199 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcc9ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 0x7fcca0158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:36008/0 (socket says 172.21.15.173:36008) 2023-10-06T05:25:18.199 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca48e3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca006cce0 0x7fcca015a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:59482/0 (socket says 172.21.15.173:59482) 2023-10-06T05:25:18.200 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcc9ffff700 1 -- 172.21.15.173:0/549061581 learned_addr learned my addr 172.21.15.173:0/549061581 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:18.200 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca50e4700 1 --2- 172.21.15.173:0/549061581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcca015c450 0x7fcca01589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.200 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca48e3700 1 -- 172.21.15.173:0/549061581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 msgr2=0x7fcca0158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.200 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca48e3700 1 --2- 172.21.15.173:0/549061581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 0x7fcca0158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.200 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca48e3700 1 -- 172.21.15.173:0/549061581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcca015c450 msgr2=0x7fcca01589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.200 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca48e3700 1 --2- 172.21.15.173:0/549061581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcca015c450 0x7fcca01589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.201 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca48e3700 1 -- 172.21.15.173:0/549061581 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0094f0 con 0x7fcca006cce0 2023-10-06T05:25:18.201 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca48e3700 1 --2- 172.21.15.173:0/549061581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca006cce0 0x7fcca015a380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400e980 tx=0x7fcc94009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:18.201 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcc9cff9700 1 -- 172.21.15.173:0/549061581 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400ee70 con 0x7fcca006cce0 2023-10-06T05:25:18.201 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcc9cff9700 1 -- 172.21.15.173:0/549061581 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9400c850 con 0x7fcca006cce0 2023-10-06T05:25:18.201 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 -- 172.21.15.173:0/549061581 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca015b550 con 0x7fcca006cce0 2023-10-06T05:25:18.201 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcc9cff9700 1 -- 172.21.15.173:0/549061581 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400cbf0 con 0x7fcca006cce0 2023-10-06T05:25:18.201 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcca58e5700 1 -- 172.21.15.173:0/549061581 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca015a8c0 con 0x7fcca006cce0 2023-10-06T05:25:18.202 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcc9cff9700 1 -- 172.21.15.173:0/549061581 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcc940136f0 con 0x7fcca006cce0 2023-10-06T05:25:18.202 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.189+0000 7fcc9cff9700 1 -- 172.21.15.173:0/549061581 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fcc9401ca50 con 0x7fcca006cce0 2023-10-06T05:25:18.202 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.193+0000 7fcca58e5700 1 -- 172.21.15.173:0/549061581 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca004be00 con 0x7fcca006cce0 2023-10-06T05:25:18.202 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.193+0000 7fcc9cff9700 1 -- 172.21.15.173:0/549061581 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcc94021060 con 0x7fcca006cce0 2023-10-06T05:25:18.277 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.269+0000 7fcca58e5700 1 -- 172.21.15.173:0/549061581 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7812b7e-f82f-46e3-8af9-5795240f1c4f", "id": 6} v 0) v1 -- 0x7fcca015bca0 con 0x7fcca006cce0 2023-10-06T05:25:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcc9cff9700 1 -- 172.21.15.173:0/549061581 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7812b7e-f82f-46e3-8af9-5795240f1c4f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcc94017070 con 0x7fcca006cce0 2023-10-06T05:25:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:6 2023-10-06T05:25:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcca58e5700 1 -- 172.21.15.173:0/549061581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca006cce0 msgr2=0x7fcca015a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcca58e5700 1 --2- 172.21.15.173:0/549061581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca006cce0 0x7fcca015a380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400e980 tx=0x7fcc94009120 comp rx=0 tx=0).stop 2023-10-06T05:25:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcca58e5700 1 -- 172.21.15.173:0/549061581 shutdown_connections 2023-10-06T05:25:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcca58e5700 1 --2- 172.21.15.173:0/549061581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcca015c450 0x7fcca01589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcca58e5700 1 --2- 172.21.15.173:0/549061581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcca00c3490 0x7fcca0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcca58e5700 1 --2- 172.21.15.173:0/549061581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcca006cce0 0x7fcca015a380 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcca58e5700 1 -- 172.21.15.173:0/549061581 >> 172.21.15.173:0/549061581 conn(0x7fcca006ba30 msgr2=0x7fcca00cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcca58e5700 1 -- 172.21.15.173:0/549061581 shutdown_connections 2023-10-06T05:25:18.290 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.281+0000 7fcca58e5700 1 -- 172.21.15.173:0/549061581 wait complete. 2023-10-06T05:25:18.301 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new e5379453-6e30-4146-9eee-a50156c3287a 7 2023-10-06T05:25:18.405 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.397+0000 7feb8aa73700 1 Processor -- start 2023-10-06T05:25:18.405 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.397+0000 7feb8aa73700 1 -- start start 2023-10-06T05:25:18.414 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.397+0000 7feb8aa73700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feb84159200 0x7feb840c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.414 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.397+0000 7feb8aa73700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8406bf90 con 0x7feb840c72f0 2023-10-06T05:25:18.414 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.397+0000 7feb8aa73700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8406b6f0 con 0x7feb84158e30 2023-10-06T05:25:18.414 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.397+0000 7feb8aa73700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8406b9d0 con 0x7feb84159200 2023-10-06T05:25:18.414 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89a71700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7feb84158e30 0x7feb84068260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44856/0 (socket says 172.21.15.173:44856) 2023-10-06T05:25:18.414 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89a71700 1 -- 172.21.15.173:0/4249222324 learned_addr learned my addr 172.21.15.173:0/4249222324 (peer_addr_for_me v1:172.21.15.173:0/0) 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89270700 1 --2- 172.21.15.173:0/4249222324 >> v2:172.21.15.29:3300/0 conn(0x7feb84159200 0x7feb840c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722662104 0 0) 0x7feb8406b6f0 con 0x7feb84158e30 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb70003570 con 0x7feb84158e30 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2685149039 0 0) 0x7feb70003570 con 0x7feb84158e30 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 >> v2:172.21.15.29:3300/0 conn(0x7feb84159200 msgr2=0x7feb840c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 --2- 172.21.15.173:0/4249222324 >> v2:172.21.15.29:3300/0 conn(0x7feb84159200 0x7feb840c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 >> v1:172.21.15.29:6789/0 conn(0x7feb840c72f0 legacy=0x7feb840676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8406bcb0 con 0x7feb84158e30 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7feb80001470 con 0x7feb84158e30 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 >> v1:172.21.15.173:6789/0 conn(0x7feb84158e30 legacy=0x7feb84068260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb70003a60 0x7feb70003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70004810 0x7feb70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.415 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb700051c0 0x7feb7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8406b9d0 con 0x7feb700051c0 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7000c0e0 con 0x7feb70003a60 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7000c2a0 con 0x7feb70004810 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89a71700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb70003a60 0x7feb70003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89270700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70004810 0x7feb70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb8a272700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb700051c0 0x7feb7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89a71700 1 -- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70004810 msgr2=0x7feb70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89a71700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70004810 0x7feb70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89a71700 1 -- 172.21.15.173:0/4249222324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb700051c0 msgr2=0x7feb7000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:18.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89a71700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb700051c0 0x7feb7000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89a71700 1 -- 172.21.15.173:0/4249222324 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70003570 con 0x7feb70003a60 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb8a272700 1 -- 172.21.15.173:0/4249222324 reap_dead start 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89270700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70004810 0x7feb70004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb89a71700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb70003a60 0x7feb70003e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb800051a0 tx=0x7feb80008c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9908488079811f29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80005920 con 0x7feb70003a60 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80005a80 con 0x7feb70003a60 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb88a6f700 1 -- 172.21.15.173:0/4249222324 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80005e40 con 0x7feb70003a60 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb8aa73700 1 -- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb70003a60 msgr2=0x7feb70003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb8aa73700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb70003a60 0x7feb70003e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb800051a0 tx=0x7feb80008c10 comp rx=0 tx=0).stop 2023-10-06T05:25:18.417 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb8aa73700 1 -- 172.21.15.173:0/4249222324 shutdown_connections 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb8aa73700 1 --2- 172.21.15.173:0/4249222324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb70003a60 0x7feb70003e30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb8aa73700 1 -- 172.21.15.173:0/4249222324 >> 172.21.15.173:0/4249222324 conn(0x7feb840c9830 msgr2=0x7feb8406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb8aa73700 1 -- 172.21.15.173:0/4249222324 shutdown_connections 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.401+0000 7feb8aa73700 1 -- 172.21.15.173:0/4249222324 wait complete. 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 Processor -- start 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 -- start start 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70003a60 0x7feb840b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb840b0060 0x7feb840c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb840a89f0 0x7feb840a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.418 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b1170 con 0x7feb840b0060 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb84156260 con 0x7feb840a89f0 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb84143ac0 con 0x7feb70003a60 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89a71700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70003a60 0x7feb840b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89a71700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70003a60 0x7feb840b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:59496/0 (socket says 172.21.15.173:59496) 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89a71700 1 -- 172.21.15.173:0/2013334435 learned_addr learned my addr 172.21.15.173:0/2013334435 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8a272700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb840a89f0 0x7feb840a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89270700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb840b0060 0x7feb840c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89a71700 1 -- 172.21.15.173:0/2013334435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb840a89f0 msgr2=0x7feb840a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89a71700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb840a89f0 0x7feb840a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89a71700 1 -- 172.21.15.173:0/2013334435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb840b0060 msgr2=0x7feb840c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89a71700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb840b0060 0x7feb840c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89a71700 1 -- 172.21.15.173:0/2013334435 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840b0560 con 0x7feb70003a60 2023-10-06T05:25:18.419 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89270700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb840b0060 0x7feb840c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb89a71700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70003a60 0x7feb840b1600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feb80009fd0 tx=0x7feb80016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb79ffb700 1 -- 172.21.15.173:0/2013334435 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80001ba0 con 0x7feb70003a60 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb79ffb700 1 -- 172.21.15.173:0/2013334435 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80008360 con 0x7feb70003a60 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 -- 172.21.15.173:0/2013334435 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb840b0840 con 0x7feb70003a60 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb79ffb700 1 -- 172.21.15.173:0/2013334435 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80008720 con 0x7feb70003a60 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb8aa73700 1 -- 172.21.15.173:0/2013334435 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb840b0e00 con 0x7feb70003a60 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb79ffb700 1 -- 172.21.15.173:0/2013334435 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7feb80015630 con 0x7feb70003a60 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.405+0000 7feb79ffb700 1 -- 172.21.15.173:0/2013334435 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7feb8002aad0 con 0x7feb70003a60 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.409+0000 7feb8aa73700 1 -- 172.21.15.173:0/2013334435 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8404be00 con 0x7feb70003a60 2023-10-06T05:25:18.420 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.409+0000 7feb79ffb700 1 -- 172.21.15.173:0/2013334435 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7feb8002ad30 con 0x7feb70003a60 2023-10-06T05:25:18.479 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:18.473+0000 7fbd1acf6000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T05:25:18.494 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.489+0000 7feb8aa73700 1 -- 172.21.15.173:0/2013334435 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e5379453-6e30-4146-9eee-a50156c3287a", "id": 7} v 0) v1 -- 0x7feb8404be00 con 0x7feb70003a60 2023-10-06T05:25:18.506 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb79ffb700 1 -- 172.21.15.173:0/2013334435 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5379453-6e30-4146-9eee-a50156c3287a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7feb80015ac0 con 0x7feb70003a60 2023-10-06T05:25:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:7 2023-10-06T05:25:18.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb8aa73700 1 -- 172.21.15.173:0/2013334435 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70003a60 msgr2=0x7feb840b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb8aa73700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70003a60 0x7feb840b1600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feb80009fd0 tx=0x7feb80016000 comp rx=0 tx=0).stop 2023-10-06T05:25:18.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb8aa73700 1 -- 172.21.15.173:0/2013334435 shutdown_connections 2023-10-06T05:25:18.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb8aa73700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb840a89f0 0x7feb840a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb8aa73700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb840b0060 0x7feb840c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb8aa73700 1 --2- 172.21.15.173:0/2013334435 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb70003a60 0x7feb840b1600 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb8aa73700 1 -- 172.21.15.173:0/2013334435 >> 172.21.15.173:0/2013334435 conn(0x7feb840c9830 msgr2=0x7feb84157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:18.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb8aa73700 1 -- 172.21.15.173:0/2013334435 shutdown_connections 2023-10-06T05:25:18.508 INFO:teuthology.orchestra.run.smithi173.stderr:2023-10-06T05:25:18.501+0000 7feb8aa73700 1 -- 172.21.15.173:0/2013334435 wait complete. 2023-10-06T05:25:18.519 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T05:25:18.519 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T05:25:18.522 INFO:tasks.ceph.osd.0:Started 2023-10-06T05:25:18.522 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T05:25:18.522 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T05:25:18.524 INFO:tasks.ceph.osd.1:Started 2023-10-06T05:25:18.524 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T05:25:18.525 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T05:25:18.527 INFO:tasks.ceph.osd.2:Started 2023-10-06T05:25:18.527 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T05:25:18.527 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T05:25:18.529 INFO:tasks.ceph.osd.3:Started 2023-10-06T05:25:18.529 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T05:25:18.530 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T05:25:18.531 INFO:tasks.ceph.osd.4:Started 2023-10-06T05:25:18.531 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T05:25:18.531 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T05:25:18.535 INFO:tasks.ceph.osd.5:Started 2023-10-06T05:25:18.535 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T05:25:18.535 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T05:25:18.537 INFO:tasks.ceph.osd.6:Started 2023-10-06T05:25:18.537 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T05:25:18.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T05:25:18.539 INFO:tasks.ceph.osd.7:Started 2023-10-06T05:25:18.540 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:18.620 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:18.613+0000 7fbd1acf6000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T05:25:18.639 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:18.633+0000 7fa09fee9000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T05:25:18.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31df2b700 1 Processor -- start 2023-10-06T05:25:18.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31df2b700 1 -- start start 2023-10-06T05:25:18.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31df2b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd31815c630 0x7fd3180d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31df2b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180cb150 con 0x7fd3180cff90 2023-10-06T05:25:18.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31df2b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180ca540 con 0x7fd3180aeb00 2023-10-06T05:25:18.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31df2b700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3180cb5e0 con 0x7fd31815c630 2023-10-06T05:25:18.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31cf29700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd3180cff90 0x7fd31815d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59536/0 (socket says 172.21.15.29:59536) 2023-10-06T05:25:18.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31cf29700 1 -- 172.21.15.29:0/2137939076 learned_addr learned my addr 172.21.15.29:0/2137939076 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:18.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31d72a700 1 --2- 172.21.15.29:0/2137939076 >> v2:172.21.15.173:3300/0 conn(0x7fd31815c630 0x7fd3180d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd3177fe700 1 -- 172.21.15.29:0/2137939076 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932539353 0 0) 0x7fd3180cb150 con 0x7fd3180cff90 2023-10-06T05:25:18.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd3177fe700 1 -- 172.21.15.29:0/2137939076 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd300003570 con 0x7fd3180cff90 2023-10-06T05:25:18.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31d72a700 1 -- 172.21.15.29:0/2137939076 >> v1:172.21.15.173:6789/0 conn(0x7fd3180aeb00 legacy=0x7fd31815bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31d72a700 1 -- 172.21.15.29:0/2137939076 >> v1:172.21.15.29:6789/0 conn(0x7fd3180cff90 legacy=0x7fd31815d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31d72a700 1 -- 172.21.15.29:0/2137939076 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180ca820 con 0x7fd31815c630 2023-10-06T05:25:18.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd31d72a700 1 --2- 172.21.15.29:0/2137939076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd31815c630 0x7fd3180d0360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0098e0 tx=0x7fd30c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c6b153002f13dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:18.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd3177fe700 1 -- 172.21.15.29:0/2137939076 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00b640 con 0x7fd31815c630 2023-10-06T05:25:18.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.661+0000 7fd3177fe700 1 -- 172.21.15.29:0/2137939076 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c00b7a0 con 0x7fd31815c630 2023-10-06T05:25:18.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.665+0000 7fd3177fe700 1 -- 172.21.15.29:0/2137939076 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00bb40 con 0x7fd31815c630 2023-10-06T05:25:18.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.665+0000 7fd31df2b700 1 -- 172.21.15.29:0/2137939076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd31815c630 msgr2=0x7fd3180d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.665+0000 7fd31df2b700 1 --2- 172.21.15.29:0/2137939076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd31815c630 0x7fd3180d0360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0098e0 tx=0x7fd30c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.665+0000 7fd31df2b700 1 -- 172.21.15.29:0/2137939076 shutdown_connections 2023-10-06T05:25:18.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.665+0000 7fd31df2b700 1 --2- 172.21.15.29:0/2137939076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd31815c630 0x7fd3180d0360 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.665+0000 7fd31df2b700 1 -- 172.21.15.29:0/2137939076 >> 172.21.15.29:0/2137939076 conn(0x7fd3180670a0 msgr2=0x7fd3180674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:18.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.665+0000 7fd31df2b700 1 -- 172.21.15.29:0/2137939076 shutdown_connections 2023-10-06T05:25:18.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.665+0000 7fd31df2b700 1 -- 172.21.15.29:0/2137939076 wait complete. 2023-10-06T05:25:18.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 Processor -- start 2023-10-06T05:25:18.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 -- start start 2023-10-06T05:25:18.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3180aeb00 0x7fd3180c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3180cff90 0x7fd318157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd31815c630 0x7fd318169050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:18.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180b3cd0 con 0x7fd31815c630 2023-10-06T05:25:18.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180b3fb0 con 0x7fd3180cff90 2023-10-06T05:25:18.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3181583c0 con 0x7fd3180aeb00 2023-10-06T05:25:18.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31d72a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd31815c630 0x7fd318169050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31d72a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd31815c630 0x7fd318169050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59700/0 (socket says 172.21.15.29:59700) 2023-10-06T05:25:18.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31d72a700 1 -- 172.21.15.29:0/2599553060 learned_addr learned my addr 172.21.15.29:0/2599553060 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:18.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31cf29700 1 --2- 172.21.15.29:0/2599553060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3180aeb00 0x7fd3180c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd317fff700 1 --2- 172.21.15.29:0/2599553060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3180cff90 0x7fd318157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:18.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31d72a700 1 -- 172.21.15.29:0/2599553060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3180aeb00 msgr2=0x7fd3180c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31d72a700 1 --2- 172.21.15.29:0/2599553060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3180aeb00 0x7fd3180c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31d72a700 1 -- 172.21.15.29:0/2599553060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3180cff90 msgr2=0x7fd318157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31d72a700 1 --2- 172.21.15.29:0/2599553060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3180cff90 0x7fd318157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31d72a700 1 -- 172.21.15.29:0/2599553060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009420 con 0x7fd31815c630 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31d72a700 1 --2- 172.21.15.29:0/2599553060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd31815c630 0x7fd318169050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd31806e4d0 tx=0x7fd30c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd314ff9700 1 -- 172.21.15.29:0/2599553060 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c006af0 con 0x7fd31815c630 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd314ff9700 1 -- 172.21.15.29:0/2599553060 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c00bb20 con 0x7fd31815c630 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 -- 172.21.15.29:0/2599553060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3181698e0 con 0x7fd31815c630 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd314ff9700 1 -- 172.21.15.29:0/2599553060 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c011670 con 0x7fd31815c630 2023-10-06T05:25:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd31df2b700 1 -- 172.21.15.29:0/2599553060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd318169ea0 con 0x7fd31815c630 2023-10-06T05:25:18.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd314ff9700 1 -- 172.21.15.29:0/2599553060 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd30c011ca0 con 0x7fd31815c630 2023-10-06T05:25:18.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.669+0000 7fd314ff9700 1 -- 172.21.15.29:0/2599553060 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fd30c025ae0 con 0x7fd31815c630 2023-10-06T05:25:18.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.677+0000 7fd31df2b700 1 -- 172.21.15.29:0/2599553060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31804be00 con 0x7fd31815c630 2023-10-06T05:25:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.681+0000 7fd314ff9700 1 -- 172.21.15.29:0/2599553060 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd30c015020 con 0x7fd31815c630 2023-10-06T05:25:18.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.749+0000 7fd31df2b700 1 -- 172.21.15.29:0/2599553060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3180b40f0 con 0x7fd31815c630 2023-10-06T05:25:18.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.749+0000 7fd314ff9700 1 -- 172.21.15.29:0/2599553060 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fd30c02e440 con 0x7fd31815c630 2023-10-06T05:25:18.755 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:18.755 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:18.494830+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:18.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.749+0000 7fd31df2b700 1 -- 172.21.15.29:0/2599553060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd31815c630 msgr2=0x7fd318169050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:18.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.749+0000 7fd31df2b700 1 --2- 172.21.15.29:0/2599553060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd31815c630 0x7fd318169050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd31806e4d0 tx=0x7fd30c017000 comp rx=0 tx=0).stop 2023-10-06T05:25:18.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.749+0000 7fd31df2b700 1 -- 172.21.15.29:0/2599553060 shutdown_connections 2023-10-06T05:25:18.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.749+0000 7fd31df2b700 1 --2- 172.21.15.29:0/2599553060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd31815c630 0x7fd318169050 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.749+0000 7fd31df2b700 1 --2- 172.21.15.29:0/2599553060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3180cff90 0x7fd318157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.749+0000 7fd31df2b700 1 --2- 172.21.15.29:0/2599553060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3180aeb00 0x7fd3180c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:18.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.753+0000 7fd31df2b700 1 -- 172.21.15.29:0/2599553060 >> 172.21.15.29:0/2599553060 conn(0x7fd3180670a0 msgr2=0x7fd3180b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:18.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.753+0000 7fd31df2b700 1 -- 172.21.15.29:0/2599553060 shutdown_connections 2023-10-06T05:25:18.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:18.753+0000 7fd31df2b700 1 -- 172.21.15.29:0/2599553060 wait complete. 2023-10-06T05:25:18.764 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:18.757+0000 7fa09fee9000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T05:25:18.768 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T05:25:18.768 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T05:25:18.882 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-06T05:25:18.877+0000 7fa6d62593c0 -1 Falling back to public interface 2023-10-06T05:25:18.887 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-10-06T05:25:18.881+0000 7f853bae33c0 -1 Falling back to public interface 2023-10-06T05:25:18.891 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-06T05:25:18.885+0000 7f862f7703c0 -1 Falling back to public interface 2023-10-06T05:25:18.905 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-06T05:25:18.901+0000 7fe5b83ed3c0 -1 Falling back to public interface 2023-10-06T05:25:18.911 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-10-06T05:25:18.905+0000 7f0ab73033c0 -1 Falling back to public interface 2023-10-06T05:25:18.913 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-06T05:25:18.909+0000 7fd375e943c0 -1 Falling back to public interface 2023-10-06T05:25:18.932 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:18.925+0000 7fbd1acf6000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T05:25:19.091 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:19.085+0000 7fbd1acf6000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T05:25:19.097 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:19.093+0000 7fa09fee9000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T05:25:19.151 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-10-06T05:25:19.145+0000 7f7680b7f3c0 -1 Falling back to public interface 2023-10-06T05:25:19.155 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:19.149+0000 7fbd1acf6000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T05:25:19.164 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-10-06T05:25:19.157+0000 7fea304633c0 -1 Falling back to public interface 2023-10-06T05:25:19.207 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:19.201+0000 7fbd1acf6000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T05:25:19.263 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:19.257+0000 7fbd1acf6000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T05:25:19.273 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:19.269+0000 7fa09fee9000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T05:25:19.341 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:19.337+0000 7fa09fee9000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T05:25:19.396 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:19.389+0000 7fa09fee9000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T05:25:19.455 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:19.449+0000 7fa09fee9000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T05:25:19.559 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:19.553+0000 7fbd1acf6000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T05:25:19.575 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:19.616 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:19.609+0000 7fbd1acf6000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T05:25:19.671 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a3fff700 1 Processor -- start 2023-10-06T05:25:19.671 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a3fff700 1 -- start start 2023-10-06T05:25:19.672 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a3fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff3a4158cc0 0x7ff3a406da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:19.672 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3a4063060 0x7ff3a406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:19.672 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a3fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a415d5e0 con 0x7ff3a406bee0 2023-10-06T05:25:19.672 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a3fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a415d3f0 con 0x7ff3a4063060 2023-10-06T05:25:19.672 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a3fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a406dfc0 con 0x7ff3a4158cc0 2023-10-06T05:25:19.673 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3a4063060 0x7ff3a406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:19.673 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a2ffd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff3a4158cc0 0x7ff3a406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:19.673 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3a4063060 0x7ff3a406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59716/0 (socket says 172.21.15.29:59716) 2023-10-06T05:25:19.673 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.665+0000 7ff3a27fc700 1 -- 172.21.15.29:0/4264198752 learned_addr learned my addr 172.21.15.29:0/4264198752 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:19.674 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a27fc700 1 -- 172.21.15.29:0/4264198752 >> v2:172.21.15.173:3300/0 conn(0x7ff3a4158cc0 msgr2=0x7ff3a406da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a27fc700 1 --2- 172.21.15.29:0/4264198752 >> v2:172.21.15.173:3300/0 conn(0x7ff3a4158cc0 0x7ff3a406da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a27fc700 1 -- 172.21.15.29:0/4264198752 >> v1:172.21.15.173:6789/0 conn(0x7ff3a406bee0 legacy=0x7ff3a40ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a1ffb700 1 -- 172.21.15.29:0/4264198752 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095994001 0 0) 0x7ff3a415d5e0 con 0x7ff3a406bee0 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a27fc700 1 -- 172.21.15.29:0/4264198752 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a415d8c0 con 0x7ff3a4063060 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a2ffd700 1 --2- 172.21.15.29:0/4264198752 >> v2:172.21.15.173:3300/0 conn(0x7ff3a4158cc0 0x7ff3a406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a27fc700 1 --2- 172.21.15.29:0/4264198752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a4063060 0x7ff3a406b9a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40b1550 tx=0x7ff398009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f812fecb6f597e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a1ffb700 1 -- 172.21.15.29:0/4264198752 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398009e70 con 0x7ff3a4063060 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a1ffb700 1 -- 172.21.15.29:0/4264198752 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800b860 con 0x7ff3a4063060 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a1ffb700 1 -- 172.21.15.29:0/4264198752 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800bc00 con 0x7ff3a4063060 2023-10-06T05:25:19.675 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 -- 172.21.15.29:0/4264198752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a4063060 msgr2=0x7ff3a406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:19.676 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 --2- 172.21.15.29:0/4264198752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a4063060 0x7ff3a406b9a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40b1550 tx=0x7ff398009250 comp rx=0 tx=0).stop 2023-10-06T05:25:19.676 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 -- 172.21.15.29:0/4264198752 shutdown_connections 2023-10-06T05:25:19.676 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 --2- 172.21.15.29:0/4264198752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a4063060 0x7ff3a406b9a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:19.676 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 --2- 172.21.15.29:0/4264198752 >> v2:172.21.15.173:3300/0 conn(0x7ff3a4158cc0 0x7ff3a406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:19.676 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 -- 172.21.15.29:0/4264198752 >> 172.21.15.29:0/4264198752 conn(0x7ff3a40670a0 msgr2=0x7ff3a4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:19.676 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 -- 172.21.15.29:0/4264198752 shutdown_connections 2023-10-06T05:25:19.676 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 -- 172.21.15.29:0/4264198752 wait complete. 2023-10-06T05:25:19.678 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 Processor -- start 2023-10-06T05:25:19.678 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.669+0000 7ff3a3fff700 1 -- start start 2023-10-06T05:25:19.678 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4063060 0x7ff3a40ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:19.678 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a406bee0 0x7ff3a4156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3a4158cc0 0x7ff3a40c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40c2db0 con 0x7ff3a406bee0 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a3fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40abb70 con 0x7ff3a4063060 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a3fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40c21e0 con 0x7ff3a4158cc0 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a27fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a406bee0 0x7ff3a4156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a27fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a406bee0 0x7ff3a4156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59724/0 (socket says 172.21.15.29:59724) 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a27fc700 1 -- 172.21.15.29:0/3381296231 learned_addr learned my addr 172.21.15.29:0/3381296231 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a2ffd700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4063060 0x7ff3a40ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a37fe700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3a4158cc0 0x7ff3a40c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a27fc700 1 -- 172.21.15.29:0/3381296231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3a4158cc0 msgr2=0x7ff3a40c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a27fc700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3a4158cc0 0x7ff3a40c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a27fc700 1 -- 172.21.15.29:0/3381296231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4063060 msgr2=0x7ff3a40ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:19.679 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a27fc700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4063060 0x7ff3a40ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a27fc700 1 -- 172.21.15.29:0/3381296231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394009420 con 0x7ff3a406bee0 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a2ffd700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4063060 0x7ff3a40ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a27fc700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a406bee0 0x7ff3a4156530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff398006fd0 tx=0x7ff398017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff38affd700 1 -- 172.21.15.29:0/3381296231 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800bbe0 con 0x7ff3a406bee0 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff38affd700 1 -- 172.21.15.29:0/3381296231 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398011420 con 0x7ff3a406bee0 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a3fff700 1 -- 172.21.15.29:0/3381296231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3980094f0 con 0x7ff3a406bee0 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff38affd700 1 -- 172.21.15.29:0/3381296231 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3980117c0 con 0x7ff3a406bee0 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a3fff700 1 -- 172.21.15.29:0/3381296231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a40c2480 con 0x7ff3a406bee0 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff38affd700 1 -- 172.21.15.29:0/3381296231 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff398011bb0 con 0x7ff3a406bee0 2023-10-06T05:25:19.680 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff38affd700 1 -- 172.21.15.29:0/3381296231 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7ff398023ad0 con 0x7ff3a406bee0 2023-10-06T05:25:19.681 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.673+0000 7ff3a3fff700 1 -- 172.21.15.29:0/3381296231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a404be00 con 0x7ff3a406bee0 2023-10-06T05:25:19.681 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:19.673+0000 7fbd1acf6000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T05:25:19.682 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.677+0000 7ff38affd700 1 -- 172.21.15.29:0/3381296231 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff398028070 con 0x7ff3a406bee0 2023-10-06T05:25:19.748 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.741+0000 7ff3a3fff700 1 -- 172.21.15.29:0/3381296231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3a406aec0 con 0x7ff3a406bee0 2023-10-06T05:25:19.749 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff38affd700 1 -- 172.21.15.29:0/3381296231 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7ff398015020 con 0x7ff3a406bee0 2023-10-06T05:25:19.749 INFO:teuthology.misc.health.smithi029.stdout: 2023-10-06T05:25:19.750 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:18.494830+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:19.751 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff3a3fff700 1 -- 172.21.15.29:0/3381296231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a406bee0 msgr2=0x7ff3a4156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:19.751 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff3a3fff700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a406bee0 0x7ff3a4156530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff398006fd0 tx=0x7ff398017000 comp rx=0 tx=0).stop 2023-10-06T05:25:19.751 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff3a3fff700 1 -- 172.21.15.29:0/3381296231 shutdown_connections 2023-10-06T05:25:19.752 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff3a3fff700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3a4158cc0 0x7ff3a40c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:19.752 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff3a3fff700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3a406bee0 0x7ff3a4156530 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:19.752 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff3a3fff700 1 --2- 172.21.15.29:0/3381296231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4063060 0x7ff3a40ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:19.752 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff3a3fff700 1 -- 172.21.15.29:0/3381296231 >> 172.21.15.29:0/3381296231 conn(0x7ff3a40670a0 msgr2=0x7ff3a4157af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:19.752 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff3a3fff700 1 -- 172.21.15.29:0/3381296231 shutdown_connections 2023-10-06T05:25:19.752 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:19.745+0000 7ff3a3fff700 1 -- 172.21.15.29:0/3381296231 wait complete. 2023-10-06T05:25:19.760 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T05:25:19.770 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:19.765+0000 7fa09fee9000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T05:25:19.823 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:19.817+0000 7fa09fee9000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T05:25:19.841 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:19.833+0000 7fbd1acf6000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T05:25:19.890 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:19.885+0000 7fa09fee9000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T05:25:19.905 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:19.897+0000 7fbd1acf6000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T05:25:20.057 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:20.053+0000 7fa09fee9000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T05:25:20.127 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:20.121+0000 7fa09fee9000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T05:25:20.607 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:20.601+0000 7fbd1acf6000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T05:25:20.863 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-06T05:25:20.857+0000 7fa09fee9000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T05:25:21.656 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:21.649+0000 7fbd03dee700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T05:25:21.659 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-10-06T05:25:21.653+0000 7fbd03dee700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T05:25:22.671 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-06T05:25:22.665+0000 7fa6d62593c0 -1 osd.3 0 log_to_monitors true 2023-10-06T05:25:22.700 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-06T05:25:22.697+0000 7f862f7703c0 -1 osd.0 0 log_to_monitors true 2023-10-06T05:25:22.736 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-10-06T05:25:22.729+0000 7f0ab73033c0 -1 osd.5 0 log_to_monitors true 2023-10-06T05:25:22.745 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-10-06T05:25:22.741+0000 7f853bae33c0 -1 osd.4 0 log_to_monitors true 2023-10-06T05:25:22.776 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-06T05:25:22.773+0000 7fd375e943c0 -1 osd.2 0 log_to_monitors true 2023-10-06T05:25:22.796 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-06T05:25:22.789+0000 7fe5b83ed3c0 -1 osd.1 0 log_to_monitors true 2023-10-06T05:25:22.816 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-10-06T05:25:22.809+0000 7fea304633c0 -1 osd.7 0 log_to_monitors true 2023-10-06T05:25:22.917 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-10-06T05:25:22.909+0000 7f7680b7f3c0 -1 osd.6 0 log_to_monitors true 2023-10-06T05:25:26.345 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-06T05:25:26.341+0000 7fe5b3b8d700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T05:25:26.352 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-06T05:25:26.345+0000 7fe5ac931700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T05:25:26.370 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-06T05:25:26.365+0000 7f862c735700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T05:25:26.376 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-06T05:25:26.369+0000 7f8623cb4700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T05:25:26.393 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-06T05:25:26.389+0000 7fd371634700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T05:25:26.399 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-06T05:25:26.393+0000 7fd36a3d8700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T05:25:26.401 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-06T05:25:26.397+0000 7fa6d19f9700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T05:25:26.407 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-06T05:25:26.401+0000 7fa6ca79d700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T05:25:26.566 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:26.659 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.653+0000 7f001228d700 1 Processor -- start 2023-10-06T05:25:26.659 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.653+0000 7f001228d700 1 -- start start 2023-10-06T05:25:26.660 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.653+0000 7f001228d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f000c158ec0 0x7f000c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:26.660 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.653+0000 7f001228d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0ac940 con 0x7f000c06cd00 2023-10-06T05:25:26.660 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.653+0000 7f001228d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0abd30 con 0x7f000c0ab7a0 2023-10-06T05:25:26.660 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.653+0000 7f001228d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c06d630 con 0x7f000c158ec0 2023-10-06T05:25:26.660 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f0010a8a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f000c06cd00 0x7f000c0ab090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52586/0 (socket says 172.21.15.29:52586) 2023-10-06T05:25:26.661 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f0010a8a700 1 -- 172.21.15.29:0/1607963209 learned_addr learned my addr 172.21.15.29:0/1607963209 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:26.662 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001128b700 1 --2- 172.21.15.29:0/1607963209 >> v2:172.21.15.29:3300/0 conn(0x7f000c158ec0 0x7f000c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:26.662 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7efffffff700 1 -- 172.21.15.29:0/1607963209 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588426823 0 0) 0x7f000c0ac940 con 0x7f000c06cd00 2023-10-06T05:25:26.662 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7efffffff700 1 -- 172.21.15.29:0/1607963209 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff8003570 con 0x7f000c06cd00 2023-10-06T05:25:26.662 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7efffffff700 1 -- 172.21.15.29:0/1607963209 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561472190 0 0) 0x7f000c0abd30 con 0x7f000c0ab7a0 2023-10-06T05:25:26.662 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7efffffff700 1 -- 172.21.15.29:0/1607963209 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f000c0ac940 con 0x7f000c0ab7a0 2023-10-06T05:25:26.662 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001128b700 1 -- 172.21.15.29:0/1607963209 >> v1:172.21.15.173:6789/0 conn(0x7f000c0ab7a0 legacy=0x7f000c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:26.662 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001128b700 1 -- 172.21.15.29:0/1607963209 >> v1:172.21.15.29:6789/0 conn(0x7f000c06cd00 legacy=0x7f000c0ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:26.662 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001128b700 1 -- 172.21.15.29:0/1607963209 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c0ac010 con 0x7f000c158ec0 2023-10-06T05:25:26.663 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001128b700 1 --2- 172.21.15.29:0/1607963209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f000c158ec0 0x7f000c06c7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f00000098e0 tx=0x7f00000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e28641242e48090 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:26.663 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7efffffff700 1 -- 172.21.15.29:0/1607963209 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000011630 con 0x7f000c158ec0 2023-10-06T05:25:26.663 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7efffffff700 1 -- 172.21.15.29:0/1607963209 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0000011790 con 0x7f000c158ec0 2023-10-06T05:25:26.663 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7efffffff700 1 -- 172.21.15.29:0/1607963209 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000011b30 con 0x7f000c158ec0 2023-10-06T05:25:26.664 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001228d700 1 -- 172.21.15.29:0/1607963209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f000c158ec0 msgr2=0x7f000c06c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:26.664 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001228d700 1 --2- 172.21.15.29:0/1607963209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f000c158ec0 0x7f000c06c7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f00000098e0 tx=0x7f00000091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:26.664 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001228d700 1 -- 172.21.15.29:0/1607963209 shutdown_connections 2023-10-06T05:25:26.664 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001228d700 1 --2- 172.21.15.29:0/1607963209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f000c158ec0 0x7f000c06c7c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:26.664 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001228d700 1 -- 172.21.15.29:0/1607963209 >> 172.21.15.29:0/1607963209 conn(0x7f000c06e0b0 msgr2=0x7f000c0ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:26.664 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001228d700 1 -- 172.21.15.29:0/1607963209 shutdown_connections 2023-10-06T05:25:26.664 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001228d700 1 -- 172.21.15.29:0/1607963209 wait complete. 2023-10-06T05:25:26.664 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001228d700 1 Processor -- start 2023-10-06T05:25:26.664 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.657+0000 7f001228d700 1 -- start start 2023-10-06T05:25:26.665 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001228d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f000c06cd00 0x7f000c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:26.665 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001228d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f000c0ab7a0 0x7f000c0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:26.665 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001228d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f000c158ec0 0x7f000c0aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:26.665 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001228d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0b2870 con 0x7f000c158ec0 2023-10-06T05:25:26.665 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001228d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0b07c0 con 0x7f000c06cd00 2023-10-06T05:25:26.665 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001228d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0cafe0 con 0x7f000c0ab7a0 2023-10-06T05:25:26.666 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0011a8c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f000c158ec0 0x7f000c0aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:26.666 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0010a8a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f000c0ab7a0 0x7f000c0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:26.666 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001128b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f000c06cd00 0x7f000c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:26.666 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0010a8a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f000c0ab7a0 0x7f000c0b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52244/0 (socket says 172.21.15.29:52244) 2023-10-06T05:25:26.666 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0010a8a700 1 -- 172.21.15.29:0/4273419047 learned_addr learned my addr 172.21.15.29:0/4273419047 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:26.667 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0010a8a700 1 -- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f000c06cd00 msgr2=0x7f000c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:26.667 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0010a8a700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f000c06cd00 0x7f000c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:26.667 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0010a8a700 1 -- 172.21.15.29:0/4273419047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f000c158ec0 msgr2=0x7f000c0aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:26.667 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0010a8a700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f000c158ec0 0x7f000c0aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:26.667 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0010a8a700 1 -- 172.21.15.29:0/4273419047 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0000009420 con 0x7f000c0ab7a0 2023-10-06T05:25:26.667 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f0010a8a700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f000c0ab7a0 0x7f000c0b10d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f000800c790 tx=0x7f0008007e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:26.667 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7efffd7fa700 1 -- 172.21.15.29:0/4273419047 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008005b30 con 0x7f000c0ab7a0 2023-10-06T05:25:26.668 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7efffd7fa700 1 -- 172.21.15.29:0/4273419047 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0008005cd0 con 0x7f000c0ab7a0 2023-10-06T05:25:26.668 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7efffd7fa700 1 -- 172.21.15.29:0/4273419047 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008007320 con 0x7f000c0ab7a0 2023-10-06T05:25:26.668 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c0af8d0 con 0x7f000c0ab7a0 2023-10-06T05:25:26.668 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c0afe90 con 0x7f000c0ab7a0 2023-10-06T05:25:26.668 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.661+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000c169910 con 0x7f000c0ab7a0 2023-10-06T05:25:26.669 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.665+0000 7efffd7fa700 1 -- 172.21.15.29:0/4273419047 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7f0008012400 con 0x7f000c0ab7a0 2023-10-06T05:25:26.669 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.665+0000 7efffd7fa700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efff00604c0 0x7efff0062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:26.669 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.665+0000 7efffd7fa700 1 -- 172.21.15.29:0/4273419047 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f000807ac80 con 0x7f000c0ab7a0 2023-10-06T05:25:26.673 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.669+0000 7f001128b700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efff00604c0 0x7efff0062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:26.674 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.669+0000 7f001128b700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efff00604c0 0x7efff0062970 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f00000093f0 tx=0x7f0000017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:26.677 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.673+0000 7efffd7fa700 1 -- 172.21.15.29:0/4273419047 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0008049be0 con 0x7f000c0ab7a0 2023-10-06T05:25:26.833 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f000c04be00 con 0x7f000c0ab7a0 2023-10-06T05:25:26.834 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7efffd7fa700 1 -- 172.21.15.29:0/4273419047 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f0008017020 con 0x7f000c0ab7a0 2023-10-06T05:25:26.834 INFO:teuthology.misc.health.smithi029.stdout: 2023-10-06T05:25:26.835 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":12,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:24.657495+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:26.836 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efff00604c0 msgr2=0x7efff0062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:26.836 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efff00604c0 0x7efff0062970 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f00000093f0 tx=0x7f0000017000 comp rx=0 tx=0).stop 2023-10-06T05:25:26.836 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f000c0ab7a0 msgr2=0x7f000c0b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:26.837 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f000c0ab7a0 0x7f000c0b10d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f000800c790 tx=0x7f0008007e80 comp rx=0 tx=0).stop 2023-10-06T05:25:26.837 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 shutdown_connections 2023-10-06T05:25:26.837 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f000c158ec0 0x7f000c0aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:26.837 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f000c0ab7a0 0x7f000c0b10d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:26.837 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efff00604c0 0x7efff0062970 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:26.837 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.829+0000 7f001228d700 1 --2- 172.21.15.29:0/4273419047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f000c06cd00 0x7f000c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:26.837 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.833+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 >> 172.21.15.29:0/4273419047 conn(0x7f000c06e0b0 msgr2=0x7f000c155870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:26.837 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.833+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 shutdown_connections 2023-10-06T05:25:26.837 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:26.833+0000 7f001228d700 1 -- 172.21.15.29:0/4273419047 wait complete. 2023-10-06T05:25:26.846 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T05:25:26.939 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-10-06T05:25:26.933+0000 7f767db44700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T05:25:26.945 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-10-06T05:25:26.937+0000 7f76750c3700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T05:25:26.950 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-10-06T05:25:26.945+0000 7f8537283700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T05:25:26.957 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-10-06T05:25:26.949+0000 7f8530027700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T05:25:26.975 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-10-06T05:25:26.969+0000 7f0ab2aa3700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T05:25:26.975 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-10-06T05:25:26.969+0000 7fea2bc03700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T05:25:26.981 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-10-06T05:25:26.973+0000 7f0aab847700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T05:25:26.981 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-10-06T05:25:26.977+0000 7fea249a7700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T05:25:33.653 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:33.757 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2b59e700 1 Processor -- start 2023-10-06T05:25:33.758 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2b59e700 1 -- start start 2023-10-06T05:25:33.759 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c0680f0 0x7f0e2c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:33.759 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2b59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0e2c06cd00 0x7f0e2c0c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:33.759 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2b59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2c069330 con 0x7f0e2c158d20 2023-10-06T05:25:33.759 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2b59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e2c0c7660 con 0x7f0e2c06cd00 2023-10-06T05:25:33.759 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c06d180 con 0x7f0e2c0680f0 2023-10-06T05:25:33.759 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2a59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0e2c158d20 0x7f0e2c068c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52592/0 (socket says 172.21.15.29:52592) 2023-10-06T05:25:33.760 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2a59c700 1 -- 172.21.15.29:0/3366846603 learned_addr learned my addr 172.21.15.29:0/3366846603 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:33.760 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2ad9d700 1 --2- 172.21.15.29:0/3366846603 >> v2:172.21.15.173:3300/0 conn(0x7f0e2c06cd00 0x7f0e2c0c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:33.760 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e29d9b700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c0680f0 0x7f0e2c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:33.760 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444568763 0 0) 0x7f0e2c069330 con 0x7f0e2c158d20 2023-10-06T05:25:33.760 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e18003570 con 0x7f0e2c158d20 2023-10-06T05:25:33.762 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2070419478 0 0) 0x7f0e18003570 con 0x7f0e2c158d20 2023-10-06T05:25:33.762 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c0680f0 msgr2=0x7f0e2c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c0680f0 0x7f0e2c06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 >> v2:172.21.15.173:3300/0 conn(0x7f0e2c06cd00 msgr2=0x7f0e2c0c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 --2- 172.21.15.29:0/3366846603 >> v2:172.21.15.173:3300/0 conn(0x7f0e2c06cd00 0x7f0e2c0c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c069590 con 0x7f0e2c158d20 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f0e1c001490 con 0x7f0e2c158d20 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 >> v1:172.21.15.29:6789/0 conn(0x7f0e2c158d20 legacy=0x7f0e2c068c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 0x7f0e18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c0680f0 0x7f0e18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18004d50 0x7f0e180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:33.763 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0c7660 con 0x7f0e18004d50 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c06d180 con 0x7f0e18003a60 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1800ba60 con 0x7f0e2c0680f0 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2ad9d700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18004d50 0x7f0e180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e2a59c700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 0x7f0e18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.753+0000 7f0e29d9b700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c0680f0 0x7f0e18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2a59c700 1 -- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c0680f0 msgr2=0x7f0e18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2a59c700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c0680f0 0x7f0e18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2a59c700 1 -- 172.21.15.29:0/3366846603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18004d50 msgr2=0x7f0e180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2a59c700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18004d50 0x7f0e180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.764 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2a59c700 1 -- 172.21.15.29:0/3366846603 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18003570 con 0x7f0e18003a60 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2a59c700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 0x7f0e18003e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0694c0 tx=0x7f0e1c007940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40d0dda09dca7afa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c00cc50 con 0x7f0e18003a60 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c00cdb0 con 0x7f0e18003a60 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2959a700 1 -- 172.21.15.29:0/3366846603 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c004b40 con 0x7f0e18003a60 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2b59e700 1 -- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 msgr2=0x7f0e18003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2b59e700 1 --2- 172.21.15.29:0/3366846603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 0x7f0e18003e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0694c0 tx=0x7f0e1c007940 comp rx=0 tx=0).stop 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2ad9d700 1 -- 172.21.15.29:0/3366846603 reap_dead start 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2b59e700 1 -- 172.21.15.29:0/3366846603 shutdown_connections 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2b59e700 1 -- 172.21.15.29:0/3366846603 >> 172.21.15.29:0/3366846603 conn(0x7f0e2c06c0b0 msgr2=0x7f0e2c067600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:33.765 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2b59e700 1 -- 172.21.15.29:0/3366846603 shutdown_connections 2023-10-06T05:25:33.766 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2b59e700 1 -- 172.21.15.29:0/3366846603 wait complete. 2023-10-06T05:25:33.768 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2b59e700 1 Processor -- start 2023-10-06T05:25:33.768 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.757+0000 7f0e2b59e700 1 -- start start 2023-10-06T05:25:33.768 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2b59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 0x7f0e2c0af800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:33.768 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c169670 0x7f0e2c162a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:33.768 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e2c1570f0 0x7f0e2c157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c157aa0 con 0x7f0e2c1570f0 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2b59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0afee0 con 0x7f0e18003a60 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0b01c0 con 0x7f0e2c169670 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e2c1570f0 0x7f0e2c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e2c1570f0 0x7f0e2c157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47890/0 (socket says 172.21.15.29:47890) 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2ad9d700 1 -- 172.21.15.29:0/1310860194 learned_addr learned my addr 172.21.15.29:0/1310860194 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2a59c700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 0x7f0e2c0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e29d9b700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c169670 0x7f0e2c162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2ad9d700 1 -- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c169670 msgr2=0x7f0e2c162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:33.769 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2ad9d700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c169670 0x7f0e2c162a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.770 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2ad9d700 1 -- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 msgr2=0x7f0e2c0af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:33.770 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2ad9d700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 0x7f0e2c0af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.770 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2ad9d700 1 -- 172.21.15.29:0/1310860194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c0b04a0 con 0x7f0e2c1570f0 2023-10-06T05:25:33.770 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2ad9d700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e2c1570f0 0x7f0e2c157560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c06b3e0 tx=0x7f0e240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:33.770 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e227fc700 1 -- 172.21.15.29:0/1310860194 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24013750 con 0x7f0e2c1570f0 2023-10-06T05:25:33.770 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e227fc700 1 -- 172.21.15.29:0/1310860194 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e240138b0 con 0x7f0e2c1570f0 2023-10-06T05:25:33.770 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2c0b0780 con 0x7f0e2c1570f0 2023-10-06T05:25:33.770 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e227fc700 1 -- 172.21.15.29:0/1310860194 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24013c50 con 0x7f0e2c1570f0 2023-10-06T05:25:33.771 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2c169ae0 con 0x7f0e2c1570f0 2023-10-06T05:25:33.771 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.761+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2c04be00 con 0x7f0e2c1570f0 2023-10-06T05:25:33.771 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.765+0000 7f0e227fc700 1 -- 172.21.15.29:0/1310860194 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0e24014650 con 0x7f0e2c1570f0 2023-10-06T05:25:33.772 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.765+0000 7f0e227fc700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e0c060550 0x7f0e0c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:33.772 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.765+0000 7f0e227fc700 1 -- 172.21.15.29:0/1310860194 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0e2407c900 con 0x7f0e2c1570f0 2023-10-06T05:25:33.772 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.765+0000 7f0e2a59c700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e0c060550 0x7f0e0c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:33.772 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.765+0000 7f0e2a59c700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e0c060550 0x7f0e0c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c008fd0 tx=0x7f0e1c015000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:33.777 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.773+0000 7f0e227fc700 1 -- 172.21.15.29:0/1310860194 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0e2404d2c0 con 0x7f0e2c1570f0 2023-10-06T05:25:33.942 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.937+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e2c0c2870 con 0x7f0e2c1570f0 2023-10-06T05:25:33.944 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.937+0000 7f0e227fc700 1 -- 172.21.15.29:0/1310860194 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f0e240508e0 con 0x7f0e2c1570f0 2023-10-06T05:25:33.944 INFO:teuthology.misc.health.smithi029.stdout: 2023-10-06T05:25:33.944 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":17,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:31.401914+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:33.946 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e0c060550 msgr2=0x7f0e0c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:33.946 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e0c060550 0x7f0e0c062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c008fd0 tx=0x7f0e1c015000 comp rx=0 tx=0).stop 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e2c1570f0 msgr2=0x7f0e2c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e2c1570f0 0x7f0e2c157560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c06b3e0 tx=0x7f0e240091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 shutdown_connections 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e2c1570f0 0x7f0e2c157560 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e2c169670 0x7f0e2c162a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e0c060550 0x7f0e0c062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 --2- 172.21.15.29:0/1310860194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e18003a60 0x7f0e2c0af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 >> 172.21.15.29:0/1310860194 conn(0x7f0e2c06c0b0 msgr2=0x7f0e2c0c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 shutdown_connections 2023-10-06T05:25:33.947 INFO:teuthology.misc.health.smithi029.stderr:2023-10-06T05:25:33.941+0000 7f0e2b59e700 1 -- 172.21.15.29:0/1310860194 wait complete. 2023-10-06T05:25:33.957 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T05:25:33.957 INFO:tasks.ceph:Creating RBD pool 2023-10-06T05:25:33.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T05:25:34.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f2265cc2700 1 Processor -- start 2023-10-06T05:25:34.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f2265cc2700 1 -- start start 2023-10-06T05:25:34.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f2265cc2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f22600c8b80 0x7f22600cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f2265cc2700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2260155da0 0x7f22600cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f2265cc2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22601596e0 con 0x7f22601559d0 2023-10-06T05:25:34.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f2265cc2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226015a520 con 0x7f22600c8b80 2023-10-06T05:25:34.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f2265cc2700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22600ae800 con 0x7f2260155da0 2023-10-06T05:25:34.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f225ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f22600c8b80 0x7f22600cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f2264cc0700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f22601559d0 0x7f22600c8470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52600/0 (socket says 172.21.15.29:52600) 2023-10-06T05:25:34.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f225ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f22600c8b80 0x7f22600cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47894/0 (socket says 172.21.15.29:47894) 2023-10-06T05:25:34.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f2264cc0700 1 -- 172.21.15.29:0/944935221 learned_addr learned my addr 172.21.15.29:0/944935221 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:34.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f22654c1700 1 --2- 172.21.15.29:0/944935221 >> v2:172.21.15.173:3300/0 conn(0x7f2260155da0 0x7f22600cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f225ffff700 1 -- 172.21.15.29:0/944935221 >> v2:172.21.15.173:3300/0 conn(0x7f2260155da0 msgr2=0x7f22600cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:34.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f225ffff700 1 --2- 172.21.15.29:0/944935221 >> v2:172.21.15.173:3300/0 conn(0x7f2260155da0 0x7f22600cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f225ffff700 1 -- 172.21.15.29:0/944935221 >> v1:172.21.15.29:6789/0 conn(0x7f22601559d0 legacy=0x7f22600c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f225f7fe700 1 -- 172.21.15.29:0/944935221 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953133284 0 0) 0x7f22601596e0 con 0x7f22601559d0 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.061+0000 7f225ffff700 1 -- 172.21.15.29:0/944935221 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2260159910 con 0x7f22600c8b80 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f225ffff700 1 --2- 172.21.15.29:0/944935221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22600c8b80 0x7f22600cae80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22600c6e10 tx=0x7f22480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceb8101df19bd15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f225f7fe700 1 -- 172.21.15.29:0/944935221 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248011630 con 0x7f22600c8b80 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f225f7fe700 1 -- 172.21.15.29:0/944935221 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2248011790 con 0x7f22600c8b80 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f225f7fe700 1 -- 172.21.15.29:0/944935221 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248011b30 con 0x7f22600c8b80 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 -- 172.21.15.29:0/944935221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22600c8b80 msgr2=0x7f22600cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 --2- 172.21.15.29:0/944935221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22600c8b80 0x7f22600cae80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22600c6e10 tx=0x7f22480091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 -- 172.21.15.29:0/944935221 shutdown_connections 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 --2- 172.21.15.29:0/944935221 >> v2:172.21.15.173:3300/0 conn(0x7f2260155da0 0x7f22600cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 --2- 172.21.15.29:0/944935221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22600c8b80 0x7f22600cae80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 -- 172.21.15.29:0/944935221 >> 172.21.15.29:0/944935221 conn(0x7f226006c6c0 msgr2=0x7f226006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:34.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 -- 172.21.15.29:0/944935221 shutdown_connections 2023-10-06T05:25:34.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 -- 172.21.15.29:0/944935221 wait complete. 2023-10-06T05:25:34.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 Processor -- start 2023-10-06T05:25:34.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.065+0000 7f2265cc2700 1 -- start start 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2265cc2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22601559d0 0x7f2260158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2265cc2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2260155da0 0x7f22600b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2265cc2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f226013e880 0x7f2260156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2264cc0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22601559d0 0x7f2260158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2265cc2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2260158ff0 con 0x7f22601559d0 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2265cc2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226013f920 con 0x7f226013e880 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2264cc0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22601559d0 0x7f2260158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47904/0 (socket says 172.21.15.29:47904) 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2265cc2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226013ed10 con 0x7f2260155da0 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2264cc0700 1 -- 172.21.15.29:0/924969429 learned_addr learned my addr 172.21.15.29:0/924969429 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:34.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f225ffff700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2260155da0 0x7f22600b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f22654c1700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f226013e880 0x7f2260156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2264cc0700 1 -- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2260155da0 msgr2=0x7f22600b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2264cc0700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2260155da0 0x7f22600b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2264cc0700 1 -- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f226013e880 msgr2=0x7f2260156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2264cc0700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f226013e880 0x7f2260156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2264cc0700 1 -- 172.21.15.29:0/924969429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248009420 con 0x7f22601559d0 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f22654c1700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f226013e880 0x7f2260156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2264cc0700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22601559d0 0x7f2260158ab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f225000c810 tx=0x7f2250007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f225cff9700 1 -- 172.21.15.29:0/924969429 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250005c00 con 0x7f22601559d0 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f225cff9700 1 -- 172.21.15.29:0/924969429 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2250005d60 con 0x7f22601559d0 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226013eff0 con 0x7f22601559d0 2023-10-06T05:25:34.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f225cff9700 1 -- 172.21.15.29:0/924969429 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250007320 con 0x7f22601559d0 2023-10-06T05:25:34.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.069+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226013f5b0 con 0x7f22601559d0 2023-10-06T05:25:34.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.073+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226004be00 con 0x7f22601559d0 2023-10-06T05:25:34.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.073+0000 7f225cff9700 1 -- 172.21.15.29:0/924969429 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f225001b3b0 con 0x7f22601559d0 2023-10-06T05:25:34.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.073+0000 7f225cff9700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2240060550 0x7f2240062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.073+0000 7f225cff9700 1 -- 172.21.15.29:0/924969429 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f225007b920 con 0x7f22601559d0 2023-10-06T05:25:34.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.073+0000 7f225ffff700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2240060550 0x7f2240062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.073+0000 7f225ffff700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2240060550 0x7f2240062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22600c8f80 tx=0x7f2248017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:34.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.081+0000 7f225cff9700 1 -- 172.21.15.29:0/924969429 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f225004c260 con 0x7f22601559d0 2023-10-06T05:25:34.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.245+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f2260159bf0 con 0x7f22601559d0 2023-10-06T05:25:34.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.477+0000 7f225cff9700 1 -- 172.21.15.29:0/924969429 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f225004f880 con 0x7f22601559d0 2023-10-06T05:25:34.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2240060550 msgr2=0x7f2240062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2240060550 0x7f2240062a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22600c8f80 tx=0x7f2248017000 comp rx=0 tx=0).stop 2023-10-06T05:25:34.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22601559d0 msgr2=0x7f2260158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22601559d0 0x7f2260158ab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f225000c810 tx=0x7f2250007dd0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 shutdown_connections 2023-10-06T05:25:34.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2240060550 0x7f2240062a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f226013e880 0x7f2260156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2260155da0 0x7f22600b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 --2- 172.21.15.29:0/924969429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22601559d0 0x7f2260158ab0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 >> 172.21.15.29:0/924969429 conn(0x7f226006c6c0 msgr2=0x7f22600670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 shutdown_connections 2023-10-06T05:25:34.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.485+0000 7f2265cc2700 1 -- 172.21.15.29:0/924969429 wait complete. 2023-10-06T05:25:34.491 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'rbd' created 2023-10-06T05:25:34.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T05:25:34.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b3fff700 1 Processor -- start 2023-10-06T05:25:34.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b3fff700 1 -- start start 2023-10-06T05:25:34.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b3fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f31b4158c40 0x7f31b40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 0x7f31b40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b3fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b40cecc0 con 0x7f31b4159010 2023-10-06T05:25:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b3fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b40cae30 con 0x7f31b4158c40 2023-10-06T05:25:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b3fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b406ba70 con 0x7f31b40ce320 2023-10-06T05:25:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b27fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f31b4159010 0x7f31b406aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33596/0 (socket says 172.21.15.29:33596) 2023-10-06T05:25:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b27fc700 1 -- 172.21.15.29:0/612070855 learned_addr learned my addr 172.21.15.29:0/612070855 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b37fe700 1 --2- 172.21.15.29:0/612070855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 0x7f31b40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b2ffd700 1 --2- 172.21.15.29:0/612070855 >> v2:172.21.15.173:3300/0 conn(0x7f31b4158c40 0x7f31b40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b1ffb700 1 -- 172.21.15.29:0/612070855 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122594724 0 0) 0x7f31a4001110 con 0x7f31b4159010 2023-10-06T05:25:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b1ffb700 1 -- 172.21.15.29:0/612070855 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f319c003570 con 0x7f31b4159010 2023-10-06T05:25:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b2ffd700 1 -- 172.21.15.29:0/612070855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 msgr2=0x7f31b40ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b2ffd700 1 --2- 172.21.15.29:0/612070855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 0x7f31b40ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b2ffd700 1 -- 172.21.15.29:0/612070855 >> v1:172.21.15.29:6789/0 conn(0x7f31b4159010 legacy=0x7f31b406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b2ffd700 1 -- 172.21.15.29:0/612070855 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b406b4b0 con 0x7f31b4158c40 2023-10-06T05:25:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b2ffd700 1 --2- 172.21.15.29:0/612070855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4158c40 0x7f31b40d0570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31a80098e0 tx=0x7f31a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=172845c34d578e6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b1ffb700 1 -- 172.21.15.29:0/612070855 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011630 con 0x7f31b4158c40 2023-10-06T05:25:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b1ffb700 1 -- 172.21.15.29:0/612070855 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8011790 con 0x7f31b4158c40 2023-10-06T05:25:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.613+0000 7f31b1ffb700 1 -- 172.21.15.29:0/612070855 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011b10 con 0x7f31b4158c40 2023-10-06T05:25:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.617+0000 7f31b3fff700 1 -- 172.21.15.29:0/612070855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4158c40 msgr2=0x7f31b40d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.617+0000 7f31b3fff700 1 --2- 172.21.15.29:0/612070855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4158c40 0x7f31b40d0570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31a80098e0 tx=0x7f31a80091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.617+0000 7f31b3fff700 1 -- 172.21.15.29:0/612070855 shutdown_connections 2023-10-06T05:25:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.617+0000 7f31b3fff700 1 --2- 172.21.15.29:0/612070855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 0x7f31b40ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.617+0000 7f31b3fff700 1 --2- 172.21.15.29:0/612070855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4158c40 0x7f31b40d0570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.617+0000 7f31b3fff700 1 -- 172.21.15.29:0/612070855 >> 172.21.15.29:0/612070855 conn(0x7f31b40670a0 msgr2=0x7f31b40674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:34.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.617+0000 7f31b3fff700 1 -- 172.21.15.29:0/612070855 shutdown_connections 2023-10-06T05:25:34.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.617+0000 7f31b3fff700 1 -- 172.21.15.29:0/612070855 wait complete. 2023-10-06T05:25:34.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b3fff700 1 Processor -- start 2023-10-06T05:25:34.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b3fff700 1 -- start start 2023-10-06T05:25:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 0x7f31b40c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31b4158c40 0x7f31b416d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4159010 0x7f31b4150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b416dbb0 con 0x7f31b4158c40 2023-10-06T05:25:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b3fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4150f50 con 0x7f31b4159010 2023-10-06T05:25:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b3fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40c8c60 con 0x7f31b40ce320 2023-10-06T05:25:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b2ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 0x7f31b40c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b2ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 0x7f31b40c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52252/0 (socket says 172.21.15.29:52252) 2023-10-06T05:25:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b2ffd700 1 -- 172.21.15.29:0/2558043929 learned_addr learned my addr 172.21.15.29:0/2558043929 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b27fc700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31b4158c40 0x7f31b416d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b37fe700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4159010 0x7f31b4150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b37fe700 1 -- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 msgr2=0x7f31b40c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b37fe700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 0x7f31b40c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b37fe700 1 -- 172.21.15.29:0/2558043929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31b4158c40 msgr2=0x7f31b416d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b37fe700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31b4158c40 0x7f31b416d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b37fe700 1 -- 172.21.15.29:0/2558043929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8009420 con 0x7f31b4159010 2023-10-06T05:25:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.621+0000 7f31b37fe700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4159010 0x7f31b4150a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009e50 tx=0x7f31ac00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.625+0000 7f319affd700 1 -- 172.21.15.29:0/2558043929 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00caa0 con 0x7f31b4159010 2023-10-06T05:25:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.625+0000 7f319affd700 1 -- 172.21.15.29:0/2558043929 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac00f040 con 0x7f31b4159010 2023-10-06T05:25:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.625+0000 7f319affd700 1 -- 172.21.15.29:0/2558043929 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00ce50 con 0x7f31b4159010 2023-10-06T05:25:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.625+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b40c8f40 con 0x7f31b4159010 2023-10-06T05:25:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.625+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b40c70f0 con 0x7f31b4159010 2023-10-06T05:25:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.625+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b404be00 con 0x7f31b4159010 2023-10-06T05:25:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.629+0000 7f319affd700 1 -- 172.21.15.29:0/2558043929 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f31ac014690 con 0x7f31b4159010 2023-10-06T05:25:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.629+0000 7f319affd700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a0060600 0x7f31a0062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.629+0000 7f319affd700 1 -- 172.21.15.29:0/2558043929 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f31ac07d1a0 con 0x7f31b4159010 2023-10-06T05:25:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.629+0000 7f31b2ffd700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a0060600 0x7f31a0062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.629+0000 7f31b2ffd700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a0060600 0x7f31a0062ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f31a8011760 tx=0x7f31a8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:34.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.637+0000 7f319affd700 1 -- 172.21.15.29:0/2558043929 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f31ac051380 con 0x7f31b4159010 2023-10-06T05:25:34.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:34.805+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f31b406b790 con 0x7f31b4159010 2023-10-06T05:25:35.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.485+0000 7f319affd700 1 -- 172.21.15.29:0/2558043929 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f31ac050f10 con 0x7f31b4159010 2023-10-06T05:25:35.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a0060600 msgr2=0x7f31a0062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a0060600 0x7f31a0062ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f31a8011760 tx=0x7f31a8017000 comp rx=0 tx=0).stop 2023-10-06T05:25:35.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4159010 msgr2=0x7f31b4150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4159010 0x7f31b4150a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009e50 tx=0x7f31ac00b040 comp rx=0 tx=0).stop 2023-10-06T05:25:35.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 shutdown_connections 2023-10-06T05:25:35.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a0060600 0x7f31a0062ab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31b4159010 0x7f31b4150a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31b4158c40 0x7f31b416d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 --2- 172.21.15.29:0/2558043929 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31b40ce320 0x7f31b40c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 >> 172.21.15.29:0/2558043929 conn(0x7f31b40670a0 msgr2=0x7f31b40cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:35.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 shutdown_connections 2023-10-06T05:25:35.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.489+0000 7f31b3fff700 1 -- 172.21.15.29:0/2558043929 wait complete. 2023-10-06T05:25:35.498 INFO:teuthology.orchestra.run.smithi029.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T05:25:35.509 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T05:25:35.510 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T05:25:35.510 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T05:25:35.513 INFO:tasks.ceph.mds.a:Started 2023-10-06T05:25:35.514 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T05:25:35.514 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T05:25:35.517 INFO:tasks.ceph.mds.c:Started 2023-10-06T05:25:35.518 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T05:25:35.518 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T05:25:35.523 INFO:tasks.ceph.mds.b:Started 2023-10-06T05:25:35.523 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T05:25:35.523 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T05:25:35.526 INFO:tasks.ceph.mds.d:Started 2023-10-06T05:25:35.526 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T05:25:35.527 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:35.583 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-06T05:25:35.595 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-10-06T05:25:35.595 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-10-06T05:25:35.605 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:25:35.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382f59e700 1 Processor -- start 2023-10-06T05:25:35.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382f59e700 1 -- start start 2023-10-06T05:25:35.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3830156fa0 0x7f383006b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38301566c0 con 0x7f3830156b50 2023-10-06T05:25:35.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382f59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38301599c0 con 0x7f38301556a0 2023-10-06T05:25:35.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38300c7b40 con 0x7f3830156fa0 2023-10-06T05:25:35.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382dd9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3830156b50 0x7f38300c6ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33606/0 (socket says 172.21.15.29:33606) 2023-10-06T05:25:35.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382dd9b700 1 -- 172.21.15.29:0/2908288131 learned_addr learned my addr 172.21.15.29:0/2908288131 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:35.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382ed9d700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3830156fa0 0x7f383006b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65858360 0 0) 0x7f38301566c0 con 0x7f3830156b50 2023-10-06T05:25:35.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3818003570 con 0x7f3830156b50 2023-10-06T05:25:35.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3611469189 0 0) 0x7f3818003570 con 0x7f3830156b50 2023-10-06T05:25:35.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3830156fa0 msgr2=0x7f383006b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3830156fa0 0x7f383006b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 >> v1:172.21.15.173:6789/0 conn(0x7f38301556a0 legacy=0x7f3830155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300c7e20 con 0x7f3830156b50 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f3824001470 con 0x7f3830156b50 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 >> v1:172.21.15.29:6789/0 conn(0x7f3830156b50 legacy=0x7f38300c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3818003a90 0x7f3818003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3830156fa0 0x7f3818004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818004d50 0x7f38180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300c7b40 con 0x7f3818003a90 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381800bba0 con 0x7f3818004d50 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381800bd60 con 0x7f3830156fa0 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382e59c700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3818003a90 0x7f3818003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382dd9b700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3830156fa0 0x7f3818004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382ed9d700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818004d50 0x7f38180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382e59c700 1 -- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3830156fa0 msgr2=0x7f3818004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.641+0000 7f382e59c700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3830156fa0 0x7f3818004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382e59c700 1 -- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818004d50 msgr2=0x7f38180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382e59c700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818004d50 0x7f38180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382e59c700 1 -- 172.21.15.29:0/2908288131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818003570 con 0x7f3818003a90 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382ed9d700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818004d50 0x7f38180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382e59c700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3818003a90 0x7f3818003ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f38200018b0 tx=0x7f3820007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78947eded7dde2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200104d0 con 0x7f3818003a90 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820010650 con 0x7f3818003a90 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382d59a700 1 -- 172.21.15.29:0/2908288131 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820010800 con 0x7f3818003a90 2023-10-06T05:25:35.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 -- 172.21.15.29:0/2908288131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3818003a90 msgr2=0x7f3818003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 --2- 172.21.15.29:0/2908288131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3818003a90 0x7f3818003ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f38200018b0 tx=0x7f3820007d30 comp rx=0 tx=0).stop 2023-10-06T05:25:35.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382ed9d700 1 -- 172.21.15.29:0/2908288131 reap_dead start 2023-10-06T05:25:35.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 -- 172.21.15.29:0/2908288131 shutdown_connections 2023-10-06T05:25:35.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 -- 172.21.15.29:0/2908288131 >> 172.21.15.29:0/2908288131 conn(0x7f383006d7d0 msgr2=0x7f383006dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:35.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 -- 172.21.15.29:0/2908288131 shutdown_connections 2023-10-06T05:25:35.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 -- 172.21.15.29:0/2908288131 wait complete. 2023-10-06T05:25:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 Processor -- start 2023-10-06T05:25:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 -- start start 2023-10-06T05:25:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3818003a90 0x7f38300c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f383014f450 0x7f38300b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38301523d0 0x7f3830152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300c3090 con 0x7f383014f450 2023-10-06T05:25:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3830152d80 con 0x7f38301523d0 2023-10-06T05:25:35.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38300c2480 con 0x7f3818003a90 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f383014f450 0x7f38300b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f383014f450 0x7f38300b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55968/0 (socket says 172.21.15.29:55968) 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382dd9b700 1 -- 172.21.15.29:0/2772468580 learned_addr learned my addr 172.21.15.29:0/2772468580 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382ed9d700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38301523d0 0x7f3830152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382e59c700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3818003a90 0x7f38300c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382dd9b700 1 -- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3818003a90 msgr2=0x7f38300c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382dd9b700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3818003a90 0x7f38300c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382dd9b700 1 -- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38301523d0 msgr2=0x7f3830152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.645+0000 7f382dd9b700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38301523d0 0x7f3830152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f382dd9b700 1 -- 172.21.15.29:0/2772468580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300c2760 con 0x7f383014f450 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f382e59c700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3818003a90 0x7f38300c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:25:35.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f382dd9b700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f383014f450 0x7f38300b2000 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f382400ebc0 tx=0x7f3830156630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:35.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f381e7fc700 1 -- 172.21.15.29:0/2772468580 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400c660 con 0x7f383014f450 2023-10-06T05:25:35.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f381e7fc700 1 -- 172.21.15.29:0/2772468580 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382400c7c0 con 0x7f383014f450 2023-10-06T05:25:35.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f381e7fc700 1 -- 172.21.15.29:0/2772468580 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400cb60 con 0x7f383014f450 2023-10-06T05:25:35.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38300c2a40 con 0x7f383014f450 2023-10-06T05:25:35.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383014f8c0 con 0x7f383014f450 2023-10-06T05:25:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f381e7fc700 1 -- 172.21.15.29:0/2772468580 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f382401d460 con 0x7f383014f450 2023-10-06T05:25:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38300c3240 con 0x7f383014f450 2023-10-06T05:25:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f381e7fc700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3810060550 0x7f3810062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f381e7fc700 1 -- 172.21.15.29:0/2772468580 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f382407c520 con 0x7f383014f450 2023-10-06T05:25:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.649+0000 7f382e59c700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3810060550 0x7f3810062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.653+0000 7f382e59c700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3810060550 0x7f3810062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3820001690 tx=0x7f3820017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:35.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.661+0000 7f381e7fc700 1 -- 172.21.15.29:0/2772468580 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f38300c3240 con 0x7f383014f450 2023-10-06T05:25:35.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.825+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38300c3240 con 0x7f383014f450 2023-10-06T05:25:35.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.825+0000 7f381e7fc700 1 -- 172.21.15.29:0/2772468580 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13660 (secure 0 0 0) 0x7f38300c3240 con 0x7f383014f450 2023-10-06T05:25:35.830 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:35.830 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:35.474636+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:35.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3810060550 msgr2=0x7f3810062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3810060550 0x7f3810062a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3820001690 tx=0x7f3820017000 comp rx=0 tx=0).stop 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f383014f450 msgr2=0x7f38300b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f383014f450 0x7f38300b2000 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f382400ebc0 tx=0x7f3830156630 comp rx=0 tx=0).stop 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 shutdown_connections 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3810060550 0x7f3810062a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38301523d0 0x7f3830152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f383014f450 0x7f38300b2000 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 --2- 172.21.15.29:0/2772468580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3818003a90 0x7f38300c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 >> 172.21.15.29:0/2772468580 conn(0x7f383006d7d0 msgr2=0x7f3830159110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:35.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 shutdown_connections 2023-10-06T05:25:35.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.829+0000 7f382f59e700 1 -- 172.21.15.29:0/2772468580 wait complete. 2023-10-06T05:25:35.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T05:25:35.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:25:35.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d3fff700 1 Processor -- start 2023-10-06T05:25:35.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d3fff700 1 -- start start 2023-10-06T05:25:35.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d4155ac0 0x7fe0d40c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0d40cb8c0 0x7fe0d40c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d3fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d40c9f10 con 0x7fe0d40c9ab0 2023-10-06T05:25:35.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d3fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d40c8ce0 con 0x7fe0d40cb8c0 2023-10-06T05:25:35.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d3fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40c8060 con 0x7fe0d4155ac0 2023-10-06T05:25:35.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0d40cb8c0 0x7fe0d40c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0d40cb8c0 0x7fe0d40c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55984/0 (socket says 172.21.15.29:55984) 2023-10-06T05:25:35.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d27fc700 1 -- 172.21.15.29:0/3370034104 learned_addr learned my addr 172.21.15.29:0/3370034104 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:35.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d37fe700 1 --1- 172.21.15.29:0/3370034104 >> v1:172.21.15.173:6789/0 conn(0x7fe0d40c9ab0 0x7fe0d4159760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:60950/0 (socket says 172.21.15.29:60950) 2023-10-06T05:25:35.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.949+0000 7fe0d2ffd700 1 --2- 172.21.15.29:0/3370034104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d4155ac0 0x7fe0d40c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d1ffb700 1 -- 172.21.15.29:0/3370034104 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531894317 0 0) 0x7fe0cc001110 con 0x7fe0d40c9ab0 2023-10-06T05:25:35.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d1ffb700 1 -- 172.21.15.29:0/3370034104 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c0003570 con 0x7fe0d40c9ab0 2023-10-06T05:25:35.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d27fc700 1 -- 172.21.15.29:0/3370034104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d4155ac0 msgr2=0x7fe0d40c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:35.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d27fc700 1 --2- 172.21.15.29:0/3370034104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d4155ac0 0x7fe0d40c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d27fc700 1 -- 172.21.15.29:0/3370034104 >> v1:172.21.15.173:6789/0 conn(0x7fe0d40c9ab0 legacy=0x7fe0d4159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d27fc700 1 -- 172.21.15.29:0/3370034104 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d40c8340 con 0x7fe0d40cb8c0 2023-10-06T05:25:35.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d27fc700 1 --2- 172.21.15.29:0/3370034104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d40cb8c0 0x7fe0d40c9570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009f50 tx=0x7fe0c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54fcef61ffd7276 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:35.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d1ffb700 1 -- 172.21.15.29:0/3370034104 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400e070 con 0x7fe0d40cb8c0 2023-10-06T05:25:35.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d1ffb700 1 -- 172.21.15.29:0/3370034104 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c400b910 con 0x7fe0d40cb8c0 2023-10-06T05:25:35.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d1ffb700 1 -- 172.21.15.29:0/3370034104 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40092e0 con 0x7fe0d40cb8c0 2023-10-06T05:25:35.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 -- 172.21.15.29:0/3370034104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d40cb8c0 msgr2=0x7fe0d40c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 --2- 172.21.15.29:0/3370034104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d40cb8c0 0x7fe0d40c9570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009f50 tx=0x7fe0c4009840 comp rx=0 tx=0).stop 2023-10-06T05:25:35.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 -- 172.21.15.29:0/3370034104 shutdown_connections 2023-10-06T05:25:35.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 --2- 172.21.15.29:0/3370034104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d40cb8c0 0x7fe0d40c9570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 --2- 172.21.15.29:0/3370034104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d4155ac0 0x7fe0d40c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 -- 172.21.15.29:0/3370034104 >> 172.21.15.29:0/3370034104 conn(0x7fe0d406ba30 msgr2=0x7fe0d4095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:35.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 -- 172.21.15.29:0/3370034104 shutdown_connections 2023-10-06T05:25:35.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 -- 172.21.15.29:0/3370034104 wait complete. 2023-10-06T05:25:35.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 Processor -- start 2023-10-06T05:25:35.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.953+0000 7fe0d3fff700 1 -- start start 2023-10-06T05:25:35.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0d40c9ab0 0x7fe0d40b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d40cb8c0 0x7fe0d40ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d4155ac0 0x7fe0d40b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40b2740 con 0x7fe0d4155ac0 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d3fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d41477d0 con 0x7fe0d40c9ab0 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d3fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4147ab0 con 0x7fe0d40cb8c0 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d4155ac0 0x7fe0d40b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0d40c9ab0 0x7fe0d40b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d4155ac0 0x7fe0d40b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55988/0 (socket says 172.21.15.29:55988) 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d37fe700 1 -- 172.21.15.29:0/4240363814 learned_addr learned my addr 172.21.15.29:0/4240363814 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d27fc700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d40cb8c0 0x7fe0d40ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d37fe700 1 -- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d40cb8c0 msgr2=0x7fe0d40ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d37fe700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d40cb8c0 0x7fe0d40ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d37fe700 1 -- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0d40c9ab0 msgr2=0x7fe0d40b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d37fe700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0d40c9ab0 0x7fe0d40b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d37fe700 1 -- 172.21.15.29:0/4240363814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4009ae0 con 0x7fe0d4155ac0 2023-10-06T05:25:35.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d27fc700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d40cb8c0 0x7fe0d40ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:35.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d37fe700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d4155ac0 0x7fe0d40b0ac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c7c0 tx=0x7fe0cc007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:35.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0caffd700 1 -- 172.21.15.29:0/4240363814 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc005a70 con 0x7fe0d4155ac0 2023-10-06T05:25:35.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0caffd700 1 -- 172.21.15.29:0/4240363814 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc005bd0 con 0x7fe0d4155ac0 2023-10-06T05:25:35.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d4147d90 con 0x7fe0d4155ac0 2023-10-06T05:25:35.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0caffd700 1 -- 172.21.15.29:0/4240363814 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0070d0 con 0x7fe0d4155ac0 2023-10-06T05:25:35.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d40b2450 con 0x7fe0d4155ac0 2023-10-06T05:25:35.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.957+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d404be00 con 0x7fe0d4155ac0 2023-10-06T05:25:35.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.961+0000 7fe0caffd700 1 -- 172.21.15.29:0/4240363814 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe0cc007500 con 0x7fe0d4155ac0 2023-10-06T05:25:35.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.961+0000 7fe0caffd700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe0b4060550 0x7fe0b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:35.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.961+0000 7fe0caffd700 1 -- 172.21.15.29:0/4240363814 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe0cc07bcd0 con 0x7fe0d4155ac0 2023-10-06T05:25:35.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.961+0000 7fe0d2ffd700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe0b4060550 0x7fe0b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.961+0000 7fe0d2ffd700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe0b4060550 0x7fe0b4062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009d00 tx=0x7fe0bc009120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:35.969+0000 7fe0caffd700 1 -- 172.21.15.29:0/4240363814 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe0cc04c560 con 0x7fe0d4155ac0 2023-10-06T05:25:36.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.129+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0d40c9f10 con 0x7fe0d4155ac0 2023-10-06T05:25:36.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.129+0000 7fe0caffd700 1 -- 172.21.15.29:0/4240363814 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0d40c9f10 con 0x7fe0d4155ac0 2023-10-06T05:25:36.135 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:25:36.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe0b4060550 msgr2=0x7fe0b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe0b4060550 0x7fe0b4062a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009d00 tx=0x7fe0bc009120 comp rx=0 tx=0).stop 2023-10-06T05:25:36.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d4155ac0 msgr2=0x7fe0d40b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d4155ac0 0x7fe0d40b0ac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c7c0 tx=0x7fe0cc007c10 comp rx=0 tx=0).stop 2023-10-06T05:25:36.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 shutdown_connections 2023-10-06T05:25:36.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0d4155ac0 0x7fe0d40b0ac0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0d40cb8c0 0x7fe0d40ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe0b4060550 0x7fe0b4062a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 --2- 172.21.15.29:0/4240363814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0d40c9ab0 0x7fe0d40b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 >> 172.21.15.29:0/4240363814 conn(0x7fe0d406ba30 msgr2=0x7fe0d40681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:36.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 shutdown_connections 2023-10-06T05:25:36.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.133+0000 7fe0d3fff700 1 -- 172.21.15.29:0/4240363814 wait complete. 2023-10-06T05:25:36.149 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:25:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f500663f700 1 Processor -- start 2023-10-06T05:25:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f500663f700 1 -- start start 2023-10-06T05:25:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f500663f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f500006b1a0 0x7f500006b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f500663f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f50000ca1e0 0x7f50000c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f500663f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500006e040 con 0x7f50000cb430 2023-10-06T05:25:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f500663f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50000ca8e0 con 0x7f50000ca1e0 2023-10-06T05:25:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f500663f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500015d000 con 0x7f500006b1a0 2023-10-06T05:25:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f4fff7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f50000cb430 0x7f500015d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33622/0 (socket says 172.21.15.29:33622) 2023-10-06T05:25:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f4fff7fe700 1 -- 172.21.15.29:0/2698124890 learned_addr learned my addr 172.21.15.29:0/2698124890 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f5004bdc700 1 --2- 172.21.15.29:0/2698124890 >> v2:172.21.15.29:3300/0 conn(0x7f50000ca1e0 0x7f50000c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f4ffffff700 1 --2- 172.21.15.29:0/2698124890 >> v2:172.21.15.173:3300/0 conn(0x7f500006b1a0 0x7f500006b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f4ffeffd700 1 -- 172.21.15.29:0/2698124890 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808766204 0 0) 0x7f500006e040 con 0x7f50000cb430 2023-10-06T05:25:36.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f4ffeffd700 1 -- 172.21.15.29:0/2698124890 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe8003570 con 0x7f50000cb430 2023-10-06T05:25:36.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f5004bdc700 1 -- 172.21.15.29:0/2698124890 >> v2:172.21.15.173:3300/0 conn(0x7f500006b1a0 msgr2=0x7f500006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:36.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f5004bdc700 1 --2- 172.21.15.29:0/2698124890 >> v2:172.21.15.173:3300/0 conn(0x7f500006b1a0 0x7f500006b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f5004bdc700 1 -- 172.21.15.29:0/2698124890 >> v1:172.21.15.29:6789/0 conn(0x7f50000cb430 legacy=0x7f500015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.257+0000 7f5004bdc700 1 -- 172.21.15.29:0/2698124890 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50000ca640 con 0x7f50000ca1e0 2023-10-06T05:25:36.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f5004bdc700 1 --2- 172.21.15.29:0/2698124890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 0x7f50000c73f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f50000c3600 tx=0x7f4ff8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0593951e244444 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:36.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f4ffeffd700 1 -- 172.21.15.29:0/2698124890 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800e070 con 0x7f50000ca1e0 2023-10-06T05:25:36.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f4ffeffd700 1 -- 172.21.15.29:0/2698124890 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800bab0 con 0x7f50000ca1e0 2023-10-06T05:25:36.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f4ffeffd700 1 -- 172.21.15.29:0/2698124890 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800be70 con 0x7f50000ca1e0 2023-10-06T05:25:36.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 -- 172.21.15.29:0/2698124890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 msgr2=0x7f50000c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 --2- 172.21.15.29:0/2698124890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 0x7f50000c73f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f50000c3600 tx=0x7f4ff8009780 comp rx=0 tx=0).stop 2023-10-06T05:25:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 -- 172.21.15.29:0/2698124890 shutdown_connections 2023-10-06T05:25:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 --2- 172.21.15.29:0/2698124890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 0x7f50000c73f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 --2- 172.21.15.29:0/2698124890 >> v2:172.21.15.173:3300/0 conn(0x7f500006b1a0 0x7f500006b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 -- 172.21.15.29:0/2698124890 >> 172.21.15.29:0/2698124890 conn(0x7f50000cd0e0 msgr2=0x7f50000c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 -- 172.21.15.29:0/2698124890 shutdown_connections 2023-10-06T05:25:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 -- 172.21.15.29:0/2698124890 wait complete. 2023-10-06T05:25:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 Processor -- start 2023-10-06T05:25:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.261+0000 7f500663f700 1 -- start start 2023-10-06T05:25:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f500663f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f500006b1a0 0x7f50000b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f500663f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 0x7f5000156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f500663f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50000cb430 0x7f50000afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f500663f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c6020 con 0x7f50000ca1e0 2023-10-06T05:25:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f500663f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c5410 con 0x7f50000cb430 2023-10-06T05:25:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f500663f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c56f0 con 0x7f500006b1a0 2023-10-06T05:25:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 0x7f5000156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fff7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 0x7f5000156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56002/0 (socket says 172.21.15.29:56002) 2023-10-06T05:25:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fff7fe700 1 -- 172.21.15.29:0/3525544402 learned_addr learned my addr 172.21.15.29:0/3525544402 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4ffffff700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f500006b1a0 0x7f50000b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fff7fe700 1 -- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f500006b1a0 msgr2=0x7f50000b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f5004bdc700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50000cb430 0x7f50000afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fff7fe700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f500006b1a0 0x7f50000b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fff7fe700 1 -- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50000cb430 msgr2=0x7f50000afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fff7fe700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50000cb430 0x7f50000afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fff7fe700 1 -- 172.21.15.29:0/3525544402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8009a20 con 0x7f50000ca1e0 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4ffffff700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f500006b1a0 0x7f50000b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f5004bdc700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50000cb430 0x7f50000afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fff7fe700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 0x7f5000156090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c7c0 tx=0x7f4ff4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fe7fff700 1 -- 172.21.15.29:0/3525544402 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4005b30 con 0x7f50000ca1e0 2023-10-06T05:25:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fe7fff700 1 -- 172.21.15.29:0/3525544402 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4005c90 con 0x7f50000ca1e0 2023-10-06T05:25:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fe7fff700 1 -- 172.21.15.29:0/3525544402 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4007340 con 0x7f50000ca1e0 2023-10-06T05:25:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50000c59d0 con 0x7f50000ca1e0 2023-10-06T05:25:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50000aeae0 con 0x7f50000ca1e0 2023-10-06T05:25:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5000071120 con 0x7f50000ca1e0 2023-10-06T05:25:36.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.265+0000 7f4fe7fff700 1 -- 172.21.15.29:0/3525544402 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4ff401b400 con 0x7f50000ca1e0 2023-10-06T05:25:36.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.269+0000 7f4fe7fff700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4fec060550 0x7f4fec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.269+0000 7f4fe7fff700 1 -- 172.21.15.29:0/3525544402 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4ff407c0c0 con 0x7f50000ca1e0 2023-10-06T05:25:36.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.269+0000 7f4ffffff700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4fec060550 0x7f4fec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.269+0000 7f4ffffff700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4fec060550 0x7f4fec062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006f00 tx=0x7f4ff0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:36.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.273+0000 7f4fe7fff700 1 -- 172.21.15.29:0/3525544402 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4ff404c920 con 0x7f50000ca1e0 2023-10-06T05:25:36.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.437+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f50000c6160 con 0x7f50000ca1e0 2023-10-06T05:25:36.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.437+0000 7f4fe7fff700 1 -- 172.21.15.29:0/3525544402 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4ff404ff40 con 0x7f50000ca1e0 2023-10-06T05:25:36.443 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:25:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4fec060550 msgr2=0x7f4fec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4fec060550 0x7f4fec062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006f00 tx=0x7f4ff0008040 comp rx=0 tx=0).stop 2023-10-06T05:25:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 msgr2=0x7f5000156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 0x7f5000156090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c7c0 tx=0x7f4ff4007e00 comp rx=0 tx=0).stop 2023-10-06T05:25:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 shutdown_connections 2023-10-06T05:25:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4fec060550 0x7f4fec062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50000cb430 0x7f50000afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50000ca1e0 0x7f5000156090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 --2- 172.21.15.29:0/3525544402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f500006b1a0 0x7f50000b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 >> 172.21.15.29:0/3525544402 conn(0x7f50000cd0e0 msgr2=0x7f5000068660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 shutdown_connections 2023-10-06T05:25:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.441+0000 7f500663f700 1 -- 172.21.15.29:0/3525544402 wait complete. 2023-10-06T05:25:36.457 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:25:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc72ce9f700 1 Processor -- start 2023-10-06T05:25:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc72ce9f700 1 -- start start 2023-10-06T05:25:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc72ce9f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc7281569f0 0x7fc7280ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc72ce9f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc7280c68b0 0x7fc7280c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc72ce9f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72806a5b0 con 0x7fc728156dc0 2023-10-06T05:25:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc72ce9f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7280c7270 con 0x7fc7280c68b0 2023-10-06T05:25:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc72ce9f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72815b0a0 con 0x7fc7281569f0 2023-10-06T05:25:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc727fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc7280c68b0 0x7fc7280c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc727fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc7280c68b0 0x7fc7280c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56008/0 (socket says 172.21.15.29:56008) 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc727fff700 1 -- 172.21.15.29:0/1621058399 learned_addr learned my addr 172.21.15.29:0/1621058399 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc7277fe700 1 --2- 172.21.15.29:0/1621058399 >> v2:172.21.15.173:3300/0 conn(0x7fc7281569f0 0x7fc7280ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc727fff700 1 -- 172.21.15.29:0/1621058399 >> v2:172.21.15.173:3300/0 conn(0x7fc7281569f0 msgr2=0x7fc7280ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc727fff700 1 --2- 172.21.15.29:0/1621058399 >> v2:172.21.15.173:3300/0 conn(0x7fc7281569f0 0x7fc7280ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc7267fc700 1 -- 172.21.15.29:0/1621058399 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967696392 0 0) 0x7fc72806a5b0 con 0x7fc728156dc0 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc727fff700 1 -- 172.21.15.29:0/1621058399 >> v1:172.21.15.29:6789/0 conn(0x7fc728156dc0 legacy=0x7fc72815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc727fff700 1 -- 172.21.15.29:0/1621058399 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72815b380 con 0x7fc7280c68b0 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.557+0000 7fc7277fe700 1 --2- 172.21.15.29:0/1621058399 >> v2:172.21.15.173:3300/0 conn(0x7fc7281569f0 0x7fc7280ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:36.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc727fff700 1 --2- 172.21.15.29:0/1621058399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7280c68b0 0x7fc7280c6d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc72806a030 tx=0x7fc720009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581cd48539172012 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:36.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc7267fc700 1 -- 172.21.15.29:0/1621058399 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000b820 con 0x7fc7280c68b0 2023-10-06T05:25:36.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc7267fc700 1 -- 172.21.15.29:0/1621058399 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000b980 con 0x7fc7280c68b0 2023-10-06T05:25:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc7267fc700 1 -- 172.21.15.29:0/1621058399 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000bd20 con 0x7fc7280c68b0 2023-10-06T05:25:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 -- 172.21.15.29:0/1621058399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7280c68b0 msgr2=0x7fc7280c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 --2- 172.21.15.29:0/1621058399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7280c68b0 0x7fc7280c6d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc72806a030 tx=0x7fc720009250 comp rx=0 tx=0).stop 2023-10-06T05:25:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 -- 172.21.15.29:0/1621058399 shutdown_connections 2023-10-06T05:25:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 --2- 172.21.15.29:0/1621058399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7280c68b0 0x7fc7280c6d30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 --2- 172.21.15.29:0/1621058399 >> v2:172.21.15.173:3300/0 conn(0x7fc7281569f0 0x7fc7280ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 -- 172.21.15.29:0/1621058399 >> 172.21.15.29:0/1621058399 conn(0x7fc7280670a0 msgr2=0x7fc7280674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 -- 172.21.15.29:0/1621058399 shutdown_connections 2023-10-06T05:25:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 -- 172.21.15.29:0/1621058399 wait complete. 2023-10-06T05:25:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 Processor -- start 2023-10-06T05:25:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.561+0000 7fc72ce9f700 1 -- start start 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc72ce9f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7280c68b0 0x7fc7280c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc72ce9f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7281569f0 0x7fc72816c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc72ce9f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc728156dc0 0x7fc72816c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc72ce9f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc728157ce0 con 0x7fc728156dc0 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc72ce9f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281573f0 con 0x7fc7281569f0 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc72ce9f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72814acd0 con 0x7fc7280c68b0 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc727fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc728156dc0 0x7fc72816c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc727fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc728156dc0 0x7fc72816c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56014/0 (socket says 172.21.15.29:56014) 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc727fff700 1 -- 172.21.15.29:0/3353727760 learned_addr learned my addr 172.21.15.29:0/3353727760 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc7277fe700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7280c68b0 0x7fc7280c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc726ffd700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7281569f0 0x7fc72816c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc727fff700 1 -- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7280c68b0 msgr2=0x7fc7280c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc727fff700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7280c68b0 0x7fc7280c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc727fff700 1 -- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7281569f0 msgr2=0x7fc72816c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc727fff700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7281569f0 0x7fc72816c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc727fff700 1 -- 172.21.15.29:0/3353727760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7200094f0 con 0x7fc728156dc0 2023-10-06T05:25:36.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc7277fe700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7280c68b0 0x7fc7280c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:36.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc727fff700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc728156dc0 0x7fc72816c870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc7200090b0 tx=0x7fc720017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:36.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc71f7fe700 1 -- 172.21.15.29:0/3353727760 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000bcc0 con 0x7fc728156dc0 2023-10-06T05:25:36.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc71f7fe700 1 -- 172.21.15.29:0/3353727760 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72001f070 con 0x7fc728156dc0 2023-10-06T05:25:36.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc728157690 con 0x7fc728156dc0 2023-10-06T05:25:36.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc71f7fe700 1 -- 172.21.15.29:0/3353727760 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72001a850 con 0x7fc728156dc0 2023-10-06T05:25:36.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7280c4c00 con 0x7fc728156dc0 2023-10-06T05:25:36.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.565+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc728157b10 con 0x7fc728156dc0 2023-10-06T05:25:36.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.569+0000 7fc71f7fe700 1 -- 172.21.15.29:0/3353727760 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc72001abc0 con 0x7fc728156dc0 2023-10-06T05:25:36.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.569+0000 7fc71f7fe700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc708060550 0x7fc708062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.569+0000 7fc71f7fe700 1 -- 172.21.15.29:0/3353727760 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc720021070 con 0x7fc728156dc0 2023-10-06T05:25:36.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.569+0000 7fc7277fe700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc708060550 0x7fc708062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.569+0000 7fc7277fe700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc708060550 0x7fc708062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc718006f00 tx=0x7fc718008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.577+0000 7fc71f7fe700 1 -- 172.21.15.29:0/3353727760 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc72004ee00 con 0x7fc728156dc0 2023-10-06T05:25:36.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7280c4df0 con 0x7fc728156dc0 2023-10-06T05:25:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc71f7fe700 1 -- 172.21.15.29:0/3353727760 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7fc720015020 con 0x7fc728156dc0 2023-10-06T05:25:36.777 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:36.778 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/320155266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":320155266},{"type":"v1","addr":"172.21.15.29:6833","nonce":320155266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3562424943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3562424943},{"type":"v1","addr":"172.21.15.173:6836","nonce":3562424943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2321165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2321165769},{"type":"v1","addr":"172.21.15.173:6837","nonce":2321165769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4315,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3557282345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3557282345},{"type":"v1","addr":"172.21.15.29:6835","nonce":3557282345}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T05:25:36.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc708060550 msgr2=0x7fc708062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc708060550 0x7fc708062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc718006f00 tx=0x7fc718008040 comp rx=0 tx=0).stop 2023-10-06T05:25:36.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc728156dc0 msgr2=0x7fc72816c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc728156dc0 0x7fc72816c870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc7200090b0 tx=0x7fc720017000 comp rx=0 tx=0).stop 2023-10-06T05:25:36.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 shutdown_connections 2023-10-06T05:25:36.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc728156dc0 0x7fc72816c870 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc708060550 0x7fc708062a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7281569f0 0x7fc72816c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 --2- 172.21.15.29:0/3353727760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7280c68b0 0x7fc7280c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.773+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 >> 172.21.15.29:0/3353727760 conn(0x7fc7280670a0 msgr2=0x7fc7280abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:36.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.777+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 shutdown_connections 2023-10-06T05:25:36.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.777+0000 7fc72ce9f700 1 -- 172.21.15.29:0/3353727760 wait complete. 2023-10-06T05:25:36.783 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 3 2023-10-06T05:25:36.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92b4ea1700 1 Processor -- start 2023-10-06T05:25:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92b4ea1700 1 -- start start 2023-10-06T05:25:36.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92b4ea1700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92b0156c80 0x7f92b00b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92b4ea1700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b006a460 con 0x7f92b0157050 2023-10-06T05:25:36.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92b4ea1700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b00cc830 con 0x7f92b006e730 2023-10-06T05:25:36.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92b4ea1700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b015b800 con 0x7f92b0156c80 2023-10-06T05:25:36.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92add9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f92b0157050 0x7f92b015a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33632/0 (socket says 172.21.15.29:33632) 2023-10-06T05:25:36.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92add9b700 1 -- 172.21.15.29:0/2784183290 learned_addr learned my addr 172.21.15.29:0/2784183290 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:36.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ae59c700 1 --2- 172.21.15.29:0/2784183290 >> v2:172.21.15.173:3300/0 conn(0x7f92b0156c80 0x7f92b00b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132405113 0 0) 0x7f92b006a460 con 0x7f92b0157050 2023-10-06T05:25:36.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9298003570 con 0x7f92b0157050 2023-10-06T05:25:36.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3925496853 0 0) 0x7f9298003570 con 0x7f92b0157050 2023-10-06T05:25:36.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 >> v2:172.21.15.173:3300/0 conn(0x7f92b0156c80 msgr2=0x7f92b00b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 --2- 172.21.15.29:0/2784183290 >> v2:172.21.15.173:3300/0 conn(0x7f92b0156c80 0x7f92b00b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 >> v1:172.21.15.173:6789/0 conn(0x7f92b006e730 legacy=0x7f92b015b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00cb940 con 0x7f92b0157050 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f92a4001470 con 0x7f92b0157050 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 >> v1:172.21.15.29:6789/0 conn(0x7f92b0157050 legacy=0x7f92b015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f9298003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.897+0000 7f92ad59a700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9298004810 0x7f9298004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ad59a700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92980051c0 0x7f929800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b015b800 con 0x7f9298003a60 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929800c050 con 0x7f9298004810 2023-10-06T05:25:36.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929800c210 con 0x7f92980051c0 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ae59c700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f9298003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92add9b700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9298004810 0x7f9298004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92aed9d700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92980051c0 0x7f929800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ae59c700 1 -- 172.21.15.29:0/2784183290 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92980051c0 msgr2=0x7f929800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ae59c700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92980051c0 0x7f929800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ae59c700 1 -- 172.21.15.29:0/2784183290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9298004810 msgr2=0x7f9298004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ae59c700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9298004810 0x7f9298004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ae59c700 1 -- 172.21.15.29:0/2784183290 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298003570 con 0x7f9298003a60 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92aed9d700 1 -- 172.21.15.29:0/2784183290 reap_dead start 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ae59c700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f9298003e30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009c00 tx=0x7f92a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159cc185765798e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a000e710 con 0x7f9298003a60 2023-10-06T05:25:36.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a000e870 con 0x7f9298003a60 2023-10-06T05:25:36.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92ad59a700 1 -- 172.21.15.29:0/2784183290 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a000ec30 con 0x7f9298003a60 2023-10-06T05:25:36.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92b4ea1700 1 -- 172.21.15.29:0/2784183290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 msgr2=0x7f9298003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92b4ea1700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f9298003e30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009c00 tx=0x7f92a00091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92b4ea1700 1 -- 172.21.15.29:0/2784183290 shutdown_connections 2023-10-06T05:25:36.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92b4ea1700 1 --2- 172.21.15.29:0/2784183290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f9298003e30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92b4ea1700 1 -- 172.21.15.29:0/2784183290 >> 172.21.15.29:0/2784183290 conn(0x7f92b0067b70 msgr2=0x7f92b006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:36.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92b4ea1700 1 -- 172.21.15.29:0/2784183290 shutdown_connections 2023-10-06T05:25:36.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92b4ea1700 1 -- 172.21.15.29:0/2784183290 wait complete. 2023-10-06T05:25:36.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92b4ea1700 1 Processor -- start 2023-10-06T05:25:36.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.901+0000 7f92b4ea1700 1 -- start start 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92b4ea1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f92b01512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92b4ea1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b01517f0 0x7f92b014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92b4ea1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92b014fa50 0x7f92b01559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92b4ea1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00a88d0 con 0x7f9298003a60 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92b4ea1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00a9450 con 0x7f92b01517f0 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92b4ea1700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b014fea0 con 0x7f92b014fa50 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92ae59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f92b01512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92ae59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f92b01512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56042/0 (socket says 172.21.15.29:56042) 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92ae59c700 1 -- 172.21.15.29:0/1291153880 learned_addr learned my addr 172.21.15.29:0/1291153880 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:36.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92add9b700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b01517f0 0x7f92b014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92aed9d700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92b014fa50 0x7f92b01559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92ae59c700 1 -- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92b014fa50 msgr2=0x7f92b01559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92ae59c700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92b014fa50 0x7f92b01559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92ae59c700 1 -- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b01517f0 msgr2=0x7f92b014f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92ae59c700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b01517f0 0x7f92b014f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92ae59c700 1 -- 172.21.15.29:0/1291153880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00a8b20 con 0x7f9298003a60 2023-10-06T05:25:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92add9b700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b01517f0 0x7f92b014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92ae59c700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f92b01512b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f92a0013f20 tx=0x7f92a001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f929e7fc700 1 -- 172.21.15.29:0/1291153880 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0022070 con 0x7f9298003a60 2023-10-06T05:25:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f929e7fc700 1 -- 172.21.15.29:0/1291153880 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a000ebf0 con 0x7f9298003a60 2023-10-06T05:25:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b00a8e00 con 0x7f9298003a60 2023-10-06T05:25:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f929e7fc700 1 -- 172.21.15.29:0/1291153880 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a001c6c0 con 0x7f9298003a60 2023-10-06T05:25:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b0155f30 con 0x7f9298003a60 2023-10-06T05:25:36.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.905+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b004be00 con 0x7f9298003a60 2023-10-06T05:25:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.909+0000 7f929e7fc700 1 -- 172.21.15.29:0/1291153880 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f92a001cab0 con 0x7f9298003a60 2023-10-06T05:25:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.909+0000 7f929e7fc700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9290060620 0x7f9290062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:36.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.909+0000 7f929e7fc700 1 -- 172.21.15.29:0/1291153880 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f92a007e030 con 0x7f9298003a60 2023-10-06T05:25:36.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.909+0000 7f92add9b700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9290060620 0x7f9290062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:36.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.909+0000 7f92add9b700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9290060620 0x7f9290062ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92a4001120 tx=0x7f92a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:36.917+0000 7f929e7fc700 1 -- 172.21.15.29:0/1291153880 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f92a0052400 con 0x7f9298003a60 2023-10-06T05:25:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.081+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92b00a88d0 con 0x7f9298003a60 2023-10-06T05:25:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.081+0000 7f929e7fc700 1 -- 172.21.15.29:0/1291153880 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13647 (secure 0 0 0) 0x7f92a002b090 con 0x7f9298003a60 2023-10-06T05:25:37.086 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:37.086 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:36.489730+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9290060620 msgr2=0x7f9290062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9290060620 0x7f9290062ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92a4001120 tx=0x7f92a4009040 comp rx=0 tx=0).stop 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 msgr2=0x7f92b01512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f92b01512b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f92a0013f20 tx=0x7f92a001a000 comp rx=0 tx=0).stop 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 shutdown_connections 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92b014fa50 0x7f92b01559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9290060620 0x7f9290062ad0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b01517f0 0x7f92b014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 --2- 172.21.15.29:0/1291153880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9298003a60 0x7f92b01512b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 >> 172.21.15.29:0/1291153880 conn(0x7f92b0067b70 msgr2=0x7f92b0152760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 shutdown_connections 2023-10-06T05:25:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.085+0000 7f92b4ea1700 1 -- 172.21.15.29:0/1291153880 wait complete. 2023-10-06T05:25:37.101 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T05:25:37.102 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:25:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.205+0000 7f3097fff700 1 Processor -- start 2023-10-06T05:25:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.205+0000 7f3097fff700 1 -- start start 2023-10-06T05:25:37.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f3097fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3098155ac0 0x7f30980c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f3097fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30980cb8c0 0x7f30980c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f3097fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980c9ed0 con 0x7f30980c9ab0 2023-10-06T05:25:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f3097fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30980c8ce0 con 0x7f30980cb8c0 2023-10-06T05:25:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f3097fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30980c8060 con 0x7f3098155ac0 2023-10-06T05:25:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f308e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30980cb8c0 0x7f30980c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f308e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30980cb8c0 0x7f30980c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56044/0 (socket says 172.21.15.29:56044) 2023-10-06T05:25:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f308e7fc700 1 -- 172.21.15.29:0/3809616303 learned_addr learned my addr 172.21.15.29:0/3809616303 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f3096ffd700 1 --2- 172.21.15.29:0/3809616303 >> v2:172.21.15.173:3300/0 conn(0x7f3098155ac0 0x7f30980c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f308e7fc700 1 -- 172.21.15.29:0/3809616303 >> v2:172.21.15.173:3300/0 conn(0x7f3098155ac0 msgr2=0x7f30980c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:37.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f308e7fc700 1 --2- 172.21.15.29:0/3809616303 >> v2:172.21.15.173:3300/0 conn(0x7f3098155ac0 0x7f30980c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f308e7fc700 1 -- 172.21.15.29:0/3809616303 >> v1:172.21.15.173:6789/0 conn(0x7f30980c9ab0 legacy=0x7f3098159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f308e7fc700 1 -- 172.21.15.29:0/3809616303 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980c8340 con 0x7f30980cb8c0 2023-10-06T05:25:37.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f308e7fc700 1 --2- 172.21.15.29:0/3809616303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30980cb8c0 0x7f30980c9570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f309806af00 tx=0x7f3080009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed714e4f9dfa7ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:37.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f30967fc700 1 -- 172.21.15.29:0/3809616303 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080009e70 con 0x7f30980cb8c0 2023-10-06T05:25:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f30967fc700 1 -- 172.21.15.29:0/3809616303 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308000b860 con 0x7f30980cb8c0 2023-10-06T05:25:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.209+0000 7f30967fc700 1 -- 172.21.15.29:0/3809616303 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000bc00 con 0x7f30980cb8c0 2023-10-06T05:25:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.213+0000 7f3097fff700 1 -- 172.21.15.29:0/3809616303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30980cb8c0 msgr2=0x7f30980c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.213+0000 7f3097fff700 1 --2- 172.21.15.29:0/3809616303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30980cb8c0 0x7f30980c9570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f309806af00 tx=0x7f3080009250 comp rx=0 tx=0).stop 2023-10-06T05:25:37.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.213+0000 7f3097fff700 1 -- 172.21.15.29:0/3809616303 shutdown_connections 2023-10-06T05:25:37.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.213+0000 7f3097fff700 1 --2- 172.21.15.29:0/3809616303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30980cb8c0 0x7f30980c9570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.213+0000 7f3097fff700 1 --2- 172.21.15.29:0/3809616303 >> v2:172.21.15.173:3300/0 conn(0x7f3098155ac0 0x7f30980c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.213+0000 7f3097fff700 1 -- 172.21.15.29:0/3809616303 >> 172.21.15.29:0/3809616303 conn(0x7f309806ba30 msgr2=0x7f3098095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:37.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.213+0000 7f3097fff700 1 -- 172.21.15.29:0/3809616303 shutdown_connections 2023-10-06T05:25:37.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.213+0000 7f3097fff700 1 -- 172.21.15.29:0/3809616303 wait complete. 2023-10-06T05:25:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 Processor -- start 2023-10-06T05:25:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 -- start start 2023-10-06T05:25:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30980c9ab0 0x7f3098169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30980cb8c0 0x7f309814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3098155ac0 0x7f309816a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309814e770 con 0x7f3098155ac0 2023-10-06T05:25:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c52d0 con 0x7f30980cb8c0 2023-10-06T05:25:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309816a620 con 0x7f30980c9ab0 2023-10-06T05:25:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f30977fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3098155ac0 0x7f309816a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f30977fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3098155ac0 0x7f309816a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56058/0 (socket says 172.21.15.29:56058) 2023-10-06T05:25:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f30977fe700 1 -- 172.21.15.29:0/1671878459 learned_addr learned my addr 172.21.15.29:0/1671878459 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:37.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f308e7fc700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30980cb8c0 0x7f309814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3096ffd700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30980c9ab0 0x7f3098169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f30977fe700 1 -- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30980c9ab0 msgr2=0x7f3098169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f30977fe700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30980c9ab0 0x7f3098169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f30977fe700 1 -- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30980cb8c0 msgr2=0x7f309814e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f30977fe700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30980cb8c0 0x7f309814e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f30977fe700 1 -- 172.21.15.29:0/1671878459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800094f0 con 0x7f3098155ac0 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f30977fe700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3098155ac0 0x7f309816a0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f309000c8e0 tx=0x7f3090001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f308f7fe700 1 -- 172.21.15.29:0/1671878459 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090012630 con 0x7f3098155ac0 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f308f7fe700 1 -- 172.21.15.29:0/1671878459 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090012790 con 0x7f3098155ac0 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30980b0910 con 0x7f3098155ac0 2023-10-06T05:25:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f308f7fe700 1 -- 172.21.15.29:0/1671878459 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090012b50 con 0x7f3098155ac0 2023-10-06T05:25:37.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.217+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30980b0ed0 con 0x7f3098155ac0 2023-10-06T05:25:37.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.221+0000 7f308f7fe700 1 -- 172.21.15.29:0/1671878459 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f309001a3a0 con 0x7f3098155ac0 2023-10-06T05:25:37.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.221+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309804be00 con 0x7f3098155ac0 2023-10-06T05:25:37.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.221+0000 7f308f7fe700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3078060550 0x7f3078062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.221+0000 7f308f7fe700 1 -- 172.21.15.29:0/1671878459 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f309007c7f0 con 0x7f3098155ac0 2023-10-06T05:25:37.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.221+0000 7f3096ffd700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3078060550 0x7f3078062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.221+0000 7f3096ffd700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3078060550 0x7f3078062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f309815a330 tx=0x7f3088009120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:37.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.229+0000 7f308f7fe700 1 -- 172.21.15.29:0/1671878459 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f30900509c0 con 0x7f3098155ac0 2023-10-06T05:25:37.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.393+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30980c8620 con 0x7f3098155ac0 2023-10-06T05:25:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.393+0000 7f308f7fe700 1 -- 172.21.15.29:0/1671878459 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3090050550 con 0x7f3098155ac0 2023-10-06T05:25:37.399 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:25:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3078060550 msgr2=0x7f3078062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3078060550 0x7f3078062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f309815a330 tx=0x7f3088009120 comp rx=0 tx=0).stop 2023-10-06T05:25:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3098155ac0 msgr2=0x7f309816a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3098155ac0 0x7f309816a0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f309000c8e0 tx=0x7f3090001710 comp rx=0 tx=0).stop 2023-10-06T05:25:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 shutdown_connections 2023-10-06T05:25:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3098155ac0 0x7f309816a0e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3078060550 0x7f3078062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30980cb8c0 0x7f309814e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 --2- 172.21.15.29:0/1671878459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30980c9ab0 0x7f3098169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 >> 172.21.15.29:0/1671878459 conn(0x7f309806ba30 msgr2=0x7f30980675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:37.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 shutdown_connections 2023-10-06T05:25:37.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.397+0000 7f3097fff700 1 -- 172.21.15.29:0/1671878459 wait complete. 2023-10-06T05:25:37.413 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:25:37.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f00a54e8700 1 Processor -- start 2023-10-06T05:25:37.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f00a54e8700 1 -- start start 2023-10-06T05:25:37.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f00a54e8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a0155bf0 0x7f00a00c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f00a54e8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00a01566d0 0x7f00a00cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f00a54e8700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a00cc030 con 0x7f00a00cb6a0 2023-10-06T05:25:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f00a54e8700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a006c6c0 con 0x7f00a01566d0 2023-10-06T05:25:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f00a54e8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a0156c10 con 0x7f00a0155bf0 2023-10-06T05:25:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f009f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00a01566d0 0x7f00a00cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f009e7fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f00a00cb6a0 0x7f00a0155fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33648/0 (socket says 172.21.15.29:33648) 2023-10-06T05:25:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f009f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00a01566d0 0x7f00a00cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56072/0 (socket says 172.21.15.29:56072) 2023-10-06T05:25:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f009e7fc700 1 -- 172.21.15.29:0/1601140058 learned_addr learned my addr 172.21.15.29:0/1601140058 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.517+0000 7f009effd700 1 --2- 172.21.15.29:0/1601140058 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a0155bf0 0x7f00a00c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f009f7fe700 1 -- 172.21.15.29:0/1601140058 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a0155bf0 msgr2=0x7f00a00c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f009f7fe700 1 --2- 172.21.15.29:0/1601140058 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a0155bf0 0x7f00a00c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f009f7fe700 1 -- 172.21.15.29:0/1601140058 >> v1:172.21.15.29:6789/0 conn(0x7f00a00cb6a0 legacy=0x7f00a0155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f009f7fe700 1 -- 172.21.15.29:0/1601140058 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0156ef0 con 0x7f00a01566d0 2023-10-06T05:25:37.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f009dffb700 1 -- 172.21.15.29:0/1601140058 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419371416 0 0) 0x7f00a00cc030 con 0x7f00a00cb6a0 2023-10-06T05:25:37.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f009f7fe700 1 --2- 172.21.15.29:0/1601140058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a01566d0 0x7f00a00cbaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00900098e0 tx=0x7f00900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd76f2fd22bdcbe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:37.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f009dffb700 1 -- 172.21.15.29:0/1601140058 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000b640 con 0x7f00a01566d0 2023-10-06T05:25:37.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f009dffb700 1 -- 172.21.15.29:0/1601140058 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009000b7a0 con 0x7f00a01566d0 2023-10-06T05:25:37.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f009dffb700 1 -- 172.21.15.29:0/1601140058 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000bb40 con 0x7f00a01566d0 2023-10-06T05:25:37.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 -- 172.21.15.29:0/1601140058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a01566d0 msgr2=0x7f00a00cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 --2- 172.21.15.29:0/1601140058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a01566d0 0x7f00a00cbaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00900098e0 tx=0x7f00900091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 -- 172.21.15.29:0/1601140058 shutdown_connections 2023-10-06T05:25:37.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 --2- 172.21.15.29:0/1601140058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a01566d0 0x7f00a00cbaf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 --2- 172.21.15.29:0/1601140058 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a0155bf0 0x7f00a00c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 -- 172.21.15.29:0/1601140058 >> 172.21.15.29:0/1601140058 conn(0x7f00a00cd0e0 msgr2=0x7f00a00c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:37.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 -- 172.21.15.29:0/1601140058 shutdown_connections 2023-10-06T05:25:37.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 -- 172.21.15.29:0/1601140058 wait complete. 2023-10-06T05:25:37.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 Processor -- start 2023-10-06T05:25:37.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.521+0000 7f00a54e8700 1 -- start start 2023-10-06T05:25:37.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f00a54e8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a00cb6a0 0x7f00a00aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f00a54e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a0155bf0 0x7f00a014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f00a54e8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00a01566d0 0x7f00a0154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f00a54e8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00a9930 con 0x7f00a0155bf0 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f00a54e8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00ab460 con 0x7f00a01566d0 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f00a54e8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a014f820 con 0x7f00a00cb6a0 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a0155bf0 0x7f00a014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a0155bf0 0x7f00a014f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56078/0 (socket says 172.21.15.29:56078) 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009e7fc700 1 -- 172.21.15.29:0/3540897466 learned_addr learned my addr 172.21.15.29:0/3540897466 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009f7fe700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00a01566d0 0x7f00a0154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009effd700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a00cb6a0 0x7f00a00aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009e7fc700 1 -- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a00cb6a0 msgr2=0x7f00a00aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009e7fc700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a00cb6a0 0x7f00a00aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009e7fc700 1 -- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00a01566d0 msgr2=0x7f00a0154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009e7fc700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00a01566d0 0x7f00a0154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009e7fc700 1 -- 172.21.15.29:0/3540897466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0090009420 con 0x7f00a0155bf0 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009f7fe700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00a01566d0 0x7f00a0154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009effd700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a00cb6a0 0x7f00a00aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f009e7fc700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a0155bf0 0x7f00a014f2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f008800c7e0 tx=0x7f0088007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f0096ffd700 1 -- 172.21.15.29:0/3540897466 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088005b30 con 0x7f00a0155bf0 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f0096ffd700 1 -- 172.21.15.29:0/3540897466 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0088005c90 con 0x7f00a0155bf0 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a00aa380 con 0x7f00a0155bf0 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f0096ffd700 1 -- 172.21.15.29:0/3540897466 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088007300 con 0x7f00a0155bf0 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.525+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a00a9090 con 0x7f00a0155bf0 2023-10-06T05:25:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.529+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a0071120 con 0x7f00a0155bf0 2023-10-06T05:25:37.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.529+0000 7f0096ffd700 1 -- 172.21.15.29:0/3540897466 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f008801b3b0 con 0x7f00a0155bf0 2023-10-06T05:25:37.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.529+0000 7f0096ffd700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0080060550 0x7f0080062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.529+0000 7f0096ffd700 1 -- 172.21.15.29:0/3540897466 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f008807bf90 con 0x7f00a0155bf0 2023-10-06T05:25:37.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.529+0000 7f009effd700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0080060550 0x7f0080062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.533+0000 7f009effd700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0080060550 0x7f0080062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f009800e950 tx=0x7f009800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.533+0000 7f0096ffd700 1 -- 172.21.15.29:0/3540897466 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f008804c750 con 0x7f00a0155bf0 2023-10-06T05:25:37.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.697+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00a01571d0 con 0x7f00a0155bf0 2023-10-06T05:25:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.697+0000 7f0096ffd700 1 -- 172.21.15.29:0/3540897466 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0088017020 con 0x7f00a0155bf0 2023-10-06T05:25:37.702 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:25:37.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0080060550 msgr2=0x7f0080062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0080060550 0x7f0080062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f009800e950 tx=0x7f009800b040 comp rx=0 tx=0).stop 2023-10-06T05:25:37.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a0155bf0 msgr2=0x7f00a014f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a0155bf0 0x7f00a014f2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f008800c7e0 tx=0x7f0088007df0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 shutdown_connections 2023-10-06T05:25:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0080060550 0x7f0080062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f00a01566d0 0x7f00a0154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00a0155bf0 0x7f00a014f2e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 --2- 172.21.15.29:0/3540897466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00a00cb6a0 0x7f00a00aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 >> 172.21.15.29:0/3540897466 conn(0x7f00a00cd0e0 msgr2=0x7f00a0150090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 shutdown_connections 2023-10-06T05:25:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.701+0000 7f00a54e8700 1 -- 172.21.15.29:0/3540897466 wait complete. 2023-10-06T05:25:37.720 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T05:25:37.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d695f5700 1 Processor -- start 2023-10-06T05:25:37.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d695f5700 1 -- start start 2023-10-06T05:25:37.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d695f5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d640af5c0 0x7f0d640af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d695f5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0d6415cd80 0x7f0d6415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d695f5700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d641614c0 con 0x7f0d64161950 2023-10-06T05:25:37.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d695f5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d64160f40 con 0x7f0d640af5c0 2023-10-06T05:25:37.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d695f5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6406d420 con 0x7f0d6415cd80 2023-10-06T05:25:37.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d62ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d640af5c0 0x7f0d640af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d62ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d640af5c0 0x7f0d640af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56084/0 (socket says 172.21.15.29:56084) 2023-10-06T05:25:37.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d62ffd700 1 -- 172.21.15.29:0/2053794323 learned_addr learned my addr 172.21.15.29:0/2053794323 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:37.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d637fe700 1 --2- 172.21.15.29:0/2053794323 >> v2:172.21.15.173:3300/0 conn(0x7f0d6415cd80 0x7f0d6415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d62ffd700 1 -- 172.21.15.29:0/2053794323 >> v2:172.21.15.173:3300/0 conn(0x7f0d6415cd80 msgr2=0x7f0d6415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:37.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d62ffd700 1 --2- 172.21.15.29:0/2053794323 >> v2:172.21.15.173:3300/0 conn(0x7f0d6415cd80 0x7f0d6415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d62ffd700 1 -- 172.21.15.29:0/2053794323 >> v1:172.21.15.173:6789/0 conn(0x7f0d64161950 legacy=0x7f0d6406a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d62ffd700 1 -- 172.21.15.29:0/2053794323 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6406af20 con 0x7f0d640af5c0 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d62ffd700 1 --2- 172.21.15.29:0/2053794323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d640af5c0 0x7f0d640af990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d640b0ce0 tx=0x7f0d4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba0f3c31944417a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d61ffb700 1 -- 172.21.15.29:0/2053794323 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c009e70 con 0x7f0d640af5c0 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d61ffb700 1 -- 172.21.15.29:0/2053794323 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00b860 con 0x7f0d640af5c0 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d61ffb700 1 -- 172.21.15.29:0/2053794323 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00bc00 con 0x7f0d640af5c0 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d695f5700 1 -- 172.21.15.29:0/2053794323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d640af5c0 msgr2=0x7f0d640af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.821+0000 7f0d695f5700 1 --2- 172.21.15.29:0/2053794323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d640af5c0 0x7f0d640af990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d640b0ce0 tx=0x7f0d4c009250 comp rx=0 tx=0).stop 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 -- 172.21.15.29:0/2053794323 shutdown_connections 2023-10-06T05:25:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 --2- 172.21.15.29:0/2053794323 >> v2:172.21.15.173:3300/0 conn(0x7f0d6415cd80 0x7f0d6415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 --2- 172.21.15.29:0/2053794323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d640af5c0 0x7f0d640af990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 -- 172.21.15.29:0/2053794323 >> 172.21.15.29:0/2053794323 conn(0x7f0d64067b70 msgr2=0x7f0d6406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 -- 172.21.15.29:0/2053794323 shutdown_connections 2023-10-06T05:25:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 -- 172.21.15.29:0/2053794323 wait complete. 2023-10-06T05:25:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 Processor -- start 2023-10-06T05:25:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 -- start start 2023-10-06T05:25:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d640af5c0 0x7f0d6416e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d6415cd80 0x7f0d64158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d64161950 0x7f0d640a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640cb8a0 con 0x7f0d64161950 2023-10-06T05:25:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6416e6e0 con 0x7f0d640af5c0 2023-10-06T05:25:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d695f5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640cac60 con 0x7f0d6415cd80 2023-10-06T05:25:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d637fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d64161950 0x7f0d640a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d637fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d64161950 0x7f0d640a44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56100/0 (socket says 172.21.15.29:56100) 2023-10-06T05:25:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d637fe700 1 -- 172.21.15.29:0/1806219726 learned_addr learned my addr 172.21.15.29:0/1806219726 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d62ffd700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d640af5c0 0x7f0d6416e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d627fc700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d6415cd80 0x7f0d64158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d637fe700 1 -- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d6415cd80 msgr2=0x7f0d64158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d637fe700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d6415cd80 0x7f0d64158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d637fe700 1 -- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d640af5c0 msgr2=0x7f0d6416e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d637fe700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d640af5c0 0x7f0d6416e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d637fe700 1 -- 172.21.15.29:0/1806219726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c0094f0 con 0x7f0d64161950 2023-10-06T05:25:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d627fc700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d6415cd80 0x7f0d64158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d62ffd700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d640af5c0 0x7f0d6416e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:37.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.825+0000 7f0d637fe700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d64161950 0x7f0d640a44c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400ea80 tx=0x7f0d540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:37.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d5affd700 1 -- 172.21.15.29:0/1806219726 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400c920 con 0x7f0d64161950 2023-10-06T05:25:37.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d5affd700 1 -- 172.21.15.29:0/1806219726 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5400ca80 con 0x7f0d64161950 2023-10-06T05:25:37.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d5affd700 1 -- 172.21.15.29:0/1806219726 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400ce40 con 0x7f0d64161950 2023-10-06T05:25:37.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d64170e20 con 0x7f0d64161950 2023-10-06T05:25:37.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d640aad40 con 0x7f0d64161950 2023-10-06T05:25:37.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6404be00 con 0x7f0d64161950 2023-10-06T05:25:37.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d5affd700 1 -- 172.21.15.29:0/1806219726 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0d54013680 con 0x7f0d64161950 2023-10-06T05:25:37.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d5affd700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d44060550 0x7f0d44062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:37.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d5affd700 1 -- 172.21.15.29:0/1806219726 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0d5407c970 con 0x7f0d64161950 2023-10-06T05:25:37.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.829+0000 7f0d62ffd700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d44060550 0x7f0d44062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.833+0000 7f0d62ffd700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d44060550 0x7f0d44062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d640b0ce0 tx=0x7f0d4c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:37.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.837+0000 7f0d5affd700 1 -- 172.21.15.29:0/1806219726 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0d5404d0b0 con 0x7f0d64161950 2023-10-06T05:25:38.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.997+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0d6406b200 con 0x7f0d64161950 2023-10-06T05:25:38.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:37.997+0000 7f0d5affd700 1 -- 172.21.15.29:0/1806219726 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0d54017090 con 0x7f0d64161950 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 2, 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": "rbd" 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:25:38.004 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-06T05:25:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d44060550 msgr2=0x7f0d44062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d44060550 0x7f0d44062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d640b0ce0 tx=0x7f0d4c017000 comp rx=0 tx=0).stop 2023-10-06T05:25:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d64161950 msgr2=0x7f0d640a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d64161950 0x7f0d640a44c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400ea80 tx=0x7f0d540091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 shutdown_connections 2023-10-06T05:25:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d64161950 0x7f0d640a44c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d6415cd80 0x7f0d64158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d44060550 0x7f0d44062a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 --2- 172.21.15.29:0/1806219726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d640af5c0 0x7f0d6416e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 >> 172.21.15.29:0/1806219726 conn(0x7f0d64067b70 msgr2=0x7f0d641606b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:38.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 shutdown_connections 2023-10-06T05:25:38.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.001+0000 7f0d695f5700 1 -- 172.21.15.29:0/1806219726 wait complete. 2023-10-06T05:25:38.022 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T05:25:38.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T05:25:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.125+0000 7f4e00f70700 1 Processor -- start 2023-10-06T05:25:38.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.125+0000 7f4e00f70700 1 -- start start 2023-10-06T05:25:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4e00f70700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4dfc15d730 0x7f4dfc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4e00f70700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4e00f70700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc0cacd0 con 0x7f4dfc158f10 2023-10-06T05:25:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4e00f70700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc06a600 con 0x7f4dfc15d730 2023-10-06T05:25:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4e00f70700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc06d080 con 0x7f4dfc06cc00 2023-10-06T05:25:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfaffd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4dfc15d730 0x7f4dfc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52414/0 (socket says 172.21.15.29:52414) 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfaffd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4dfc15d730 0x7f4dfc06c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:50830/0 (socket says 172.21.15.29:50830) 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfbfff700 1 -- 172.21.15.29:0/2733073080 learned_addr learned my addr 172.21.15.29:0/2733073080 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfbfff700 1 -- 172.21.15.29:0/2733073080 >> v2:172.21.15.173:3300/0 conn(0x7f4dfc15d730 msgr2=0x7f4dfc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfbfff700 1 --2- 172.21.15.29:0/2733073080 >> v2:172.21.15.173:3300/0 conn(0x7f4dfc15d730 0x7f4dfc06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfbfff700 1 -- 172.21.15.29:0/2733073080 >> v1:172.21.15.173:6789/0 conn(0x7f4dfc158f10 legacy=0x7f4dfc0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfbfff700 1 -- 172.21.15.29:0/2733073080 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0cafb0 con 0x7f4dfc06cc00 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfaffd700 1 --2- 172.21.15.29:0/2733073080 >> v2:172.21.15.173:3300/0 conn(0x7f4dfc15d730 0x7f4dfc06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfbfff700 1 --2- 172.21.15.29:0/2733073080 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc06aa50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009f20 tx=0x7f4df4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=858cacb2970b97a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfa7fc700 1 -- 172.21.15.29:0/2733073080 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400e070 con 0x7f4dfc06cc00 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfa7fc700 1 -- 172.21.15.29:0/2733073080 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df400b9d0 con 0x7f4dfc06cc00 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4dfa7fc700 1 -- 172.21.15.29:0/2733073080 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40092e0 con 0x7f4dfc06cc00 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4e00f70700 1 -- 172.21.15.29:0/2733073080 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 msgr2=0x7f4dfc06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4e00f70700 1 --2- 172.21.15.29:0/2733073080 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc06aa50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009f20 tx=0x7f4df4009840 comp rx=0 tx=0).stop 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.129+0000 7f4e00f70700 1 -- 172.21.15.29:0/2733073080 shutdown_connections 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 --2- 172.21.15.29:0/2733073080 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc06aa50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 --2- 172.21.15.29:0/2733073080 >> v2:172.21.15.173:3300/0 conn(0x7f4dfc15d730 0x7f4dfc06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 -- 172.21.15.29:0/2733073080 >> 172.21.15.29:0/2733073080 conn(0x7f4dfc062b60 msgr2=0x7f4dfc062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 -- 172.21.15.29:0/2733073080 shutdown_connections 2023-10-06T05:25:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 -- 172.21.15.29:0/2733073080 wait complete. 2023-10-06T05:25:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 Processor -- start 2023-10-06T05:25:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 -- start start 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dfc158f10 0x7f4dfc1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15d730 0x7f4dfc0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0c8680 con 0x7f4dfc15d730 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc157140 con 0x7f4dfc158f10 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4e00f70700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0c83a0 con 0x7f4dfc06cc00 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4dfbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15d730 0x7f4dfc0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4dfbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15d730 0x7f4dfc0c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56104/0 (socket says 172.21.15.29:56104) 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4dfbfff700 1 -- 172.21.15.29:0/1324415337 learned_addr learned my addr 172.21.15.29:0/1324415337 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4dfaffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dfc158f10 0x7f4dfc1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.133+0000 7f4dfb7fe700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4dfbfff700 1 -- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 msgr2=0x7f4dfc156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4dfbfff700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4dfbfff700 1 -- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dfc158f10 msgr2=0x7f4dfc1575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4dfbfff700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dfc158f10 0x7f4dfc1575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4dfbfff700 1 -- 172.21.15.29:0/1324415337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec009420 con 0x7f4dfc15d730 2023-10-06T05:25:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4dfaffd700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dfc158f10 0x7f4dfc1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4dfbfff700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15d730 0x7f4dfc0c7920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4df400b610 tx=0x7f4df4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4de37fe700 1 -- 172.21.15.29:0/1324415337 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4008ad0 con 0x7f4dfc15d730 2023-10-06T05:25:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4de37fe700 1 -- 172.21.15.29:0/1324415337 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df4008c30 con 0x7f4dfc15d730 2023-10-06T05:25:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4de37fe700 1 -- 172.21.15.29:0/1324415337 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df401c410 con 0x7f4dfc15d730 2023-10-06T05:25:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df4009ae0 con 0x7f4dfc15d730 2023-10-06T05:25:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc156dd0 con 0x7f4dfc15d730 2023-10-06T05:25:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4de37fe700 1 -- 172.21.15.29:0/1324415337 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4df4003040 con 0x7f4dfc15d730 2023-10-06T05:25:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc157b10 con 0x7f4dfc15d730 2023-10-06T05:25:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4de37fe700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4de8060550 0x7f4de8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.137+0000 7f4de37fe700 1 -- 172.21.15.29:0/1324415337 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4df407e1b0 con 0x7f4dfc15d730 2023-10-06T05:25:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.141+0000 7f4dfb7fe700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4de8060550 0x7f4de8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.141+0000 7f4dfb7fe700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4de8060550 0x7f4de8062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4df00039e0 tx=0x7f4df0007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:38.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.145+0000 7f4de37fe700 1 -- 172.21.15.29:0/1324415337 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4df404e8f0 con 0x7f4dfc15d730 2023-10-06T05:25:38.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.305+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4dfc04be00 con 0x7f4dfc15d730 2023-10-06T05:25:38.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.609+0000 7f4de37fe700 1 -- 172.21.15.29:0/1324415337 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4df4051f10 con 0x7f4dfc15d730 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4de8060550 msgr2=0x7f4de8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4de8060550 0x7f4de8062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4df00039e0 tx=0x7f4df0007ec0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15d730 msgr2=0x7f4dfc0c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15d730 0x7f4dfc0c7920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4df400b610 tx=0x7f4df4018000 comp rx=0 tx=0).stop 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 shutdown_connections 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15d730 0x7f4dfc0c7920 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4de8060550 0x7f4de8062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4dfc158f10 0x7f4dfc1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 --2- 172.21.15.29:0/1324415337 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4dfc06cc00 0x7f4dfc156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 >> 172.21.15.29:0/1324415337 conn(0x7f4dfc062b60 msgr2=0x7f4dfc158330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:38.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 shutdown_connections 2023-10-06T05:25:38.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.613+0000 7f4e00f70700 1 -- 172.21.15.29:0/1324415337 wait complete. 2023-10-06T05:25:38.621 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-06T05:25:38.638 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T05:25:38.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1ff4c60700 1 Processor -- start 2023-10-06T05:25:38.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1ff4c60700 1 -- start start 2023-10-06T05:25:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1ff4c60700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ff0159200 0x7f1ff00c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1ff4c60700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1ff00c72f0 0x7f1ff00676f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1ff4c60700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff006bf90 con 0x7f1ff0158e30 2023-10-06T05:25:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1ff4c60700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff006b6f0 con 0x7f1ff0159200 2023-10-06T05:25:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1ff4c60700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff006b9d0 con 0x7f1ff00c72f0 2023-10-06T05:25:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1feeffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ff0159200 0x7f1ff00c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1feeffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ff0159200 0x7f1ff00c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56108/0 (socket says 172.21.15.29:56108) 2023-10-06T05:25:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1feeffd700 1 -- 172.21.15.29:0/3241520420 learned_addr learned my addr 172.21.15.29:0/3241520420 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1feffff700 1 --2- 172.21.15.29:0/3241520420 >> v2:172.21.15.173:3300/0 conn(0x7f1ff00c72f0 0x7f1ff00676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1feeffd700 1 -- 172.21.15.29:0/3241520420 >> v2:172.21.15.173:3300/0 conn(0x7f1ff00c72f0 msgr2=0x7f1ff00676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1feeffd700 1 --2- 172.21.15.29:0/3241520420 >> v2:172.21.15.173:3300/0 conn(0x7f1ff00c72f0 0x7f1ff00676f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1feeffd700 1 -- 172.21.15.29:0/3241520420 >> v1:172.21.15.29:6789/0 conn(0x7f1ff0158e30 legacy=0x7f1ff0068260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1feeffd700 1 -- 172.21.15.29:0/3241520420 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff006bcb0 con 0x7f1ff0159200 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1fee7fc700 1 -- 172.21.15.29:0/3241520420 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155309683 0 0) 0x7f1ff006bf90 con 0x7f1ff0158e30 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1feeffd700 1 --2- 172.21.15.29:0/3241520420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 0x7f1ff00c6db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00c6b80 tx=0x7f1fe4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8039d786aa046f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.753+0000 7f1fee7fc700 1 -- 172.21.15.29:0/3241520420 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400b860 con 0x7f1ff0159200 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1fee7fc700 1 -- 172.21.15.29:0/3241520420 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400b9c0 con 0x7f1ff0159200 2023-10-06T05:25:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1fee7fc700 1 -- 172.21.15.29:0/3241520420 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400bd60 con 0x7f1ff0159200 2023-10-06T05:25:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 -- 172.21.15.29:0/3241520420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 msgr2=0x7f1ff00c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 --2- 172.21.15.29:0/3241520420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 0x7f1ff00c6db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00c6b80 tx=0x7f1fe4009250 comp rx=0 tx=0).stop 2023-10-06T05:25:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 -- 172.21.15.29:0/3241520420 shutdown_connections 2023-10-06T05:25:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 --2- 172.21.15.29:0/3241520420 >> v2:172.21.15.173:3300/0 conn(0x7f1ff00c72f0 0x7f1ff00676f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 --2- 172.21.15.29:0/3241520420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 0x7f1ff00c6db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 -- 172.21.15.29:0/3241520420 >> 172.21.15.29:0/3241520420 conn(0x7f1ff00c9830 msgr2=0x7f1ff006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 -- 172.21.15.29:0/3241520420 shutdown_connections 2023-10-06T05:25:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 -- 172.21.15.29:0/3241520420 wait complete. 2023-10-06T05:25:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 Processor -- start 2023-10-06T05:25:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.757+0000 7f1ff4c60700 1 -- start start 2023-10-06T05:25:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1ff4c60700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ff00c72f0 0x7f1ff015c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1ff4c60700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ff0158e30 0x7f1ff0149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1ff4c60700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 0x7f1ff0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1ff4c60700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff006c6c0 con 0x7f1ff0159200 2023-10-06T05:25:38.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1ff4c60700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff015ce90 con 0x7f1ff0158e30 2023-10-06T05:25:38.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1ff4c60700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff0169f90 con 0x7f1ff00c72f0 2023-10-06T05:25:38.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 0x7f1ff0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 0x7f1ff0155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56112/0 (socket says 172.21.15.29:56112) 2023-10-06T05:25:38.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feffff700 1 -- 172.21.15.29:0/716095912 learned_addr learned my addr 172.21.15.29:0/716095912 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:38.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feeffd700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ff0158e30 0x7f1ff0149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1fef7fe700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ff00c72f0 0x7f1ff015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feffff700 1 -- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ff00c72f0 msgr2=0x7f1ff015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feffff700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ff00c72f0 0x7f1ff015c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feffff700 1 -- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ff0158e30 msgr2=0x7f1ff0149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feffff700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ff0158e30 0x7f1ff0149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feffff700 1 -- 172.21.15.29:0/716095912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40094f0 con 0x7f1ff0159200 2023-10-06T05:25:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1feffff700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 0x7f1ff0155de0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8007f20 tx=0x7f1fe8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1fd77fe700 1 -- 172.21.15.29:0/716095912 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800eb90 con 0x7f1ff0159200 2023-10-06T05:25:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1fd77fe700 1 -- 172.21.15.29:0/716095912 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe800ed10 con 0x7f1ff0159200 2023-10-06T05:25:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1fd77fe700 1 -- 172.21.15.29:0/716095912 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8014670 con 0x7f1ff0159200 2023-10-06T05:25:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff006c910 con 0x7f1ff0159200 2023-10-06T05:25:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff006ced0 con 0x7f1ff0159200 2023-10-06T05:25:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff006d0f0 con 0x7f1ff0159200 2023-10-06T05:25:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.761+0000 7f1fd77fe700 1 -- 172.21.15.29:0/716095912 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1fe80149e0 con 0x7f1ff0159200 2023-10-06T05:25:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.765+0000 7f1fd77fe700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1fdc060550 0x7f1fdc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.765+0000 7f1fd77fe700 1 -- 172.21.15.29:0/716095912 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f1fe807cd00 con 0x7f1ff0159200 2023-10-06T05:25:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.765+0000 7f1fef7fe700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1fdc060550 0x7f1fdc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:38.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.765+0000 7f1fef7fe700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1fdc060550 0x7f1fdc062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0007fd0 tx=0x7f1fe0007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:38.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.769+0000 7f1fd77fe700 1 -- 172.21.15.29:0/716095912 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1fe804d370 con 0x7f1ff0159200 2023-10-06T05:25:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:38.933+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1ff004be00 con 0x7f1ff0159200 2023-10-06T05:25:39.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.625+0000 7f1fd77fe700 1 -- 172.21.15.29:0/716095912 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1fe8050990 con 0x7f1ff0159200 2023-10-06T05:25:39.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1fdc060550 msgr2=0x7f1fdc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:39.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1fdc060550 0x7f1fdc062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0007fd0 tx=0x7f1fe0007d30 comp rx=0 tx=0).stop 2023-10-06T05:25:39.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 msgr2=0x7f1ff0155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:39.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 0x7f1ff0155de0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8007f20 tx=0x7f1fe8009860 comp rx=0 tx=0).stop 2023-10-06T05:25:39.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 shutdown_connections 2023-10-06T05:25:39.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff0159200 0x7f1ff0155de0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:39.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1fdc060550 0x7f1fdc062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:39.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ff0158e30 0x7f1ff0149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:39.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 --2- 172.21.15.29:0/716095912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ff00c72f0 0x7f1ff015c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:39.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 >> 172.21.15.29:0/716095912 conn(0x7f1ff00c9830 msgr2=0x7f1ff0157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:39.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 shutdown_connections 2023-10-06T05:25:39.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.649+0000 7f1ff4c60700 1 -- 172.21.15.29:0/716095912 wait complete. 2023-10-06T05:25:39.657 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-06T05:25:39.668 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T05:25:39.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d7c0d700 1 Processor -- start 2023-10-06T05:25:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d7c0d700 1 -- start start 2023-10-06T05:25:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d7c0d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f53d00ad720 0x7f53d0157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d7c0d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f53d00ccd20 0x7f53d00cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d7c0d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00af4c0 con 0x7f53d0067810 2023-10-06T05:25:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d7c0d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00ace70 con 0x7f53d00ccd20 2023-10-06T05:25:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d7c0d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d015ab70 con 0x7f53d00ad720 2023-10-06T05:25:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d61aa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f53d00ccd20 0x7f53d00cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d61aa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f53d00ccd20 0x7f53d00cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56120/0 (socket says 172.21.15.29:56120) 2023-10-06T05:25:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d61aa700 1 -- 172.21.15.29:0/2836217780 learned_addr learned my addr 172.21.15.29:0/2836217780 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d51a8700 1 --1- 172.21.15.29:0/2836217780 >> v1:172.21.15.29:6789/0 conn(0x7f53d0067810 0x7f53d00ac760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33664/0 (socket says 172.21.15.29:33664) 2023-10-06T05:25:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d59a9700 1 --2- 172.21.15.29:0/2836217780 >> v2:172.21.15.173:3300/0 conn(0x7f53d00ad720 0x7f53d0157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d61aa700 1 -- 172.21.15.29:0/2836217780 >> v2:172.21.15.173:3300/0 conn(0x7f53d00ad720 msgr2=0x7f53d0157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d61aa700 1 --2- 172.21.15.29:0/2836217780 >> v2:172.21.15.173:3300/0 conn(0x7f53d00ad720 0x7f53d0157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d61aa700 1 -- 172.21.15.29:0/2836217780 >> v1:172.21.15.29:6789/0 conn(0x7f53d0067810 legacy=0x7f53d00ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.769+0000 7f53d61aa700 1 -- 172.21.15.29:0/2836217780 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00cd680 con 0x7f53d00ccd20 2023-10-06T05:25:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d61aa700 1 --2- 172.21.15.29:0/2836217780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 0x7f53d00cd140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f53d00cccb0 tx=0x7f53c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c3afb4b97d80f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d49a7700 1 -- 172.21.15.29:0/2836217780 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c800e070 con 0x7f53d00ccd20 2023-10-06T05:25:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d49a7700 1 -- 172.21.15.29:0/2836217780 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c800ba20 con 0x7f53d00ccd20 2023-10-06T05:25:39.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d49a7700 1 -- 172.21.15.29:0/2836217780 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80092e0 con 0x7f53d00ccd20 2023-10-06T05:25:39.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 -- 172.21.15.29:0/2836217780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 msgr2=0x7f53d00cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:39.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 --2- 172.21.15.29:0/2836217780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 0x7f53d00cd140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f53d00cccb0 tx=0x7f53c8009840 comp rx=0 tx=0).stop 2023-10-06T05:25:39.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 -- 172.21.15.29:0/2836217780 shutdown_connections 2023-10-06T05:25:39.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 --2- 172.21.15.29:0/2836217780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 0x7f53d00cd140 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:39.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 --2- 172.21.15.29:0/2836217780 >> v2:172.21.15.173:3300/0 conn(0x7f53d00ad720 0x7f53d0157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:39.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 -- 172.21.15.29:0/2836217780 >> 172.21.15.29:0/2836217780 conn(0x7f53d006b820 msgr2=0x7f53d006bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:39.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 -- 172.21.15.29:0/2836217780 shutdown_connections 2023-10-06T05:25:39.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 -- 172.21.15.29:0/2836217780 wait complete. 2023-10-06T05:25:39.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 Processor -- start 2023-10-06T05:25:39.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.773+0000 7f53d7c0d700 1 -- start start 2023-10-06T05:25:39.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d7c0d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53d0067810 0x7f53d0168260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d7c0d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53d00ad720 0x7f53d0150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d7c0d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 0x7f53d01689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d7c0d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d01687a0 con 0x7f53d00ccd20 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d7c0d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00b0cb0 con 0x7f53d00ad720 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d7c0d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00b0f90 con 0x7f53d0067810 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d61aa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 0x7f53d01689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d61aa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 0x7f53d01689b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56136/0 (socket says 172.21.15.29:56136) 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d51a8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53d00ad720 0x7f53d0150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d61aa700 1 -- 172.21.15.29:0/441019925 learned_addr learned my addr 172.21.15.29:0/441019925 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:39.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d59a9700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53d0067810 0x7f53d0168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:39.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d61aa700 1 -- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53d0067810 msgr2=0x7f53d0168260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:39.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d61aa700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53d0067810 0x7f53d0168260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d61aa700 1 -- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53d00ad720 msgr2=0x7f53d0150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d61aa700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53d00ad720 0x7f53d0150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d61aa700 1 -- 172.21.15.29:0/441019925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8009ae0 con 0x7f53d00ccd20 2023-10-06T05:25:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d61aa700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 0x7f53d01689b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009880 tx=0x7f53c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53c5ffb700 1 -- 172.21.15.29:0/441019925 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80089b0 con 0x7f53d00ccd20 2023-10-06T05:25:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53c5ffb700 1 -- 172.21.15.29:0/441019925 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8008b30 con 0x7f53d00ccd20 2023-10-06T05:25:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d00b1270 con 0x7f53d00ccd20 2023-10-06T05:25:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53c5ffb700 1 -- 172.21.15.29:0/441019925 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8025460 con 0x7f53d00ccd20 2023-10-06T05:25:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.777+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00b1600 con 0x7f53d00ccd20 2023-10-06T05:25:39.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.781+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d0071120 con 0x7f53d00ccd20 2023-10-06T05:25:39.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.781+0000 7f53c5ffb700 1 -- 172.21.15.29:0/441019925 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f53c8003040 con 0x7f53d00ccd20 2023-10-06T05:25:39.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.781+0000 7f53c5ffb700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53b4060580 0x7f53b4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:39.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.781+0000 7f53c5ffb700 1 -- 172.21.15.29:0/441019925 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f53c807e330 con 0x7f53d00ccd20 2023-10-06T05:25:39.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.781+0000 7f53d59a9700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53b4060580 0x7f53b4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.781+0000 7f53d59a9700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53b4060580 0x7f53b4062a30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f53d00b29c0 tx=0x7f53cc0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:39.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.789+0000 7f53c5ffb700 1 -- 172.21.15.29:0/441019925 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f53c804e820 con 0x7f53d00ccd20 2023-10-06T05:25:39.868 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:25:39.870 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:25:39.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:39.981+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f53d0067cf0 con 0x7f53d00ccd20 2023-10-06T05:25:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.645+0000 7f53c5ffb700 1 -- 172.21.15.29:0/441019925 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f53c8009940 con 0x7f53d00ccd20 2023-10-06T05:25:40.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53b4060580 msgr2=0x7f53b4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:40.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53b4060580 0x7f53b4062a30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f53d00b29c0 tx=0x7f53cc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 msgr2=0x7f53d01689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:40.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 0x7f53d01689b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009880 tx=0x7f53c8018000 comp rx=0 tx=0).stop 2023-10-06T05:25:40.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 shutdown_connections 2023-10-06T05:25:40.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53d00ccd20 0x7f53d01689b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53b4060580 0x7f53b4062a30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53d00ad720 0x7f53d0150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 --2- 172.21.15.29:0/441019925 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53d0067810 0x7f53d0168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 >> 172.21.15.29:0/441019925 conn(0x7f53d006b820 msgr2=0x7f53d0159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:40.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 shutdown_connections 2023-10-06T05:25:40.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.665+0000 7f53d7c0d700 1 -- 172.21.15.29:0/441019925 wait complete. 2023-10-06T05:25:40.672 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T05:25:40.683 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:40.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.781+0000 7f088b59e700 1 Processor -- start 2023-10-06T05:25:40.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.781+0000 7f088b59e700 1 -- start start 2023-10-06T05:25:40.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f088c0c8b50 0x7f088c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:40.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f088c155cb0 0x7f088c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:40.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c06b9e0 con 0x7f088c06c8f0 2023-10-06T05:25:40.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c0cb7e0 con 0x7f088c155cb0 2023-10-06T05:25:40.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c0caf80 con 0x7f088c0c8b50 2023-10-06T05:25:40.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f088c155cb0 0x7f088c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f088c155cb0 0x7f088c06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56142/0 (socket says 172.21.15.29:56142) 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f0889d9b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f088c0c8b50 0x7f088c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088ad9d700 1 -- 172.21.15.29:0/1229549094 learned_addr learned my addr 172.21.15.29:0/1229549094 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088ad9d700 1 -- 172.21.15.29:0/1229549094 >> v2:172.21.15.173:3300/0 conn(0x7f088c0c8b50 msgr2=0x7f088c06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088ad9d700 1 --2- 172.21.15.29:0/1229549094 >> v2:172.21.15.173:3300/0 conn(0x7f088c0c8b50 0x7f088c06ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088ad9d700 1 -- 172.21.15.29:0/1229549094 >> v1:172.21.15.173:6789/0 conn(0x7f088c06c8f0 legacy=0x7f088c1555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088ad9d700 1 -- 172.21.15.29:0/1229549094 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c0c7660 con 0x7f088c155cb0 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088ad9d700 1 --2- 172.21.15.29:0/1229549094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c155cb0 0x7f088c06b4a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f088c0c7450 tx=0x7f0884009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f43465776738ab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088959a700 1 -- 172.21.15.29:0/1229549094 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088400e070 con 0x7f088c155cb0 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088959a700 1 -- 172.21.15.29:0/1229549094 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088400ba20 con 0x7f088c155cb0 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088959a700 1 -- 172.21.15.29:0/1229549094 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08840092e0 con 0x7f088c155cb0 2023-10-06T05:25:40.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 -- 172.21.15.29:0/1229549094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c155cb0 msgr2=0x7f088c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:40.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 --2- 172.21.15.29:0/1229549094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c155cb0 0x7f088c06b4a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f088c0c7450 tx=0x7f0884009840 comp rx=0 tx=0).stop 2023-10-06T05:25:40.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 -- 172.21.15.29:0/1229549094 shutdown_connections 2023-10-06T05:25:40.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 --2- 172.21.15.29:0/1229549094 >> v2:172.21.15.173:3300/0 conn(0x7f088c0c8b50 0x7f088c06ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 --2- 172.21.15.29:0/1229549094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c155cb0 0x7f088c06b4a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 -- 172.21.15.29:0/1229549094 >> 172.21.15.29:0/1229549094 conn(0x7f088c0670a0 msgr2=0x7f088c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:40.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 -- 172.21.15.29:0/1229549094 shutdown_connections 2023-10-06T05:25:40.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.785+0000 7f088b59e700 1 -- 172.21.15.29:0/1229549094 wait complete. 2023-10-06T05:25:40.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 Processor -- start 2023-10-06T05:25:40.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 -- start start 2023-10-06T05:25:40.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c06c8f0 0x7f088c1494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:40.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f088c155cb0 0x7f088c14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:40.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f088c149c40 0x7f088c14dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c14d890 con 0x7f088c06c8f0 2023-10-06T05:25:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c149a00 con 0x7f088c149c40 2023-10-06T05:25:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0aecc0 con 0x7f088c155cb0 2023-10-06T05:25:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c06c8f0 0x7f088c1494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c06c8f0 0x7f088c1494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56148/0 (socket says 172.21.15.29:56148) 2023-10-06T05:25:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088a59c700 1 -- 172.21.15.29:0/1606332139 learned_addr learned my addr 172.21.15.29:0/1606332139 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088ad9d700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f088c149c40 0x7f088c14dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f0889d9b700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f088c155cb0 0x7f088c14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088a59c700 1 -- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f088c155cb0 msgr2=0x7f088c14ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088a59c700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f088c155cb0 0x7f088c14ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088a59c700 1 -- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f088c149c40 msgr2=0x7f088c14dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088a59c700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f088c149c40 0x7f088c14dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088a59c700 1 -- 172.21.15.29:0/1606332139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884009ae0 con 0x7f088c06c8f0 2023-10-06T05:25:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088a59c700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c06c8f0 0x7f088c1494c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f087400c590 tx=0x7f087400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f08827fc700 1 -- 172.21.15.29:0/1606332139 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874011590 con 0x7f088c06c8f0 2023-10-06T05:25:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f08827fc700 1 -- 172.21.15.29:0/1606332139 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874011710 con 0x7f088c06c8f0 2023-10-06T05:25:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c0aefa0 con 0x7f088c06c8f0 2023-10-06T05:25:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f08827fc700 1 -- 172.21.15.29:0/1606332139 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874011ad0 con 0x7f088c06c8f0 2023-10-06T05:25:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.789+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c0af560 con 0x7f088c06c8f0 2023-10-06T05:25:40.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.793+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c04be00 con 0x7f088c06c8f0 2023-10-06T05:25:40.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.793+0000 7f08827fc700 1 -- 172.21.15.29:0/1606332139 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f087401b3b0 con 0x7f088c06c8f0 2023-10-06T05:25:40.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.793+0000 7f08827fc700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f086c060550 0x7f086c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:40.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.793+0000 7f08827fc700 1 -- 172.21.15.29:0/1606332139 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f087407bc70 con 0x7f088c06c8f0 2023-10-06T05:25:40.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.793+0000 7f0889d9b700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f086c060550 0x7f086c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:40.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.793+0000 7f0889d9b700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f086c060550 0x7f086c062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f088c0c4a50 tx=0x7f087c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:40.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.797+0000 7f08827fc700 1 -- 172.21.15.29:0/1606332139 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f087404c100 con 0x7f088c06c8f0 2023-10-06T05:25:40.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.961+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f088c06b9e0 con 0x7f088c06c8f0 2023-10-06T05:25:40.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f08827fc700 1 -- 172.21.15.29:0/1606332139 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f088c06b9e0 con 0x7f088c06c8f0 2023-10-06T05:25:40.969 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:40.969 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":23,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:39.985491+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:40.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f086c060550 msgr2=0x7f086c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:40.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f086c060550 0x7f086c062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f088c0c4a50 tx=0x7f087c008040 comp rx=0 tx=0).stop 2023-10-06T05:25:40.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c06c8f0 msgr2=0x7f088c1494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:40.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c06c8f0 0x7f088c1494c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f087400c590 tx=0x7f087400c8a0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 shutdown_connections 2023-10-06T05:25:40.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f086c060550 0x7f086c062a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f088c149c40 0x7f088c14dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f088c155cb0 0x7f088c14ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 --2- 172.21.15.29:0/1606332139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f088c06c8f0 0x7f088c1494c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:40.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 >> 172.21.15.29:0/1606332139 conn(0x7f088c0670a0 msgr2=0x7f088c1522f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:40.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 shutdown_connections 2023-10-06T05:25:40.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:40.965+0000 7f088b59e700 1 -- 172.21.15.29:0/1606332139 wait complete. 2023-10-06T05:25:40.984 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:41.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafb67fc700 1 Processor -- start 2023-10-06T05:25:41.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafb67fc700 1 -- start start 2023-10-06T05:25:41.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafb67fc700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fafb0158c00 0x7fafb006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafb67fc700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb006b250 con 0x7fafb00ce740 2023-10-06T05:25:41.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafb67fc700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb006a640 con 0x7fafb00cebc0 2023-10-06T05:25:41.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafb67fc700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb006a920 con 0x7fafb0158c00 2023-10-06T05:25:41.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafb4ff9700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fafb00ce740 0x7fafb00cfb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33678/0 (socket says 172.21.15.29:33678) 2023-10-06T05:25:41.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafb4ff9700 1 -- 172.21.15.29:0/672056629 learned_addr learned my addr 172.21.15.29:0/672056629 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:41.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafb57fa700 1 --2- 172.21.15.29:0/672056629 >> v2:172.21.15.173:3300/0 conn(0x7fafb0158c00 0x7fafb006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafa3fff700 1 -- 172.21.15.29:0/672056629 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494767974 0 0) 0x7fafb006b250 con 0x7fafb00ce740 2023-10-06T05:25:41.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.089+0000 7fafa3fff700 1 -- 172.21.15.29:0/672056629 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf9c003570 con 0x7fafb00ce740 2023-10-06T05:25:41.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafa3fff700 1 -- 172.21.15.29:0/672056629 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3887293443 0 0) 0x7faf9c003570 con 0x7fafb00ce740 2023-10-06T05:25:41.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb57fa700 1 -- 172.21.15.29:0/672056629 >> v1:172.21.15.173:6789/0 conn(0x7fafb00cebc0 legacy=0x7fafb015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb57fa700 1 -- 172.21.15.29:0/672056629 >> v1:172.21.15.29:6789/0 conn(0x7fafb00ce740 legacy=0x7fafb00cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb57fa700 1 -- 172.21.15.29:0/672056629 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb006ac00 con 0x7fafb0158c00 2023-10-06T05:25:41.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb57fa700 1 --2- 172.21.15.29:0/672056629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 0x7fafb006b6e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafac0098e0 tx=0x7fafac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dde72dc5714591e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:41.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafa3fff700 1 -- 172.21.15.29:0/672056629 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4001470 con 0x7fafb0158c00 2023-10-06T05:25:41.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafa3fff700 1 -- 172.21.15.29:0/672056629 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac011420 con 0x7fafb0158c00 2023-10-06T05:25:41.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafa3fff700 1 -- 172.21.15.29:0/672056629 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac0117a0 con 0x7fafb0158c00 2023-10-06T05:25:41.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb67fc700 1 -- 172.21.15.29:0/672056629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 msgr2=0x7fafb006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb67fc700 1 --2- 172.21.15.29:0/672056629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 0x7fafb006b6e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafac0098e0 tx=0x7fafac0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb67fc700 1 -- 172.21.15.29:0/672056629 shutdown_connections 2023-10-06T05:25:41.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb67fc700 1 --2- 172.21.15.29:0/672056629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 0x7fafb006b6e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb67fc700 1 -- 172.21.15.29:0/672056629 >> 172.21.15.29:0/672056629 conn(0x7fafb00670a0 msgr2=0x7fafb0067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:41.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb67fc700 1 -- 172.21.15.29:0/672056629 shutdown_connections 2023-10-06T05:25:41.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.093+0000 7fafb67fc700 1 -- 172.21.15.29:0/672056629 wait complete. 2023-10-06T05:25:41.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb67fc700 1 Processor -- start 2023-10-06T05:25:41.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb67fc700 1 -- start start 2023-10-06T05:25:41.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb67fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafb00ce740 0x7fafb00c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb67fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fafb00cebc0 0x7fafb01528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb67fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 0x7fafb00b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb67fc700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0157c40 con 0x7fafb00ce740 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb67fc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0158170 con 0x7fafb0158c00 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb67fc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0157e90 con 0x7fafb00cebc0 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb57fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafb00ce740 0x7fafb00c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb57fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafb00ce740 0x7fafb00c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56160/0 (socket says 172.21.15.29:56160) 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb57fa700 1 -- 172.21.15.29:0/3771895092 learned_addr learned my addr 172.21.15.29:0/3771895092 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb4ff9700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fafb00cebc0 0x7fafb01528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.097+0000 7fafb5ffb700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 0x7fafb00b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb57fa700 1 -- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fafb00cebc0 msgr2=0x7fafb01528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb57fa700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fafb00cebc0 0x7fafb01528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb57fa700 1 -- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 msgr2=0x7fafb00b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb57fa700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 0x7fafb00b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb57fa700 1 -- 172.21.15.29:0/3771895092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac009420 con 0x7fafb00ce740 2023-10-06T05:25:41.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb4ff9700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fafb00cebc0 0x7fafb01528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:41.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb5ffb700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 0x7fafb00b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:41.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb57fa700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafb00ce740 0x7fafb00c6e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fafac009f80 tx=0x7fafac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:41.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafa17fa700 1 -- 172.21.15.29:0/3771895092 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac01cd10 con 0x7fafb00ce740 2023-10-06T05:25:41.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafa17fa700 1 -- 172.21.15.29:0/3771895092 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac01ce70 con 0x7fafb00ce740 2023-10-06T05:25:41.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00b3220 con 0x7fafb00ce740 2023-10-06T05:25:41.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafa17fa700 1 -- 172.21.15.29:0/3771895092 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac01a680 con 0x7fafb00ce740 2023-10-06T05:25:41.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb00b37e0 con 0x7fafb00ce740 2023-10-06T05:25:41.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb004be00 con 0x7fafb00ce740 2023-10-06T05:25:41.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafa17fa700 1 -- 172.21.15.29:0/3771895092 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fafac01aa70 con 0x7fafb00ce740 2023-10-06T05:25:41.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafa17fa700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf94060550 0x7faf94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.101+0000 7fafa17fa700 1 -- 172.21.15.29:0/3771895092 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fafac07e3d0 con 0x7fafb00ce740 2023-10-06T05:25:41.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.105+0000 7fafb4ff9700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf94060550 0x7faf94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.105+0000 7fafb4ff9700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf94060550 0x7faf94062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fafb00c9e60 tx=0x7fafa4000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:41.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.109+0000 7fafa17fa700 1 -- 172.21.15.29:0/3771895092 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fafac04e7c0 con 0x7fafb00ce740 2023-10-06T05:25:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.273+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafb00b39d0 con 0x7fafb00ce740 2023-10-06T05:25:41.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafa17fa700 1 -- 172.21.15.29:0/3771895092 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fafac051de0 con 0x7fafb00ce740 2023-10-06T05:25:41.282 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:41.282 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":23,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:39.985491+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:41.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf94060550 msgr2=0x7faf94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf94060550 0x7faf94062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fafb00c9e60 tx=0x7fafa4000bc0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafb00ce740 msgr2=0x7fafb00c6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafb00ce740 0x7fafb00c6e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fafac009f80 tx=0x7fafac016000 comp rx=0 tx=0).stop 2023-10-06T05:25:41.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 shutdown_connections 2023-10-06T05:25:41.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf94060550 0x7faf94062a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafb0158c00 0x7fafb00b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fafb00cebc0 0x7fafb01528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 --2- 172.21.15.29:0/3771895092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafb00ce740 0x7fafb00c6e60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 >> 172.21.15.29:0/3771895092 conn(0x7fafb00670a0 msgr2=0x7fafb00c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:41.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 shutdown_connections 2023-10-06T05:25:41.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.277+0000 7fafb67fc700 1 -- 172.21.15.29:0/3771895092 wait complete. 2023-10-06T05:25:41.296 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T05:25:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.405+0000 7f1a6759e700 1 Processor -- start 2023-10-06T05:25:41.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.405+0000 7f1a6759e700 1 -- start start 2023-10-06T05:25:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.405+0000 7f1a6759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a6806b440 0x7f1a680670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.405+0000 7f1a6759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6806afb0 con 0x7f1a681599d0 2023-10-06T05:25:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.405+0000 7f1a6759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6806a410 con 0x7f1a68155050 2023-10-06T05:25:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.405+0000 7f1a6759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6806a680 con 0x7f1a6806b440 2023-10-06T05:25:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.405+0000 7f1a66d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1a681599d0 0x7f1a68155420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33688/0 (socket says 172.21.15.29:33688) 2023-10-06T05:25:41.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.405+0000 7f1a66d9d700 1 -- 172.21.15.29:0/2970408692 learned_addr learned my addr 172.21.15.29:0/2970408692 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.405+0000 7f1a65d9b700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a6806b440 0x7f1a680670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975783848 0 0) 0x7f1a6806afb0 con 0x7f1a681599d0 2023-10-06T05:25:41.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a50003570 con 0x7f1a681599d0 2023-10-06T05:25:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876410217 0 0) 0x7f1a6806a410 con 0x7f1a68155050 2023-10-06T05:25:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a6806afb0 con 0x7f1a68155050 2023-10-06T05:25:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 446334154 0 0) 0x7f1a50003570 con 0x7f1a681599d0 2023-10-06T05:25:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a6806b440 msgr2=0x7f1a680670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a6806b440 0x7f1a680670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 >> v1:172.21.15.173:6789/0 conn(0x7f1a68155050 legacy=0x7f1a680aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6806a960 con 0x7f1a681599d0 2023-10-06T05:25:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f1a600017f0 con 0x7f1a681599d0 2023-10-06T05:25:41.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 >> v1:172.21.15.29:6789/0 conn(0x7f1a681599d0 legacy=0x7f1a68155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a50004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a50004810 0x7f1a50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a6806b440 0x7f1a50005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6806a680 con 0x7f1a50003c20 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5000cd30 con 0x7f1a50004810 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5000cef0 con 0x7f1a6806b440 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6659c700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a50004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a65d9b700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a50004810 0x7f1a50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a66d9d700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a6806b440 0x7f1a50005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6659c700 1 -- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a6806b440 msgr2=0x7f1a50005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6659c700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a6806b440 0x7f1a50005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6659c700 1 -- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a50004810 msgr2=0x7f1a50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:41.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6659c700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a50004810 0x7f1a50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6659c700 1 -- 172.21.15.29:0/2970408692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a50003570 con 0x7f1a50003c20 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6659c700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a50004010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1a58001a10 tx=0x7f1a58007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c148ef8b31acb5ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800c5d0 con 0x7f1a50003c20 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5800c730 con 0x7f1a50003c20 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6559a700 1 -- 172.21.15.29:0/2970408692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800cad0 con 0x7f1a50003c20 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6759e700 1 -- 172.21.15.29:0/2970408692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 msgr2=0x7f1a50004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6759e700 1 --2- 172.21.15.29:0/2970408692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a50004010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1a58001a10 tx=0x7f1a58007d30 comp rx=0 tx=0).stop 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a66d9d700 1 -- 172.21.15.29:0/2970408692 reap_dead start 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6759e700 1 -- 172.21.15.29:0/2970408692 shutdown_connections 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6759e700 1 -- 172.21.15.29:0/2970408692 >> 172.21.15.29:0/2970408692 conn(0x7f1a6806c6c0 msgr2=0x7f1a6806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6759e700 1 -- 172.21.15.29:0/2970408692 shutdown_connections 2023-10-06T05:25:41.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.409+0000 7f1a6759e700 1 -- 172.21.15.29:0/2970408692 wait complete. 2023-10-06T05:25:41.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6759e700 1 Processor -- start 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6759e700 1 -- start start 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a6814a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a680b07c0 0x7f1a680b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a680ac870 0x7f1a680acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680b1170 con 0x7f1a50003c20 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680ae1d0 con 0x7f1a680b07c0 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680ad5c0 con 0x7f1a680ac870 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a6814a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a6814a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56170/0 (socket says 172.21.15.29:56170) 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6659c700 1 -- 172.21.15.29:0/410411426 learned_addr learned my addr 172.21.15.29:0/410411426 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:41.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a65d9b700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a680b07c0 0x7f1a680b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a66d9d700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a680ac870 0x7f1a680acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6659c700 1 -- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a680ac870 msgr2=0x7f1a680acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6659c700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a680ac870 0x7f1a680acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6659c700 1 -- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a680b07c0 msgr2=0x7f1a680b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6659c700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a680b07c0 0x7f1a680b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6659c700 1 -- 172.21.15.29:0/410411426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a680ad8a0 con 0x7f1a50003c20 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a6659c700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a6814a480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800c3c0 tx=0x7f1a58015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.413+0000 7f1a567fc700 1 -- 172.21.15.29:0/410411426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58023070 con 0x7f1a50003c20 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.417+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a680adb80 con 0x7f1a50003c20 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.417+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a680ad1e0 con 0x7f1a50003c20 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.417+0000 7f1a567fc700 1 -- 172.21.15.29:0/410411426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5800cab0 con 0x7f1a50003c20 2023-10-06T05:25:41.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.417+0000 7f1a567fc700 1 -- 172.21.15.29:0/410411426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800c5d0 con 0x7f1a50003c20 2023-10-06T05:25:41.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.417+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c0052b0 con 0x7f1a50003c20 2023-10-06T05:25:41.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.417+0000 7f1a567fc700 1 -- 172.21.15.29:0/410411426 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1a58019070 con 0x7f1a50003c20 2023-10-06T05:25:41.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.417+0000 7f1a567fc700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1a48060550 0x7f1a48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:41.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.417+0000 7f1a567fc700 1 -- 172.21.15.29:0/410411426 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1a5807cfa0 con 0x7f1a50003c20 2023-10-06T05:25:41.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.421+0000 7f1a65d9b700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1a48060550 0x7f1a48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:41.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.421+0000 7f1a65d9b700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1a48060550 0x7f1a48062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a680c5bf0 tx=0x7f1a5c0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:41.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.425+0000 7f1a567fc700 1 -- 172.21.15.29:0/410411426 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1a5804d390 con 0x7f1a50003c20 2023-10-06T05:25:41.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:41.625+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1a4c005ae0 con 0x7f1a50003c20 2023-10-06T05:25:42.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.641+0000 7f1a567fc700 1 -- 172.21.15.29:0/410411426 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1a580170b0 con 0x7f1a50003c20 2023-10-06T05:25:42.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1a48060550 msgr2=0x7f1a48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:42.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1a48060550 0x7f1a48062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a680c5bf0 tx=0x7f1a5c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 msgr2=0x7f1a6814a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:42.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a6814a480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800c3c0 tx=0x7f1a58015000 comp rx=0 tx=0).stop 2023-10-06T05:25:42.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 shutdown_connections 2023-10-06T05:25:42.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a680ac870 0x7f1a680acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1a48060550 0x7f1a48062a00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a680b07c0 0x7f1a680b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 --2- 172.21.15.29:0/410411426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a50003c20 0x7f1a6814a480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 >> 172.21.15.29:0/410411426 conn(0x7f1a6806c6c0 msgr2=0x7f1a680c3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:42.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 shutdown_connections 2023-10-06T05:25:42.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.645+0000 7f1a6759e700 1 -- 172.21.15.29:0/410411426 wait complete. 2023-10-06T05:25:42.665 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T05:25:42.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c7fff700 1 Processor -- start 2023-10-06T05:25:42.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c7fff700 1 -- start start 2023-10-06T05:25:42.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23c8158c40 0x7f23c80d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:42.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c8159010 0x7f23c806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:42.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c7fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f23c80ce320 0x7f23c80ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:42.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c7fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80ced00 con 0x7f23c8158c40 2023-10-06T05:25:42.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c7fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80cae30 con 0x7f23c80ce320 2023-10-06T05:25:42.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c7fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c806ba70 con 0x7f23c8159010 2023-10-06T05:25:42.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c6ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23c8158c40 0x7f23c80d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:42.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c67fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c8159010 0x7f23c806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:42.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c6ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23c8158c40 0x7f23c80d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56182/0 (socket says 172.21.15.29:56182) 2023-10-06T05:25:42.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c6ffd700 1 -- 172.21.15.29:0/536746912 learned_addr learned my addr 172.21.15.29:0/536746912 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:42.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.785+0000 7f23c77fe700 1 --2- 172.21.15.29:0/536746912 >> v2:172.21.15.173:3300/0 conn(0x7f23c80ce320 0x7f23c80ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:42.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c6ffd700 1 -- 172.21.15.29:0/536746912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c8159010 msgr2=0x7f23c806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:42.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c6ffd700 1 --2- 172.21.15.29:0/536746912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c8159010 0x7f23c806aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c6ffd700 1 -- 172.21.15.29:0/536746912 >> v2:172.21.15.173:3300/0 conn(0x7f23c80ce320 msgr2=0x7f23c80ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:42.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c6ffd700 1 --2- 172.21.15.29:0/536746912 >> v2:172.21.15.173:3300/0 conn(0x7f23c80ce320 0x7f23c80ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c6ffd700 1 -- 172.21.15.29:0/536746912 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c806b1e0 con 0x7f23c8158c40 2023-10-06T05:25:42.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c6ffd700 1 --2- 172.21.15.29:0/536746912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c8158c40 0x7f23c80d0570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f23c815dae0 tx=0x7f23c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd158753ec812b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:42.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c5ffb700 1 -- 172.21.15.29:0/536746912 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000e070 con 0x7f23c8158c40 2023-10-06T05:25:42.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c5ffb700 1 -- 172.21.15.29:0/536746912 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c000b970 con 0x7f23c8158c40 2023-10-06T05:25:42.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c5ffb700 1 -- 172.21.15.29:0/536746912 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c00092e0 con 0x7f23c8158c40 2023-10-06T05:25:42.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 -- 172.21.15.29:0/536746912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c8158c40 msgr2=0x7f23c80d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:42.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 --2- 172.21.15.29:0/536746912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c8158c40 0x7f23c80d0570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f23c815dae0 tx=0x7f23c0009840 comp rx=0 tx=0).stop 2023-10-06T05:25:42.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 -- 172.21.15.29:0/536746912 shutdown_connections 2023-10-06T05:25:42.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 --2- 172.21.15.29:0/536746912 >> v2:172.21.15.173:3300/0 conn(0x7f23c80ce320 0x7f23c80ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 --2- 172.21.15.29:0/536746912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c8159010 0x7f23c806aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 --2- 172.21.15.29:0/536746912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c8158c40 0x7f23c80d0570 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 -- 172.21.15.29:0/536746912 >> 172.21.15.29:0/536746912 conn(0x7f23c80670a0 msgr2=0x7f23c80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 -- 172.21.15.29:0/536746912 shutdown_connections 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 -- 172.21.15.29:0/536746912 wait complete. 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 Processor -- start 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.789+0000 7f23c7fff700 1 -- start start 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c80ce320 0x7f23c815b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c8159010 0x7f23c80c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c80c9a70 0x7f23c8148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80c95e0 con 0x7f23c80ce320 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c7fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c815b670 con 0x7f23c8159010 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c7fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80c7d10 con 0x7f23c80c9a70 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c80ce320 0x7f23c815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:42.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c77fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c80c9a70 0x7f23c8148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c80ce320 0x7f23c815b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56188/0 (socket says 172.21.15.29:56188) 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c77fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c80c9a70 0x7f23c8148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52522/0 (socket says 172.21.15.29:52522) 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c67fc700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c8159010 0x7f23c80c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c6ffd700 1 -- 172.21.15.29:0/3914639196 learned_addr learned my addr 172.21.15.29:0/3914639196 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c6ffd700 1 -- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c80c9a70 msgr2=0x7f23c8148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c6ffd700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c80c9a70 0x7f23c8148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c6ffd700 1 -- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c8159010 msgr2=0x7f23c80c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c6ffd700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c8159010 0x7f23c80c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c6ffd700 1 -- 172.21.15.29:0/3914639196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0009ae0 con 0x7f23c80ce320 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c67fc700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c8159010 0x7f23c80c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c77fe700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c80c9a70 0x7f23c8148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c6ffd700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c80ce320 0x7f23c815b130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23c806e080 tx=0x7f23c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:42.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23beffd700 1 -- 172.21.15.29:0/3914639196 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0008720 con 0x7f23c80ce320 2023-10-06T05:25:42.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23beffd700 1 -- 172.21.15.29:0/3914639196 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0008880 con 0x7f23c80ce320 2023-10-06T05:25:42.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c80c8cb0 con 0x7f23c80ce320 2023-10-06T05:25:42.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23beffd700 1 -- 172.21.15.29:0/3914639196 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0008c40 con 0x7f23c80ce320 2023-10-06T05:25:42.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.793+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c80c9270 con 0x7f23c80ce320 2023-10-06T05:25:42.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.797+0000 7f23beffd700 1 -- 172.21.15.29:0/3914639196 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f23c0003040 con 0x7f23c80ce320 2023-10-06T05:25:42.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.797+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c80676d0 con 0x7f23c80ce320 2023-10-06T05:25:42.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.797+0000 7f23beffd700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f23a8060580 0x7f23a8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:42.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.797+0000 7f23beffd700 1 -- 172.21.15.29:0/3914639196 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23c007e390 con 0x7f23c80ce320 2023-10-06T05:25:42.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.797+0000 7f23c67fc700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f23a8060580 0x7f23a8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:42.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.797+0000 7f23c67fc700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f23a8060580 0x7f23a8062a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23c814ce00 tx=0x7f23b00091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:42.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:42.805+0000 7f23beffd700 1 -- 172.21.15.29:0/3914639196 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f23c80676d0 con 0x7f23c80ce320 2023-10-06T05:25:43.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.005+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f23c80676d0 con 0x7f23c80ce320 2023-10-06T05:25:43.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.653+0000 7f23beffd700 1 -- 172.21.15.29:0/3914639196 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f23c80676d0 con 0x7f23c80ce320 2023-10-06T05:25:43.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f23a8060580 msgr2=0x7f23a8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:43.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f23a8060580 0x7f23a8062a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23c814ce00 tx=0x7f23b00091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c80ce320 msgr2=0x7f23c815b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:43.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c80ce320 0x7f23c815b130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23c806e080 tx=0x7f23c0018000 comp rx=0 tx=0).stop 2023-10-06T05:25:43.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 shutdown_connections 2023-10-06T05:25:43.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23c80c9a70 0x7f23c8148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f23a8060580 0x7f23a8062a30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23c8159010 0x7f23c80c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 --2- 172.21.15.29:0/3914639196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c80ce320 0x7f23c815b130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 >> 172.21.15.29:0/3914639196 conn(0x7f23c80670a0 msgr2=0x7f23c8149180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:43.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 shutdown_connections 2023-10-06T05:25:43.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.657+0000 7f23c7fff700 1 -- 172.21.15.29:0/3914639196 wait complete. 2023-10-06T05:25:43.678 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:25:43.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc4317700 1 Processor -- start 2023-10-06T05:25:43.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc4317700 1 -- start start 2023-10-06T05:25:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc4317700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fabbc0b0de0 0x7fabbc0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc4317700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fabbc06e9f0 0x7fabbc0cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc4317700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 0x7fabbc0ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc4317700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc06f6e0 con 0x7fabbc0b0de0 2023-10-06T05:25:43.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc4317700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc0cc9a0 con 0x7fabbc06e9f0 2023-10-06T05:25:43.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc4317700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc06a970 con 0x7fabbc0ca070 2023-10-06T05:25:43.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc20b3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fabbc0b0de0 0x7fabbc0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc20b3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fabbc0b0de0 0x7fabbc0b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56204/0 (socket says 172.21.15.29:56204) 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc20b3700 1 -- 172.21.15.29:0/2319588663 learned_addr learned my addr 172.21.15.29:0/2319588663 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc18b2700 1 --2- 172.21.15.29:0/2319588663 >> v2:172.21.15.173:3300/0 conn(0x7fabbc06e9f0 0x7fabbc0cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc28b4700 1 --2- 172.21.15.29:0/2319588663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 0x7fabbc0ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc28b4700 1 -- 172.21.15.29:0/2319588663 >> v2:172.21.15.173:3300/0 conn(0x7fabbc06e9f0 msgr2=0x7fabbc0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc28b4700 1 --2- 172.21.15.29:0/2319588663 >> v2:172.21.15.173:3300/0 conn(0x7fabbc06e9f0 0x7fabbc0cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc28b4700 1 -- 172.21.15.29:0/2319588663 >> v2:172.21.15.29:3300/0 conn(0x7fabbc0b0de0 msgr2=0x7fabbc0b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc28b4700 1 --2- 172.21.15.29:0/2319588663 >> v2:172.21.15.29:3300/0 conn(0x7fabbc0b0de0 0x7fabbc0b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc28b4700 1 -- 172.21.15.29:0/2319588663 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc06ee70 con 0x7fabbc0ca070 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc20b3700 1 --2- 172.21.15.29:0/2319588663 >> v2:172.21.15.29:3300/0 conn(0x7fabbc0b0de0 0x7fabbc0b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:43.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc28b4700 1 --2- 172.21.15.29:0/2319588663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 0x7fabbc0ca480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fabbc068270 tx=0x7fabb4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ad0473994a8c957 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:43.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc10b1700 1 -- 172.21.15.29:0/2319588663 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400e070 con 0x7fabbc0ca070 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc10b1700 1 -- 172.21.15.29:0/2319588663 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb400bab0 con 0x7fabbc0ca070 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.785+0000 7fabc10b1700 1 -- 172.21.15.29:0/2319588663 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400be70 con 0x7fabbc0ca070 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 -- 172.21.15.29:0/2319588663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 msgr2=0x7fabbc0ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 --2- 172.21.15.29:0/2319588663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 0x7fabbc0ca480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fabbc068270 tx=0x7fabb4009780 comp rx=0 tx=0).stop 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 -- 172.21.15.29:0/2319588663 shutdown_connections 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 --2- 172.21.15.29:0/2319588663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 0x7fabbc0ca480 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 --2- 172.21.15.29:0/2319588663 >> v2:172.21.15.173:3300/0 conn(0x7fabbc06e9f0 0x7fabbc0cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 --2- 172.21.15.29:0/2319588663 >> v2:172.21.15.29:3300/0 conn(0x7fabbc0b0de0 0x7fabbc0b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 -- 172.21.15.29:0/2319588663 >> 172.21.15.29:0/2319588663 conn(0x7fabbc067b70 msgr2=0x7fabbc06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 -- 172.21.15.29:0/2319588663 shutdown_connections 2023-10-06T05:25:43.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 -- 172.21.15.29:0/2319588663 wait complete. 2023-10-06T05:25:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 Processor -- start 2023-10-06T05:25:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 -- start start 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabbc06e9f0 0x7fabbc14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabbc0b0de0 0x7fabbc154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 0x7fabbc14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc154b60 con 0x7fabbc06e9f0 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc15cee0 con 0x7fabbc0b0de0 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc4317700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc15d070 con 0x7fabbc0ca070 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc20b3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabbc06e9f0 0x7fabbc14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc20b3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabbc06e9f0 0x7fabbc14eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56220/0 (socket says 172.21.15.29:56220) 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc20b3700 1 -- 172.21.15.29:0/1095234125 learned_addr learned my addr 172.21.15.29:0/1095234125 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc18b2700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabbc0b0de0 0x7fabbc154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:43.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.789+0000 7fabc28b4700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 0x7fabbc14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabc20b3700 1 -- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 msgr2=0x7fabbc14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabc20b3700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 0x7fabbc14c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabc20b3700 1 -- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabbc0b0de0 msgr2=0x7fabbc154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabc20b3700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabbc0b0de0 0x7fabbc154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabc20b3700 1 -- 172.21.15.29:0/1095234125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80094f0 con 0x7fabbc06e9f0 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabc20b3700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabbc06e9f0 0x7fabbc14eda0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fabb800ec50 tx=0x7fabb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabb27fc700 1 -- 172.21.15.29:0/1095234125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800c850 con 0x7fabbc06e9f0 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabb27fc700 1 -- 172.21.15.29:0/1095234125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800c9b0 con 0x7fabbc06e9f0 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb4009a20 con 0x7fabbc06e9f0 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabb27fc700 1 -- 172.21.15.29:0/1095234125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800cd50 con 0x7fabbc06e9f0 2023-10-06T05:25:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc14f480 con 0x7fabbc06e9f0 2023-10-06T05:25:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.793+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc04be00 con 0x7fabbc06e9f0 2023-10-06T05:25:43.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.797+0000 7fabb27fc700 1 -- 172.21.15.29:0/1095234125 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fabb8013680 con 0x7fabbc06e9f0 2023-10-06T05:25:43.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.797+0000 7fabb27fc700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faba0060550 0x7faba0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:43.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.797+0000 7fabb27fc700 1 -- 172.21.15.29:0/1095234125 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fabb807cc60 con 0x7fabbc06e9f0 2023-10-06T05:25:43.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.797+0000 7fabc18b2700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faba0060550 0x7faba0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:43.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.797+0000 7fabc18b2700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faba0060550 0x7faba0062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0caf60 tx=0x7fabac0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:43.801+0000 7fabb27fc700 1 -- 172.21.15.29:0/1095234125 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fabb804d0f0 con 0x7fabbc06e9f0 2023-10-06T05:25:44.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.001+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabbc06d070 con 0x7fabbc06e9f0 2023-10-06T05:25:44.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.001+0000 7fabb27fc700 1 -- 172.21.15.29:0/1095234125 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fabb8050710 con 0x7fabbc06e9f0 2023-10-06T05:25:44.008 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:44.008 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/320155266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":320155266},{"type":"v1","addr":"172.21.15.29:6833","nonce":320155266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3562424943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3562424943},{"type":"v1","addr":"172.21.15.173:6836","nonce":3562424943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2321165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2321165769},{"type":"v1","addr":"172.21.15.173:6837","nonce":2321165769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:25:39.986226+0000","modified":"2023-10-06T05:25:43.642085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3557282345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3557282345},{"type":"v1","addr":"172.21.15.29:6835","nonce":3557282345}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T05:25:44.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faba0060550 msgr2=0x7faba0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faba0060550 0x7faba0062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0caf60 tx=0x7fabac0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabbc06e9f0 msgr2=0x7fabbc14eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabbc06e9f0 0x7fabbc14eda0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fabb800ec50 tx=0x7fabb8009250 comp rx=0 tx=0).stop 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 shutdown_connections 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabbc0ca070 0x7fabbc14c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faba0060550 0x7faba0062a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabbc0b0de0 0x7fabbc154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 --2- 172.21.15.29:0/1095234125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabbc06e9f0 0x7fabbc14eda0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 >> 172.21.15.29:0/1095234125 conn(0x7fabbc067b70 msgr2=0x7fabbc0b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 shutdown_connections 2023-10-06T05:25:44.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.005+0000 7fabc4317700 1 -- 172.21.15.29:0/1095234125 wait complete. 2023-10-06T05:25:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-06T05:25:44.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f6470da7700 1 Processor -- start 2023-10-06T05:25:44.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f6470da7700 1 -- start start 2023-10-06T05:25:44.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f6470da7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f646c1569f0 0x7f646c0ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f6470da7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c0c68b0 0x7f646c0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f6470da7700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c06a5b0 con 0x7f646c156dc0 2023-10-06T05:25:44.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f6470da7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c0c7270 con 0x7f646c1569f0 2023-10-06T05:25:44.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f6470da7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c15b0a0 con 0x7f646c0c68b0 2023-10-06T05:25:44.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f646b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f646c1569f0 0x7f646c0ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f6463fff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f646c156dc0 0x7f646c15a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:60994/0 (socket says 172.21.15.29:60994) 2023-10-06T05:25:44.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f6463fff700 1 -- 172.21.15.29:0/3477476753 learned_addr learned my addr 172.21.15.29:0/3477476753 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:44.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f646bfff700 1 --2- 172.21.15.29:0/3477476753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c0c68b0 0x7f646c0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f646affd700 1 -- 172.21.15.29:0/3477476753 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618896366 0 0) 0x7f646c06a5b0 con 0x7f646c156dc0 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.121+0000 7f646affd700 1 -- 172.21.15.29:0/3477476753 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6458003570 con 0x7f646c156dc0 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f646b7fe700 1 -- 172.21.15.29:0/3477476753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c0c68b0 msgr2=0x7f646c0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f646b7fe700 1 --2- 172.21.15.29:0/3477476753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c0c68b0 0x7f646c0c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f646b7fe700 1 -- 172.21.15.29:0/3477476753 >> v1:172.21.15.173:6789/0 conn(0x7f646c156dc0 legacy=0x7f646c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f646b7fe700 1 -- 172.21.15.29:0/3477476753 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c15b380 con 0x7f646c1569f0 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f646b7fe700 1 --2- 172.21.15.29:0/3477476753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 0x7f646c0ab220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f645c0098e0 tx=0x7f645c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866c45fc431e8445 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f646affd700 1 -- 172.21.15.29:0/3477476753 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011630 con 0x7f646c1569f0 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f646affd700 1 -- 172.21.15.29:0/3477476753 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c011790 con 0x7f646c1569f0 2023-10-06T05:25:44.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f646affd700 1 -- 172.21.15.29:0/3477476753 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011b10 con 0x7f646c1569f0 2023-10-06T05:25:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 -- 172.21.15.29:0/3477476753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 msgr2=0x7f646c0ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 --2- 172.21.15.29:0/3477476753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 0x7f646c0ab220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f645c0098e0 tx=0x7f645c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 -- 172.21.15.29:0/3477476753 shutdown_connections 2023-10-06T05:25:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 --2- 172.21.15.29:0/3477476753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c0c68b0 0x7f646c0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 --2- 172.21.15.29:0/3477476753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 0x7f646c0ab220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 -- 172.21.15.29:0/3477476753 >> 172.21.15.29:0/3477476753 conn(0x7f646c0670a0 msgr2=0x7f646c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 -- 172.21.15.29:0/3477476753 shutdown_connections 2023-10-06T05:25:44.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 -- 172.21.15.29:0/3477476753 wait complete. 2023-10-06T05:25:44.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 Processor -- start 2023-10-06T05:25:44.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 -- start start 2023-10-06T05:25:44.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c0c68b0 0x7f646c150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 0x7f646c159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c156dc0 0x7f646c16a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c15a030 con 0x7f646c1569f0 2023-10-06T05:25:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c169560 con 0x7f646c0c68b0 2023-10-06T05:25:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.125+0000 7f6470da7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c157840 con 0x7f646c156dc0 2023-10-06T05:25:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6463fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 0x7f646c159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f646b7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c0c68b0 0x7f646c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6463fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 0x7f646c159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56242/0 (socket says 172.21.15.29:56242) 2023-10-06T05:25:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6463fff700 1 -- 172.21.15.29:0/2334455869 learned_addr learned my addr 172.21.15.29:0/2334455869 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:44.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f646bfff700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c156dc0 0x7f646c16a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6463fff700 1 -- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c156dc0 msgr2=0x7f646c16a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6463fff700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c156dc0 0x7f646c16a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6463fff700 1 -- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c0c68b0 msgr2=0x7f646c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6463fff700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c0c68b0 0x7f646c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6463fff700 1 -- 172.21.15.29:0/2334455869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c009420 con 0x7f646c1569f0 2023-10-06T05:25:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6463fff700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 0x7f646c159380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64540011e0 tx=0x7f6454007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f64637fe700 1 -- 172.21.15.29:0/2334455869 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454005b30 con 0x7f646c1569f0 2023-10-06T05:25:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f64637fe700 1 -- 172.21.15.29:0/2334455869 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454005c90 con 0x7f646c1569f0 2023-10-06T05:25:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c157b20 con 0x7f646c1569f0 2023-10-06T05:25:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f64637fe700 1 -- 172.21.15.29:0/2334455869 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454007300 con 0x7f646c1569f0 2023-10-06T05:25:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c1580e0 con 0x7f646c1569f0 2023-10-06T05:25:44.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.129+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c169360 con 0x7f646c1569f0 2023-10-06T05:25:44.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.133+0000 7f64637fe700 1 -- 172.21.15.29:0/2334455869 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6454007670 con 0x7f646c1569f0 2023-10-06T05:25:44.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.133+0000 7f64637fe700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f644c060550 0x7f644c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.133+0000 7f64637fe700 1 -- 172.21.15.29:0/2334455869 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f645407bdc0 con 0x7f646c1569f0 2023-10-06T05:25:44.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.133+0000 7f646b7fe700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f644c060550 0x7f644c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.133+0000 7f646b7fe700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f644c060550 0x7f644c062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f645c0091e0 tx=0x7f645c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:44.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.141+0000 7f64637fe700 1 -- 172.21.15.29:0/2334455869 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f645404c1b0 con 0x7f646c1569f0 2023-10-06T05:25:44.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.305+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f646c0c9270 con 0x7f646c1569f0 2023-10-06T05:25:44.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.305+0000 7f64637fe700 1 -- 172.21.15.29:0/2334455869 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f646c0c9270 con 0x7f646c1569f0 2023-10-06T05:25:44.312 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:44.312 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:44.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f644c060550 msgr2=0x7f644c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f644c060550 0x7f644c062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f645c0091e0 tx=0x7f645c017000 comp rx=0 tx=0).stop 2023-10-06T05:25:44.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 msgr2=0x7f646c159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 0x7f646c159380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64540011e0 tx=0x7f6454007df0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 shutdown_connections 2023-10-06T05:25:44.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f646c156dc0 0x7f646c16a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f646c1569f0 0x7f646c159380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f644c060550 0x7f644c062a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 --2- 172.21.15.29:0/2334455869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f646c0c68b0 0x7f646c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 >> 172.21.15.29:0/2334455869 conn(0x7f646c0670a0 msgr2=0x7f646c151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:44.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 shutdown_connections 2023-10-06T05:25:44.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.309+0000 7f6470da7700 1 -- 172.21.15.29:0/2334455869 wait complete. 2023-10-06T05:25:44.327 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T05:25:44.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:25:44.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f3603e5f700 1 Processor -- start 2023-10-06T05:25:44.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f3603e5f700 1 -- start start 2023-10-06T05:25:44.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f3603e5f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35fc0c83b0 0x7f35fc161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f3603e5f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc069940 con 0x7f35fc156bb0 2023-10-06T05:25:44.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f3603e5f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc069010 con 0x7f35fc156f80 2023-10-06T05:25:44.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f3603e5f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc068e00 con 0x7f35fc0c83b0 2023-10-06T05:25:44.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f36023fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35fc0c83b0 0x7f35fc161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f3601bfb700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f35fc156bb0 0x7f35fc06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50504/0 (socket says 172.21.15.29:50504) 2023-10-06T05:25:44.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f36023fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35fc0c83b0 0x7f35fc161cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51080/0 (socket says 172.21.15.29:51080) 2023-10-06T05:25:44.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f3601bfb700 1 -- 172.21.15.29:0/2629034802 learned_addr learned my addr 172.21.15.29:0/2629034802 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:44.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f36023fc700 1 -- 172.21.15.29:0/2629034802 >> v1:172.21.15.173:6789/0 conn(0x7f35fc156f80 legacy=0x7f35fc0c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f36023fc700 1 -- 172.21.15.29:0/2629034802 >> v1:172.21.15.29:6789/0 conn(0x7f35fc156bb0 legacy=0x7f35fc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.429+0000 7f36023fc700 1 -- 172.21.15.29:0/2629034802 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0692f0 con 0x7f35fc0c83b0 2023-10-06T05:25:44.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f36023fc700 1 --2- 172.21.15.29:0/2629034802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc0c83b0 0x7f35fc161cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009e60 tx=0x7f35f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c331eafdf7b14022 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:44.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3600bf9700 1 -- 172.21.15.29:0/2629034802 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f400e070 con 0x7f35fc0c83b0 2023-10-06T05:25:44.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3600bf9700 1 -- 172.21.15.29:0/2629034802 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f400bc30 con 0x7f35fc0c83b0 2023-10-06T05:25:44.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3600bf9700 1 -- 172.21.15.29:0/2629034802 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4012430 con 0x7f35fc0c83b0 2023-10-06T05:25:44.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3603e5f700 1 -- 172.21.15.29:0/2629034802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc0c83b0 msgr2=0x7f35fc161cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3603e5f700 1 --2- 172.21.15.29:0/2629034802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc0c83b0 0x7f35fc161cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009e60 tx=0x7f35f4009780 comp rx=0 tx=0).stop 2023-10-06T05:25:44.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3603e5f700 1 -- 172.21.15.29:0/2629034802 shutdown_connections 2023-10-06T05:25:44.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3603e5f700 1 --2- 172.21.15.29:0/2629034802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc0c83b0 0x7f35fc161cb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3603e5f700 1 -- 172.21.15.29:0/2629034802 >> 172.21.15.29:0/2629034802 conn(0x7f35fc06e270 msgr2=0x7f35fc0675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:44.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3603e5f700 1 -- 172.21.15.29:0/2629034802 shutdown_connections 2023-10-06T05:25:44.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3603e5f700 1 -- 172.21.15.29:0/2629034802 wait complete. 2023-10-06T05:25:44.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3603e5f700 1 Processor -- start 2023-10-06T05:25:44.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.433+0000 7f3603e5f700 1 -- start start 2023-10-06T05:25:44.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3603e5f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35fc0c83b0 0x7f35fc1676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3603e5f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35fc156bb0 0x7f35fc14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3603e5f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc156f80 0x7f35fc157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3603e5f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc168980 con 0x7f35fc156f80 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3603e5f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc158300 con 0x7f35fc0c83b0 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3603e5f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0b0900 con 0x7f35fc156bb0 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36023fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc156f80 0x7f35fc157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36023fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc156f80 0x7f35fc157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51096/0 (socket says 172.21.15.29:51096) 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36023fc700 1 -- 172.21.15.29:0/2873178795 learned_addr learned my addr 172.21.15.29:0/2873178795 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3601bfb700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35fc0c83b0 0x7f35fc1676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36013fa700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35fc156bb0 0x7f35fc14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36023fc700 1 -- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35fc156bb0 msgr2=0x7f35fc14b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36023fc700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35fc156bb0 0x7f35fc14b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36023fc700 1 -- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35fc0c83b0 msgr2=0x7f35fc1676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36023fc700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35fc0c83b0 0x7f35fc1676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36023fc700 1 -- 172.21.15.29:0/2873178795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4009a20 con 0x7f35fc156f80 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3601bfb700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35fc0c83b0 0x7f35fc1676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f36023fc700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc156f80 0x7f35fc157dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f35f4013000 tx=0x7f35f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f35f9ffb700 1 -- 172.21.15.29:0/2873178795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f401e700 con 0x7f35fc156f80 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f35f9ffb700 1 -- 172.21.15.29:0/2873178795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f401e880 con 0x7f35fc156f80 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc167d70 con 0x7f35fc156f80 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f35f9ffb700 1 -- 172.21.15.29:0/2873178795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f401ec40 con 0x7f35fc156f80 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.437+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc168330 con 0x7f35fc156f80 2023-10-06T05:25:44.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.441+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc158860 con 0x7f35fc156f80 2023-10-06T05:25:44.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.441+0000 7f35f9ffb700 1 -- 172.21.15.29:0/2873178795 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f35f4024070 con 0x7f35fc156f80 2023-10-06T05:25:44.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.441+0000 7f35f9ffb700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35e8060580 0x7f35e8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.441+0000 7f35f9ffb700 1 -- 172.21.15.29:0/2873178795 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f35f407f300 con 0x7f35fc156f80 2023-10-06T05:25:44.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.441+0000 7f3601bfb700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35e8060580 0x7f35e8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.441+0000 7f3601bfb700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35e8060580 0x7f35e8062a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0018c0 tx=0x7f35ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:44.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.449+0000 7f35f9ffb700 1 -- 172.21.15.29:0/2873178795 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f35fc158860 con 0x7f35fc156f80 2023-10-06T05:25:44.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.609+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35fc158860 con 0x7f35e8060580 2023-10-06T05:25:44.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.625+0000 7f35f9ffb700 1 -- 172.21.15.29:0/2873178795 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271880 (secure 0 0 0) 0x7f35fc158860 con 0x7f35e8060580 2023-10-06T05:25:44.635 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:44.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35e8060580 msgr2=0x7f35e8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35e8060580 0x7f35e8062a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0018c0 tx=0x7f35ec009040 comp rx=0 tx=0).stop 2023-10-06T05:25:44.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc156f80 msgr2=0x7f35fc157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc156f80 0x7f35fc157dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f35f4013000 tx=0x7f35f4019000 comp rx=0 tx=0).stop 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 shutdown_connections 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc156f80 0x7f35fc157dc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35fc156bb0 0x7f35fc14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35e8060580 0x7f35e8062a30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 --2- 172.21.15.29:0/2873178795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35fc0c83b0 0x7f35fc1676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 >> 172.21.15.29:0/2873178795 conn(0x7f35fc06e270 msgr2=0x7f35fc0675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 shutdown_connections 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.629+0000 7f3603e5f700 1 -- 172.21.15.29:0/2873178795 wait complete. 2023-10-06T05:25:44.640 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:25:44.648 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T05:25:42.648703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2397540,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577180,"statfs":{"total":773094113280,"available":770639032320,"internally_reserved":0,"allocated":2789376,"data_stored":1703168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035199"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-06T05:25:34.486843+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:25:34.486843+0000","last_peered":"2023-10-06T05:25:34.486843+0000","last_clean":"2023-10-06T05:25:34.486843+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:25:34.486843+0000","last_undegraded":"2023-10-06T05:25:34.486843+0000","last_fullsized":"2023-10-06T05:25:34.486843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T05:25:35.495584+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:25:35.495584+0000","last_peered":"2023-10-06T05:25:35.495584+0000","last_clean":"2023-10-06T05:25:35.495584+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:25:35.495584+0000","last_undegraded":"2023-10-06T05:25:35.495584+0000","last_fullsized":"2023-10-06T05:25:35.495584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T05:25:35.492276+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:25:35.492276+0000","last_peered":"2023-10-06T05:25:35.492276+0000","last_clean":"2023-10-06T05:25:35.492276+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:25:35.492276+0000","last_undegraded":"2023-10-06T05:25:35.492276+0000","last_fullsized":"2023-10-06T05:25:35.492276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T05:25:35.638058+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:25:35.638058+0000","last_peered":"2023-10-06T05:25:35.638058+0000","last_clean":"2023-10-06T05:25:35.638058+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:25:35.638058+0000","last_undegraded":"2023-10-06T05:25:35.638058+0000","last_fullsized":"2023-10-06T05:25:35.638058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T05:25:35.496064+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:25:35.496064+0000","last_peered":"2023-10-06T05:25:35.496064+0000","last_clean":"2023-10-06T05:25:35.496064+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:25:35.496064+0000","last_undegraded":"2023-10-06T05:25:35.496064+0000","last_fullsized":"2023-10-06T05:25:35.496064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T05:25:35.707452+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:25:35.707452+0000","last_peered":"2023-10-06T05:25:35.707452+0000","last_clean":"2023-10-06T05:25:35.707452+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:25:35.707452+0000","last_undegraded":"2023-10-06T05:25:35.707452+0000","last_fullsized":"2023-10-06T05:25:35.707452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T05:25:35.707140+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:25:35.707140+0000","last_peered":"2023-10-06T05:25:35.707140+0000","last_clean":"2023-10-06T05:25:35.707140+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:25:35.707140+0000","last_undegraded":"2023-10-06T05:25:35.707140+0000","last_fullsized":"2023-10-06T05:25:35.707140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T05:25:35.495168+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:25:35.495168+0000","last_peered":"2023-10-06T05:25:35.495168+0000","last_clean":"2023-10-06T05:25:35.495168+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:25:35.495168+0000","last_undegraded":"2023-10-06T05:25:35.495168+0000","last_fullsized":"2023-10-06T05:25:35.495168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T05:25:35.496632+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:25:35.496632+0000","last_peered":"2023-10-06T05:25:35.496632+0000","last_clean":"2023-10-06T05:25:35.496632+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:25:35.496632+0000","last_undegraded":"2023-10-06T05:25:35.496632+0000","last_fullsized":"2023-10-06T05:25:35.496632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:39.609014+0000","last_change":"2023-10-06T05:25:39.609014+0000","last_active":"2023-10-06T05:25:39.609014+0000","last_peered":"2023-10-06T05:25:39.609014+0000","last_clean":"2023-10-06T05:25:39.609014+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:39.609014+0000","last_undegraded":"2023-10-06T05:25:39.609014+0000","last_fullsized":"2023-10-06T05:25:39.609014+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:25:38.604532+0000","last_change":"2023-10-06T05:25:38.604532+0000","last_active":"2023-10-06T05:25:38.604532+0000","last_peered":"2023-10-06T05:25:38.604532+0000","last_clean":"2023-10-06T05:25:38.604532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:25:38.604532+0000","last_undegraded":"2023-10-06T05:25:38.604532+0000","last_fullsized":"2023-10-06T05:25:38.604532+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":786432,"data_stored":652087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":192512,"data_stored":61719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070268,"statfs":{"total":96636764160,"available":96327954432,"internally_reserved":0,"allocated":192512,"data_stored":61719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301584,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070256,"statfs":{"total":96636764160,"available":96327942144,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301584,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070256,"statfs":{"total":96636764160,"available":96327942144,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069676,"statfs":{"total":96636764160,"available":96327348224,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:25:44.655 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:25:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 Processor -- start 2023-10-06T05:25:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 -- start start 2023-10-06T05:25:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 0x7f3bc00cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3bc00ad070 0x7f3bc00c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3bc00c9000 0x7f3bc00ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00ccfe0 con 0x7f3bc00c9000 2023-10-06T05:25:44.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc006d3a0 con 0x7f3bc00ad070 2023-10-06T05:25:44.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00cc160 con 0x7f3bc00acca0 2023-10-06T05:25:44.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc59e1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3bc00c9000 0x7f3bc00ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc59e1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3bc00c9000 0x7f3bc00ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51104/0 (socket says 172.21.15.29:51104) 2023-10-06T05:25:44.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc59e1700 1 -- 172.21.15.29:0/72347492 learned_addr learned my addr 172.21.15.29:0/72347492 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:44.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc49df700 1 --2- 172.21.15.29:0/72347492 >> v2:172.21.15.173:3300/0 conn(0x7f3bc00ad070 0x7f3bc00c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc51e0700 1 --2- 172.21.15.29:0/72347492 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 0x7f3bc00cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc49df700 1 -- 172.21.15.29:0/72347492 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 msgr2=0x7f3bc00cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:44.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc49df700 1 --2- 172.21.15.29:0/72347492 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 0x7f3bc00cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc49df700 1 -- 172.21.15.29:0/72347492 >> v2:172.21.15.29:3300/0 conn(0x7f3bc00c9000 msgr2=0x7f3bc00ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:44.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc49df700 1 --2- 172.21.15.29:0/72347492 >> v2:172.21.15.29:3300/0 conn(0x7f3bc00c9000 0x7f3bc00ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc49df700 1 -- 172.21.15.29:0/72347492 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00cc3d0 con 0x7f3bc00ad070 2023-10-06T05:25:44.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc59e1700 1 --2- 172.21.15.29:0/72347492 >> v2:172.21.15.29:3300/0 conn(0x7f3bc00c9000 0x7f3bc00ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:44.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc49df700 1 --2- 172.21.15.29:0/72347492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bc00ad070 0x7f3bc00c8ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0070cf0 tx=0x7f3bb8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec4ef4f4362f6f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bb7fff700 1 -- 172.21.15.29:0/72347492 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800e070 con 0x7f3bc00ad070 2023-10-06T05:25:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bb7fff700 1 -- 172.21.15.29:0/72347492 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb800bab0 con 0x7f3bc00ad070 2023-10-06T05:25:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bb7fff700 1 -- 172.21.15.29:0/72347492 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800be70 con 0x7f3bc00ad070 2023-10-06T05:25:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 -- 172.21.15.29:0/72347492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bc00ad070 msgr2=0x7f3bc00c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/72347492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bc00ad070 0x7f3bc00c8ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0070cf0 tx=0x7f3bb8009780 comp rx=0 tx=0).stop 2023-10-06T05:25:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 -- 172.21.15.29:0/72347492 shutdown_connections 2023-10-06T05:25:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/72347492 >> v2:172.21.15.29:3300/0 conn(0x7f3bc00c9000 0x7f3bc00ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/72347492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bc00ad070 0x7f3bc00c8ac0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/72347492 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 0x7f3bc00cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.757+0000 7f3bc61e2700 1 -- 172.21.15.29:0/72347492 >> 172.21.15.29:0/72347492 conn(0x7f3bc0069d80 msgr2=0x7f3bc006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 -- 172.21.15.29:0/72347492 shutdown_connections 2023-10-06T05:25:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 -- 172.21.15.29:0/72347492 wait complete. 2023-10-06T05:25:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 Processor -- start 2023-10-06T05:25:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 -- start start 2023-10-06T05:25:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 0x7f3bc00c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc00ad070 0x7f3bc0145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bc00c9000 0x7f3bc01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00c6a20 con 0x7f3bc00ad070 2023-10-06T05:25:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00c65d0 con 0x7f3bc00c9000 2023-10-06T05:25:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0145d40 con 0x7f3bc00acca0 2023-10-06T05:25:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc49df700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc00ad070 0x7f3bc0145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc49df700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc00ad070 0x7f3bc0145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51118/0 (socket says 172.21.15.29:51118) 2023-10-06T05:25:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc49df700 1 -- 172.21.15.29:0/910936971 learned_addr learned my addr 172.21.15.29:0/910936971 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc51e0700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 0x7f3bc00c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc59e1700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bc00c9000 0x7f3bc01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc49df700 1 -- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 msgr2=0x7f3bc00c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc49df700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 0x7f3bc00c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc49df700 1 -- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bc00c9000 msgr2=0x7f3bc01550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc49df700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bc00c9000 0x7f3bc01550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc49df700 1 -- 172.21.15.29:0/910936971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00094f0 con 0x7f3bc00ad070 2023-10-06T05:25:44.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc49df700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc00ad070 0x7f3bc0145800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009fd0 tx=0x7f3bb8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:44.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bb57fa700 1 -- 172.21.15.29:0/910936971 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8012b60 con 0x7f3bc00ad070 2023-10-06T05:25:44.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bb57fa700 1 -- 172.21.15.29:0/910936971 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb8012cc0 con 0x7f3bc00ad070 2023-10-06T05:25:44.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb8009a20 con 0x7f3bc00ad070 2023-10-06T05:25:44.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bb57fa700 1 -- 172.21.15.29:0/910936971 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80276c0 con 0x7f3bc00ad070 2023-10-06T05:25:44.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.761+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc00c6ee0 con 0x7f3bc00ad070 2023-10-06T05:25:44.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.765+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc00c6890 con 0x7f3bc00ad070 2023-10-06T05:25:44.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.765+0000 7f3bb57fa700 1 -- 172.21.15.29:0/910936971 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3bb8024070 con 0x7f3bc00ad070 2023-10-06T05:25:44.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.765+0000 7f3bb57fa700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3bac060550 0x7f3bac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:44.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.765+0000 7f3bb57fa700 1 -- 172.21.15.29:0/910936971 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3bb807ed40 con 0x7f3bc00ad070 2023-10-06T05:25:44.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.765+0000 7f3bc51e0700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3bac060550 0x7f3bac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:44.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.769+0000 7f3bc51e0700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3bac060550 0x7f3bac062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009db0 tx=0x7f3bbc0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:44.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.773+0000 7f3bb57fa700 1 -- 172.21.15.29:0/910936971 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3bb804f1d0 con 0x7f3bc00ad070 2023-10-06T05:25:44.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.929+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bc00cc6b0 con 0x7f3bac060550 2023-10-06T05:25:44.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.949+0000 7f3bb57fa700 1 -- 172.21.15.29:0/910936971 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286563 (secure 0 0 0) 0x7f3bc00cc6b0 con 0x7f3bac060550 2023-10-06T05:25:44.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:44.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3bac060550 msgr2=0x7f3bac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3bac060550 0x7f3bac062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009db0 tx=0x7f3bbc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc00ad070 msgr2=0x7f3bc0145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:44.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc00ad070 0x7f3bc0145800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009fd0 tx=0x7f3bb8019000 comp rx=0 tx=0).stop 2023-10-06T05:25:44.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 shutdown_connections 2023-10-06T05:25:44.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3bac060550 0x7f3bac062a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bc00c9000 0x7f3bc01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc00ad070 0x7f3bc0145800 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 --2- 172.21.15.29:0/910936971 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3bc00acca0 0x7f3bc00c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:44.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 >> 172.21.15.29:0/910936971 conn(0x7f3bc0069d80 msgr2=0x7f3bc00ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:44.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 shutdown_connections 2023-10-06T05:25:44.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:44.953+0000 7f3bc61e2700 1 -- 172.21.15.29:0/910936971 wait complete. 2023-10-06T05:25:44.963 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:25:44.973 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-06T05:25:44.649358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397860,"kb_used_data":3172,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576860,"statfs":{"total":773094113280,"available":770638704640,"internally_reserved":0,"allocated":3248128,"data_stored":1917249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001791"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662207+0000","last_change":"2023-10-06T05:25:40.648302+0000","last_active":"2023-10-06T05:25:40.662207+0000","last_peered":"2023-10-06T05:25:40.662207+0000","last_clean":"2023-10-06T05:25:40.662207+0000","last_became_active":"2023-10-06T05:25:40.647162+0000","last_became_peered":"2023-10-06T05:25:40.647162+0000","last_unstale":"2023-10-06T05:25:40.662207+0000","last_undegraded":"2023-10-06T05:25:40.662207+0000","last_fullsized":"2023-10-06T05:25:40.662207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:17.982392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.658161+0000","last_change":"2023-10-06T05:25:40.654236+0000","last_active":"2023-10-06T05:25:40.658161+0000","last_peered":"2023-10-06T05:25:40.658161+0000","last_clean":"2023-10-06T05:25:40.658161+0000","last_became_active":"2023-10-06T05:25:40.653899+0000","last_became_peered":"2023-10-06T05:25:40.653899+0000","last_unstale":"2023-10-06T05:25:40.658161+0000","last_undegraded":"2023-10-06T05:25:40.658161+0000","last_fullsized":"2023-10-06T05:25:40.658161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659366+0000","last_change":"2023-10-06T05:25:40.652315+0000","last_active":"2023-10-06T05:25:40.659366+0000","last_peered":"2023-10-06T05:25:40.659366+0000","last_clean":"2023-10-06T05:25:40.659366+0000","last_became_active":"2023-10-06T05:25:40.651958+0000","last_became_peered":"2023-10-06T05:25:40.651958+0000","last_unstale":"2023-10-06T05:25:40.659366+0000","last_undegraded":"2023-10-06T05:25:40.659366+0000","last_fullsized":"2023-10-06T05:25:40.659366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.536955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656801+0000","last_change":"2023-10-06T05:25:40.650525+0000","last_active":"2023-10-06T05:25:40.656801+0000","last_peered":"2023-10-06T05:25:40.656801+0000","last_clean":"2023-10-06T05:25:40.656801+0000","last_became_active":"2023-10-06T05:25:40.650064+0000","last_became_peered":"2023-10-06T05:25:40.650064+0000","last_unstale":"2023-10-06T05:25:40.656801+0000","last_undegraded":"2023-10-06T05:25:40.656801+0000","last_fullsized":"2023-10-06T05:25:40.656801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:19.825924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668443+0000","last_change":"2023-10-06T05:25:40.665445+0000","last_active":"2023-10-06T05:25:40.668443+0000","last_peered":"2023-10-06T05:25:40.668443+0000","last_clean":"2023-10-06T05:25:40.668443+0000","last_became_active":"2023-10-06T05:25:40.662917+0000","last_became_peered":"2023-10-06T05:25:40.662917+0000","last_unstale":"2023-10-06T05:25:40.668443+0000","last_undegraded":"2023-10-06T05:25:40.668443+0000","last_fullsized":"2023-10-06T05:25:40.668443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662747+0000","last_change":"2023-10-06T05:25:40.652496+0000","last_active":"2023-10-06T05:25:40.662747+0000","last_peered":"2023-10-06T05:25:40.662747+0000","last_clean":"2023-10-06T05:25:40.662747+0000","last_became_active":"2023-10-06T05:25:40.652182+0000","last_became_peered":"2023-10-06T05:25:40.652182+0000","last_unstale":"2023-10-06T05:25:40.662747+0000","last_undegraded":"2023-10-06T05:25:40.662747+0000","last_fullsized":"2023-10-06T05:25:40.662747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:14.458549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663020+0000","last_change":"2023-10-06T05:25:40.656290+0000","last_active":"2023-10-06T05:25:40.663020+0000","last_peered":"2023-10-06T05:25:40.663020+0000","last_clean":"2023-10-06T05:25:40.663020+0000","last_became_active":"2023-10-06T05:25:40.655918+0000","last_became_peered":"2023-10-06T05:25:40.655918+0000","last_unstale":"2023-10-06T05:25:40.663020+0000","last_undegraded":"2023-10-06T05:25:40.663020+0000","last_fullsized":"2023-10-06T05:25:40.663020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656714+0000","last_change":"2023-10-06T05:25:40.650564+0000","last_active":"2023-10-06T05:25:40.656714+0000","last_peered":"2023-10-06T05:25:40.656714+0000","last_clean":"2023-10-06T05:25:40.656714+0000","last_became_active":"2023-10-06T05:25:40.650224+0000","last_became_peered":"2023-10-06T05:25:40.650224+0000","last_unstale":"2023-10-06T05:25:40.656714+0000","last_undegraded":"2023-10-06T05:25:40.656714+0000","last_fullsized":"2023-10-06T05:25:40.656714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668613+0000","last_change":"2023-10-06T05:25:40.659416+0000","last_active":"2023-10-06T05:25:40.668613+0000","last_peered":"2023-10-06T05:25:40.668613+0000","last_clean":"2023-10-06T05:25:40.668613+0000","last_became_active":"2023-10-06T05:25:40.657687+0000","last_became_peered":"2023-10-06T05:25:40.657687+0000","last_unstale":"2023-10-06T05:25:40.668613+0000","last_undegraded":"2023-10-06T05:25:40.668613+0000","last_fullsized":"2023-10-06T05:25:40.668613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656221+0000","last_change":"2023-10-06T05:25:40.650557+0000","last_active":"2023-10-06T05:25:40.656221+0000","last_peered":"2023-10-06T05:25:40.656221+0000","last_clean":"2023-10-06T05:25:40.656221+0000","last_became_active":"2023-10-06T05:25:40.650254+0000","last_became_peered":"2023-10-06T05:25:40.650254+0000","last_unstale":"2023-10-06T05:25:40.656221+0000","last_undegraded":"2023-10-06T05:25:40.656221+0000","last_fullsized":"2023-10-06T05:25:40.656221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659455+0000","last_change":"2023-10-06T05:25:40.652762+0000","last_active":"2023-10-06T05:25:40.659455+0000","last_peered":"2023-10-06T05:25:40.659455+0000","last_clean":"2023-10-06T05:25:40.659455+0000","last_became_active":"2023-10-06T05:25:40.652458+0000","last_became_peered":"2023-10-06T05:25:40.652458+0000","last_unstale":"2023-10-06T05:25:40.659455+0000","last_undegraded":"2023-10-06T05:25:40.659455+0000","last_fullsized":"2023-10-06T05:25:40.659455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:12.635712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663186+0000","last_change":"2023-10-06T05:25:40.651354+0000","last_active":"2023-10-06T05:25:40.663186+0000","last_peered":"2023-10-06T05:25:40.663186+0000","last_clean":"2023-10-06T05:25:40.663186+0000","last_became_active":"2023-10-06T05:25:40.651057+0000","last_became_peered":"2023-10-06T05:25:40.651057+0000","last_unstale":"2023-10-06T05:25:40.663186+0000","last_undegraded":"2023-10-06T05:25:40.663186+0000","last_fullsized":"2023-10-06T05:25:40.663186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:37.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662132+0000","last_change":"2023-10-06T05:25:40.648238+0000","last_active":"2023-10-06T05:25:40.662132+0000","last_peered":"2023-10-06T05:25:40.662132+0000","last_clean":"2023-10-06T05:25:40.662132+0000","last_became_active":"2023-10-06T05:25:40.647824+0000","last_became_peered":"2023-10-06T05:25:40.647824+0000","last_unstale":"2023-10-06T05:25:40.662132+0000","last_undegraded":"2023-10-06T05:25:40.662132+0000","last_fullsized":"2023-10-06T05:25:40.662132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:33.454028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.652755+0000","last_change":"2023-10-06T05:25:40.647850+0000","last_active":"2023-10-06T05:25:40.652755+0000","last_peered":"2023-10-06T05:25:40.652755+0000","last_clean":"2023-10-06T05:25:40.652755+0000","last_became_active":"2023-10-06T05:25:40.647638+0000","last_became_peered":"2023-10-06T05:25:40.647638+0000","last_unstale":"2023-10-06T05:25:40.652755+0000","last_undegraded":"2023-10-06T05:25:40.652755+0000","last_fullsized":"2023-10-06T05:25:40.652755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663047+0000","last_change":"2023-10-06T05:25:40.657665+0000","last_active":"2023-10-06T05:25:40.663047+0000","last_peered":"2023-10-06T05:25:40.663047+0000","last_clean":"2023-10-06T05:25:40.663047+0000","last_became_active":"2023-10-06T05:25:40.656326+0000","last_became_peered":"2023-10-06T05:25:40.656326+0000","last_unstale":"2023-10-06T05:25:40.663047+0000","last_undegraded":"2023-10-06T05:25:40.663047+0000","last_fullsized":"2023-10-06T05:25:40.663047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:29.231778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659999+0000","last_change":"2023-10-06T05:25:40.654213+0000","last_active":"2023-10-06T05:25:40.659999+0000","last_peered":"2023-10-06T05:25:40.659999+0000","last_clean":"2023-10-06T05:25:40.659999+0000","last_became_active":"2023-10-06T05:25:40.653879+0000","last_became_peered":"2023-10-06T05:25:40.653879+0000","last_unstale":"2023-10-06T05:25:40.659999+0000","last_undegraded":"2023-10-06T05:25:40.659999+0000","last_fullsized":"2023-10-06T05:25:40.659999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:06.564230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668950+0000","last_change":"2023-10-06T05:25:40.664811+0000","last_active":"2023-10-06T05:25:40.668950+0000","last_peered":"2023-10-06T05:25:40.668950+0000","last_clean":"2023-10-06T05:25:40.668950+0000","last_became_active":"2023-10-06T05:25:40.662900+0000","last_became_peered":"2023-10-06T05:25:40.662900+0000","last_unstale":"2023-10-06T05:25:40.668950+0000","last_undegraded":"2023-10-06T05:25:40.668950+0000","last_fullsized":"2023-10-06T05:25:40.668950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657879+0000","last_change":"2023-10-06T05:25:40.649530+0000","last_active":"2023-10-06T05:25:40.657879+0000","last_peered":"2023-10-06T05:25:40.657879+0000","last_clean":"2023-10-06T05:25:40.657879+0000","last_became_active":"2023-10-06T05:25:40.649306+0000","last_became_peered":"2023-10-06T05:25:40.649306+0000","last_unstale":"2023-10-06T05:25:40.657879+0000","last_undegraded":"2023-10-06T05:25:40.657879+0000","last_fullsized":"2023-10-06T05:25:40.657879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:24.213618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663062+0000","last_change":"2023-10-06T05:25:40.656290+0000","last_active":"2023-10-06T05:25:40.663062+0000","last_peered":"2023-10-06T05:25:40.663062+0000","last_clean":"2023-10-06T05:25:40.663062+0000","last_became_active":"2023-10-06T05:25:40.655968+0000","last_became_peered":"2023-10-06T05:25:40.655968+0000","last_unstale":"2023-10-06T05:25:40.663062+0000","last_undegraded":"2023-10-06T05:25:40.663062+0000","last_fullsized":"2023-10-06T05:25:40.663062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:04.694861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.660496+0000","last_change":"2023-10-06T05:25:40.651544+0000","last_active":"2023-10-06T05:25:40.660496+0000","last_peered":"2023-10-06T05:25:40.660496+0000","last_clean":"2023-10-06T05:25:40.660496+0000","last_became_active":"2023-10-06T05:25:40.651160+0000","last_became_peered":"2023-10-06T05:25:40.651160+0000","last_unstale":"2023-10-06T05:25:40.660496+0000","last_undegraded":"2023-10-06T05:25:40.660496+0000","last_fullsized":"2023-10-06T05:25:40.660496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668308+0000","last_change":"2023-10-06T05:25:40.665366+0000","last_active":"2023-10-06T05:25:40.668308+0000","last_peered":"2023-10-06T05:25:40.668308+0000","last_clean":"2023-10-06T05:25:40.668308+0000","last_became_active":"2023-10-06T05:25:40.664987+0000","last_became_peered":"2023-10-06T05:25:40.664987+0000","last_unstale":"2023-10-06T05:25:40.668308+0000","last_undegraded":"2023-10-06T05:25:40.668308+0000","last_fullsized":"2023-10-06T05:25:40.668308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667832+0000","last_change":"2023-10-06T05:25:40.654793+0000","last_active":"2023-10-06T05:25:40.667832+0000","last_peered":"2023-10-06T05:25:40.667832+0000","last_clean":"2023-10-06T05:25:40.667832+0000","last_became_active":"2023-10-06T05:25:40.654476+0000","last_became_peered":"2023-10-06T05:25:40.654476+0000","last_unstale":"2023-10-06T05:25:40.667832+0000","last_undegraded":"2023-10-06T05:25:40.667832+0000","last_fullsized":"2023-10-06T05:25:40.667832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656922+0000","last_change":"2023-10-06T05:25:40.651368+0000","last_active":"2023-10-06T05:25:40.656922+0000","last_peered":"2023-10-06T05:25:40.656922+0000","last_clean":"2023-10-06T05:25:40.656922+0000","last_became_active":"2023-10-06T05:25:40.650938+0000","last_became_peered":"2023-10-06T05:25:40.650938+0000","last_unstale":"2023-10-06T05:25:40.656922+0000","last_undegraded":"2023-10-06T05:25:40.656922+0000","last_fullsized":"2023-10-06T05:25:40.656922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.581083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668218+0000","last_change":"2023-10-06T05:25:40.664677+0000","last_active":"2023-10-06T05:25:40.668218+0000","last_peered":"2023-10-06T05:25:40.668218+0000","last_clean":"2023-10-06T05:25:40.668218+0000","last_became_active":"2023-10-06T05:25:40.664171+0000","last_became_peered":"2023-10-06T05:25:40.664171+0000","last_unstale":"2023-10-06T05:25:40.668218+0000","last_undegraded":"2023-10-06T05:25:40.668218+0000","last_fullsized":"2023-10-06T05:25:40.668218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668224+0000","last_change":"2023-10-06T05:25:40.659304+0000","last_active":"2023-10-06T05:25:40.668224+0000","last_peered":"2023-10-06T05:25:40.668224+0000","last_clean":"2023-10-06T05:25:40.668224+0000","last_became_active":"2023-10-06T05:25:40.654657+0000","last_became_peered":"2023-10-06T05:25:40.654657+0000","last_unstale":"2023-10-06T05:25:40.668224+0000","last_undegraded":"2023-10-06T05:25:40.668224+0000","last_fullsized":"2023-10-06T05:25:40.668224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:55.603377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668210+0000","last_change":"2023-10-06T05:25:40.658604+0000","last_active":"2023-10-06T05:25:40.668210+0000","last_peered":"2023-10-06T05:25:40.668210+0000","last_clean":"2023-10-06T05:25:40.668210+0000","last_became_active":"2023-10-06T05:25:40.651895+0000","last_became_peered":"2023-10-06T05:25:40.651895+0000","last_unstale":"2023-10-06T05:25:40.668210+0000","last_undegraded":"2023-10-06T05:25:40.668210+0000","last_fullsized":"2023-10-06T05:25:40.668210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659944+0000","last_change":"2023-10-06T05:25:40.656488+0000","last_active":"2023-10-06T05:25:40.659944+0000","last_peered":"2023-10-06T05:25:40.659944+0000","last_clean":"2023-10-06T05:25:40.659944+0000","last_became_active":"2023-10-06T05:25:40.655672+0000","last_became_peered":"2023-10-06T05:25:40.655672+0000","last_unstale":"2023-10-06T05:25:40.659944+0000","last_undegraded":"2023-10-06T05:25:40.659944+0000","last_fullsized":"2023-10-06T05:25:40.659944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668507+0000","last_change":"2023-10-06T05:25:40.660602+0000","last_active":"2023-10-06T05:25:40.668507+0000","last_peered":"2023-10-06T05:25:40.668507+0000","last_clean":"2023-10-06T05:25:40.668507+0000","last_became_active":"2023-10-06T05:25:40.658211+0000","last_became_peered":"2023-10-06T05:25:40.658211+0000","last_unstale":"2023-10-06T05:25:40.668507+0000","last_undegraded":"2023-10-06T05:25:40.668507+0000","last_fullsized":"2023-10-06T05:25:40.668507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:29.231778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.664246+0000","last_change":"2023-10-06T05:25:40.657180+0000","last_active":"2023-10-06T05:25:40.664246+0000","last_peered":"2023-10-06T05:25:40.664246+0000","last_clean":"2023-10-06T05:25:40.664246+0000","last_became_active":"2023-10-06T05:25:40.656552+0000","last_became_peered":"2023-10-06T05:25:40.656552+0000","last_unstale":"2023-10-06T05:25:40.664246+0000","last_undegraded":"2023-10-06T05:25:40.664246+0000","last_fullsized":"2023-10-06T05:25:40.664246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662769+0000","last_change":"2023-10-06T05:25:40.653289+0000","last_active":"2023-10-06T05:25:40.662769+0000","last_peered":"2023-10-06T05:25:40.662769+0000","last_clean":"2023-10-06T05:25:40.662769+0000","last_became_active":"2023-10-06T05:25:40.652964+0000","last_became_peered":"2023-10-06T05:25:40.652964+0000","last_unstale":"2023-10-06T05:25:40.662769+0000","last_undegraded":"2023-10-06T05:25:40.662769+0000","last_fullsized":"2023-10-06T05:25:40.662769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662256+0000","last_change":"2023-10-06T05:25:40.654134+0000","last_active":"2023-10-06T05:25:40.662256+0000","last_peered":"2023-10-06T05:25:40.662256+0000","last_clean":"2023-10-06T05:25:40.662256+0000","last_became_active":"2023-10-06T05:25:40.653840+0000","last_became_peered":"2023-10-06T05:25:40.653840+0000","last_unstale":"2023-10-06T05:25:40.662256+0000","last_undegraded":"2023-10-06T05:25:40.662256+0000","last_fullsized":"2023-10-06T05:25:40.662256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667214+0000","last_change":"2023-10-06T05:25:40.657501+0000","last_active":"2023-10-06T05:25:40.667214+0000","last_peered":"2023-10-06T05:25:40.667214+0000","last_clean":"2023-10-06T05:25:40.667214+0000","last_became_active":"2023-10-06T05:25:40.657215+0000","last_became_peered":"2023-10-06T05:25:40.657215+0000","last_unstale":"2023-10-06T05:25:40.667214+0000","last_undegraded":"2023-10-06T05:25:40.667214+0000","last_fullsized":"2023-10-06T05:25:40.667214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:24.671427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662019+0000","last_change":"2023-10-06T05:25:40.653923+0000","last_active":"2023-10-06T05:25:40.662019+0000","last_peered":"2023-10-06T05:25:40.662019+0000","last_clean":"2023-10-06T05:25:40.662019+0000","last_became_active":"2023-10-06T05:25:40.653592+0000","last_became_peered":"2023-10-06T05:25:40.653592+0000","last_unstale":"2023-10-06T05:25:40.662019+0000","last_undegraded":"2023-10-06T05:25:40.662019+0000","last_fullsized":"2023-10-06T05:25:40.662019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:24.213618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668046+0000","last_change":"2023-10-06T05:25:39.646425+0000","last_active":"2023-10-06T05:25:40.668046+0000","last_peered":"2023-10-06T05:25:40.668046+0000","last_clean":"2023-10-06T05:25:40.668046+0000","last_became_active":"2023-10-06T05:25:39.646111+0000","last_became_peered":"2023-10-06T05:25:39.646111+0000","last_unstale":"2023-10-06T05:25:40.668046+0000","last_undegraded":"2023-10-06T05:25:40.668046+0000","last_fullsized":"2023-10-06T05:25:40.668046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:53:34.113340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659962+0000","last_change":"2023-10-06T05:25:40.656838+0000","last_active":"2023-10-06T05:25:40.659962+0000","last_peered":"2023-10-06T05:25:40.659962+0000","last_clean":"2023-10-06T05:25:40.659962+0000","last_became_active":"2023-10-06T05:25:40.656116+0000","last_became_peered":"2023-10-06T05:25:40.656116+0000","last_unstale":"2023-10-06T05:25:40.659962+0000","last_undegraded":"2023-10-06T05:25:40.659962+0000","last_fullsized":"2023-10-06T05:25:40.659962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640078+0000","last_change":"2023-10-06T05:25:39.650939+0000","last_active":"2023-10-06T05:25:40.640078+0000","last_peered":"2023-10-06T05:25:40.640078+0000","last_clean":"2023-10-06T05:25:40.640078+0000","last_became_active":"2023-10-06T05:25:39.650629+0000","last_became_peered":"2023-10-06T05:25:39.650629+0000","last_unstale":"2023-10-06T05:25:40.640078+0000","last_undegraded":"2023-10-06T05:25:40.640078+0000","last_fullsized":"2023-10-06T05:25:40.640078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668158+0000","last_change":"2023-10-06T05:25:40.657223+0000","last_active":"2023-10-06T05:25:40.668158+0000","last_peered":"2023-10-06T05:25:40.668158+0000","last_clean":"2023-10-06T05:25:40.668158+0000","last_became_active":"2023-10-06T05:25:40.656938+0000","last_became_peered":"2023-10-06T05:25:40.656938+0000","last_unstale":"2023-10-06T05:25:40.668158+0000","last_undegraded":"2023-10-06T05:25:40.668158+0000","last_fullsized":"2023-10-06T05:25:40.668158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642920+0000","last_change":"2023-10-06T05:25:39.649214+0000","last_active":"2023-10-06T05:25:40.642920+0000","last_peered":"2023-10-06T05:25:40.642920+0000","last_clean":"2023-10-06T05:25:40.642920+0000","last_became_active":"2023-10-06T05:25:39.648663+0000","last_became_peered":"2023-10-06T05:25:39.648663+0000","last_unstale":"2023-10-06T05:25:40.642920+0000","last_undegraded":"2023-10-06T05:25:40.642920+0000","last_fullsized":"2023-10-06T05:25:40.642920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:23.666945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.664350+0000","last_change":"2023-10-06T05:25:40.657849+0000","last_active":"2023-10-06T05:25:40.664350+0000","last_peered":"2023-10-06T05:25:40.664350+0000","last_clean":"2023-10-06T05:25:40.664350+0000","last_became_active":"2023-10-06T05:25:40.657491+0000","last_became_peered":"2023-10-06T05:25:40.657491+0000","last_unstale":"2023-10-06T05:25:40.664350+0000","last_undegraded":"2023-10-06T05:25:40.664350+0000","last_fullsized":"2023-10-06T05:25:40.664350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:56.403005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.670093+0000","last_change":"2023-10-06T05:25:39.649359+0000","last_active":"2023-10-06T05:25:40.670093+0000","last_peered":"2023-10-06T05:25:40.670093+0000","last_clean":"2023-10-06T05:25:40.670093+0000","last_became_active":"2023-10-06T05:25:39.649053+0000","last_became_peered":"2023-10-06T05:25:39.649053+0000","last_unstale":"2023-10-06T05:25:40.670093+0000","last_undegraded":"2023-10-06T05:25:40.670093+0000","last_fullsized":"2023-10-06T05:25:40.670093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:12.214301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667742+0000","last_change":"2023-10-06T05:25:39.649076+0000","last_active":"2023-10-06T05:25:40.667742+0000","last_peered":"2023-10-06T05:25:40.667742+0000","last_clean":"2023-10-06T05:25:40.667742+0000","last_became_active":"2023-10-06T05:25:39.648697+0000","last_became_peered":"2023-10-06T05:25:39.648697+0000","last_unstale":"2023-10-06T05:25:40.667742+0000","last_undegraded":"2023-10-06T05:25:40.667742+0000","last_fullsized":"2023-10-06T05:25:40.667742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:27.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.658270+0000","last_change":"2023-10-06T05:25:40.655308+0000","last_active":"2023-10-06T05:25:40.658270+0000","last_peered":"2023-10-06T05:25:40.658270+0000","last_clean":"2023-10-06T05:25:40.658270+0000","last_became_active":"2023-10-06T05:25:40.654916+0000","last_became_peered":"2023-10-06T05:25:40.654916+0000","last_unstale":"2023-10-06T05:25:40.658270+0000","last_undegraded":"2023-10-06T05:25:40.658270+0000","last_fullsized":"2023-10-06T05:25:40.658270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667897+0000","last_change":"2023-10-06T05:25:39.649974+0000","last_active":"2023-10-06T05:25:40.667897+0000","last_peered":"2023-10-06T05:25:40.667897+0000","last_clean":"2023-10-06T05:25:40.667897+0000","last_became_active":"2023-10-06T05:25:39.649670+0000","last_became_peered":"2023-10-06T05:25:39.649670+0000","last_unstale":"2023-10-06T05:25:40.667897+0000","last_undegraded":"2023-10-06T05:25:40.667897+0000","last_fullsized":"2023-10-06T05:25:40.667897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:53.879668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659599+0000","last_change":"2023-10-06T05:25:40.652556+0000","last_active":"2023-10-06T05:25:40.659599+0000","last_peered":"2023-10-06T05:25:40.659599+0000","last_clean":"2023-10-06T05:25:40.659599+0000","last_became_active":"2023-10-06T05:25:40.652257+0000","last_became_peered":"2023-10-06T05:25:40.652257+0000","last_unstale":"2023-10-06T05:25:40.659599+0000","last_undegraded":"2023-10-06T05:25:40.659599+0000","last_fullsized":"2023-10-06T05:25:40.659599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:56.403005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667980+0000","last_change":"2023-10-06T05:25:39.642832+0000","last_active":"2023-10-06T05:25:40.667980+0000","last_peered":"2023-10-06T05:25:40.667980+0000","last_clean":"2023-10-06T05:25:40.667980+0000","last_became_active":"2023-10-06T05:25:39.642583+0000","last_became_peered":"2023-10-06T05:25:39.642583+0000","last_unstale":"2023-10-06T05:25:40.667980+0000","last_undegraded":"2023-10-06T05:25:40.667980+0000","last_fullsized":"2023-10-06T05:25:40.667980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:18.821442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656884+0000","last_change":"2023-10-06T05:25:40.652099+0000","last_active":"2023-10-06T05:25:40.656884+0000","last_peered":"2023-10-06T05:25:40.656884+0000","last_clean":"2023-10-06T05:25:40.656884+0000","last_became_active":"2023-10-06T05:25:40.651805+0000","last_became_peered":"2023-10-06T05:25:40.651805+0000","last_unstale":"2023-10-06T05:25:40.656884+0000","last_undegraded":"2023-10-06T05:25:40.656884+0000","last_fullsized":"2023-10-06T05:25:40.656884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:35.122722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.634617+0000","last_change":"2023-10-06T05:25:39.647808+0000","last_active":"2023-10-06T05:25:40.634617+0000","last_peered":"2023-10-06T05:25:40.634617+0000","last_clean":"2023-10-06T05:25:40.634617+0000","last_became_active":"2023-10-06T05:25:39.647514+0000","last_became_peered":"2023-10-06T05:25:39.647514+0000","last_unstale":"2023-10-06T05:25:40.634617+0000","last_undegraded":"2023-10-06T05:25:40.634617+0000","last_fullsized":"2023-10-06T05:25:40.634617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:53.879668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667822+0000","last_change":"2023-10-06T05:25:40.654845+0000","last_active":"2023-10-06T05:25:40.667822+0000","last_peered":"2023-10-06T05:25:40.667822+0000","last_clean":"2023-10-06T05:25:40.667822+0000","last_became_active":"2023-10-06T05:25:40.654528+0000","last_became_peered":"2023-10-06T05:25:40.654528+0000","last_unstale":"2023-10-06T05:25:40.667822+0000","last_undegraded":"2023-10-06T05:25:40.667822+0000","last_fullsized":"2023-10-06T05:25:40.667822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:29.231778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668928+0000","last_change":"2023-10-06T05:25:39.654257+0000","last_active":"2023-10-06T05:25:40.668928+0000","last_peered":"2023-10-06T05:25:40.668928+0000","last_clean":"2023-10-06T05:25:40.668928+0000","last_became_active":"2023-10-06T05:25:39.653887+0000","last_became_peered":"2023-10-06T05:25:39.653887+0000","last_unstale":"2023-10-06T05:25:40.668928+0000","last_undegraded":"2023-10-06T05:25:40.668928+0000","last_fullsized":"2023-10-06T05:25:40.668928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:32.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.665508+0000","last_change":"2023-10-06T05:25:40.659413+0000","last_active":"2023-10-06T05:25:40.665508+0000","last_peered":"2023-10-06T05:25:40.665508+0000","last_clean":"2023-10-06T05:25:40.665508+0000","last_became_active":"2023-10-06T05:25:40.657813+0000","last_became_peered":"2023-10-06T05:25:40.657813+0000","last_unstale":"2023-10-06T05:25:40.665508+0000","last_undegraded":"2023-10-06T05:25:40.665508+0000","last_fullsized":"2023-10-06T05:25:40.665508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:14.451109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.634919+0000","last_change":"2023-10-06T05:25:39.645469+0000","last_active":"2023-10-06T05:25:40.634919+0000","last_peered":"2023-10-06T05:25:40.634919+0000","last_clean":"2023-10-06T05:25:40.634919+0000","last_became_active":"2023-10-06T05:25:39.645048+0000","last_became_peered":"2023-10-06T05:25:39.645048+0000","last_unstale":"2023-10-06T05:25:40.634919+0000","last_undegraded":"2023-10-06T05:25:40.634919+0000","last_fullsized":"2023-10-06T05:25:40.634919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:58.619912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657869+0000","last_change":"2023-10-06T05:25:40.650163+0000","last_active":"2023-10-06T05:25:40.657869+0000","last_peered":"2023-10-06T05:25:40.657869+0000","last_clean":"2023-10-06T05:25:40.657869+0000","last_became_active":"2023-10-06T05:25:40.649866+0000","last_became_peered":"2023-10-06T05:25:40.649866+0000","last_unstale":"2023-10-06T05:25:40.657869+0000","last_undegraded":"2023-10-06T05:25:40.657869+0000","last_fullsized":"2023-10-06T05:25:40.657869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.581083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.639533+0000","last_change":"2023-10-06T05:25:39.648409+0000","last_active":"2023-10-06T05:25:40.639533+0000","last_peered":"2023-10-06T05:25:40.639533+0000","last_clean":"2023-10-06T05:25:40.639533+0000","last_became_active":"2023-10-06T05:25:39.647601+0000","last_became_peered":"2023-10-06T05:25:39.647601+0000","last_unstale":"2023-10-06T05:25:40.639533+0000","last_undegraded":"2023-10-06T05:25:40.639533+0000","last_fullsized":"2023-10-06T05:25:40.639533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:58.619912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657848+0000","last_change":"2023-10-06T05:25:40.649485+0000","last_active":"2023-10-06T05:25:40.657848+0000","last_peered":"2023-10-06T05:25:40.657848+0000","last_clean":"2023-10-06T05:25:40.657848+0000","last_became_active":"2023-10-06T05:25:40.649196+0000","last_became_peered":"2023-10-06T05:25:40.649196+0000","last_unstale":"2023-10-06T05:25:40.657848+0000","last_undegraded":"2023-10-06T05:25:40.657848+0000","last_fullsized":"2023-10-06T05:25:40.657848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:13:45.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.633485+0000","last_change":"2023-10-06T05:25:39.645785+0000","last_active":"2023-10-06T05:25:40.633485+0000","last_peered":"2023-10-06T05:25:40.633485+0000","last_clean":"2023-10-06T05:25:40.633485+0000","last_became_active":"2023-10-06T05:25:39.645464+0000","last_became_peered":"2023-10-06T05:25:39.645464+0000","last_unstale":"2023-10-06T05:25:40.633485+0000","last_undegraded":"2023-10-06T05:25:40.633485+0000","last_fullsized":"2023-10-06T05:25:40.633485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.654959+0000","last_change":"2023-10-06T05:25:40.650246+0000","last_active":"2023-10-06T05:25:40.654959+0000","last_peered":"2023-10-06T05:25:40.654959+0000","last_clean":"2023-10-06T05:25:40.654959+0000","last_became_active":"2023-10-06T05:25:40.649077+0000","last_became_peered":"2023-10-06T05:25:40.649077+0000","last_unstale":"2023-10-06T05:25:40.654959+0000","last_undegraded":"2023-10-06T05:25:40.654959+0000","last_fullsized":"2023-10-06T05:25:40.654959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642551+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:25:40.642551+0000","last_peered":"2023-10-06T05:25:40.642551+0000","last_clean":"2023-10-06T05:25:40.642551+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:25:40.642551+0000","last_undegraded":"2023-10-06T05:25:40.642551+0000","last_fullsized":"2023-10-06T05:25:40.642551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.632788+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:25:40.632788+0000","last_peered":"2023-10-06T05:25:40.632788+0000","last_clean":"2023-10-06T05:25:40.632788+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:25:40.632788+0000","last_undegraded":"2023-10-06T05:25:40.632788+0000","last_fullsized":"2023-10-06T05:25:40.632788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.630148+0000","last_change":"2023-10-06T05:25:39.645950+0000","last_active":"2023-10-06T05:25:40.630148+0000","last_peered":"2023-10-06T05:25:40.630148+0000","last_clean":"2023-10-06T05:25:40.630148+0000","last_became_active":"2023-10-06T05:25:39.645615+0000","last_became_peered":"2023-10-06T05:25:39.645615+0000","last_unstale":"2023-10-06T05:25:40.630148+0000","last_undegraded":"2023-10-06T05:25:40.630148+0000","last_fullsized":"2023-10-06T05:25:40.630148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:53.879668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656838+0000","last_change":"2023-10-06T05:25:40.650348+0000","last_active":"2023-10-06T05:25:40.656838+0000","last_peered":"2023-10-06T05:25:40.656838+0000","last_clean":"2023-10-06T05:25:40.656838+0000","last_became_active":"2023-10-06T05:25:40.650054+0000","last_became_peered":"2023-10-06T05:25:40.650054+0000","last_unstale":"2023-10-06T05:25:40.656838+0000","last_undegraded":"2023-10-06T05:25:40.656838+0000","last_fullsized":"2023-10-06T05:25:40.656838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:07.043543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642450+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:25:40.642450+0000","last_peered":"2023-10-06T05:25:40.642450+0000","last_clean":"2023-10-06T05:25:40.642450+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:25:40.642450+0000","last_undegraded":"2023-10-06T05:25:40.642450+0000","last_fullsized":"2023-10-06T05:25:40.642450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.639797+0000","last_change":"2023-10-06T05:25:39.648749+0000","last_active":"2023-10-06T05:25:40.639797+0000","last_peered":"2023-10-06T05:25:40.639797+0000","last_clean":"2023-10-06T05:25:40.639797+0000","last_became_active":"2023-10-06T05:25:39.645268+0000","last_became_peered":"2023-10-06T05:25:39.645268+0000","last_unstale":"2023-10-06T05:25:40.639797+0000","last_undegraded":"2023-10-06T05:25:40.639797+0000","last_fullsized":"2023-10-06T05:25:40.639797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667879+0000","last_change":"2023-10-06T05:25:40.655542+0000","last_active":"2023-10-06T05:25:40.667879+0000","last_peered":"2023-10-06T05:25:40.667879+0000","last_clean":"2023-10-06T05:25:40.667879+0000","last_became_active":"2023-10-06T05:25:40.655243+0000","last_became_peered":"2023-10-06T05:25:40.655243+0000","last_unstale":"2023-10-06T05:25:40.667879+0000","last_undegraded":"2023-10-06T05:25:40.667879+0000","last_fullsized":"2023-10-06T05:25:40.667879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642698+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:25:40.642698+0000","last_peered":"2023-10-06T05:25:40.642698+0000","last_clean":"2023-10-06T05:25:40.642698+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:25:40.642698+0000","last_undegraded":"2023-10-06T05:25:40.642698+0000","last_fullsized":"2023-10-06T05:25:40.642698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640227+0000","last_change":"2023-10-06T05:25:39.650313+0000","last_active":"2023-10-06T05:25:40.640227+0000","last_peered":"2023-10-06T05:25:40.640227+0000","last_clean":"2023-10-06T05:25:40.640227+0000","last_became_active":"2023-10-06T05:25:39.650004+0000","last_became_peered":"2023-10-06T05:25:39.650004+0000","last_unstale":"2023-10-06T05:25:40.640227+0000","last_undegraded":"2023-10-06T05:25:40.640227+0000","last_fullsized":"2023-10-06T05:25:40.640227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.665445+0000","last_change":"2023-10-06T05:25:40.653499+0000","last_active":"2023-10-06T05:25:40.665445+0000","last_peered":"2023-10-06T05:25:40.665445+0000","last_clean":"2023-10-06T05:25:40.665445+0000","last_became_active":"2023-10-06T05:25:40.652683+0000","last_became_peered":"2023-10-06T05:25:40.652683+0000","last_unstale":"2023-10-06T05:25:40.665445+0000","last_undegraded":"2023-10-06T05:25:40.665445+0000","last_fullsized":"2023-10-06T05:25:40.665445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.634303+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:25:40.634303+0000","last_peered":"2023-10-06T05:25:40.634303+0000","last_clean":"2023-10-06T05:25:40.634303+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:25:40.634303+0000","last_undegraded":"2023-10-06T05:25:40.634303+0000","last_fullsized":"2023-10-06T05:25:40.634303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.645584+0000","last_change":"2023-10-06T05:25:39.653023+0000","last_active":"2023-10-06T05:25:40.645584+0000","last_peered":"2023-10-06T05:25:40.645584+0000","last_clean":"2023-10-06T05:25:40.645584+0000","last_became_active":"2023-10-06T05:25:39.652679+0000","last_became_peered":"2023-10-06T05:25:39.652679+0000","last_unstale":"2023-10-06T05:25:40.645584+0000","last_undegraded":"2023-10-06T05:25:40.645584+0000","last_fullsized":"2023-10-06T05:25:40.645584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.669116+0000","last_change":"2023-10-06T05:25:40.665644+0000","last_active":"2023-10-06T05:25:40.669116+0000","last_peered":"2023-10-06T05:25:40.669116+0000","last_clean":"2023-10-06T05:25:40.669116+0000","last_became_active":"2023-10-06T05:25:40.660838+0000","last_became_peered":"2023-10-06T05:25:40.660838+0000","last_unstale":"2023-10-06T05:25:40.669116+0000","last_undegraded":"2023-10-06T05:25:40.669116+0000","last_fullsized":"2023-10-06T05:25:40.669116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.636749+0000","last_change":"2023-10-06T05:25:39.648631+0000","last_active":"2023-10-06T05:25:40.636749+0000","last_peered":"2023-10-06T05:25:40.636749+0000","last_clean":"2023-10-06T05:25:40.636749+0000","last_became_active":"2023-10-06T05:25:39.648362+0000","last_became_peered":"2023-10-06T05:25:39.648362+0000","last_unstale":"2023-10-06T05:25:40.636749+0000","last_undegraded":"2023-10-06T05:25:40.636749+0000","last_fullsized":"2023-10-06T05:25:40.636749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:53:34.113340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.641183+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:25:40.641183+0000","last_peered":"2023-10-06T05:25:40.641183+0000","last_clean":"2023-10-06T05:25:40.641183+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:25:40.641183+0000","last_undegraded":"2023-10-06T05:25:40.641183+0000","last_fullsized":"2023-10-06T05:25:40.641183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.669146+0000","last_change":"2023-10-06T05:25:40.660343+0000","last_active":"2023-10-06T05:25:40.669146+0000","last_peered":"2023-10-06T05:25:40.669146+0000","last_clean":"2023-10-06T05:25:40.669146+0000","last_became_active":"2023-10-06T05:25:40.652927+0000","last_became_peered":"2023-10-06T05:25:40.652927+0000","last_unstale":"2023-10-06T05:25:40.669146+0000","last_undegraded":"2023-10-06T05:25:40.669146+0000","last_fullsized":"2023-10-06T05:25:40.669146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640731+0000","last_change":"2023-10-06T05:25:39.651074+0000","last_active":"2023-10-06T05:25:40.640731+0000","last_peered":"2023-10-06T05:25:40.640731+0000","last_clean":"2023-10-06T05:25:40.640731+0000","last_became_active":"2023-10-06T05:25:39.650792+0000","last_became_peered":"2023-10-06T05:25:39.650792+0000","last_unstale":"2023-10-06T05:25:40.640731+0000","last_undegraded":"2023-10-06T05:25:40.640731+0000","last_fullsized":"2023-10-06T05:25:40.640731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:36.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.644998+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:25:40.644998+0000","last_peered":"2023-10-06T05:25:40.644998+0000","last_clean":"2023-10-06T05:25:40.644998+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:25:40.644998+0000","last_undegraded":"2023-10-06T05:25:40.644998+0000","last_fullsized":"2023-10-06T05:25:40.644998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.651695+0000","last_change":"2023-10-06T05:25:40.647939+0000","last_active":"2023-10-06T05:25:40.651695+0000","last_peered":"2023-10-06T05:25:40.651695+0000","last_clean":"2023-10-06T05:25:40.651695+0000","last_became_active":"2023-10-06T05:25:40.647637+0000","last_became_peered":"2023-10-06T05:25:40.647637+0000","last_unstale":"2023-10-06T05:25:40.651695+0000","last_undegraded":"2023-10-06T05:25:40.651695+0000","last_fullsized":"2023-10-06T05:25:40.651695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:55.603377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667544+0000","last_change":"2023-10-06T05:25:39.646802+0000","last_active":"2023-10-06T05:25:40.667544+0000","last_peered":"2023-10-06T05:25:40.667544+0000","last_clean":"2023-10-06T05:25:40.667544+0000","last_became_active":"2023-10-06T05:25:39.646464+0000","last_became_peered":"2023-10-06T05:25:39.646464+0000","last_unstale":"2023-10-06T05:25:40.667544+0000","last_undegraded":"2023-10-06T05:25:40.667544+0000","last_fullsized":"2023-10-06T05:25:40.667544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.641083+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:25:40.641083+0000","last_peered":"2023-10-06T05:25:40.641083+0000","last_clean":"2023-10-06T05:25:40.641083+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:25:40.641083+0000","last_undegraded":"2023-10-06T05:25:40.641083+0000","last_fullsized":"2023-10-06T05:25:40.641083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.664530+0000","last_change":"2023-10-06T05:25:40.656613+0000","last_active":"2023-10-06T05:25:40.664530+0000","last_peered":"2023-10-06T05:25:40.664530+0000","last_clean":"2023-10-06T05:25:40.664530+0000","last_became_active":"2023-10-06T05:25:40.656295+0000","last_became_peered":"2023-10-06T05:25:40.656295+0000","last_unstale":"2023-10-06T05:25:40.664530+0000","last_undegraded":"2023-10-06T05:25:40.664530+0000","last_fullsized":"2023-10-06T05:25:40.664530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:13:45.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.648188+0000","last_change":"2023-10-06T05:25:39.648524+0000","last_active":"2023-10-06T05:25:40.648188+0000","last_peered":"2023-10-06T05:25:40.648188+0000","last_clean":"2023-10-06T05:25:40.648188+0000","last_became_active":"2023-10-06T05:25:39.648217+0000","last_became_peered":"2023-10-06T05:25:39.648217+0000","last_unstale":"2023-10-06T05:25:40.648188+0000","last_undegraded":"2023-10-06T05:25:40.648188+0000","last_fullsized":"2023-10-06T05:25:40.648188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:12.214301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.632885+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:25:40.632885+0000","last_peered":"2023-10-06T05:25:40.632885+0000","last_clean":"2023-10-06T05:25:40.632885+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:25:40.632885+0000","last_undegraded":"2023-10-06T05:25:40.632885+0000","last_fullsized":"2023-10-06T05:25:40.632885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.653834+0000","last_change":"2023-10-06T05:25:40.646109+0000","last_active":"2023-10-06T05:25:40.653834+0000","last_peered":"2023-10-06T05:25:40.653834+0000","last_clean":"2023-10-06T05:25:40.653834+0000","last_became_active":"2023-10-06T05:25:40.645670+0000","last_became_peered":"2023-10-06T05:25:40.645670+0000","last_unstale":"2023-10-06T05:25:40.653834+0000","last_undegraded":"2023-10-06T05:25:40.653834+0000","last_fullsized":"2023-10-06T05:25:40.653834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659523+0000","last_change":"2023-10-06T05:25:40.651457+0000","last_active":"2023-10-06T05:25:40.659523+0000","last_peered":"2023-10-06T05:25:40.659523+0000","last_clean":"2023-10-06T05:25:40.659523+0000","last_became_active":"2023-10-06T05:25:40.651136+0000","last_became_peered":"2023-10-06T05:25:40.651136+0000","last_unstale":"2023-10-06T05:25:40.659523+0000","last_undegraded":"2023-10-06T05:25:40.659523+0000","last_fullsized":"2023-10-06T05:25:40.659523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.671043+0000","last_change":"2023-10-06T05:25:39.642604+0000","last_active":"2023-10-06T05:25:40.671043+0000","last_peered":"2023-10-06T05:25:40.671043+0000","last_clean":"2023-10-06T05:25:40.671043+0000","last_became_active":"2023-10-06T05:25:39.642261+0000","last_became_peered":"2023-10-06T05:25:39.642261+0000","last_unstale":"2023-10-06T05:25:40.671043+0000","last_undegraded":"2023-10-06T05:25:40.671043+0000","last_fullsized":"2023-10-06T05:25:40.671043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:40.419929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668144+0000","last_change":"2023-10-06T05:25:40.658190+0000","last_active":"2023-10-06T05:25:40.668144+0000","last_peered":"2023-10-06T05:25:40.668144+0000","last_clean":"2023-10-06T05:25:40.668144+0000","last_became_active":"2023-10-06T05:25:40.652990+0000","last_became_peered":"2023-10-06T05:25:40.652990+0000","last_unstale":"2023-10-06T05:25:40.668144+0000","last_undegraded":"2023-10-06T05:25:40.668144+0000","last_fullsized":"2023-10-06T05:25:40.668144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:08.157544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667893+0000","last_change":"2023-10-06T05:25:39.648924+0000","last_active":"2023-10-06T05:25:40.667893+0000","last_peered":"2023-10-06T05:25:40.667893+0000","last_clean":"2023-10-06T05:25:40.667893+0000","last_became_active":"2023-10-06T05:25:39.648562+0000","last_became_peered":"2023-10-06T05:25:39.648562+0000","last_unstale":"2023-10-06T05:25:40.667893+0000","last_undegraded":"2023-10-06T05:25:40.667893+0000","last_fullsized":"2023-10-06T05:25:40.667893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:06.039061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.633764+0000","last_change":"2023-10-06T05:25:39.639616+0000","last_active":"2023-10-06T05:25:40.633764+0000","last_peered":"2023-10-06T05:25:40.633764+0000","last_clean":"2023-10-06T05:25:40.633764+0000","last_became_active":"2023-10-06T05:25:39.639332+0000","last_became_peered":"2023-10-06T05:25:39.639332+0000","last_unstale":"2023-10-06T05:25:40.633764+0000","last_undegraded":"2023-10-06T05:25:40.633764+0000","last_fullsized":"2023-10-06T05:25:40.633764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:32.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662281+0000","last_change":"2023-10-06T05:25:40.655147+0000","last_active":"2023-10-06T05:25:40.662281+0000","last_peered":"2023-10-06T05:25:40.662281+0000","last_clean":"2023-10-06T05:25:40.662281+0000","last_became_active":"2023-10-06T05:25:40.654858+0000","last_became_peered":"2023-10-06T05:25:40.654858+0000","last_unstale":"2023-10-06T05:25:40.662281+0000","last_undegraded":"2023-10-06T05:25:40.662281+0000","last_fullsized":"2023-10-06T05:25:40.662281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:12.635712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640870+0000","last_change":"2023-10-06T05:25:39.644781+0000","last_active":"2023-10-06T05:25:40.640870+0000","last_peered":"2023-10-06T05:25:40.640870+0000","last_clean":"2023-10-06T05:25:40.640870+0000","last_became_active":"2023-10-06T05:25:39.643752+0000","last_became_peered":"2023-10-06T05:25:39.643752+0000","last_unstale":"2023-10-06T05:25:40.640870+0000","last_undegraded":"2023-10-06T05:25:40.640870+0000","last_fullsized":"2023-10-06T05:25:40.640870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:58.619912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.652623+0000","last_change":"2023-10-06T05:25:40.646184+0000","last_active":"2023-10-06T05:25:40.652623+0000","last_peered":"2023-10-06T05:25:40.652623+0000","last_clean":"2023-10-06T05:25:40.652623+0000","last_became_active":"2023-10-06T05:25:40.645885+0000","last_became_peered":"2023-10-06T05:25:40.645885+0000","last_unstale":"2023-10-06T05:25:40.652623+0000","last_undegraded":"2023-10-06T05:25:40.652623+0000","last_fullsized":"2023-10-06T05:25:40.652623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.652805+0000","last_change":"2023-10-06T05:25:40.645235+0000","last_active":"2023-10-06T05:25:40.652805+0000","last_peered":"2023-10-06T05:25:40.652805+0000","last_clean":"2023-10-06T05:25:40.652805+0000","last_became_active":"2023-10-06T05:25:40.644011+0000","last_became_peered":"2023-10-06T05:25:40.644011+0000","last_unstale":"2023-10-06T05:25:40.652805+0000","last_undegraded":"2023-10-06T05:25:40.652805+0000","last_fullsized":"2023-10-06T05:25:40.652805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:53:35.117823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.633175+0000","last_change":"2023-10-06T05:25:39.653597+0000","last_active":"2023-10-06T05:25:40.633175+0000","last_peered":"2023-10-06T05:25:40.633175+0000","last_clean":"2023-10-06T05:25:40.633175+0000","last_became_active":"2023-10-06T05:25:39.653182+0000","last_became_peered":"2023-10-06T05:25:39.653182+0000","last_unstale":"2023-10-06T05:25:40.633175+0000","last_undegraded":"2023-10-06T05:25:40.633175+0000","last_fullsized":"2023-10-06T05:25:40.633175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:27.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668115+0000","last_change":"2023-10-06T05:25:40.656142+0000","last_active":"2023-10-06T05:25:40.668115+0000","last_peered":"2023-10-06T05:25:40.668115+0000","last_clean":"2023-10-06T05:25:40.668115+0000","last_became_active":"2023-10-06T05:25:40.655855+0000","last_became_peered":"2023-10-06T05:25:40.655855+0000","last_unstale":"2023-10-06T05:25:40.668115+0000","last_undegraded":"2023-10-06T05:25:40.668115+0000","last_fullsized":"2023-10-06T05:25:40.668115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.639959+0000","last_change":"2023-10-06T05:25:39.647617+0000","last_active":"2023-10-06T05:25:40.639959+0000","last_peered":"2023-10-06T05:25:40.639959+0000","last_clean":"2023-10-06T05:25:40.639959+0000","last_became_active":"2023-10-06T05:25:39.647339+0000","last_became_peered":"2023-10-06T05:25:39.647339+0000","last_unstale":"2023-10-06T05:25:40.639959+0000","last_undegraded":"2023-10-06T05:25:40.639959+0000","last_fullsized":"2023-10-06T05:25:40.639959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662166+0000","last_change":"2023-10-06T05:25:40.654281+0000","last_active":"2023-10-06T05:25:40.662166+0000","last_peered":"2023-10-06T05:25:40.662166+0000","last_clean":"2023-10-06T05:25:40.662166+0000","last_became_active":"2023-10-06T05:25:40.653887+0000","last_became_peered":"2023-10-06T05:25:40.653887+0000","last_unstale":"2023-10-06T05:25:40.662166+0000","last_undegraded":"2023-10-06T05:25:40.662166+0000","last_fullsized":"2023-10-06T05:25:40.662166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.670357+0000","last_change":"2023-10-06T05:25:39.650088+0000","last_active":"2023-10-06T05:25:40.670357+0000","last_peered":"2023-10-06T05:25:40.670357+0000","last_clean":"2023-10-06T05:25:40.670357+0000","last_became_active":"2023-10-06T05:25:39.649849+0000","last_became_peered":"2023-10-06T05:25:39.649849+0000","last_unstale":"2023-10-06T05:25:40.670357+0000","last_undegraded":"2023-10-06T05:25:40.670357+0000","last_fullsized":"2023-10-06T05:25:40.670357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:12.214301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663216+0000","last_change":"2023-10-06T05:25:40.656643+0000","last_active":"2023-10-06T05:25:40.663216+0000","last_peered":"2023-10-06T05:25:40.663216+0000","last_clean":"2023-10-06T05:25:40.663216+0000","last_became_active":"2023-10-06T05:25:40.656184+0000","last_became_peered":"2023-10-06T05:25:40.656184+0000","last_unstale":"2023-10-06T05:25:40.663216+0000","last_undegraded":"2023-10-06T05:25:40.663216+0000","last_fullsized":"2023-10-06T05:25:40.663216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:28.259232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668354+0000","last_change":"2023-10-06T05:25:39.650188+0000","last_active":"2023-10-06T05:25:40.668354+0000","last_peered":"2023-10-06T05:25:40.668354+0000","last_clean":"2023-10-06T05:25:40.668354+0000","last_became_active":"2023-10-06T05:25:39.649862+0000","last_became_peered":"2023-10-06T05:25:39.649862+0000","last_unstale":"2023-10-06T05:25:40.668354+0000","last_undegraded":"2023-10-06T05:25:40.668354+0000","last_fullsized":"2023-10-06T05:25:40.668354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:36.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667272+0000","last_change":"2023-10-06T05:25:40.664421+0000","last_active":"2023-10-06T05:25:40.667272+0000","last_peered":"2023-10-06T05:25:40.667272+0000","last_clean":"2023-10-06T05:25:40.667272+0000","last_became_active":"2023-10-06T05:25:40.664125+0000","last_became_peered":"2023-10-06T05:25:40.664125+0000","last_unstale":"2023-10-06T05:25:40.667272+0000","last_undegraded":"2023-10-06T05:25:40.667272+0000","last_fullsized":"2023-10-06T05:25:40.667272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:28.190832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667628+0000","last_change":"2023-10-06T05:25:39.646681+0000","last_active":"2023-10-06T05:25:40.667628+0000","last_peered":"2023-10-06T05:25:40.667628+0000","last_clean":"2023-10-06T05:25:40.667628+0000","last_became_active":"2023-10-06T05:25:39.646351+0000","last_became_peered":"2023-10-06T05:25:39.646351+0000","last_unstale":"2023-10-06T05:25:40.667628+0000","last_undegraded":"2023-10-06T05:25:40.667628+0000","last_fullsized":"2023-10-06T05:25:40.667628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:27.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662786+0000","last_change":"2023-10-06T05:25:40.658180+0000","last_active":"2023-10-06T05:25:40.662786+0000","last_peered":"2023-10-06T05:25:40.662786+0000","last_clean":"2023-10-06T05:25:40.662786+0000","last_became_active":"2023-10-06T05:25:40.657860+0000","last_became_peered":"2023-10-06T05:25:40.657860+0000","last_unstale":"2023-10-06T05:25:40.662786+0000","last_undegraded":"2023-10-06T05:25:40.662786+0000","last_fullsized":"2023-10-06T05:25:40.662786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:16.418406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667622+0000","last_change":"2023-10-06T05:25:39.645234+0000","last_active":"2023-10-06T05:25:40.667622+0000","last_peered":"2023-10-06T05:25:40.667622+0000","last_clean":"2023-10-06T05:25:40.667622+0000","last_became_active":"2023-10-06T05:25:39.644921+0000","last_became_peered":"2023-10-06T05:25:39.644921+0000","last_unstale":"2023-10-06T05:25:40.667622+0000","last_undegraded":"2023-10-06T05:25:40.667622+0000","last_fullsized":"2023-10-06T05:25:40.667622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.651655+0000","last_change":"2023-10-06T05:25:40.647515+0000","last_active":"2023-10-06T05:25:40.651655+0000","last_peered":"2023-10-06T05:25:40.651655+0000","last_clean":"2023-10-06T05:25:40.651655+0000","last_became_active":"2023-10-06T05:25:40.647229+0000","last_became_peered":"2023-10-06T05:25:40.647229+0000","last_unstale":"2023-10-06T05:25:40.651655+0000","last_undegraded":"2023-10-06T05:25:40.651655+0000","last_fullsized":"2023-10-06T05:25:40.651655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.666635+0000","last_change":"2023-10-06T05:25:39.646056+0000","last_active":"2023-10-06T05:25:40.666635+0000","last_peered":"2023-10-06T05:25:40.666635+0000","last_clean":"2023-10-06T05:25:40.666635+0000","last_became_active":"2023-10-06T05:25:39.645679+0000","last_became_peered":"2023-10-06T05:25:39.645679+0000","last_unstale":"2023-10-06T05:25:40.666635+0000","last_undegraded":"2023-10-06T05:25:40.666635+0000","last_fullsized":"2023-10-06T05:25:40.666635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:36.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657934+0000","last_change":"2023-10-06T05:25:40.649520+0000","last_active":"2023-10-06T05:25:40.657934+0000","last_peered":"2023-10-06T05:25:40.657934+0000","last_clean":"2023-10-06T05:25:40.657934+0000","last_became_active":"2023-10-06T05:25:40.649109+0000","last_became_peered":"2023-10-06T05:25:40.649109+0000","last_unstale":"2023-10-06T05:25:40.657934+0000","last_undegraded":"2023-10-06T05:25:40.657934+0000","last_fullsized":"2023-10-06T05:25:40.657934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668977+0000","last_change":"2023-10-06T05:25:39.652715+0000","last_active":"2023-10-06T05:25:40.668977+0000","last_peered":"2023-10-06T05:25:40.668977+0000","last_clean":"2023-10-06T05:25:40.668977+0000","last_became_active":"2023-10-06T05:25:39.652403+0000","last_became_peered":"2023-10-06T05:25:39.652403+0000","last_unstale":"2023-10-06T05:25:40.668977+0000","last_undegraded":"2023-10-06T05:25:40.668977+0000","last_fullsized":"2023-10-06T05:25:40.668977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:32.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":679457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":88929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301636,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070204,"statfs":{"total":96636764160,"available":96327888896,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301632,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070208,"statfs":{"total":96636764160,"available":96327892992,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301632,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070208,"statfs":{"total":96636764160,"available":96327892992,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302204,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069636,"statfs":{"total":96636764160,"available":96327307264,"internally_reserved":0,"allocated":839680,"data_stored":678259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:25:44.980 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T05:25:44.981 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T05:25:44.981 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T05:25:44.981 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T05:25:44.981 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T05:25:45.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 Processor -- start 2023-10-06T05:25:45.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 -- start start 2023-10-06T05:25:45.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f540c9220 0x7f4f540c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f540c7090 con 0x7f4f54158fa0 2023-10-06T05:25:45.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5406b9b0 con 0x7f4f54158bd0 2023-10-06T05:25:45.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f54159420 con 0x7f4f540c9220 2023-10-06T05:25:45.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5a643700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f540c9220 0x7f4f540c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f59641700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4f54158fa0 0x7f4f540ac700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50512/0 (socket says 172.21.15.29:50512) 2023-10-06T05:25:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f59641700 1 -- 172.21.15.29:0/2226850023 learned_addr learned my addr 172.21.15.29:0/2226850023 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5a643700 1 -- 172.21.15.29:0/2226850023 >> v1:172.21.15.173:6789/0 conn(0x7f4f54158bd0 legacy=0x7f4f5406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5a643700 1 -- 172.21.15.29:0/2226850023 >> v1:172.21.15.29:6789/0 conn(0x7f4f54158fa0 legacy=0x7f4f540ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5a643700 1 -- 172.21.15.29:0/2226850023 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5406bc80 con 0x7f4f540c9220 2023-10-06T05:25:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5a643700 1 --2- 172.21.15.29:0/2226850023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 0x7f4f540c9640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009e60 tx=0x7f4f4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9e5e4bb00a401b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f58e40700 1 -- 172.21.15.29:0/2226850023 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00e070 con 0x7f4f540c9220 2023-10-06T05:25:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f58e40700 1 -- 172.21.15.29:0/2226850023 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c00bc30 con 0x7f4f540c9220 2023-10-06T05:25:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f58e40700 1 -- 172.21.15.29:0/2226850023 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c012430 con 0x7f4f540c9220 2023-10-06T05:25:45.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 -- 172.21.15.29:0/2226850023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 msgr2=0x7f4f540c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 --2- 172.21.15.29:0/2226850023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 0x7f4f540c9640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009e60 tx=0x7f4f4c009780 comp rx=0 tx=0).stop 2023-10-06T05:25:45.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 -- 172.21.15.29:0/2226850023 shutdown_connections 2023-10-06T05:25:45.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 --2- 172.21.15.29:0/2226850023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 0x7f4f540c9640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 -- 172.21.15.29:0/2226850023 >> 172.21.15.29:0/2226850023 conn(0x7f4f5406d7d0 msgr2=0x7f4f5406dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:45.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 -- 172.21.15.29:0/2226850023 shutdown_connections 2023-10-06T05:25:45.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.089+0000 7f4f5ae44700 1 -- 172.21.15.29:0/2226850023 wait complete. 2023-10-06T05:25:45.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f5ae44700 1 Processor -- start 2023-10-06T05:25:45.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f5ae44700 1 -- start start 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f5ae44700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 0x7f4f540aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f5ae44700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f54158bd0 0x7f4f540af800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f5ae44700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f54158fa0 0x7f4f54153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f5ae44700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540b0030 con 0x7f4f540c9220 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f5ae44700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540b0310 con 0x7f4f54158bd0 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f5ae44700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540b05f0 con 0x7f4f54158fa0 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f59e42700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 0x7f4f540aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f59e42700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 0x7f4f540aac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51128/0 (socket says 172.21.15.29:51128) 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f59e42700 1 -- 172.21.15.29:0/3382931467 learned_addr learned my addr 172.21.15.29:0/3382931467 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f59641700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f54158bd0 0x7f4f540af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.093+0000 7f4f5a643700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f54158fa0 0x7f4f54153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f59e42700 1 -- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f54158fa0 msgr2=0x7f4f54153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f59e42700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f54158fa0 0x7f4f54153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f59e42700 1 -- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f54158bd0 msgr2=0x7f4f540af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f59e42700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f54158bd0 0x7f4f540af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f59e42700 1 -- 172.21.15.29:0/3382931467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c009a20 con 0x7f4f540c9220 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f59641700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f54158bd0 0x7f4f540af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f59e42700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 0x7f4f540aac50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000c790 tx=0x7f4f50007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f49ffb700 1 -- 172.21.15.29:0/3382931467 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50011590 con 0x7f4f540c9220 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f49ffb700 1 -- 172.21.15.29:0/3382931467 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f50011710 con 0x7f4f540c9220 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f540b08d0 con 0x7f4f540c9220 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f49ffb700 1 -- 172.21.15.29:0/3382931467 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50011ad0 con 0x7f4f540c9220 2023-10-06T05:25:45.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f540afd40 con 0x7f4f540c9220 2023-10-06T05:25:45.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f54156fc0 con 0x7f4f540c9220 2023-10-06T05:25:45.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f49ffb700 1 -- 172.21.15.29:0/3382931467 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4f5001b3b0 con 0x7f4f540c9220 2023-10-06T05:25:45.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.097+0000 7f4f49ffb700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4f38060550 0x7f4f38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.101+0000 7f4f49ffb700 1 -- 172.21.15.29:0/3382931467 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f5007be40 con 0x7f4f540c9220 2023-10-06T05:25:45.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.101+0000 7f4f59641700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4f38060550 0x7f4f38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.101+0000 7f4f59641700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4f38060550 0x7f4f38062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f541540f0 tx=0x7f4f44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:45.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.105+0000 7f4f49ffb700 1 -- 172.21.15.29:0/3382931467 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4f5004c350 con 0x7f4f540c9220 2023-10-06T05:25:45.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.309+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4f54156fc0 con 0x7f4f540c9220 2023-10-06T05:25:45.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.313+0000 7f4f49ffb700 1 -- 172.21.15.29:0/3382931467 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154137 (secure 0 0 0) 0x7f4f54156fc0 con 0x7f4f540c9220 2023-10-06T05:25:45.322 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4f38060550 msgr2=0x7f4f38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4f38060550 0x7f4f38062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f541540f0 tx=0x7f4f44009040 comp rx=0 tx=0).stop 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 msgr2=0x7f4f540aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 0x7f4f540aac50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000c790 tx=0x7f4f50007f40 comp rx=0 tx=0).stop 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 shutdown_connections 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f54158fa0 0x7f4f54153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4f38060550 0x7f4f38062a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f54158bd0 0x7f4f540af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 --2- 172.21.15.29:0/3382931467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f540c9220 0x7f4f540aac50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 >> 172.21.15.29:0/3382931467 conn(0x7f4f5406d7d0 msgr2=0x7f4f540ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:45.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 shutdown_connections 2023-10-06T05:25:45.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.317+0000 7f4f5ae44700 1 -- 172.21.15.29:0/3382931467 wait complete. 2023-10-06T05:25:45.337 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":33379},{"type":"v1","addr":"172.21.15.173:6833","nonce":33379}]},"active_addr":"172.21.15.173:6833/33379","active_change":"2023-10-06T05:25:20.627025+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":2536442642}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":880361583}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":3177499554}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":1226886847}]}]} 2023-10-06T05:25:45.340 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T05:25:45.341 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T05:25:45.341 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 Processor -- start 2023-10-06T05:25:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 -- start start 2023-10-06T05:25:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 0x7f22bc156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f22bc0c6ff0 0x7f22bc0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc1566c0 con 0x7f22bc1556a0 2023-10-06T05:25:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc1599c0 con 0x7f22bc0c6ff0 2023-10-06T05:25:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0c7b40 con 0x7f22bc156b50 2023-10-06T05:25:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22bb7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f22bc1556a0 0x7f22bc155a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50516/0 (socket says 172.21.15.29:50516) 2023-10-06T05:25:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22bb7fe700 1 -- 172.21.15.29:0/3639552167 learned_addr learned my addr 172.21.15.29:0/3639552167 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22bbfff700 1 --2- 172.21.15.29:0/3639552167 >> v2:172.21.15.29:3300/0 conn(0x7f22bc0c6ff0 0x7f22bc0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22baffd700 1 --2- 172.21.15.29:0/3639552167 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 0x7f22bc156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22ba7fc700 1 -- 172.21.15.29:0/3639552167 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319529551 0 0) 0x7f22bc1566c0 con 0x7f22bc1556a0 2023-10-06T05:25:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22ba7fc700 1 -- 172.21.15.29:0/3639552167 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a4003570 con 0x7f22bc1556a0 2023-10-06T05:25:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22bbfff700 1 -- 172.21.15.29:0/3639552167 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 msgr2=0x7f22bc156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22ba7fc700 1 -- 172.21.15.29:0/3639552167 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3452265912 0 0) 0x7f22a4003570 con 0x7f22bc1556a0 2023-10-06T05:25:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22bbfff700 1 --2- 172.21.15.29:0/3639552167 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 0x7f22bc156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22bbfff700 1 -- 172.21.15.29:0/3639552167 >> v1:172.21.15.29:6789/0 conn(0x7f22bc1556a0 legacy=0x7f22bc155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22bbfff700 1 -- 172.21.15.29:0/3639552167 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0c7e20 con 0x7f22bc0c6ff0 2023-10-06T05:25:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22bbfff700 1 --2- 172.21.15.29:0/3639552167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc0c6ff0 0x7f22bc0c7450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009e60 tx=0x7f22b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be85d0738c78203 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22ba7fc700 1 -- 172.21.15.29:0/3639552167 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400e070 con 0x7f22bc0c6ff0 2023-10-06T05:25:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22ba7fc700 1 -- 172.21.15.29:0/3639552167 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400b7a0 con 0x7f22bc0c6ff0 2023-10-06T05:25:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22ba7fc700 1 -- 172.21.15.29:0/3639552167 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0001470 con 0x7f22bc0c6ff0 2023-10-06T05:25:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 -- 172.21.15.29:0/3639552167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc0c6ff0 msgr2=0x7f22bc0c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 --2- 172.21.15.29:0/3639552167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc0c6ff0 0x7f22bc0c7450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009e60 tx=0x7f22b4009780 comp rx=0 tx=0).stop 2023-10-06T05:25:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 -- 172.21.15.29:0/3639552167 shutdown_connections 2023-10-06T05:25:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 --2- 172.21.15.29:0/3639552167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc0c6ff0 0x7f22bc0c7450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 --2- 172.21.15.29:0/3639552167 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 0x7f22bc156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 -- 172.21.15.29:0/3639552167 >> 172.21.15.29:0/3639552167 conn(0x7f22bc06d7d0 msgr2=0x7f22bc06dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:45.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.449+0000 7f22c0c25700 1 -- 172.21.15.29:0/3639552167 shutdown_connections 2023-10-06T05:25:45.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 -- 172.21.15.29:0/3639552167 wait complete. 2023-10-06T05:25:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 Processor -- start 2023-10-06T05:25:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 -- start start 2023-10-06T05:25:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22bc0c6ff0 0x7f22bc14be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc1556a0 0x7f22bc148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 0x7f22bc0bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc14b980 con 0x7f22bc1556a0 2023-10-06T05:25:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc14b050 con 0x7f22bc0c6ff0 2023-10-06T05:25:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc14b330 con 0x7f22bc156b50 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22baffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc1556a0 0x7f22bc148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22baffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc1556a0 0x7f22bc148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51148/0 (socket says 172.21.15.29:51148) 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22bb7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22bc0c6ff0 0x7f22bc14be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22baffd700 1 -- 172.21.15.29:0/2226633703 learned_addr learned my addr 172.21.15.29:0/2226633703 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22bbfff700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 0x7f22bc0bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22baffd700 1 -- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 msgr2=0x7f22bc0bfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22baffd700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 0x7f22bc0bfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22baffd700 1 -- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22bc0c6ff0 msgr2=0x7f22bc14be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22baffd700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22bc0c6ff0 0x7f22bc14be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22baffd700 1 -- 172.21.15.29:0/2226633703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4009a20 con 0x7f22bc1556a0 2023-10-06T05:25:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22baffd700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc1556a0 0x7f22bc148e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00ec80 tx=0x7f22ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22a37fe700 1 -- 172.21.15.29:0/2226633703 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac009690 con 0x7f22bc1556a0 2023-10-06T05:25:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22a37fe700 1 -- 172.21.15.29:0/2226633703 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac00c850 con 0x7f22bc1556a0 2023-10-06T05:25:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc14b610 con 0x7f22bc1556a0 2023-10-06T05:25:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22a37fe700 1 -- 172.21.15.29:0/2226633703 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00cc10 con 0x7f22bc1556a0 2023-10-06T05:25:45.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.453+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc0bff80 con 0x7f22bc1556a0 2023-10-06T05:25:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.457+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc04be00 con 0x7f22bc1556a0 2023-10-06T05:25:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.457+0000 7f22a37fe700 1 -- 172.21.15.29:0/2226633703 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f22ac013470 con 0x7f22bc1556a0 2023-10-06T05:25:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.461+0000 7f22a37fe700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22a8060550 0x7f22a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.461+0000 7f22a37fe700 1 -- 172.21.15.29:0/2226633703 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f22ac07cbb0 con 0x7f22bc1556a0 2023-10-06T05:25:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.461+0000 7f22bb7fe700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22a8060550 0x7f22a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.461+0000 7f22bb7fe700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22a8060550 0x7f22a8062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22b0004e60 tx=0x7f22b0001a10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:45.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.465+0000 7f22a37fe700 1 -- 172.21.15.29:0/2226633703 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f22ac04cfa0 con 0x7f22bc1556a0 2023-10-06T05:25:45.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.625+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22bc06b4c0 con 0x7f22bc1556a0 2023-10-06T05:25:45.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.625+0000 7f22a37fe700 1 -- 172.21.15.29:0/2226633703 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f22ac0505c0 con 0x7f22bc1556a0 2023-10-06T05:25:45.631 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:45.631 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:45.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22a8060550 msgr2=0x7f22a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22a8060550 0x7f22a8062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22b0004e60 tx=0x7f22b0001a10 comp rx=0 tx=0).stop 2023-10-06T05:25:45.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc1556a0 msgr2=0x7f22bc148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc1556a0 0x7f22bc148e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00ec80 tx=0x7f22ac0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 shutdown_connections 2023-10-06T05:25:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f22bc156b50 0x7f22bc0bfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22bc1556a0 0x7f22bc148e70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22a8060550 0x7f22a8062a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 --2- 172.21.15.29:0/2226633703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22bc0c6ff0 0x7f22bc14be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 >> 172.21.15.29:0/2226633703 conn(0x7f22bc06d7d0 msgr2=0x7f22bc14cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:45.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 shutdown_connections 2023-10-06T05:25:45.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.629+0000 7f22c0c25700 1 -- 172.21.15.29:0/2226633703 wait complete. 2023-10-06T05:25:45.645 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T05:25:45.645 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:45.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 Processor -- start 2023-10-06T05:25:45.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 -- start start 2023-10-06T05:25:45.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f99c01605e0 0x7f99c00c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99c006b320 0x7f99c00c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c00c2980 con 0x7f99c00ca1f0 2023-10-06T05:25:45.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c00ca630 con 0x7f99c006b320 2023-10-06T05:25:45.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c00c6bb0 con 0x7f99c01605e0 2023-10-06T05:25:45.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99beffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99c006b320 0x7f99c00c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99beffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99c006b320 0x7f99c00c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51160/0 (socket says 172.21.15.29:51160) 2023-10-06T05:25:45.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99beffd700 1 -- 172.21.15.29:0/321744979 learned_addr learned my addr 172.21.15.29:0/321744979 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99bf7fe700 1 --2- 172.21.15.29:0/321744979 >> v2:172.21.15.173:3300/0 conn(0x7f99c01605e0 0x7f99c00c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99beffd700 1 -- 172.21.15.29:0/321744979 >> v2:172.21.15.173:3300/0 conn(0x7f99c01605e0 msgr2=0x7f99c00c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99beffd700 1 --2- 172.21.15.29:0/321744979 >> v2:172.21.15.173:3300/0 conn(0x7f99c01605e0 0x7f99c00c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99beffd700 1 -- 172.21.15.29:0/321744979 >> v1:172.21.15.173:6789/0 conn(0x7f99c00ca1f0 legacy=0x7f99c006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99beffd700 1 -- 172.21.15.29:0/321744979 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c00c6e90 con 0x7f99c006b320 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99bf7fe700 1 --2- 172.21.15.29:0/321744979 >> v2:172.21.15.173:3300/0 conn(0x7f99c01605e0 0x7f99c00c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99beffd700 1 --2- 172.21.15.29:0/321744979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c006b320 0x7f99c00c9cb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99c006d780 tx=0x7f99b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b41811485fe83b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99be7fc700 1 -- 172.21.15.29:0/321744979 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000e070 con 0x7f99c006b320 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99be7fc700 1 -- 172.21.15.29:0/321744979 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000ba10 con 0x7f99c006b320 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99be7fc700 1 -- 172.21.15.29:0/321744979 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00092e0 con 0x7f99c006b320 2023-10-06T05:25:45.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 -- 172.21.15.29:0/321744979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c006b320 msgr2=0x7f99c00c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 --2- 172.21.15.29:0/321744979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c006b320 0x7f99c00c9cb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99c006d780 tx=0x7f99b0009840 comp rx=0 tx=0).stop 2023-10-06T05:25:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 -- 172.21.15.29:0/321744979 shutdown_connections 2023-10-06T05:25:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 --2- 172.21.15.29:0/321744979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c006b320 0x7f99c00c9cb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 --2- 172.21.15.29:0/321744979 >> v2:172.21.15.173:3300/0 conn(0x7f99c01605e0 0x7f99c00c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 -- 172.21.15.29:0/321744979 >> 172.21.15.29:0/321744979 conn(0x7f99c00670a0 msgr2=0x7f99c00674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 -- 172.21.15.29:0/321744979 shutdown_connections 2023-10-06T05:25:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.749+0000 7f99c4d32700 1 -- 172.21.15.29:0/321744979 wait complete. 2023-10-06T05:25:45.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.753+0000 7f99c4d32700 1 Processor -- start 2023-10-06T05:25:45.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.753+0000 7f99c4d32700 1 -- start start 2023-10-06T05:25:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99c4d32700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c006b320 0x7f99c0152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99c4d32700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c00ca1f0 0x7f99c0156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99c4d32700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c01605e0 0x7f99c00c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99c4d32700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c016e080 con 0x7f99c01605e0 2023-10-06T05:25:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99c4d32700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0158e50 con 0x7f99c006b320 2023-10-06T05:25:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99c4d32700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0152f80 con 0x7f99c00ca1f0 2023-10-06T05:25:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bf7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c006b320 0x7f99c0152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c01605e0 0x7f99c00c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99beffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c00ca1f0 0x7f99c0156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bf7fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c006b320 0x7f99c0152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45654/0 (socket says 172.21.15.29:45654) 2023-10-06T05:25:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99beffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c00ca1f0 0x7f99c0156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52640/0 (socket says 172.21.15.29:52640) 2023-10-06T05:25:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99beffd700 1 -- 172.21.15.29:0/1175815858 learned_addr learned my addr 172.21.15.29:0/1175815858 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c01605e0 0x7f99c00c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51164/0 (socket says 172.21.15.29:51164) 2023-10-06T05:25:45.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bffff700 1 -- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c00ca1f0 msgr2=0x7f99c0156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bffff700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c00ca1f0 0x7f99c0156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bffff700 1 -- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c006b320 msgr2=0x7f99c0152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bffff700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c006b320 0x7f99c0152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bffff700 1 -- 172.21.15.29:0/1175815858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0009ae0 con 0x7f99c01605e0 2023-10-06T05:25:45.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99beffd700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c00ca1f0 0x7f99c0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:45.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99bffff700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c01605e0 0x7f99c00c4660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99b800c490 tx=0x7f99b8007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:45.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99b77fe700 1 -- 172.21.15.29:0/1175815858 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b800ce40 con 0x7f99c01605e0 2023-10-06T05:25:45.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99b77fe700 1 -- 172.21.15.29:0/1175815858 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b8011590 con 0x7f99c01605e0 2023-10-06T05:25:45.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c016d750 con 0x7f99c01605e0 2023-10-06T05:25:45.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99b77fe700 1 -- 172.21.15.29:0/1175815858 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8011950 con 0x7f99c01605e0 2023-10-06T05:25:45.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.757+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c016dd10 con 0x7f99c01605e0 2023-10-06T05:25:45.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.761+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c016e230 con 0x7f99c01605e0 2023-10-06T05:25:45.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.761+0000 7f99b77fe700 1 -- 172.21.15.29:0/1175815858 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f99b8011d40 con 0x7f99c01605e0 2023-10-06T05:25:45.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.761+0000 7f99b77fe700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99a0060550 0x7f99a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:45.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.761+0000 7f99b77fe700 1 -- 172.21.15.29:0/1175815858 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f99b807c410 con 0x7f99c01605e0 2023-10-06T05:25:45.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.761+0000 7f99bf7fe700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99a0060550 0x7f99a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:45.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.761+0000 7f99bf7fe700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99a0060550 0x7f99a0062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f99a8006fd0 tx=0x7f99a8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.765+0000 7f99b77fe700 1 -- 172.21.15.29:0/1175815858 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f99c016e230 con 0x7f99c01605e0 2023-10-06T05:25:45.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.925+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99c004be00 con 0x7f99c01605e0 2023-10-06T05:25:45.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99b77fe700 1 -- 172.21.15.29:0/1175815858 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f99b804c8a0 con 0x7f99c01605e0 2023-10-06T05:25:45.934 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:45.934 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:45.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99a0060550 msgr2=0x7f99a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99a0060550 0x7f99a0062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f99a8006fd0 tx=0x7f99a8008040 comp rx=0 tx=0).stop 2023-10-06T05:25:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c01605e0 msgr2=0x7f99c00c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c01605e0 0x7f99c00c4660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99b800c490 tx=0x7f99b8007ea0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 shutdown_connections 2023-10-06T05:25:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c01605e0 0x7f99c00c4660 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c00ca1f0 0x7f99c0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99a0060550 0x7f99a0062a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 --2- 172.21.15.29:0/1175815858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c006b320 0x7f99c0152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 >> 172.21.15.29:0/1175815858 conn(0x7f99c00670a0 msgr2=0x7f99c00c51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:45.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.929+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 shutdown_connections 2023-10-06T05:25:45.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:45.933+0000 7f99c4d32700 1 -- 172.21.15.29:0/1175815858 wait complete. 2023-10-06T05:25:45.948 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T05:25:45.949 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T05:25:45.949 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T05:25:45.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T05:25:45.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T05:25:45.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T05:25:45.951 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T05:25:45.951 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T05:25:46.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448f59e700 1 Processor -- start 2023-10-06T05:25:46.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448f59e700 1 -- start start 2023-10-06T05:25:46.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44901581c0 0x7f44900c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f44900ca8c0 0x7f44900c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44900c9120 con 0x7f4490158590 2023-10-06T05:25:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44900c7d50 con 0x7f44900ca8c0 2023-10-06T05:25:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900c6d30 con 0x7f44901581c0 2023-10-06T05:25:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448dd9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4490158590 0x7f44900ca1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50520/0 (socket says 172.21.15.29:50520) 2023-10-06T05:25:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448ed9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f44900ca8c0 0x7f44900c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448dd9b700 1 -- 172.21.15.29:0/239845599 learned_addr learned my addr 172.21.15.29:0/239845599 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448e59c700 1 --2- 172.21.15.29:0/239845599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44901581c0 0x7f44900c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448ed9d700 1 -- 172.21.15.29:0/239845599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44901581c0 msgr2=0x7f44900c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448ed9d700 1 --2- 172.21.15.29:0/239845599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44901581c0 0x7f44900c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448ed9d700 1 -- 172.21.15.29:0/239845599 >> v1:172.21.15.29:6789/0 conn(0x7f4490158590 legacy=0x7f44900ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448ed9d700 1 -- 172.21.15.29:0/239845599 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44900c7010 con 0x7f44900ca8c0 2023-10-06T05:25:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448ed9d700 1 --2- 172.21.15.29:0/239845599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 0x7f44900c83d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4488007c00 tx=0x7f4488006470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df94e32a514bdf9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448d59a700 1 -- 172.21.15.29:0/239845599 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488007260 con 0x7f44900ca8c0 2023-10-06T05:25:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448d59a700 1 -- 172.21.15.29:0/239845599 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44880073c0 con 0x7f44900ca8c0 2023-10-06T05:25:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f448d59a700 1 -- 172.21.15.29:0/239845599 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800c7f0 con 0x7f44900ca8c0 2023-10-06T05:25:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f5415cfd700 1 Processor -- start 2023-10-06T05:25:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.089+0000 7f5415cfd700 1 -- start start 2023-10-06T05:25:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 -- 172.21.15.29:0/239845599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 msgr2=0x7f44900c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 --2- 172.21.15.29:0/239845599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 0x7f44900c83d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4488007c00 tx=0x7f4488006470 comp rx=0 tx=0).stop 2023-10-06T05:25:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 -- 172.21.15.29:0/239845599 shutdown_connections 2023-10-06T05:25:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 --2- 172.21.15.29:0/239845599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 0x7f44900c83d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 --2- 172.21.15.29:0/239845599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44901581c0 0x7f44900c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 -- 172.21.15.29:0/239845599 >> 172.21.15.29:0/239845599 conn(0x7f44900670a0 msgr2=0x7f44900674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 -- 172.21.15.29:0/239845599 shutdown_connections 2023-10-06T05:25:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 -- 172.21.15.29:0/239845599 wait complete. 2023-10-06T05:25:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f5415cfd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f54100ac9e0 0x7f54100acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f5415cfd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 0x7f541006f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f5415cfd700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54100af010 con 0x7f54100aeb70 2023-10-06T05:25:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f5415cfd700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541015ce10 con 0x7f54100ac9e0 2023-10-06T05:25:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f5415cfd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541015d0f0 con 0x7f541006cdd0 2023-10-06T05:25:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58cde28700 1 Processor -- start 2023-10-06T05:25:46.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f54100aeb70 0x7f5410158920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50524/0 (socket says 172.21.15.29:50524) 2023-10-06T05:25:46.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540ffff700 1 -- 172.21.15.29:0/907851355 learned_addr learned my addr 172.21.15.29:0/907851355 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:46.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540f7fe700 1 --2- 172.21.15.29:0/907851355 >> v2:172.21.15.173:3300/0 conn(0x7f54100ac9e0 0x7f54100acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58cde28700 1 -- start start 2023-10-06T05:25:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540e7fc700 1 -- 172.21.15.29:0/907851355 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152992058 0 0) 0x7f54100af010 con 0x7f54100aeb70 2023-10-06T05:25:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540e7fc700 1 -- 172.21.15.29:0/907851355 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f8003570 con 0x7f54100aeb70 2023-10-06T05:25:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540f7fe700 1 -- 172.21.15.29:0/907851355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 msgr2=0x7f541006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58a70ac700 1 Processor -- start 2023-10-06T05:25:46.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 Processor -- start 2023-10-06T05:25:46.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540e7fc700 1 -- 172.21.15.29:0/907851355 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3692472399 0 0) 0x7f53f8003570 con 0x7f54100aeb70 2023-10-06T05:25:46.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540effd700 1 --2- 172.21.15.29:0/907851355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 0x7f541006f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f8611460700 1 Processor -- start 2023-10-06T05:25:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f8611460700 1 -- start start 2023-10-06T05:25:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540f7fe700 1 --2- 172.21.15.29:0/907851355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 0x7f541006f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540f7fe700 1 -- 172.21.15.29:0/907851355 >> v1:172.21.15.29:6789/0 conn(0x7f54100aeb70 legacy=0x7f5410158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540f7fe700 1 -- 172.21.15.29:0/907851355 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541015d3d0 con 0x7f54100ac9e0 2023-10-06T05:25:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540effd700 1 --2- 172.21.15.29:0/907851355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 0x7f541006f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:25:46.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58a70ac700 1 -- start start 2023-10-06T05:25:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58cde28700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f58c815ace0 0x7f58c806b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58cde28700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58c815e490 0x7f58c80cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58cde28700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c806b280 con 0x7f58c80c9ea0 2023-10-06T05:25:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58cde28700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c806bc50 con 0x7f58c815e490 2023-10-06T05:25:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58cde28700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c806a670 con 0x7f58c815ace0 2023-10-06T05:25:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 -- start start 2023-10-06T05:25:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540f7fe700 1 --2- 172.21.15.29:0/907851355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54100ac9e0 0x7f54100acdb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54000098e0 tx=0x7f54000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8127da183a21a2f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58c7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58c815e490 0x7f58c80cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58cce26700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f58c815ace0 0x7f58c806b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540e7fc700 1 -- 172.21.15.29:0/907851355 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080017f0 con 0x7f54100ac9e0 2023-10-06T05:25:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540e7fc700 1 -- 172.21.15.29:0/907851355 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400011420 con 0x7f54100ac9e0 2023-10-06T05:25:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f540e7fc700 1 -- 172.21.15.29:0/907851355 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54000117a0 con 0x7f54100ac9e0 2023-10-06T05:25:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58c7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58c815e490 0x7f58c80cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51172/0 (socket says 172.21.15.29:51172) 2023-10-06T05:25:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58c7fff700 1 -- 172.21.15.29:0/3705274713 learned_addr learned my addr 172.21.15.29:0/3705274713 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f8611460700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c150000 0x7f860c06e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f8611460700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c15cb40 con 0x7f860c0ac720 2023-10-06T05:25:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f8611460700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c15cd90 con 0x7f860c0a6690 2023-10-06T05:25:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f8611460700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c15d070 con 0x7f860c150000 2023-10-06T05:25:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58c7fff700 1 -- 172.21.15.29:0/3705274713 >> v2:172.21.15.173:3300/0 conn(0x7f58c815ace0 msgr2=0x7f58c806b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58c7fff700 1 --2- 172.21.15.29:0/3705274713 >> v2:172.21.15.173:3300/0 conn(0x7f58c815ace0 0x7f58c806b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58c7fff700 1 -- 172.21.15.29:0/3705274713 >> v1:172.21.15.173:6789/0 conn(0x7f58c80c9ea0 legacy=0x7f58c80ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f58c7fff700 1 -- 172.21.15.29:0/3705274713 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c806a950 con 0x7f58c815e490 2023-10-06T05:25:46.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 0x7f4490148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44901581c0 0x7f44901659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.093+0000 7f448f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44900a5120 0x7f4490167390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44901662f0 con 0x7f44900ca8c0 2023-10-06T05:25:46.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448f59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44901665d0 con 0x7f44901581c0 2023-10-06T05:25:46.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44901668b0 con 0x7f44900a5120 2023-10-06T05:25:46.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 0x7f4490148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 0x7f4490148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51184/0 (socket says 172.21.15.29:51184) 2023-10-06T05:25:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448e59c700 1 -- 172.21.15.29:0/3335906506 learned_addr learned my addr 172.21.15.29:0/3335906506 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448dd9b700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44901581c0 0x7f44901659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f860a7fc700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f860c0a6690 0x7f860c0abdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:38408/0 (socket says 172.21.15.29:38408) 2023-10-06T05:25:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f860a7fc700 1 -- 172.21.15.29:0/3181217438 learned_addr learned my addr 172.21.15.29:0/3181217438 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:46.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448ed9d700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44900a5120 0x7f4490167390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f860affd700 1 --2- 172.21.15.29:0/3181217438 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c150000 0x7f860c06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448e59c700 1 -- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44900a5120 msgr2=0x7f4490167390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448e59c700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44900a5120 0x7f4490167390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448e59c700 1 -- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44901581c0 msgr2=0x7f44901659a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448e59c700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44901581c0 0x7f44901659a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448e59c700 1 -- 172.21.15.29:0/3335906506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488007740 con 0x7f44900ca8c0 2023-10-06T05:25:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a70ac700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f58a00a6690 0x7f58a006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58c7fff700 1 --2- 172.21.15.29:0/3705274713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815e490 0x7f58c80cc1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58c806e7a0 tx=0x7f58bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38e5b533fe4e602 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a70ac700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58a00ac720 0x7f58a00acb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a70ac700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a00ad0d0 con 0x7f58a0150000 2023-10-06T05:25:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f5415cfd700 1 -- 172.21.15.29:0/907851355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54100ac9e0 msgr2=0x7f54100acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f5415cfd700 1 --2- 172.21.15.29:0/907851355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54100ac9e0 0x7f54100acdb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54000098e0 tx=0x7f54000091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a70ac700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a015cb40 con 0x7f58a00ac720 2023-10-06T05:25:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f8609ffb700 1 -- 172.21.15.29:0/3181217438 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473638445 0 0) 0x7f860c15cd90 con 0x7f860c0a6690 2023-10-06T05:25:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a70ac700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a015cd90 con 0x7f58a00a6690 2023-10-06T05:25:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f860affd700 1 -- 172.21.15.29:0/3181217438 >> v1:172.21.15.173:6789/0 conn(0x7f860c0a6690 legacy=0x7f860c0abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f860affd700 1 -- 172.21.15.29:0/3181217438 >> v1:172.21.15.29:6789/0 conn(0x7f860c0ac720 legacy=0x7f860c0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f860affd700 1 -- 172.21.15.29:0/3181217438 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c15d350 con 0x7f860c150000 2023-10-06T05:25:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f5415cfd700 1 -- 172.21.15.29:0/907851355 shutdown_connections 2023-10-06T05:25:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f5415cfd700 1 --2- 172.21.15.29:0/907851355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 0x7f541006f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f5415cfd700 1 --2- 172.21.15.29:0/907851355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54100ac9e0 0x7f54100acdb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f5415cfd700 1 -- 172.21.15.29:0/907851355 >> 172.21.15.29:0/907851355 conn(0x7f5410067b70 msgr2=0x7f541006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a5649700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58a00ac720 0x7f58a00acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f5415cfd700 1 -- 172.21.15.29:0/907851355 shutdown_connections 2023-10-06T05:25:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448e59c700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 0x7f4490148510 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4480010db0 tx=0x7f448000b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58c77fe700 1 -- 172.21.15.29:0/3705274713 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc009e70 con 0x7f58c815e490 2023-10-06T05:25:46.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58c77fe700 1 -- 172.21.15.29:0/3705274713 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc00b860 con 0x7f58c815e490 2023-10-06T05:25:46.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a5649700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58a00ac720 0x7f58a00acb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51200/0 (socket says 172.21.15.29:51200) 2023-10-06T05:25:46.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a5649700 1 -- 172.21.15.29:0/1213591270 learned_addr learned my addr 172.21.15.29:0/1213591270 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58c77fe700 1 -- 172.21.15.29:0/3705274713 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00bc00 con 0x7f58c815e490 2023-10-06T05:25:46.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f447e7fc700 1 -- 172.21.15.29:0/3335906506 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448000ed90 con 0x7f44900ca8c0 2023-10-06T05:25:46.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4490166b90 con 0x7f44900ca8c0 2023-10-06T05:25:46.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f447e7fc700 1 -- 172.21.15.29:0/3335906506 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480019440 con 0x7f44900ca8c0 2023-10-06T05:25:46.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f447e7fc700 1 -- 172.21.15.29:0/3335906506 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480019800 con 0x7f44900ca8c0 2023-10-06T05:25:46.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4490148a50 con 0x7f44900ca8c0 2023-10-06T05:25:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58cde28700 1 -- 172.21.15.29:0/3705274713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815e490 msgr2=0x7f58c80cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58cde28700 1 --2- 172.21.15.29:0/3705274713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815e490 0x7f58c80cc1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58c806e7a0 tx=0x7f58bc009250 comp rx=0 tx=0).stop 2023-10-06T05:25:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58cde28700 1 -- 172.21.15.29:0/3705274713 shutdown_connections 2023-10-06T05:25:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a5649700 1 -- 172.21.15.29:0/1213591270 >> v2:172.21.15.173:3300/0 conn(0x7f58a00a6690 msgr2=0x7f58a006e730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T05:25:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a5649700 1 --2- 172.21.15.29:0/1213591270 >> v2:172.21.15.173:3300/0 conn(0x7f58a00a6690 0x7f58a006e730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a5649700 1 -- 172.21.15.29:0/1213591270 >> v1:172.21.15.173:6789/0 conn(0x7f58a0150000 legacy=0x7f58a00abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a5649700 1 -- 172.21.15.29:0/1213591270 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a015d070 con 0x7f58a00ac720 2023-10-06T05:25:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58a5649700 1 --2- 172.21.15.29:0/1213591270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58a00ac720 0x7f58a00acb90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58a00698b0 tx=0x7f5898009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a554a8e61eb5cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f860affd700 1 --2- 172.21.15.29:0/3181217438 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c150000 0x7f860c06e730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009910 tx=0x7f85fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7740c4ea1d7e6c35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f8609ffb700 1 -- 172.21.15.29:0/3181217438 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc00b860 con 0x7f860c150000 2023-10-06T05:25:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f8609ffb700 1 -- 172.21.15.29:0/3181217438 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc00b9c0 con 0x7f860c150000 2023-10-06T05:25:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f8609ffb700 1 -- 172.21.15.29:0/3181217438 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc00bd60 con 0x7f860c150000 2023-10-06T05:25:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58cde28700 1 --2- 172.21.15.29:0/3705274713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815e490 0x7f58c80cc1a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58cde28700 1 --2- 172.21.15.29:0/3705274713 >> v2:172.21.15.173:3300/0 conn(0x7f58c815ace0 0x7f58c806b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58cde28700 1 -- 172.21.15.29:0/3705274713 >> 172.21.15.29:0/3705274713 conn(0x7f58c80670a0 msgr2=0x7f58c8067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f589f7fe700 1 -- 172.21.15.29:0/1213591270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800e070 con 0x7f58a00ac720 2023-10-06T05:25:46.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f589f7fe700 1 -- 172.21.15.29:0/1213591270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589800ba10 con 0x7f58a00ac720 2023-10-06T05:25:46.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f589f7fe700 1 -- 172.21.15.29:0/1213591270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58980092e0 con 0x7f58a00ac720 2023-10-06T05:25:46.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58cde28700 1 -- 172.21.15.29:0/3705274713 shutdown_connections 2023-10-06T05:25:46.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f58cde28700 1 -- 172.21.15.29:0/3705274713 wait complete. 2023-10-06T05:25:46.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f8611460700 1 -- 172.21.15.29:0/3181217438 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c150000 msgr2=0x7f860c06e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f8611460700 1 --2- 172.21.15.29:0/3181217438 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c150000 0x7f860c06e730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009910 tx=0x7f85fc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f8611460700 1 -- 172.21.15.29:0/3181217438 shutdown_connections 2023-10-06T05:25:46.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f8611460700 1 --2- 172.21.15.29:0/3181217438 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c150000 0x7f860c06e730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f8611460700 1 -- 172.21.15.29:0/3181217438 >> 172.21.15.29:0/3181217438 conn(0x7f860c067b70 msgr2=0x7f860c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7f5415cfd700 1 -- 172.21.15.29:0/907851355 wait complete. 2023-10-06T05:25:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f5415cfd700 1 Processor -- start 2023-10-06T05:25:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f5415cfd700 1 -- start start 2023-10-06T05:25:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58a70ac700 1 -- 172.21.15.29:0/1213591270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58a00ac720 msgr2=0x7f58a00acb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58a70ac700 1 --2- 172.21.15.29:0/1213591270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58a00ac720 0x7f58a00acb90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58a00698b0 tx=0x7f5898009840 comp rx=0 tx=0).stop 2023-10-06T05:25:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58cde28700 1 Processor -- start 2023-10-06T05:25:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f447e7fc700 1 -- 172.21.15.29:0/3335906506 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4480019bb0 con 0x7f44900ca8c0 2023-10-06T05:25:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4490166740 con 0x7f44900ca8c0 2023-10-06T05:25:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f447e7fc700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4470060550 0x7f4470062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f8611460700 1 -- 172.21.15.29:0/3181217438 shutdown_connections 2023-10-06T05:25:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58cde28700 1 -- start start 2023-10-06T05:25:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f864f59e700 1 Processor -- start 2023-10-06T05:25:46.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58a70ac700 1 -- 172.21.15.29:0/1213591270 shutdown_connections 2023-10-06T05:25:46.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58a70ac700 1 --2- 172.21.15.29:0/1213591270 >> v2:172.21.15.173:3300/0 conn(0x7f58a00a6690 0x7f58a006e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58a70ac700 1 --2- 172.21.15.29:0/1213591270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58a00ac720 0x7f58a00acb90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58a70ac700 1 -- 172.21.15.29:0/1213591270 >> 172.21.15.29:0/1213591270 conn(0x7f58a0067b70 msgr2=0x7f58a006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7fc0d98fb700 1 Processor -- start 2023-10-06T05:25:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.097+0000 7fc0d98fb700 1 -- start start 2023-10-06T05:25:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d98fb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 0x7fc0d40ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d98fb700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc0d4165530 0x7fc0d4165990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f447e7fc700 1 -- 172.21.15.29:0/3335906506 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f448007ef30 con 0x7f44900ca8c0 2023-10-06T05:25:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f448dd9b700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4470060550 0x7f4470062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f447e7fc700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f4470068d80 0x7f447006b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f447e7fc700 1 -- 172.21.15.29:0/3335906506 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f447006b840 con 0x7f4470068d80 2023-10-06T05:25:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f447e7fc700 1 -- 172.21.15.29:0/3335906506 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4480052f00 con 0x7f44900ca8c0 2023-10-06T05:25:46.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f448ed9d700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f4470068d80 0x7f447006b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f8611460700 1 -- 172.21.15.29:0/3181217438 wait complete. 2023-10-06T05:25:46.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d98fb700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d4165ed0 con 0x7fc0d406b950 2023-10-06T05:25:46.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d98fb700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d40cc4d0 con 0x7fc0d4165530 2023-10-06T05:25:46.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d98fb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d406a8b0 con 0x7fc0d40ca020 2023-10-06T05:25:46.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d3fff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc0d406b950 0x7fc0d40cbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:38428/0 (socket says 172.21.15.29:38428) 2023-10-06T05:25:46.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d3fff700 1 -- 172.21.15.29:0/1139063098 learned_addr learned my addr 172.21.15.29:0/1139063098 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:46.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f864f59e700 1 -- start start 2023-10-06T05:25:46.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58a70ac700 1 -- 172.21.15.29:0/1213591270 shutdown_connections 2023-10-06T05:25:46.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d88f9700 1 --2- 172.21.15.29:0/1139063098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 0x7fc0d40ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d90fa700 1 --2- 172.21.15.29:0/1139063098 >> v2:172.21.15.173:3300/0 conn(0x7fc0d4165530 0x7fc0d4165990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58a70ac700 1 -- 172.21.15.29:0/1213591270 wait complete. 2023-10-06T05:25:46.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f5415cfd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 0x7f541015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f5415cfd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54100ac9e0 0x7f5410155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d37fe700 1 -- 172.21.15.29:0/1139063098 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440570853 0 0) 0x7fc0d4165ed0 con 0x7fc0d406b950 2023-10-06T05:25:46.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d37fe700 1 -- 172.21.15.29:0/1139063098 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0bc003570 con 0x7fc0d406b950 2023-10-06T05:25:46.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f5415cfd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54100aeb70 0x7f5410151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540f7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 0x7f541015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540f7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 0x7f541015c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52686/0 (socket says 172.21.15.29:52686) 2023-10-06T05:25:46.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d90fa700 1 -- 172.21.15.29:0/1139063098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 msgr2=0x7fc0d40ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d90fa700 1 --2- 172.21.15.29:0/1139063098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 0x7fc0d40ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d90fa700 1 -- 172.21.15.29:0/1139063098 >> v1:172.21.15.173:6789/0 conn(0x7fc0d406b950 legacy=0x7fc0d40cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d90fa700 1 -- 172.21.15.29:0/1139063098 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d406ab90 con 0x7fc0d4165530 2023-10-06T05:25:46.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f448ed9d700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f4470068d80 0x7f447006b190 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54100aeb70 0x7f5410151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54100aeb70 0x7f5410151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51216/0 (socket says 172.21.15.29:51216) 2023-10-06T05:25:46.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540f7fe700 1 -- 172.21.15.29:0/1668816641 learned_addr learned my addr 172.21.15.29:0/1668816641 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f864f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8650067bb0 0x7f86500c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d90fa700 1 --2- 172.21.15.29:0/1139063098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d4165530 0x7fc0d4165990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40098e0 tx=0x7fc0c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2274d263bda16a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54100a8a60 con 0x7f54100aeb70 2023-10-06T05:25:46.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5410179b70 con 0x7f54100ac9e0 2023-10-06T05:25:46.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54100a87c0 con 0x7f541006cdd0 2023-10-06T05:25:46.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f864f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86500ca8c0 0x7f86501583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f864f59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86500c6d30 con 0x7f8650157f90 2023-10-06T05:25:46.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f864f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86500c7d50 con 0x7f8650067bb0 2023-10-06T05:25:46.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f864f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86500c7010 con 0x7f86500ca8c0 2023-10-06T05:25:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58cde28700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c80c9ea0 0x7f58c815bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58cde28700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815ace0 0x7f58c815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58cde28700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58c815e490 0x7f58c8150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58cde28700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c815c260 con 0x7f58c815ace0 2023-10-06T05:25:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58cde28700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81601e0 con 0x7f58c815e490 2023-10-06T05:25:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58cde28700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c815ec00 con 0x7f58c80c9ea0 2023-10-06T05:25:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815ace0 0x7f58c815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815ace0 0x7f58c815fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51212/0 (socket says 172.21.15.29:51212) 2023-10-06T05:25:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58c7fff700 1 -- 172.21.15.29:0/2202922505 learned_addr learned my addr 172.21.15.29:0/2202922505 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58c7fff700 1 -- 172.21.15.29:0/2202922505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c80c9ea0 msgr2=0x7f58c815bd20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T05:25:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58c7fff700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c80c9ea0 0x7f58c815bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58c7fff700 1 -- 172.21.15.29:0/2202922505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58c815e490 msgr2=0x7f58c8150a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T05:25:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58c7fff700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58c815e490 0x7f58c8150a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58c7fff700 1 -- 172.21.15.29:0/2202922505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0094f0 con 0x7f58c815ace0 2023-10-06T05:25:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540ffff700 1 -- 172.21.15.29:0/1668816641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 msgr2=0x7f541015c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540ffff700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f541006cdd0 0x7f541015c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540ffff700 1 -- 172.21.15.29:0/1668816641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54100ac9e0 msgr2=0x7f5410155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540ffff700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54100ac9e0 0x7f5410155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f540ffff700 1 -- 172.21.15.29:0/1668816641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400009420 con 0x7f54100aeb70 2023-10-06T05:25:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f448dd9b700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4470060550 0x7f4470062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4490158cc0 tx=0x7f4484009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f58a70ac700 1 Processor -- start 2023-10-06T05:25:46.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7f864e59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8650067bb0 0x7f86500c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.101+0000 7fc0d37fe700 1 -- 172.21.15.29:0/1139063098 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4011630 con 0x7fc0d4165530 2023-10-06T05:25:46.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7fc0d37fe700 1 -- 172.21.15.29:0/1139063098 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c4011790 con 0x7fc0d4165530 2023-10-06T05:25:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a70ac700 1 -- start start 2023-10-06T05:25:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7fc0d37fe700 1 -- 172.21.15.29:0/1139063098 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4011b30 con 0x7fc0d4165530 2023-10-06T05:25:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58c7fff700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815ace0 0x7f58c815fca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f58c80697b0 tx=0x7f58bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f540ffff700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54100aeb70 0x7f5410151240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5408001560 tx=0x7f54080015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864e59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8650067bb0 0x7f86500c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51226/0 (socket says 172.21.15.29:51226) 2023-10-06T05:25:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864e59c700 1 -- 172.21.15.29:0/759451375 learned_addr learned my addr 172.21.15.29:0/759451375 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f447e7fc700 1 -- 172.21.15.29:0/3335906506 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f447006b840 con 0x7f4470068d80 2023-10-06T05:25:46.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864ed9d700 1 --2- 172.21.15.29:0/759451375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86500ca8c0 0x7f86501583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8611460700 1 Processor -- start 2023-10-06T05:25:46.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f53f77fe700 1 -- 172.21.15.29:0/1668816641 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408004dc0 con 0x7f54100aeb70 2023-10-06T05:25:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58c4ff9700 1 -- 172.21.15.29:0/2202922505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00bbe0 con 0x7f58c815ace0 2023-10-06T05:25:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58c4ff9700 1 -- 172.21.15.29:0/2202922505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc037440 con 0x7f58c815ace0 2023-10-06T05:25:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8611460700 1 -- start start 2023-10-06T05:25:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864e59c700 1 -- 172.21.15.29:0/759451375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86500ca8c0 msgr2=0x7f86501583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864e59c700 1 --2- 172.21.15.29:0/759451375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86500ca8c0 0x7f86501583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864e59c700 1 -- 172.21.15.29:0/759451375 >> v1:172.21.15.173:6789/0 conn(0x7f8650157f90 legacy=0x7f86500ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864e59c700 1 -- 172.21.15.29:0/759451375 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500c72f0 con 0x7f8650067bb0 2023-10-06T05:25:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864e59c700 1 --2- 172.21.15.29:0/759451375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8650067bb0 0x7f86500c7810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86400099b0 tx=0x7f8640009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817f4acf92161edb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864d59a700 1 -- 172.21.15.29:0/759451375 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640009ea0 con 0x7f8650067bb0 2023-10-06T05:25:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a70ac700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58a00a6690 0x7f58a014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a70ac700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58a00ac720 0x7f58a0152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a70ac700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a0150000 0x7f58a00c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a70ac700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a016e710 con 0x7f58a00ac720 2023-10-06T05:25:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a70ac700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a016f530 con 0x7f58a0150000 2023-10-06T05:25:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a70ac700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a016e920 con 0x7f58a00a6690 2023-10-06T05:25:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a4e48700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58a00a6690 0x7f58a014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f53f77fe700 1 -- 172.21.15.29:0/1668816641 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540800a5a0 con 0x7f54100aeb70 2023-10-06T05:25:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5410179dc0 con 0x7f54100aeb70 2023-10-06T05:25:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f53f77fe700 1 -- 172.21.15.29:0/1668816641 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800a960 con 0x7f54100aeb70 2023-10-06T05:25:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a4e48700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58a00a6690 0x7f58a014f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52708/0 (socket says 172.21.15.29:52708) 2023-10-06T05:25:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a4e48700 1 -- 172.21.15.29:0/2250128288 learned_addr learned my addr 172.21.15.29:0/2250128288 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541017a380 con 0x7f54100aeb70 2023-10-06T05:25:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5410071120 con 0x7f54100aeb70 2023-10-06T05:25:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a5649700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a0150000 0x7f58a00c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8611460700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c0a6690 0x7f860c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8611460700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f860c0ac720 0x7f860c14eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864d59a700 1 -- 172.21.15.29:0/759451375 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864000b8b0 con 0x7f8650067bb0 2023-10-06T05:25:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8611460700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f860c150000 0x7f860c0ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8611460700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c156f60 con 0x7f860c0ac720 2023-10-06T05:25:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8611460700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c152740 con 0x7f860c150000 2023-10-06T05:25:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8611460700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c155150 con 0x7f860c0a6690 2023-10-06T05:25:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f589ffff700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58a00ac720 0x7f58a0152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a4e48700 1 -- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a0150000 msgr2=0x7f58a00c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a4e48700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58a0150000 0x7f58a00c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a4e48700 1 -- 172.21.15.29:0/2250128288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58a00ac720 msgr2=0x7f58a0152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a4e48700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58a00ac720 0x7f58a0152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a4e48700 1 -- 172.21.15.29:0/2250128288 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009ae0 con 0x7f58a00a6690 2023-10-06T05:25:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f860c0ac720 0x7f860c14eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f860c0ac720 0x7f860c14eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51236/0 (socket says 172.21.15.29:51236) 2023-10-06T05:25:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860a7fc700 1 -- 172.21.15.29:0/408079568 learned_addr learned my addr 172.21.15.29:0/408079568 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860b7fe700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f860c150000 0x7f860c0ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860affd700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c0a6690 0x7f860c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a4e48700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58a00a6690 0x7f58a014f790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f589000c5d0 tx=0x7f5890007f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f53f77fe700 1 -- 172.21.15.29:0/1668816641 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f540800ad10 con 0x7f54100aeb70 2023-10-06T05:25:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7fc0d98fb700 1 -- 172.21.15.29:0/1139063098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d4165530 msgr2=0x7fc0d4165990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7fc0d98fb700 1 --2- 172.21.15.29:0/1139063098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d4165530 0x7fc0d4165990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40098e0 tx=0x7fc0c40091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f589cff9700 1 -- 172.21.15.29:0/2250128288 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890011590 con 0x7f58a00a6690 2023-10-06T05:25:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7fc0d98fb700 1 -- 172.21.15.29:0/1139063098 shutdown_connections 2023-10-06T05:25:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7fc0d98fb700 1 --2- 172.21.15.29:0/1139063098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d4165530 0x7fc0d4165990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7fc0d98fb700 1 --2- 172.21.15.29:0/1139063098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 0x7fc0d40ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7fc0d98fb700 1 -- 172.21.15.29:0/1139063098 >> 172.21.15.29:0/1139063098 conn(0x7fc0d40670a0 msgr2=0x7fc0d40674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f53f77fe700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53fc060550 0x7f53fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a016ec00 con 0x7f58a00a6690 2023-10-06T05:25:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860affd700 1 -- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f860c150000 msgr2=0x7f860c0ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860affd700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f860c150000 0x7f860c0ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860affd700 1 -- 172.21.15.29:0/408079568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f860c0ac720 msgr2=0x7f860c14eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860affd700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f860c0ac720 0x7f860c14eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860affd700 1 -- 172.21.15.29:0/408079568 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc009420 con 0x7f860c0a6690 2023-10-06T05:25:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f860affd700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c0a6690 0x7f860c156a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f860c06b8a0 tx=0x7f85fc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58c4ff9700 1 -- 172.21.15.29:0/2202922505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0377e0 con 0x7f58c815ace0 2023-10-06T05:25:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864d59a700 1 -- 172.21.15.29:0/759451375 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864000bc50 con 0x7f8650067bb0 2023-10-06T05:25:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864f59e700 1 -- 172.21.15.29:0/759451375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8650067bb0 msgr2=0x7f86500c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f864f59e700 1 --2- 172.21.15.29:0/759451375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8650067bb0 0x7f86500c7810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86400099b0 tx=0x7f8640009250 comp rx=0 tx=0).stop 2023-10-06T05:25:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f53f77fe700 1 -- 172.21.15.29:0/1668816641 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f540807cb00 con 0x7f54100aeb70 2023-10-06T05:25:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f53f77fe700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f53fc068e00 0x7f53fc06b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f53f77fe700 1 -- 172.21.15.29:0/1668816641 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53fc06b8c0 con 0x7f53fc068e00 2023-10-06T05:25:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f53f77fe700 1 -- 172.21.15.29:0/1668816641 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f540807ced0 con 0x7f54100aeb70 2023-10-06T05:25:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f540f7fe700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53fc060550 0x7f53fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f540effd700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f53fc068e00 0x7f53fc06b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a016f1c0 con 0x7f58a00a6690 2023-10-06T05:25:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f589cff9700 1 -- 172.21.15.29:0/2250128288 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890011710 con 0x7f58a00a6690 2023-10-06T05:25:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f589cff9700 1 -- 172.21.15.29:0/2250128288 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890011ad0 con 0x7f58a00a6690 2023-10-06T05:25:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 -- 172.21.15.29:0/1139063098 shutdown_connections 2023-10-06T05:25:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f85f2ffd700 1 -- 172.21.15.29:0/408079568 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc024440 con 0x7f860c0a6690 2023-10-06T05:25:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f540effd700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f53fc068e00 0x7f53fc06b210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f864f59e700 1 -- 172.21.15.29:0/759451375 shutdown_connections 2023-10-06T05:25:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f864f59e700 1 --2- 172.21.15.29:0/759451375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86500ca8c0 0x7f86501583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f864f59e700 1 --2- 172.21.15.29:0/759451375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8650067bb0 0x7f86500c7810 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f864f59e700 1 -- 172.21.15.29:0/759451375 >> 172.21.15.29:0/759451375 conn(0x7f86500670a0 msgr2=0x7f86500674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 -- 172.21.15.29:0/1139063098 wait complete. 2023-10-06T05:25:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f540f7fe700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53fc060550 0x7f53fc062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f540000a010 tx=0x7f5400016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5880000fd0 con 0x7f58a00a6690 2023-10-06T05:25:46.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f85f2ffd700 1 -- 172.21.15.29:0/408079568 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc0245c0 con 0x7f860c0a6690 2023-10-06T05:25:46.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f85f2ffd700 1 -- 172.21.15.29:0/408079568 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc024980 con 0x7f860c0a6690 2023-10-06T05:25:46.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c155430 con 0x7f860c0a6690 2023-10-06T05:25:46.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c1523d0 con 0x7f860c0a6690 2023-10-06T05:25:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f864f59e700 1 -- 172.21.15.29:0/759451375 shutdown_connections 2023-10-06T05:25:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f53f77fe700 1 -- 172.21.15.29:0/1668816641 <== osd.0 v2:172.21.15.29:6808/33420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f53fc06b8c0 con 0x7f53fc068e00 2023-10-06T05:25:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85ec000fd0 con 0x7f860c0a6690 2023-10-06T05:25:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 Processor -- start 2023-10-06T05:25:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f589cff9700 1 -- 172.21.15.29:0/2250128288 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f589001c460 con 0x7f58a00a6690 2023-10-06T05:25:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 -- start start 2023-10-06T05:25:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f589cff9700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f588c060550 0x7f588c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f589cff9700 1 -- 172.21.15.29:0/2250128288 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f589007d1a0 con 0x7f58a00a6690 2023-10-06T05:25:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f589cff9700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f588c068e00 0x7f588c06b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f589ffff700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f588c060550 0x7f588c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f589cff9700 1 -- 172.21.15.29:0/2250128288 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f588c06b8c0 con 0x7f588c068e00 2023-10-06T05:25:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f589cff9700 1 -- 172.21.15.29:0/2250128288 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f589007d490 con 0x7f58a00a6690 2023-10-06T05:25:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f85f2ffd700 1 -- 172.21.15.29:0/408079568 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f85fc01a420 con 0x7f860c0a6690 2023-10-06T05:25:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f58a5649700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f588c068e00 0x7f588c06b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d406b950 0x7fc0d4163040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 0x7fc0d4163580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0d4165530 0x7fc0d417e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d4162600 con 0x7fc0d4165530 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d4161280 con 0x7fc0d406b950 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d98fb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d4161560 con 0x7fc0d40ca020 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d88f9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d406b950 0x7fc0d4163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 0x7fc0d4163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 0x7fc0d4163580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52726/0 (socket says 172.21.15.29:52726) 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7fc0d3fff700 1 -- 172.21.15.29:0/2881694392 learned_addr learned my addr 172.21.15.29:0/2881694392 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f85f2ffd700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f85f8060550 0x7f85f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8c2a46f700 1 Processor -- start 2023-10-06T05:25:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8c2a46f700 1 -- start start 2023-10-06T05:25:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8c2a46f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c240adf10 0x7f8c240c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8c2a46f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c240ae2e0 0x7f8c240cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c815eee0 con 0x7f58c815ace0 2023-10-06T05:25:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f864f59e700 1 -- 172.21.15.29:0/759451375 wait complete. 2023-10-06T05:25:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8c2a46f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c240c6950 con 0x7f8c240cbea0 2023-10-06T05:25:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8c2a46f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c24159990 con 0x7f8c240ae2e0 2023-10-06T05:25:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.105+0000 7f8c2a46f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240cc340 con 0x7f8c240adf10 2023-10-06T05:25:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c28c6c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c240ae2e0 0x7f8c240cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864f59e700 1 Processor -- start 2023-10-06T05:25:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c28c6c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c240ae2e0 0x7f8c240cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51240/0 (socket says 172.21.15.29:51240) 2023-10-06T05:25:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c28c6c700 1 -- 172.21.15.29:0/1860460108 learned_addr learned my addr 172.21.15.29:0/1860460108 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c2946d700 1 --2- 172.21.15.29:0/1860460108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c240adf10 0x7f8c240c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c28c6c700 1 -- 172.21.15.29:0/1860460108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c240adf10 msgr2=0x7f8c240c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c28c6c700 1 --2- 172.21.15.29:0/1860460108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c240adf10 0x7f8c240c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c28c6c700 1 -- 172.21.15.29:0/1860460108 >> v1:172.21.15.29:6789/0 conn(0x7f8c240cbea0 legacy=0x7f8c24158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c28c6c700 1 -- 172.21.15.29:0/1860460108 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c241552b0 con 0x7f8c240ae2e0 2023-10-06T05:25:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c28c6c700 1 --2- 172.21.15.29:0/1860460108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240ae2e0 0x7f8c240cb960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c140099b0 tx=0x7f8c14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d178430c97162e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c815f4a0 con 0x7f58c815ace0 2023-10-06T05:25:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c1bfff700 1 -- 172.21.15.29:0/1860460108 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400b820 con 0x7f8c240ae2e0 2023-10-06T05:25:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f85f2ffd700 1 -- 172.21.15.29:0/408079568 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f85fc07ed00 con 0x7f860c0a6690 2023-10-06T05:25:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d90fa700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0d4165530 0x7fc0d417e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c1bfff700 1 -- 172.21.15.29:0/1860460108 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1400b980 con 0x7f8c240ae2e0 2023-10-06T05:25:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c1bfff700 1 -- 172.21.15.29:0/1860460108 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400bd20 con 0x7f8c240ae2e0 2023-10-06T05:25:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1860460108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240ae2e0 msgr2=0x7f8c240cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.109+0000 7f8c2a46f700 1 --2- 172.21.15.29:0/1860460108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240ae2e0 0x7f8c240cb960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c140099b0 tx=0x7f8c14009250 comp rx=0 tx=0).stop 2023-10-06T05:25:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f58a5649700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f588c068e00 0x7f588c06b210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f589ffff700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f588c060550 0x7f588c062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5894006fd0 tx=0x7f5894008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f85f2ffd700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f85f8068e00 0x7f85f806b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f860a7fc700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f85f8060550 0x7f85f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f85f2ffd700 1 -- 172.21.15.29:0/408079568 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85f806b8c0 con 0x7f85f8068e00 2023-10-06T05:25:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f85f2ffd700 1 -- 172.21.15.29:0/408079568 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85fc07eff0 con 0x7f860c0a6690 2023-10-06T05:25:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d88f9700 1 -- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 msgr2=0x7fc0d4163580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d88f9700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0d40ca020 0x7fc0d4163580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d88f9700 1 -- 172.21.15.29:0/2881694392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0d4165530 msgr2=0x7fc0d417e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d88f9700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0d4165530 0x7fc0d417e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d88f9700 1 -- 172.21.15.29:0/2881694392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c4009420 con 0x7fc0d406b950 2023-10-06T05:25:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f860b7fe700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f85f8068e00 0x7f85f806b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d88f9700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d406b950 0x7fc0d4163040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009ef0 tx=0x7fc0cc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f860a7fc700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f85f8060550 0x7f85f8062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f860c0b0bd0 tx=0x7f8604009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d0ff9700 1 -- 172.21.15.29:0/2881694392 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00cc20 con 0x7fc0d406b950 2023-10-06T05:25:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864f59e700 1 -- start start 2023-10-06T05:25:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8650067bb0 0x7f86500b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864f59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86500ca8c0 0x7f8650175f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8650157f90 0x7f8650178db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86501792f0 con 0x7f8650067bb0 2023-10-06T05:25:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864f59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86500ae8e0 con 0x7f86500ca8c0 2023-10-06T05:25:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86500af180 con 0x7f8650157f90 2023-10-06T05:25:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d0ff9700 1 -- 172.21.15.29:0/2881694392 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc00f040 con 0x7fc0d406b950 2023-10-06T05:25:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d4161840 con 0x7fc0d406b950 2023-10-06T05:25:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1860460108 shutdown_connections 2023-10-06T05:25:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f8c2a46f700 1 --2- 172.21.15.29:0/1860460108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240ae2e0 0x7f8c240cb960 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f8c2a46f700 1 --2- 172.21.15.29:0/1860460108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c240adf10 0x7f8c240c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1860460108 >> 172.21.15.29:0/1860460108 conn(0x7f8c240670a0 msgr2=0x7f8c24067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d0ff9700 1 -- 172.21.15.29:0/2881694392 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc014480 con 0x7fc0d406b950 2023-10-06T05:25:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864dd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86500ca8c0 0x7f8650175f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864dd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86500ca8c0 0x7f8650175f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45734/0 (socket says 172.21.15.29:45734) 2023-10-06T05:25:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864dd9b700 1 -- 172.21.15.29:0/210213101 learned_addr learned my addr 172.21.15.29:0/210213101 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d4161e00 con 0x7fc0d406b950 2023-10-06T05:25:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864ed9d700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8650157f90 0x7f8650178db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864e59c700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8650067bb0 0x7f86500b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1860460108 shutdown_connections 2023-10-06T05:25:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f860b7fe700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f85f8068e00 0x7f85f806b210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864e59c700 1 -- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8650157f90 msgr2=0x7f8650178db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864e59c700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8650157f90 0x7f8650178db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864e59c700 1 -- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86500ca8c0 msgr2=0x7f8650175f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864e59c700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86500ca8c0 0x7f8650175f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864e59c700 1 -- 172.21.15.29:0/210213101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86400094f0 con 0x7f8650067bb0 2023-10-06T05:25:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864ed9d700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8650157f90 0x7f8650178db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f589cff9700 1 -- 172.21.15.29:0/2250128288 <== osd.4 v2:172.21.15.173:6800/33715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f588c06b8c0 con 0x7f588c068e00 2023-10-06T05:25:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1860460108 wait complete. 2023-10-06T05:25:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f864e59c700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8650067bb0 0x7f86500b0710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8640002000 tx=0x7f8640016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d0ff9700 1 -- 172.21.15.29:0/2881694392 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc0cc014830 con 0x7fc0d406b950 2023-10-06T05:25:46.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7f85f2ffd700 1 -- 172.21.15.29:0/408079568 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f85f806b8c0 con 0x7f85f8068e00 2023-10-06T05:25:46.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d0ff9700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0c0060550 0x7fc0c0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.113+0000 7fc0d0ff9700 1 -- 172.21.15.29:0/2881694392 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc0cc07d640 con 0x7fc0d406b950 2023-10-06T05:25:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7fc0d3fff700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0c0060550 0x7fc0c0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c2a46f700 1 Processor -- start 2023-10-06T05:25:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c2a46f700 1 -- start start 2023-10-06T05:25:46.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7fc0d3fff700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0c0060550 0x7fc0c0062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc0d417e5a0 tx=0x7fc0c8007e70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c2a46f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c240adf10 0x7f8c240c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c2a46f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c240ae2e0 0x7f8c24138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c2a46f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240cbea0 0x7f8c241391e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c2a46f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240c3a50 con 0x7f8c240cbea0 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c2a46f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240c3cf0 con 0x7f8c240ae2e0 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c2a46f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240c3fd0 con 0x7f8c240adf10 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c29c6e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240cbea0 0x7f8c241391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c29c6e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240cbea0 0x7f8c241391e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51272/0 (socket says 172.21.15.29:51272) 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c29c6e700 1 -- 172.21.15.29:0/1198982444 learned_addr learned my addr 172.21.15.29:0/1198982444 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c2946d700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c240adf10 0x7f8c240c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c28c6c700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c240ae2e0 0x7f8c24138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c29c6e700 1 -- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c240adf10 msgr2=0x7f8c240c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c29c6e700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c240adf10 0x7f8c240c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c29c6e700 1 -- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c240ae2e0 msgr2=0x7f8c24138ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c29c6e700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c240ae2e0 0x7f8c24138ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c29c6e700 1 -- 172.21.15.29:0/1198982444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c140094f0 con 0x7f8c240cbea0 2023-10-06T05:25:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.117+0000 7f8c29c6e700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240cbea0 0x7f8c241391e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00bc30 tx=0x7f8c1c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f863e7fc700 1 -- 172.21.15.29:0/210213101 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640011bc0 con 0x7f8650067bb0 2023-10-06T05:25:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f863e7fc700 1 -- 172.21.15.29:0/210213101 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640020070 con 0x7f8650067bb0 2023-10-06T05:25:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f863e7fc700 1 -- 172.21.15.29:0/210213101 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864001b450 con 0x7f8650067bb0 2023-10-06T05:25:46.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58c806b8a0 con 0x7f58c815ace0 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58c4ff9700 1 -- 172.21.15.29:0/2202922505 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f58bc037bd0 con 0x7f58c815ace0 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58c4ff9700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58b4060580 0x7f58b4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58c4ff9700 1 -- 172.21.15.29:0/2202922505 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f58bc08f2d0 con 0x7f58c815ace0 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58c4ff9700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7f58b4068c40 0x7f58b406b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58c4ff9700 1 -- 172.21.15.29:0/2202922505 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58b406b700 con 0x7f58b4068c40 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58c4ff9700 1 -- 172.21.15.29:0/2202922505 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58bc08f6a0 con 0x7f58c815ace0 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58cce26700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58b4060580 0x7f58b4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58cd627700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7f58b4068c40 0x7f58b406b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58cd627700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7f58b4068c40 0x7f58b406b050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.121+0000 7f58cce26700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58b4060580 0x7f58b4062a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009bb0 tx=0x7f58b80091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86500c3b40 con 0x7f8650067bb0 2023-10-06T05:25:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86500aee10 con 0x7f8650067bb0 2023-10-06T05:25:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7fc0d98fb700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7fc0d417ed40 0x7fc0d417f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0d406ae70 con 0x7fc0d417ed40 2023-10-06T05:25:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7f58c4ff9700 1 -- 172.21.15.29:0/2202922505 <== osd.2 v2:172.21.15.29:6824/33445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f58b406b700 con 0x7f58b4068c40 2023-10-06T05:25:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7fc0d90fa700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7fc0d417ed40 0x7fc0d417f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7fc0d90fa700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7fc0d417ed40 0x7fc0d417f110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7f863e7fc700 1 -- 172.21.15.29:0/210213101 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8640022030 con 0x7f8650067bb0 2023-10-06T05:25:46.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7fc0d0ff9700 1 -- 172.21.15.29:0/2881694392 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc0d406ae70 con 0x7fc0d417ed40 2023-10-06T05:25:46.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7f863e7fc700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8630060620 0x7f8630062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7f863e7fc700 1 -- 172.21.15.29:0/210213101 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f864007e5d0 con 0x7f8650067bb0 2023-10-06T05:25:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.129+0000 7f8c197fa700 1 -- 172.21.15.29:0/1198982444 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00c840 con 0x7f8c240cbea0 2023-10-06T05:25:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7f864dd9b700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8630060620 0x7f8630062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.125+0000 7f864dd9b700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8630060620 0x7f8630062ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8644006fd0 tx=0x7f8644008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.129+0000 7f864f59e700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f865006c6c0 0x7f86500c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.129+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f865006d670 con 0x7f865006c6c0 2023-10-06T05:25:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.129+0000 7f8c197fa700 1 -- 172.21.15.29:0/1198982444 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00c9e0 con 0x7f8c240cbea0 2023-10-06T05:25:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.129+0000 7f8c197fa700 1 -- 172.21.15.29:0/1198982444 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00cda0 con 0x7f8c240cbea0 2023-10-06T05:25:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.129+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c240c42b0 con 0x7f8c240cbea0 2023-10-06T05:25:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.129+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2415f950 con 0x7f8c240cbea0 2023-10-06T05:25:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.129+0000 7f864ed9d700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f865006c6c0 0x7f86500c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f864ed9d700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f865006c6c0 0x7f86500c4ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f449004be00 con 0x7f4470068d80 2023-10-06T05:25:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f447e7fc700 1 -- 172.21.15.29:0/3335906506 <== osd.1 v2:172.21.15.29:6816/33422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f449004be00 con 0x7f4470068d80 2023-10-06T05:25:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f8c197fa700 1 -- 172.21.15.29:0/1198982444 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8c1c014620 con 0x7f8c240cbea0 2023-10-06T05:25:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f8c197fa700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c10060780 0x7f8c10062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f8c197fa700 1 -- 172.21.15.29:0/1198982444 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c1c07c850 con 0x7f8c240cbea0 2023-10-06T05:25:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f863e7fc700 1 -- 172.21.15.29:0/210213101 <== osd.3 v2:172.21.15.29:6800/33419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f865006d670 con 0x7f865006c6c0 2023-10-06T05:25:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f8c2946d700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c10060780 0x7f8c10062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f8c2946d700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c10060780 0x7f8c10062c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000acb0 tx=0x7f8c20008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.133+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85ec002d30 con 0x7f85f8068e00 2023-10-06T05:25:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8c2a46f700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f8c240c4ff0 0x7f8c24141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c240c6e60 con 0x7f8c240c4ff0 2023-10-06T05:25:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8c28c6c700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f8c240c4ff0 0x7f8c24141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5880002d30 con 0x7f588c068e00 2023-10-06T05:25:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f85f2ffd700 1 -- 172.21.15.29:0/408079568 <== osd.5 v2:172.21.15.173:6808/33716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85ec002d30 con 0x7f85f8068e00 2023-10-06T05:25:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f541015d6b0 con 0x7f53fc068e00 2023-10-06T05:25:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f53f77fe700 1 -- 172.21.15.29:0/1668816641 <== osd.0 v2:172.21.15.29:6808/33420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f541015d6b0 con 0x7f53fc068e00 2023-10-06T05:25:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8c28c6c700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f8c240c4ff0 0x7f8c24141bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f589cff9700 1 -- 172.21.15.29:0/2250128288 <== osd.4 v2:172.21.15.173:6800/33715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5880002d30 con 0x7f588c068e00 2023-10-06T05:25:46.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f53fc068e00 msgr2=0x7f53fc06b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f53fc068e00 0x7f53fc06b210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f85f8068e00 msgr2=0x7f85f806b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f85f8068e00 0x7f85f806b210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53fc060550 msgr2=0x7f53fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f53fc060550 0x7f53fc062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f540000a010 tx=0x7f5400016000 comp rx=0 tx=0).stop 2023-10-06T05:25:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54100aeb70 msgr2=0x7f5410151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 --2- 172.21.15.29:0/1668816641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54100aeb70 0x7f5410151240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5408001560 tx=0x7f54080015b0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f540ffff700 1 -- 172.21.15.29:0/1668816641 reap_dead start 2023-10-06T05:25:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f588c068e00 msgr2=0x7f588c06b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f588c068e00 0x7f588c06b210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f85f8060550 msgr2=0x7f85f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f85f8060550 0x7f85f8062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f860c0b0bd0 tx=0x7f8604009040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c0a6690 msgr2=0x7f860c156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 --2- 172.21.15.29:0/408079568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f860c0a6690 0x7f860c156a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f860c06b8a0 tx=0x7f85fc017000 comp rx=0 tx=0).stop 2023-10-06T05:25:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f860b7fe700 1 -- 172.21.15.29:0/408079568 reap_dead start 2023-10-06T05:25:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 shutdown_connections 2023-10-06T05:25:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 >> 172.21.15.29:0/408079568 conn(0x7f860c067b70 msgr2=0x7f860c0a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f588c060550 msgr2=0x7f588c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f588c060550 0x7f588c062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5894006fd0 tx=0x7f5894008040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58a00a6690 msgr2=0x7f58a014f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 --2- 172.21.15.29:0/2250128288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58a00a6690 0x7f58a014f790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f589000c5d0 tx=0x7f5890007f60 comp rx=0 tx=0).stop 2023-10-06T05:25:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a5649700 1 -- 172.21.15.29:0/2250128288 reap_dead start 2023-10-06T05:25:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 shutdown_connections 2023-10-06T05:25:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8611460700 1 -- 172.21.15.29:0/408079568 wait complete. 2023-10-06T05:25:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 shutdown_connections 2023-10-06T05:25:46.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 >> 172.21.15.29:0/2250128288 conn(0x7f58a0067b70 msgr2=0x7f58a006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 shutdown_connections 2023-10-06T05:25:46.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 >> 172.21.15.29:0/1668816641 conn(0x7f5410067b70 msgr2=0x7f5410157c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 shutdown_connections 2023-10-06T05:25:46.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 shutdown_connections 2023-10-06T05:25:46.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f5415cfd700 1 -- 172.21.15.29:0/1668816641 wait complete. 2023-10-06T05:25:46.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f58a70ac700 1 -- 172.21.15.29:0/2250128288 wait complete. 2023-10-06T05:25:46.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.137+0000 7f8c197fa700 1 -- 172.21.15.29:0/1198982444 <== osd.6 v2:172.21.15.173:6816/33717 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8c240c6e60 con 0x7f8c240c4ff0 2023-10-06T05:25:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f4470068d80 msgr2=0x7f447006b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f4470068d80 0x7f447006b190 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4470060550 msgr2=0x7f4470062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4470060550 0x7f4470062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4490158cc0 tx=0x7f4484009040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 msgr2=0x7f4490148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 --2- 172.21.15.29:0/3335906506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44900ca8c0 0x7f4490148510 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4480010db0 tx=0x7f448000b690 comp rx=0 tx=0).stop 2023-10-06T05:25:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448ed9d700 1 -- 172.21.15.29:0/3335906506 reap_dead start 2023-10-06T05:25:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 shutdown_connections 2023-10-06T05:25:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 >> 172.21.15.29:0/3335906506 conn(0x7f44900670a0 msgr2=0x7f44900c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 shutdown_connections 2023-10-06T05:25:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.149+0000 7f448f59e700 1 -- 172.21.15.29:0/3335906506 wait complete. 2023-10-06T05:25:46.211 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:46.211 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T05:25:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f58c804be00 con 0x7f58b4068c40 2023-10-06T05:25:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7f58c4ff9700 1 -- 172.21.15.29:0/2202922505 <== osd.2 v2:172.21.15.29:6824/33445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f58c804be00 con 0x7f58b4068c40 2023-10-06T05:25:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc0d40cc730 con 0x7fc0d417ed40 2023-10-06T05:25:46.213 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:46.213 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:46.214 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T05:25:46.214 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T05:25:46.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7fc0d0ff9700 1 -- 172.21.15.29:0/2881694392 <== osd.7 v2:172.21.15.173:6824/33718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc0d40cc730 con 0x7fc0d417ed40 2023-10-06T05:25:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7fc0d417ed40 msgr2=0x7fc0d417f110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7fc0d98fb700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7fc0d417ed40 0x7fc0d417f110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0c0060550 msgr2=0x7fc0c0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7fc0d98fb700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0c0060550 0x7fc0c0062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc0d417e5a0 tx=0x7fc0c8007e70 comp rx=0 tx=0).stop 2023-10-06T05:25:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d406b950 msgr2=0x7fc0d4163040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7fc0d98fb700 1 --2- 172.21.15.29:0/2881694392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d406b950 0x7fc0d4163040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009ef0 tx=0x7fc0cc00b040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.153+0000 7fc0d90fa700 1 -- 172.21.15.29:0/2881694392 reap_dead start 2023-10-06T05:25:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 shutdown_connections 2023-10-06T05:25:46.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 >> 172.21.15.29:0/2881694392 conn(0x7fc0d40670a0 msgr2=0x7fc0d40c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 shutdown_connections 2023-10-06T05:25:46.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7fc0d98fb700 1 -- 172.21.15.29:0/2881694392 wait complete. 2023-10-06T05:25:46.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7f58b4068c40 msgr2=0x7f58b406b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7f58b4068c40 0x7f58b406b050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58b4060580 msgr2=0x7f58b4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58b4060580 0x7f58b4062a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009bb0 tx=0x7f58b80091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815ace0 msgr2=0x7f58c815fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 --2- 172.21.15.29:0/2202922505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c815ace0 0x7f58c815fca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f58c80697b0 tx=0x7f58bc017000 comp rx=0 tx=0).stop 2023-10-06T05:25:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cd627700 1 -- 172.21.15.29:0/2202922505 reap_dead start 2023-10-06T05:25:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 shutdown_connections 2023-10-06T05:25:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 >> 172.21.15.29:0/2202922505 conn(0x7f58c80670a0 msgr2=0x7f58c80c9500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 shutdown_connections 2023-10-06T05:25:46.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.157+0000 7f58cde28700 1 -- 172.21.15.29:0/2202922505 wait complete. 2023-10-06T05:25:46.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.161+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f86500c38b0 con 0x7f865006c6c0 2023-10-06T05:25:46.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.161+0000 7f863e7fc700 1 -- 172.21.15.29:0/210213101 <== osd.3 v2:172.21.15.29:6800/33419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f86500c38b0 con 0x7f865006c6c0 2023-10-06T05:25:46.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.161+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c2406dd00 con 0x7f8c240c4ff0 2023-10-06T05:25:46.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.161+0000 7f8c197fa700 1 -- 172.21.15.29:0/1198982444 <== osd.6 v2:172.21.15.173:6816/33717 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c2406dd00 con 0x7f8c240c4ff0 2023-10-06T05:25:46.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f865006c6c0 msgr2=0x7f86500c4ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f865006c6c0 0x7f86500c4ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8630060620 msgr2=0x7f8630062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8630060620 0x7f8630062ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8644006fd0 tx=0x7f8644008040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8650067bb0 msgr2=0x7f86500b0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 --2- 172.21.15.29:0/210213101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8650067bb0 0x7f86500b0710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8640002000 tx=0x7f8640016000 comp rx=0 tx=0).stop 2023-10-06T05:25:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864ed9d700 1 -- 172.21.15.29:0/210213101 reap_dead start 2023-10-06T05:25:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 shutdown_connections 2023-10-06T05:25:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 >> 172.21.15.29:0/210213101 conn(0x7f86500670a0 msgr2=0x7f86500c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 shutdown_connections 2023-10-06T05:25:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f864f59e700 1 -- 172.21.15.29:0/210213101 wait complete. 2023-10-06T05:25:46.224 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:46.224 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T05:25:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f8c240c4ff0 msgr2=0x7f8c24141bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f8c2a46f700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f8c240c4ff0 0x7f8c24141bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.165+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c10060780 msgr2=0x7f8c10062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.169+0000 7f8c2a46f700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c10060780 0x7f8c10062c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000acb0 tx=0x7f8c20008040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.169+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240cbea0 msgr2=0x7f8c241391e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.169+0000 7f8c2a46f700 1 --2- 172.21.15.29:0/1198982444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c240cbea0 0x7f8c241391e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00bc30 tx=0x7f8c1c009820 comp rx=0 tx=0).stop 2023-10-06T05:25:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.169+0000 7f8c29c6e700 1 -- 172.21.15.29:0/1198982444 reap_dead start 2023-10-06T05:25:46.226 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:46.226 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T05:25:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.169+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 shutdown_connections 2023-10-06T05:25:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.169+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 >> 172.21.15.29:0/1198982444 conn(0x7f8c240670a0 msgr2=0x7f8c240b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.169+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 shutdown_connections 2023-10-06T05:25:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.169+0000 7f8c2a46f700 1 -- 172.21.15.29:0/1198982444 wait complete. 2023-10-06T05:25:46.228 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:46.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T05:25:46.229 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:46.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T05:25:46.230 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:46.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T05:25:46.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80ad68700 1 Processor -- start 2023-10-06T05:25:46.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80ad68700 1 -- start start 2023-10-06T05:25:46.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7babc41700 1 Processor -- start 2023-10-06T05:25:46.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7babc41700 1 -- start start 2023-10-06T05:25:46.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb111bdd700 1 Processor -- start 2023-10-06T05:25:46.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb111bdd700 1 -- start start 2023-10-06T05:25:46.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca5a656700 1 Processor -- start 2023-10-06T05:25:46.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca5a656700 1 -- start start 2023-10-06T05:25:46.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7babc41700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ba41534b0 0x7f7ba406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7babc41700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba415a070 con 0x7f7ba406cc00 2023-10-06T05:25:46.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7babc41700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba41594a0 con 0x7f7ba41530e0 2023-10-06T05:25:46.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7babc41700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba406d080 con 0x7f7ba41534b0 2023-10-06T05:25:46.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb111bdd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb111bdd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb10c0ca0d0 0x7fb10c0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb111bdd700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c156140 con 0x7fb10c0adef0 2023-10-06T05:25:46.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb111bdd700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0c8c20 con 0x7fb10c0ca0d0 2023-10-06T05:25:46.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb111bdd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0c8010 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7ba91dc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ba41534b0 0x7f7ba406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7ba91dc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ba41534b0 0x7f7ba406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51286/0 (socket says 172.21.15.29:51286) 2023-10-06T05:25:46.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7ba91dc700 1 -- 172.21.15.29:0/427721109 learned_addr learned my addr 172.21.15.29:0/427721109 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80ad68700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd804156be0 0x7fd8040cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80ad68700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd80406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80ad68700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040cc2e0 con 0x7fd8040cbe60 2023-10-06T05:25:46.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80ad68700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80415a900 con 0x7fd804156be0 2023-10-06T05:25:46.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80ad68700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80415abe0 con 0x7fd8040c7090 2023-10-06T05:25:46.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb10affd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca5a656700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca54155d00 0x7fca540c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca5a656700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca540b1050 0x7fca5406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca5a656700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca540b18f0 con 0x7fca54155930 2023-10-06T05:25:46.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca5a656700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5406ce40 con 0x7fca54155d00 2023-10-06T05:25:46.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca5a656700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540c9d20 con 0x7fca540b1050 2023-10-06T05:25:46.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb10b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb10c0adef0 0x7fb10c0c7610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50552/0 (socket says 172.21.15.29:50552) 2023-10-06T05:25:46.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb10b7fe700 1 -- 172.21.15.29:0/215213444 learned_addr learned my addr 172.21.15.29:0/215213444 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:46.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca59e55700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca540b1050 0x7fca5406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80a567700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd80406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca59e55700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca540b1050 0x7fca5406d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45758/0 (socket says 172.21.15.29:45758) 2023-10-06T05:25:46.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca59e55700 1 -- 172.21.15.29:0/3574434013 learned_addr learned my addr 172.21.15.29:0/3574434013 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb10bfff700 1 --2- 172.21.15.29:0/215213444 >> v2:172.21.15.173:3300/0 conn(0x7fb10c0ca0d0 0x7fb10c0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fca58e53700 1 --2- 172.21.15.29:0/3574434013 >> v2:172.21.15.29:3300/0 conn(0x7fca54155d00 0x7fca540c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80a567700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd80406a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52768/0 (socket says 172.21.15.29:52768) 2023-10-06T05:25:46.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd80a567700 1 -- 172.21.15.29:0/1310744517 learned_addr learned my addr 172.21.15.29:0/1310744517 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd809d66700 1 --2- 172.21.15.29:0/1310744517 >> v2:172.21.15.29:3300/0 conn(0x7fd804156be0 0x7fd8040cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7ba91dc700 1 -- 172.21.15.29:0/427721109 >> v1:172.21.15.173:6789/0 conn(0x7f7ba41530e0 legacy=0x7f7ba40c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb10bfff700 1 -- 172.21.15.29:0/215213444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 msgr2=0x7fb10c0c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb10bfff700 1 --2- 172.21.15.29:0/215213444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c0c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb10bfff700 1 -- 172.21.15.29:0/215213444 >> v1:172.21.15.29:6789/0 conn(0x7fb10c0adef0 legacy=0x7fb10c0c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25caa13700 1 Processor -- start 2023-10-06T05:25:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fb10bfff700 1 -- 172.21.15.29:0/215213444 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0c82f0 con 0x7fb10c0ca0d0 2023-10-06T05:25:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7ba89db700 1 -- 172.21.15.29:0/427721109 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105695198 0 0) 0x7f7ba41594a0 con 0x7f7ba41530e0 2023-10-06T05:25:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7ba91dc700 1 -- 172.21.15.29:0/427721109 >> v1:172.21.15.29:6789/0 conn(0x7f7ba406cc00 legacy=0x7f7ba406a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7f7ba91dc700 1 -- 172.21.15.29:0/427721109 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba4159740 con 0x7f7ba41534b0 2023-10-06T05:25:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd4ac811700 1 Processor -- start 2023-10-06T05:25:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.397+0000 7fd4ac811700 1 -- start start 2023-10-06T05:25:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80a567700 1 -- 172.21.15.29:0/1310744517 >> v2:172.21.15.29:3300/0 conn(0x7fd804156be0 msgr2=0x7fd8040cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80a567700 1 --2- 172.21.15.29:0/1310744517 >> v2:172.21.15.29:3300/0 conn(0x7fd804156be0 0x7fd8040cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80a567700 1 -- 172.21.15.29:0/1310744517 >> v1:172.21.15.173:6789/0 conn(0x7fd8040cbe60 legacy=0x7fd8040c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80a567700 1 -- 172.21.15.29:0/1310744517 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80415aec0 con 0x7fd8040c7090 2023-10-06T05:25:46.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca59e55700 1 -- 172.21.15.29:0/3574434013 >> v2:172.21.15.29:3300/0 conn(0x7fca54155d00 msgr2=0x7fca540c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca59e55700 1 --2- 172.21.15.29:0/3574434013 >> v2:172.21.15.29:3300/0 conn(0x7fca54155d00 0x7fca540c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca59e55700 1 -- 172.21.15.29:0/3574434013 >> v1:172.21.15.29:6789/0 conn(0x7fca54155930 legacy=0x7fca5406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca59e55700 1 -- 172.21.15.29:0/3574434013 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540b1610 con 0x7fca540b1050 2023-10-06T05:25:46.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca4bfff700 1 -- 172.21.15.29:0/3574434013 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791345242 0 0) 0x7fca540b18f0 con 0x7fca54155930 2023-10-06T05:25:46.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25caa13700 1 -- start start 2023-10-06T05:25:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb10bfff700 1 --2- 172.21.15.29:0/215213444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb10c0ca0d0 0x7fb10c0c9a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0098e0 tx=0x7fb0fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87ab334352ba7112 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80a567700 1 --2- 172.21.15.29:0/1310744517 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd80406a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009f20 tx=0x7fd7fc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab721676f07c2073 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb10a7fc700 1 -- 172.21.15.29:0/215213444 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00b640 con 0x7fb10c0ca0d0 2023-10-06T05:25:46.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca59e55700 1 --2- 172.21.15.29:0/3574434013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca540b1050 0x7fca5406d9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca5406a010 tx=0x7fca4c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be3e7a7af6e5a03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb10a7fc700 1 -- 172.21.15.29:0/215213444 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc00b7a0 con 0x7fb10c0ca0d0 2023-10-06T05:25:46.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb10a7fc700 1 -- 172.21.15.29:0/215213444 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00bb40 con 0x7fb10c0ca0d0 2023-10-06T05:25:46.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4ac811700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd4a80ac9e0 0x7fd4a80aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4ac811700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd4a806e730 0x7fd4a806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4ac811700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a8166000 con 0x7fd4a8165c30 2023-10-06T05:25:46.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4ac811700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a80ac170 con 0x7fd4a80ac9e0 2023-10-06T05:25:46.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4ac811700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a806f0b0 con 0x7fd4a806e730 2023-10-06T05:25:46.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd808d64700 1 -- 172.21.15.29:0/1310744517 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00e070 con 0x7fd8040c7090 2023-10-06T05:25:46.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd808d64700 1 -- 172.21.15.29:0/1310744517 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc00b8d0 con 0x7fd8040c7090 2023-10-06T05:25:46.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd808d64700 1 -- 172.21.15.29:0/1310744517 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0092e0 con 0x7fd8040c7090 2023-10-06T05:25:46.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca4bfff700 1 -- 172.21.15.29:0/3574434013 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00e070 con 0x7fca540b1050 2023-10-06T05:25:46.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca4bfff700 1 -- 172.21.15.29:0/3574434013 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c00ba50 con 0x7fca540b1050 2023-10-06T05:25:46.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca4bfff700 1 -- 172.21.15.29:0/3574434013 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0092e0 con 0x7fca540b1050 2023-10-06T05:25:46.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a5d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd4a80ac9e0 0x7fd4a80aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a5d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd4a80ac9e0 0x7fd4a80aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51332/0 (socket says 172.21.15.29:51332) 2023-10-06T05:25:46.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a5d9b700 1 -- 172.21.15.29:0/3354113853 learned_addr learned my addr 172.21.15.29:0/3354113853 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a5d9b700 1 -- 172.21.15.29:0/3354113853 >> v2:172.21.15.173:3300/0 conn(0x7fd4a806e730 msgr2=0x7fd4a806eb70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T05:25:46.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a6d9d700 1 --2- 172.21.15.29:0/3354113853 >> v2:172.21.15.173:3300/0 conn(0x7fd4a806e730 0x7fd4a806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25caa13700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 0x7f25c40ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f7ba91dc700 1 --2- 172.21.15.29:0/427721109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba41534b0 0x7f7ba406c6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00099b0 tx=0x7f7ba0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca086353b143d05c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f7ba89db700 1 -- 172.21.15.29:0/427721109 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba000b860 con 0x7f7ba41534b0 2023-10-06T05:25:46.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25caa13700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25c406b810 0x7f25c40c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25caa13700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c406a7b0 con 0x7f25c40add80 2023-10-06T05:25:46.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25caa13700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c41592f0 con 0x7f25c406b810 2023-10-06T05:25:46.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25caa13700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40cc430 con 0x7f25c415d6c0 2023-10-06T05:25:46.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f7ba89db700 1 -- 172.21.15.29:0/427721109 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba000b9c0 con 0x7f7ba41534b0 2023-10-06T05:25:46.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f7ba89db700 1 -- 172.21.15.29:0/427721109 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba000bd60 con 0x7f7ba41534b0 2023-10-06T05:25:46.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb111bdd700 1 -- 172.21.15.29:0/215213444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb10c0ca0d0 msgr2=0x7fb10c0c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb111bdd700 1 --2- 172.21.15.29:0/215213444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb10c0ca0d0 0x7fb10c0c9a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0098e0 tx=0x7fb0fc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80ad68700 1 -- 172.21.15.29:0/1310744517 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 msgr2=0x7fd80406a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80ad68700 1 --2- 172.21.15.29:0/1310744517 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd80406a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009f20 tx=0x7fd7fc009840 comp rx=0 tx=0).stop 2023-10-06T05:25:46.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb111bdd700 1 -- 172.21.15.29:0/215213444 shutdown_connections 2023-10-06T05:25:46.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb111bdd700 1 --2- 172.21.15.29:0/215213444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb10c0ca0d0 0x7fb10c0c9a60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb111bdd700 1 --2- 172.21.15.29:0/215213444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c0c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb111bdd700 1 -- 172.21.15.29:0/215213444 >> 172.21.15.29:0/215213444 conn(0x7fb10c06c6c0 msgr2=0x7fb10c06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca5a656700 1 -- 172.21.15.29:0/3574434013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca540b1050 msgr2=0x7fca5406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca5a656700 1 --2- 172.21.15.29:0/3574434013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca540b1050 0x7fca5406d9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca5406a010 tx=0x7fca4c009840 comp rx=0 tx=0).stop 2023-10-06T05:25:46.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca5a656700 1 -- 172.21.15.29:0/3574434013 shutdown_connections 2023-10-06T05:25:46.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca5a656700 1 --2- 172.21.15.29:0/3574434013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca540b1050 0x7fca5406d9e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca5a656700 1 --2- 172.21.15.29:0/3574434013 >> v2:172.21.15.29:3300/0 conn(0x7fca54155d00 0x7fca540c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca5a656700 1 -- 172.21.15.29:0/3574434013 >> 172.21.15.29:0/3574434013 conn(0x7fca5406abc0 msgr2=0x7fca540adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80ad68700 1 -- 172.21.15.29:0/1310744517 shutdown_connections 2023-10-06T05:25:46.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80ad68700 1 --2- 172.21.15.29:0/1310744517 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd80406a760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80ad68700 1 --2- 172.21.15.29:0/1310744517 >> v2:172.21.15.29:3300/0 conn(0x7fd804156be0 0x7fd8040cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80ad68700 1 -- 172.21.15.29:0/1310744517 >> 172.21.15.29:0/1310744517 conn(0x7fd8040670a0 msgr2=0x7fd8040674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25c9a11700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f25c40add80 0x7f25c40cbd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50580/0 (socket says 172.21.15.29:50580) 2023-10-06T05:25:46.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25c9a11700 1 -- 172.21.15.29:0/1496405287 learned_addr learned my addr 172.21.15.29:0/1496405287 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:46.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25c9210700 1 --2- 172.21.15.29:0/1496405287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 0x7f25c40ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca5a656700 1 -- 172.21.15.29:0/3574434013 shutdown_connections 2023-10-06T05:25:46.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fca5a656700 1 -- 172.21.15.29:0/3574434013 wait complete. 2023-10-06T05:25:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25ca212700 1 --2- 172.21.15.29:0/1496405287 >> v2:172.21.15.29:3300/0 conn(0x7f25c406b810 0x7f25c40c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a5d9b700 1 --2- 172.21.15.29:0/3354113853 >> v2:172.21.15.173:3300/0 conn(0x7fd4a806e730 0x7fd4a806eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f7babc41700 1 -- 172.21.15.29:0/427721109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba41534b0 msgr2=0x7f7ba406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f7babc41700 1 --2- 172.21.15.29:0/427721109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba41534b0 0x7f7ba406c6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00099b0 tx=0x7f7ba0009250 comp rx=0 tx=0).stop 2023-10-06T05:25:46.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a5d9b700 1 -- 172.21.15.29:0/3354113853 >> v1:172.21.15.173:6789/0 conn(0x7fd4a8165c30 legacy=0x7fd4a80ace30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T05:25:46.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a5d9b700 1 -- 172.21.15.29:0/3354113853 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80ab5a0 con 0x7fd4a80ac9e0 2023-10-06T05:25:46.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a5d9b700 1 --2- 172.21.15.29:0/3354113853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a80ac9e0 0x7fd4a80aed90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80a6b50 tx=0x7fd4a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd0097406fa6fff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25ca212700 1 -- 172.21.15.29:0/1496405287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 msgr2=0x7f25c40ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25ca212700 1 --2- 172.21.15.29:0/1496405287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 0x7f25c40ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25ca212700 1 -- 172.21.15.29:0/1496405287 >> v1:172.21.15.29:6789/0 conn(0x7f25c40add80 legacy=0x7f25c40cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb111bdd700 1 -- 172.21.15.29:0/215213444 shutdown_connections 2023-10-06T05:25:46.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fb111bdd700 1 -- 172.21.15.29:0/215213444 wait complete. 2023-10-06T05:25:46.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25ca212700 1 -- 172.21.15.29:0/1496405287 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c406aa50 con 0x7f25c406b810 2023-10-06T05:25:46.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f7babc41700 1 -- 172.21.15.29:0/427721109 shutdown_connections 2023-10-06T05:25:46.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f7babc41700 1 --2- 172.21.15.29:0/427721109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba41534b0 0x7f7ba406c6c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f7babc41700 1 -- 172.21.15.29:0/427721109 >> 172.21.15.29:0/427721109 conn(0x7f7ba4062b60 msgr2=0x7f7ba4062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80ad68700 1 -- 172.21.15.29:0/1310744517 shutdown_connections 2023-10-06T05:25:46.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd80ad68700 1 -- 172.21.15.29:0/1310744517 wait complete. 2023-10-06T05:25:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f381e1c5700 1 Processor -- start 2023-10-06T05:25:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f381e1c5700 1 -- start start 2023-10-06T05:25:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25ca212700 1 --2- 172.21.15.29:0/1496405287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c406b810 0x7f25c40c9df0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009e60 tx=0x7f25bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9f3372f15a71f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a559a700 1 -- 172.21.15.29:0/3354113853 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000e070 con 0x7fd4a80ac9e0 2023-10-06T05:25:46.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a559a700 1 -- 172.21.15.29:0/3354113853 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a000ba10 con 0x7fd4a80ac9e0 2023-10-06T05:25:46.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7fd4a559a700 1 -- 172.21.15.29:0/3354113853 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00092e0 con 0x7fd4a80ac9e0 2023-10-06T05:25:46.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25c8a0f700 1 -- 172.21.15.29:0/1496405287 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00e070 con 0x7f25c406b810 2023-10-06T05:25:46.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.401+0000 7f25c8a0f700 1 -- 172.21.15.29:0/1496405287 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc00bc30 con 0x7f25c406b810 2023-10-06T05:25:46.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f25c8a0f700 1 -- 172.21.15.29:0/1496405287 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc012430 con 0x7f25c406b810 2023-10-06T05:25:46.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca5a656700 1 Processor -- start 2023-10-06T05:25:46.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb111bdd700 1 Processor -- start 2023-10-06T05:25:46.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb111bdd700 1 -- start start 2023-10-06T05:25:46.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca5a656700 1 -- start start 2023-10-06T05:25:46.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd4ac811700 1 -- 172.21.15.29:0/3354113853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a80ac9e0 msgr2=0x7fd4a80aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd4ac811700 1 --2- 172.21.15.29:0/3354113853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a80ac9e0 0x7fd4a80aed90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80a6b50 tx=0x7fd4a0009840 comp rx=0 tx=0).stop 2023-10-06T05:25:46.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f25caa13700 1 -- 172.21.15.29:0/1496405287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c406b810 msgr2=0x7f25c40c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f25caa13700 1 --2- 172.21.15.29:0/1496405287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c406b810 0x7f25c40c9df0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009e60 tx=0x7f25bc009780 comp rx=0 tx=0).stop 2023-10-06T05:25:46.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f7babc41700 1 -- 172.21.15.29:0/427721109 shutdown_connections 2023-10-06T05:25:46.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f7babc41700 1 -- 172.21.15.29:0/427721109 wait complete. 2023-10-06T05:25:46.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd4ac811700 1 -- 172.21.15.29:0/3354113853 shutdown_connections 2023-10-06T05:25:46.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd4ac811700 1 --2- 172.21.15.29:0/3354113853 >> v2:172.21.15.173:3300/0 conn(0x7fd4a806e730 0x7fd4a806eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd4ac811700 1 --2- 172.21.15.29:0/3354113853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a80ac9e0 0x7fd4a80aed90 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80a6b50 tx=0x7fd4a0009840 comp rx=0 tx=0).stop 2023-10-06T05:25:46.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd4ac811700 1 -- 172.21.15.29:0/3354113853 >> 172.21.15.29:0/3354113853 conn(0x7fd4a8067b70 msgr2=0x7fd4a806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f381e1c5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38180670a0 0x7f3818156da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd80ad68700 1 Processor -- start 2023-10-06T05:25:46.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f381e1c5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381806a3e0 con 0x7f38180c82f0 2023-10-06T05:25:46.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f381e1c5700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180c7270 con 0x7f38181569d0 2023-10-06T05:25:46.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f381e1c5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180675f0 con 0x7f38180670a0 2023-10-06T05:25:46.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f25caa13700 1 -- 172.21.15.29:0/1496405287 shutdown_connections 2023-10-06T05:25:46.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f25caa13700 1 --2- 172.21.15.29:0/1496405287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c406b810 0x7f25c40c9df0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f25caa13700 1 --2- 172.21.15.29:0/1496405287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 0x7f25c40ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f25caa13700 1 -- 172.21.15.29:0/1496405287 >> 172.21.15.29:0/1496405287 conn(0x7f25c40670a0 msgr2=0x7f25c40674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38177fe700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f38181569d0 0x7f38180c6b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:38474/0 (socket says 172.21.15.29:38474) 2023-10-06T05:25:46.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38177fe700 1 -- 172.21.15.29:0/3292789764 learned_addr learned my addr 172.21.15.29:0/3292789764 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:46.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb111bdd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb10c0adef0 0x7fb10c152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb111bdd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c16de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb111bdd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb10c0ca0d0 0x7fb10c1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb111bdd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c16e390 con 0x7fb10c0adef0 2023-10-06T05:25:46.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb111bdd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c156640 con 0x7fb10c0ca0d0 2023-10-06T05:25:46.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb111bdd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c156920 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f3816ffd700 1 --2- 172.21.15.29:0/3292789764 >> v2:172.21.15.29:3300/0 conn(0x7f38180670a0 0x7f3818156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca5a656700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540b1050 0x7fca5415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca5a656700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54155930 0x7fca54152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca5a656700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca54155d00 0x7fca5414e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca5a656700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5415a0c0 con 0x7fca54155930 2023-10-06T05:25:46.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca5a656700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5415aa90 con 0x7fca54155d00 2023-10-06T05:25:46.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca5a656700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca540ad4b0 con 0x7fca540b1050 2023-10-06T05:25:46.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd4ac811700 1 -- 172.21.15.29:0/3354113853 shutdown_connections 2023-10-06T05:25:46.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761559525 0 0) 0x7f38180c7270 con 0x7f38181569d0 2023-10-06T05:25:46.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3800003570 con 0x7f38181569d0 2023-10-06T05:25:46.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca58e53700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54155930 0x7fca54152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca59654700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540b1050 0x7fca5415a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca58e53700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54155930 0x7fca54152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51364/0 (socket says 172.21.15.29:51364) 2023-10-06T05:25:46.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca58e53700 1 -- 172.21.15.29:0/3273019893 learned_addr learned my addr 172.21.15.29:0/3273019893 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb10affd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c16de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb10affd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c16de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52796/0 (socket says 172.21.15.29:52796) 2023-10-06T05:25:46.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb10affd700 1 -- 172.21.15.29:0/2617639650 learned_addr learned my addr 172.21.15.29:0/2617639650 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3452501649 0 0) 0x7f3800003570 con 0x7f38181569d0 2023-10-06T05:25:46.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 >> v2:172.21.15.29:3300/0 conn(0x7f38180670a0 msgr2=0x7f3818156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 --2- 172.21.15.29:0/3292789764 >> v2:172.21.15.29:3300/0 conn(0x7f38180670a0 0x7f3818156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 >> v1:172.21.15.29:6789/0 conn(0x7f38180c82f0 legacy=0x7f38180c86e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T05:25:46.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca58e53700 1 -- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540b1050 msgr2=0x7fca5415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca58e53700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540b1050 0x7fca5415a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca58e53700 1 -- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca54155d00 msgr2=0x7fca5414e950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T05:25:46.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca58e53700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca54155d00 0x7fca5414e950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca58e53700 1 -- 172.21.15.29:0/3273019893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c009ae0 con 0x7fca54155930 2023-10-06T05:25:46.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180678d0 con 0x7f38181569d0 2023-10-06T05:25:46.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f380c001470 con 0x7f38181569d0 2023-10-06T05:25:46.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 >> v1:172.21.15.173:6789/0 conn(0x7f38181569d0 legacy=0x7f38180c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 --2- 172.21.15.29:0/3292789764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3800003a60 0x7f3800003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 --2- 172.21.15.29:0/3292789764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3800004810 0x7f3800004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 --2- 172.21.15.29:0/3292789764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38000051c0 0x7f380000fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180675f0 con 0x7f38000051c0 2023-10-06T05:25:46.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800010490 con 0x7f3800003a60 2023-10-06T05:25:46.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3800010650 con 0x7f3800004810 2023-10-06T05:25:46.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f7babc41700 1 Processor -- start 2023-10-06T05:25:46.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd80ad68700 1 -- start start 2023-10-06T05:25:46.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd80ad68700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd804150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd80ad68700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8040cbe60 0x7fd8040af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd80ad68700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd804156be0 0x7fd8040c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd80ad68700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040b15e0 con 0x7fd8040cbe60 2023-10-06T05:25:46.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f25caa13700 1 -- 172.21.15.29:0/1496405287 shutdown_connections 2023-10-06T05:25:46.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd80ad68700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804150d90 con 0x7fd804156be0 2023-10-06T05:25:46.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd80ad68700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040ade60 con 0x7fd8040c7090 2023-10-06T05:25:46.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb10affd700 1 -- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb10c0ca0d0 msgr2=0x7fb10c1576e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T05:25:46.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb10affd700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb10c0ca0d0 0x7fb10c1576e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb10affd700 1 -- 172.21.15.29:0/2617639650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb10c0adef0 msgr2=0x7fb10c152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb10affd700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb10c0adef0 0x7fb10c152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb10affd700 1 -- 172.21.15.29:0/2617639650 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc009420 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f7babc41700 1 -- start start 2023-10-06T05:25:46.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fca58e53700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54155930 0x7fca54152ec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fca4400d860 tx=0x7fca44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd809565700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8040cbe60 0x7fd8040af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd809565700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8040cbe60 0x7fd8040af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51378/0 (socket says 172.21.15.29:51378) 2023-10-06T05:25:46.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd809565700 1 -- 172.21.15.29:0/2597818710 learned_addr learned my addr 172.21.15.29:0/2597818710 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd80a567700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd804156be0 0x7fd8040c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd809d66700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd804150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb10affd700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c16de50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb104009ef0 tx=0x7fb10400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb1037fe700 1 -- 172.21.15.29:0/2617639650 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10400cc50 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd809565700 1 -- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 msgr2=0x7fd804150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd809565700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd804150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd809565700 1 -- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd804156be0 msgr2=0x7fd8040c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd809565700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd804156be0 0x7fd8040c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd809565700 1 -- 172.21.15.29:0/2597818710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc009ae0 con 0x7fd8040cbe60 2023-10-06T05:25:46.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fd4ac811700 1 -- 172.21.15.29:0/3354113853 wait complete. 2023-10-06T05:25:46.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd809565700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8040cbe60 0x7fd8040af3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c810 tx=0x7fd800007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7fb1037fe700 1 -- 172.21.15.29:0/2617639650 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10400f040 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c156c00 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c1571c0 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fca497fa700 1 -- 172.21.15.29:0/3273019893 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440125f0 con 0x7fca54155930 2023-10-06T05:25:46.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fca497fa700 1 -- 172.21.15.29:0/3273019893 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca44012750 con 0x7fca54155930 2023-10-06T05:25:46.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f25caa13700 1 -- 172.21.15.29:0/1496405287 wait complete. 2023-10-06T05:25:46.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25caa13700 1 Processor -- start 2023-10-06T05:25:46.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7babc41700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba406cc00 0x7f7ba4169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7babc41700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba41530e0 0x7f7ba4151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7babc41700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba41534b0 0x7f7ba415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7babc41700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40bfa20 con 0x7f7ba406cc00 2023-10-06T05:25:46.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7babc41700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40bfd00 con 0x7f7ba41530e0 2023-10-06T05:25:46.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7babc41700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40bffe0 con 0x7f7ba41534b0 2023-10-06T05:25:46.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f3816ffd700 1 --2- 172.21.15.29:0/3292789764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3800004810 0x7f3800004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f3816ffd700 1 -- 172.21.15.29:0/3292789764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3800003a60 msgr2=0x7f3800003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T05:25:46.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f3816ffd700 1 --2- 172.21.15.29:0/3292789764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3800003a60 0x7f3800003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f3816ffd700 1 -- 172.21.15.29:0/3292789764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38000051c0 msgr2=0x7f380000fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f3816ffd700 1 --2- 172.21.15.29:0/3292789764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38000051c0 0x7f380000fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.405+0000 7f3816ffd700 1 -- 172.21.15.29:0/3292789764 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180678d0 con 0x7f3800004810 2023-10-06T05:25:46.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f3817fff700 1 -- 172.21.15.29:0/3292789764 reap_dead start 2023-10-06T05:25:46.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f3816ffd700 1 --2- 172.21.15.29:0/3292789764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3800004810 0x7f3800004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3818067520 tx=0x7f381000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b17f67ff81214a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4ac811700 1 Processor -- start 2023-10-06T05:25:46.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4ac811700 1 -- start start 2023-10-06T05:25:46.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7ba91dc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba41530e0 0x7f7ba4151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7ba91dc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba41530e0 0x7f7ba4151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45810/0 (socket says 172.21.15.29:45810) 2023-10-06T05:25:46.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7ba91dc700 1 -- 172.21.15.29:0/2204386806 learned_addr learned my addr 172.21.15.29:0/2204386806 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7baa1de700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba41534b0 0x7f7ba415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd7f9ffb700 1 -- 172.21.15.29:0/2597818710 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800011590 con 0x7fd8040cbe60 2023-10-06T05:25:46.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd7f9ffb700 1 -- 172.21.15.29:0/2597818710 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8000116f0 con 0x7fd8040cbe60 2023-10-06T05:25:46.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80416e370 con 0x7fd8040cbe60 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25caa13700 1 -- start start 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25caa13700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25c406b810 0x7f25c4154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25caa13700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c40add80 0x7f25c40c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25caa13700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 0x7f25c40c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25caa13700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c4e80 con 0x7f25c40add80 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25caa13700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c415bec0 con 0x7f25c406b810 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25caa13700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c4270 con 0x7f25c415d6c0 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9a11700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25c406b810 0x7f25c4154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9210700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c40add80 0x7f25c40c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9a11700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25c406b810 0x7f25c4154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45820/0 (socket says 172.21.15.29:45820) 2023-10-06T05:25:46.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9a11700 1 -- 172.21.15.29:0/1613125734 learned_addr learned my addr 172.21.15.29:0/1613125734 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25ca212700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 0x7f25c40c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9210700 1 -- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 msgr2=0x7f25c40c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9210700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 0x7f25c40c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9210700 1 -- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25c406b810 msgr2=0x7f25c4154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000ea90 con 0x7f3800004810 2023-10-06T05:25:46.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381000f040 con 0x7f3800004810 2023-10-06T05:25:46.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f38167fc700 1 -- 172.21.15.29:0/3292789764 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000ee20 con 0x7f3800004810 2023-10-06T05:25:46.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f381e1c5700 1 -- 172.21.15.29:0/3292789764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3800004810 msgr2=0x7f3800004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f381e1c5700 1 --2- 172.21.15.29:0/3292789764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3800004810 0x7f3800004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3818067520 tx=0x7f381000b040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f381e1c5700 1 -- 172.21.15.29:0/3292789764 shutdown_connections 2023-10-06T05:25:46.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f381e1c5700 1 --2- 172.21.15.29:0/3292789764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3800004810 0x7f3800004c80 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3818067520 tx=0x7f381000b040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f381e1c5700 1 -- 172.21.15.29:0/3292789764 >> 172.21.15.29:0/3292789764 conn(0x7f381806c6c0 msgr2=0x7f381806ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fb1037fe700 1 -- 172.21.15.29:0/2617639650 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104014480 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f00052b0 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7ba91dc700 1 -- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba41534b0 msgr2=0x7f7ba415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7ba91dc700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba41534b0 0x7f7ba415b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7ba91dc700 1 -- 172.21.15.29:0/2204386806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba406cc00 msgr2=0x7f7ba4169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7ba91dc700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba406cc00 0x7f7ba4169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7ba91dc700 1 -- 172.21.15.29:0/2204386806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba00094f0 con 0x7f7ba41530e0 2023-10-06T05:25:46.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4ac811700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4a806e730 0x7fd4a8166b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4ac811700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a8165c30 0x7fd4a8168880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4ac811700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a8085990 0x7fd4a80a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd7f9ffb700 1 -- 172.21.15.29:0/2597818710 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800011ab0 con 0x7fd8040cbe60 2023-10-06T05:25:46.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8040aebc0 con 0x7fd8040cbe60 2023-10-06T05:25:46.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9210700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25c406b810 0x7f25c4154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9210700 1 -- 172.21.15.29:0/1613125734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc009a20 con 0x7f25c40add80 2023-10-06T05:25:46.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4ac811700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a81875b0 con 0x7fd4a8165c30 2023-10-06T05:25:46.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4ac811700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8167180 con 0x7fd4a8085990 2023-10-06T05:25:46.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4ac811700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8167460 con 0x7fd4a806e730 2023-10-06T05:25:46.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4a806e730 0x7fd4a8166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4a806e730 0x7fd4a8166b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52850/0 (socket says 172.21.15.29:52850) 2023-10-06T05:25:46.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a659c700 1 -- 172.21.15.29:0/1138266711 learned_addr learned my addr 172.21.15.29:0/1138266711 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a6d9d700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a8085990 0x7fd4a80a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a5d9b700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a8165c30 0x7fd4a8168880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7ba91dc700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba41530e0 0x7f7ba4151e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009290 tx=0x7f7ba0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a659c700 1 -- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a8085990 msgr2=0x7fd4a80a86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a659c700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a8085990 0x7fd4a80a86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a659c700 1 -- 172.21.15.29:0/1138266711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a8165c30 msgr2=0x7fd4a8168880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a659c700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a8165c30 0x7fd4a8168880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a659c700 1 -- 172.21.15.29:0/1138266711 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0009ae0 con 0x7fd4a806e730 2023-10-06T05:25:46.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80404be00 con 0x7fd8040cbe60 2023-10-06T05:25:46.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f25c9210700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c40add80 0x7f25c40c3700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c850 tx=0x7f25b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f381e1c5700 1 -- 172.21.15.29:0/3292789764 shutdown_connections 2023-10-06T05:25:46.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7b99ffb700 1 -- 172.21.15.29:0/2204386806 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0024440 con 0x7f7ba41530e0 2023-10-06T05:25:46.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7b99ffb700 1 -- 172.21.15.29:0/2204386806 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba00245c0 con 0x7f7ba41530e0 2023-10-06T05:25:46.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7b99ffb700 1 -- 172.21.15.29:0/2204386806 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0024980 con 0x7f7ba41530e0 2023-10-06T05:25:46.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba40c02c0 con 0x7f7ba41530e0 2023-10-06T05:25:46.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba416a4b0 con 0x7f7ba41530e0 2023-10-06T05:25:46.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fd4a659c700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4a806e730 0x7fd4a8166b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b600 tx=0x7fd49c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca54159790 con 0x7fca54155930 2023-10-06T05:25:46.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fca497fa700 1 -- 172.21.15.29:0/3273019893 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44012ad0 con 0x7fca54155930 2023-10-06T05:25:46.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.409+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca54159d50 con 0x7fca54155930 2023-10-06T05:25:46.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f381e1c5700 1 -- 172.21.15.29:0/3292789764 wait complete. 2023-10-06T05:25:46.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5415a270 con 0x7fca54155930 2023-10-06T05:25:46.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fb1037fe700 1 -- 172.21.15.29:0/2617639650 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb104037ba0 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fd7f9ffb700 1 -- 172.21.15.29:0/2597818710 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd80001b3b0 con 0x7fd8040cbe60 2023-10-06T05:25:46.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fb1037fe700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb0ec060550 0x7fb0ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fb1037fe700 1 -- 172.21.15.29:0/2617639650 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb10407d570 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fd7f9ffb700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd7e8060620 0x7fd7e8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fd7f9ffb700 1 -- 172.21.15.29:0/2597818710 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd80007c2a0 con 0x7fd8040cbe60 2023-10-06T05:25:46.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fb10b7fe700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb0ec060550 0x7fb0ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba40c07a0 con 0x7f7ba41530e0 2023-10-06T05:25:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fd809d66700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd7e8060620 0x7fd7e8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f381e1c5700 1 Processor -- start 2023-10-06T05:25:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f7b99ffb700 1 -- 172.21.15.29:0/2204386806 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7ba001a420 con 0x7f7ba41530e0 2023-10-06T05:25:46.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fb10b7fe700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb0ec060550 0x7fb0ec062a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40016a0 tx=0x7fb0f4007b30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f7b99ffb700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7b88060550 0x7f7b88062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f381e1c5700 1 -- start start 2023-10-06T05:25:46.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f7b99ffb700 1 -- 172.21.15.29:0/2204386806 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ba007e870 con 0x7f7ba41530e0 2023-10-06T05:25:46.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fd809d66700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd7e8060620 0x7fd7e8062ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400de80 tx=0x7fd7f400f040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f7ba99dd700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7b88060550 0x7f7b88062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f381e1c5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818178cf0 0x7f38180b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f381e1c5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f38181575b0 0x7f38180b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f381e1c5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38180afad0 0x7f38180b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f381e1c5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180c4bf0 con 0x7f38180afad0 2023-10-06T05:25:46.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f381e1c5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3818157d00 con 0x7f3818178cf0 2023-10-06T05:25:46.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f381e1c5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3818157a20 con 0x7f38181575b0 2023-10-06T05:25:46.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f3817fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38180afad0 0x7f38180b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f3817fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38180afad0 0x7f38180b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51420/0 (socket says 172.21.15.29:51420) 2023-10-06T05:25:46.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f3817fff700 1 -- 172.21.15.29:0/463809218 learned_addr learned my addr 172.21.15.29:0/463809218 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f3816ffd700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f38181575b0 0x7f38180b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f38177fe700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818178cf0 0x7f38180b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f7ba99dd700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7b88060550 0x7f7b88062a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c007fd0 tx=0x7f7b9c007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f3817fff700 1 -- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f38181575b0 msgr2=0x7f38180b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f3817fff700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f38181575b0 0x7f38180b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f3817fff700 1 -- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818178cf0 msgr2=0x7f38180b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f3817fff700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818178cf0 0x7f38180b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f3817fff700 1 -- 172.21.15.29:0/463809218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180c45a0 con 0x7f38180afad0 2023-10-06T05:25:46.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7f38177fe700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818178cf0 0x7f38180b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:46.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.413+0000 7fdf45f13700 1 Processor -- start 2023-10-06T05:25:46.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf45f13700 1 -- start start 2023-10-06T05:25:46.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7f3817fff700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38180afad0 0x7f38180b0a80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38180c8e20 tx=0x7f3808002cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf45f13700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdf40069690 0x7fdf40069a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf45f13700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdf4006b9b0 0x7fdf40159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf45f13700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf40159b70 con 0x7fdf400ad7c0 2023-10-06T05:25:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf45f13700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4015a640 con 0x7fdf4006b9b0 2023-10-06T05:25:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf45f13700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf40159da0 con 0x7fdf40069690 2023-10-06T05:25:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdf4006b9b0 0x7fdf40159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdf4006b9b0 0x7fdf40159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51432/0 (socket says 172.21.15.29:51432) 2023-10-06T05:25:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3ffff700 1 -- 172.21.15.29:0/1910072846 learned_addr learned my addr 172.21.15.29:0/1910072846 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf44f11700 1 --2- 172.21.15.29:0/1910072846 >> v2:172.21.15.173:3300/0 conn(0x7fdf40069690 0x7fdf40069a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3ffff700 1 -- 172.21.15.29:0/1910072846 >> v2:172.21.15.173:3300/0 conn(0x7fdf40069690 msgr2=0x7fdf40069a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3ffff700 1 --2- 172.21.15.29:0/1910072846 >> v2:172.21.15.173:3300/0 conn(0x7fdf40069690 0x7fdf40069a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3ffff700 1 -- 172.21.15.29:0/1910072846 >> v1:172.21.15.173:6789/0 conn(0x7fdf400ad7c0 legacy=0x7fdf40158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3ffff700 1 -- 172.21.15.29:0/1910072846 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4015a080 con 0x7fdf4006b9b0 2023-10-06T05:25:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3ffff700 1 --2- 172.21.15.29:0/1910072846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf4006b9b0 0x7fdf40159630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf4006af60 tx=0x7fdf2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42f6d04ba818667 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fd7f9ffb700 1 -- 172.21.15.29:0/2597818710 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd80004c7b0 con 0x7fd8040cbe60 2023-10-06T05:25:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7f37ff7fe700 1 -- 172.21.15.29:0/463809218 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808015030 con 0x7f38180afad0 2023-10-06T05:25:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38180c4880 con 0x7f38180afad0 2023-10-06T05:25:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38180c5220 con 0x7f38180afad0 2023-10-06T05:25:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7f25b9ffb700 1 -- 172.21.15.29:0/1613125734 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011600 con 0x7f25c40add80 2023-10-06T05:25:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7f25b9ffb700 1 -- 172.21.15.29:0/1613125734 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4011780 con 0x7f25c40add80 2023-10-06T05:25:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7f25b9ffb700 1 -- 172.21.15.29:0/1613125734 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011b40 con 0x7f25c40add80 2023-10-06T05:25:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c40c4550 con 0x7f25c40add80 2023-10-06T05:25:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c40c4b10 con 0x7f25c40add80 2023-10-06T05:25:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7f37ff7fe700 1 -- 172.21.15.29:0/463809218 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380801b470 con 0x7f38180afad0 2023-10-06T05:25:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7f37ff7fe700 1 -- 172.21.15.29:0/463809218 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380800f430 con 0x7f38180afad0 2023-10-06T05:25:46.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fca497fa700 1 -- 172.21.15.29:0/3273019893 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fca44028430 con 0x7fca54155930 2023-10-06T05:25:46.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c40c4ff0 con 0x7f25c40add80 2023-10-06T05:25:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fca497fa700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca380605d0 0x7fca38062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fca497fa700 1 -- 172.21.15.29:0/3273019893 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca4407d5d0 con 0x7fca54155930 2023-10-06T05:25:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fca59654700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca380605d0 0x7fca38062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fca59654700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca380605d0 0x7fca38062a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca50007fd0 tx=0x7fca50007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fb1037fe700 1 -- 172.21.15.29:0/2617639650 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb10404d9e0 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f80052b0 con 0x7f38180afad0 2023-10-06T05:25:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fd4967fc700 1 -- 172.21.15.29:0/1138266711 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00f510 con 0x7fd4a806e730 2023-10-06T05:25:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fd4967fc700 1 -- 172.21.15.29:0/1138266711 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c00f690 con 0x7fd4a806e730 2023-10-06T05:25:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a8167740 con 0x7fd4a806e730 2023-10-06T05:25:46.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fd4967fc700 1 -- 172.21.15.29:0/1138266711 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00fa50 con 0x7fd4a806e730 2023-10-06T05:25:46.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a8168dc0 con 0x7fd4a806e730 2023-10-06T05:25:46.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a8071120 con 0x7fd4a806e730 2023-10-06T05:25:46.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3f7fe700 1 -- 172.21.15.29:0/1910072846 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00b860 con 0x7fdf4006b9b0 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3f7fe700 1 -- 172.21.15.29:0/1910072846 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c00b9c0 con 0x7fdf4006b9b0 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.417+0000 7fdf3f7fe700 1 -- 172.21.15.29:0/1910072846 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00bd60 con 0x7fdf4006b9b0 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fdf45f13700 1 -- 172.21.15.29:0/1910072846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf4006b9b0 msgr2=0x7fdf40159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fdf45f13700 1 --2- 172.21.15.29:0/1910072846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf4006b9b0 0x7fdf40159630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf4006af60 tx=0x7fdf2c009250 comp rx=0 tx=0).stop 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fdf45f13700 1 -- 172.21.15.29:0/1910072846 shutdown_connections 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fdf45f13700 1 --2- 172.21.15.29:0/1910072846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf4006b9b0 0x7fdf40159630 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fdf45f13700 1 --2- 172.21.15.29:0/1910072846 >> v2:172.21.15.173:3300/0 conn(0x7fdf40069690 0x7fdf40069a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.421+0000 7fdf45f13700 1 -- 172.21.15.29:0/1910072846 >> 172.21.15.29:0/1910072846 conn(0x7fdf400c9540 msgr2=0x7fdf400c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fdf45f13700 1 -- 172.21.15.29:0/1910072846 shutdown_connections 2023-10-06T05:25:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fdf45f13700 1 -- 172.21.15.29:0/1910072846 wait complete. 2023-10-06T05:25:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fd4967fc700 1 -- 172.21.15.29:0/1138266711 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd49c034b50 con 0x7fd4a806e730 2023-10-06T05:25:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fd4967fc700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd488060550 0x7fd488062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fd4967fc700 1 -- 172.21.15.29:0/1138266711 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd49c07c4d0 con 0x7fd4a806e730 2023-10-06T05:25:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fd4a5d9b700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd488060550 0x7fd488062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fd4a5d9b700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd488060550 0x7fd488062a00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80ace00 tx=0x7fd4a0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fdf45f13700 1 Processor -- start 2023-10-06T05:25:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fca497fa700 1 -- 172.21.15.29:0/3273019893 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca4404dbc0 con 0x7fca54155930 2023-10-06T05:25:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7fdf45f13700 1 -- start start 2023-10-06T05:25:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7f7b99ffb700 1 -- 172.21.15.29:0/2204386806 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7ba004ed00 con 0x7f7ba41530e0 2023-10-06T05:25:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.425+0000 7f37ff7fe700 1 -- 172.21.15.29:0/463809218 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3808018070 con 0x7f38180afad0 2023-10-06T05:25:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7f37ff7fe700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3804060550 0x7f3804062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7f37ff7fe700 1 -- 172.21.15.29:0/463809218 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3808016070 con 0x7f38180afad0 2023-10-06T05:25:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fd4967fc700 1 -- 172.21.15.29:0/1138266711 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd49c04cac0 con 0x7fd4a806e730 2023-10-06T05:25:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf45f13700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf40069690 0x7fdf400bf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf45f13700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf4006b9b0 0x7fdf4013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf45f13700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf400ad7c0 0x7fdf4013f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7f25b9ffb700 1 -- 172.21.15.29:0/1613125734 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f25b4023480 con 0x7f25c40add80 2023-10-06T05:25:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf44f11700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf40069690 0x7fdf400bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf44f11700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf40069690 0x7fdf400bf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51436/0 (socket says 172.21.15.29:51436) 2023-10-06T05:25:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf45712700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf400ad7c0 0x7fdf4013f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf45712700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf400ad7c0 0x7fdf4013f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52878/0 (socket says 172.21.15.29:52878) 2023-10-06T05:25:46.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7f25b9ffb700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f25a8060550 0x7f25a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7f25b9ffb700 1 -- 172.21.15.29:0/1613125734 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f25b407c970 con 0x7f25c40add80 2023-10-06T05:25:46.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf44f11700 1 -- 172.21.15.29:0/1421120630 learned_addr learned my addr 172.21.15.29:0/1421120630 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:46.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4013eda0 con 0x7fdf40069690 2023-10-06T05:25:46.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4013e190 con 0x7fdf4006b9b0 2023-10-06T05:25:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4013e470 con 0x7fdf400ad7c0 2023-10-06T05:25:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7f25c9a11700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f25a8060550 0x7f25a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf44f11700 1 -- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf400ad7c0 msgr2=0x7fdf4013f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf44f11700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf400ad7c0 0x7fdf4013f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf44f11700 1 -- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf4006b9b0 msgr2=0x7fdf4013f230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T05:25:46.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf44f11700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf4006b9b0 0x7fdf4013f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf44f11700 1 -- 172.21.15.29:0/1421120630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0094f0 con 0x7fdf40069690 2023-10-06T05:25:46.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7fdf44f11700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf40069690 0x7fdf400bf930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400d890 tx=0x7fdf34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.429+0000 7f25c9a11700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f25a8060550 0x7f25a8062a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f25c40c5880 tx=0x7f25c0007f70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.433+0000 7f38177fe700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3804060550 0x7f3804062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.433+0000 7f38177fe700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3804060550 0x7f3804062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f380c000e10 tx=0x7f380c001aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.433+0000 7f37ff7fe700 1 -- 172.21.15.29:0/463809218 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f380804d390 con 0x7f38180afad0 2023-10-06T05:25:46.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.441+0000 7f25b9ffb700 1 -- 172.21.15.29:0/1613125734 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f25b4050870 con 0x7f25c40add80 2023-10-06T05:25:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.441+0000 7fdf3cff9700 1 -- 172.21.15.29:0/1421120630 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340125f0 con 0x7fdf40069690 2023-10-06T05:25:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.441+0000 7fdf3cff9700 1 -- 172.21.15.29:0/1421120630 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34012750 con 0x7fdf40069690 2023-10-06T05:25:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.441+0000 7fdf3cff9700 1 -- 172.21.15.29:0/1421120630 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34012af0 con 0x7fdf40069690 2023-10-06T05:25:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.445+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4013e750 con 0x7fdf40069690 2023-10-06T05:25:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.445+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf400bf030 con 0x7fdf40069690 2023-10-06T05:25:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.445+0000 7fdf3cff9700 1 -- 172.21.15.29:0/1421120630 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdf3401e460 con 0x7fdf40069690 2023-10-06T05:25:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.445+0000 7fdf3cff9700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdf24060650 0x7fdf24062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.449+0000 7fdf3ffff700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdf24060650 0x7fdf24062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.449+0000 7fdf3cff9700 1 -- 172.21.15.29:0/1421120630 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf340517c0 con 0x7fdf40069690 2023-10-06T05:25:46.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.449+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4004be00 con 0x7fdf40069690 2023-10-06T05:25:46.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.449+0000 7fdf3ffff700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdf24060650 0x7fdf24062b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf4006af60 tx=0x7fdf2c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:46.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.457+0000 7fdf3cff9700 1 -- 172.21.15.29:0/1421120630 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdf3404d3c0 con 0x7fdf40069690 2023-10-06T05:25:46.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.737+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb0f0005830 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.737+0000 7fb1037fe700 1 -- 172.21.15.29:0/2617639650 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb104051000 con 0x7fb10c0ae2c0 2023-10-06T05:25:46.744 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb0ec060550 msgr2=0x7fb0ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb0ec060550 0x7fb0ec062a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40016a0 tx=0x7fb0f4007b30 comp rx=0 tx=0).stop 2023-10-06T05:25:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 msgr2=0x7fb10c16de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c16de50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb104009ef0 tx=0x7fb10400b040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 shutdown_connections 2023-10-06T05:25:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb0ec060550 0x7fb0ec062a00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb10c0ca0d0 0x7fb10c1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb10c0ae2c0 0x7fb10c16de50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 --2- 172.21.15.29:0/2617639650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb10c0adef0 0x7fb10c152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 >> 172.21.15.29:0/2617639650 conn(0x7fb10c06c6c0 msgr2=0x7fb10c0ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 shutdown_connections 2023-10-06T05:25:46.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.741+0000 7fb111bdd700 1 -- 172.21.15.29:0/2617639650 wait complete. 2023-10-06T05:25:46.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ba4069340 con 0x7f7ba41530e0 2023-10-06T05:25:46.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7b99ffb700 1 -- 172.21.15.29:0/2204386806 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ba0015020 con 0x7f7ba41530e0 2023-10-06T05:25:46.749 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:46.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7b88060550 msgr2=0x7f7b88062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7b88060550 0x7f7b88062a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c007fd0 tx=0x7f7b9c007d30 comp rx=0 tx=0).stop 2023-10-06T05:25:46.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba41530e0 msgr2=0x7f7ba4151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba41530e0 0x7f7ba4151e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009290 tx=0x7f7ba0017000 comp rx=0 tx=0).stop 2023-10-06T05:25:46.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 shutdown_connections 2023-10-06T05:25:46.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba41534b0 0x7f7ba415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7b88060550 0x7f7b88062a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba41530e0 0x7f7ba4151e30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 --2- 172.21.15.29:0/2204386806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba406cc00 0x7f7ba4169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 >> 172.21.15.29:0/2204386806 conn(0x7f7ba4062b60 msgr2=0x7f7ba406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 shutdown_connections 2023-10-06T05:25:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7f7babc41700 1 -- 172.21.15.29:0/2204386806 wait complete. 2023-10-06T05:25:46.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.745+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca5404be00 con 0x7fca54155930 2023-10-06T05:25:46.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.749+0000 7fca497fa700 1 -- 172.21.15.29:0/3273019893 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca440511e0 con 0x7fca54155930 2023-10-06T05:25:46.753 INFO:teuthology.orchestra.run.smithi029.stdout:55834574852 2023-10-06T05:25:46.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.749+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f37f8005830 con 0x7f38180afad0 2023-10-06T05:25:46.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.749+0000 7f37ff7fe700 1 -- 172.21.15.29:0/463809218 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3808005020 con 0x7f38180afad0 2023-10-06T05:25:46.755 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:46.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca380605d0 msgr2=0x7fca38062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca380605d0 0x7fca38062a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca50007fd0 tx=0x7fca50007d30 comp rx=0 tx=0).stop 2023-10-06T05:25:46.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54155930 msgr2=0x7fca54152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54155930 0x7fca54152ec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fca4400d860 tx=0x7fca44008040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 shutdown_connections 2023-10-06T05:25:46.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca380605d0 0x7fca38062a80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca54155d00 0x7fca5414e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54155930 0x7fca54152ec0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 --2- 172.21.15.29:0/3273019893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca540b1050 0x7fca5415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 >> 172.21.15.29:0/3273019893 conn(0x7fca5406abc0 msgr2=0x7fca540b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 shutdown_connections 2023-10-06T05:25:46.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fca5a656700 1 -- 172.21.15.29:0/3273019893 wait complete. 2023-10-06T05:25:46.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd8040cc510 con 0x7fd8040cbe60 2023-10-06T05:25:46.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3804060550 msgr2=0x7f3804062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3804060550 0x7f3804062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f380c000e10 tx=0x7f380c001aa0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38180afad0 msgr2=0x7f38180b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38180afad0 0x7f38180b0a80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38180c8e20 tx=0x7f3808002cd0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-06T05:25:46.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 shutdown_connections 2023-10-06T05:25:46.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38180afad0 0x7f38180b0a80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f38181575b0 0x7f38180b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3804060550 0x7f3804062a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 --2- 172.21.15.29:0/463809218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3818178cf0 0x7f38180b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 >> 172.21.15.29:0/463809218 conn(0x7f381806c6c0 msgr2=0x7f38180c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fd7f9ffb700 1 -- 172.21.15.29:0/2597818710 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd800017020 con 0x7fd8040cbe60 2023-10-06T05:25:46.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 shutdown_connections 2023-10-06T05:25:46.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7f381e1c5700 1 -- 172.21.15.29:0/463809218 wait complete. 2023-10-06T05:25:46.763 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:46.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd4a81675a0 con 0x7fd4a806e730 2023-10-06T05:25:46.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.753+0000 7fd4967fc700 1 -- 172.21.15.29:0/1138266711 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4a81675a0 con 0x7fd4a806e730 2023-10-06T05:25:46.763 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:46.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd7e8060620 msgr2=0x7fd7e8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd7e8060620 0x7fd7e8062ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400de80 tx=0x7fd7f400f040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8040cbe60 msgr2=0x7fd8040af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8040cbe60 0x7fd8040af3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c810 tx=0x7fd800007ee0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 shutdown_connections 2023-10-06T05:25:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd7e8060620 0x7fd7e8062ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd804156be0 0x7fd8040c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8040cbe60 0x7fd8040af3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 --2- 172.21.15.29:0/2597818710 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8040c7090 0x7fd804150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 >> 172.21.15.29:0/2597818710 conn(0x7fd8040670a0 msgr2=0x7fd8040cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 shutdown_connections 2023-10-06T05:25:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd80ad68700 1 -- 172.21.15.29:0/2597818710 wait complete. 2023-10-06T05:25:46.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25c404be00 con 0x7f25c40add80 2023-10-06T05:25:46.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7f25b9ffb700 1 -- 172.21.15.29:0/1613125734 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25b401e020 con 0x7f25c40add80 2023-10-06T05:25:46.766 INFO:teuthology.orchestra.run.smithi029.stdout:55834574852 2023-10-06T05:25:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd488060550 msgr2=0x7fd488062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd488060550 0x7fd488062a00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80ace00 tx=0x7fd4a0017000 comp rx=0 tx=0).stop 2023-10-06T05:25:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4a806e730 msgr2=0x7fd4a8166b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4a806e730 0x7fd4a8166b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00b600 tx=0x7fd49c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 shutdown_connections 2023-10-06T05:25:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd488060550 0x7fd488062a00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a8085990 0x7fd4a80a86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4a8165c30 0x7fd4a8168880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 --2- 172.21.15.29:0/1138266711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4a806e730 0x7fd4a8166b90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 >> 172.21.15.29:0/1138266711 conn(0x7fd4a8067b70 msgr2=0x7fd4a806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 shutdown_connections 2023-10-06T05:25:46.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.757+0000 7fd4ac811700 1 -- 172.21.15.29:0/1138266711 wait complete. 2023-10-06T05:25:46.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-06T05:25:46.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f25a8060550 msgr2=0x7f25a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f25a8060550 0x7f25a8062a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f25c40c5880 tx=0x7f25c0007f70 comp rx=0 tx=0).stop 2023-10-06T05:25:46.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c40add80 msgr2=0x7f25c40c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c40add80 0x7f25c40c3700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c850 tx=0x7f25b4008040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 shutdown_connections 2023-10-06T05:25:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c415d6c0 0x7f25c40c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25c40add80 0x7f25c40c3700 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f25a8060550 0x7f25a8062a00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 --2- 172.21.15.29:0/1613125734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25c406b810 0x7f25c4154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 >> 172.21.15.29:0/1613125734 conn(0x7f25c40670a0 msgr2=0x7f25c415c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 shutdown_connections 2023-10-06T05:25:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.761+0000 7f25caa13700 1 -- 172.21.15.29:0/1613125734 wait complete. 2023-10-06T05:25:46.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-10-06T05:25:46.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-06T05:25:46.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-06T05:25:46.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-10-06T05:25:46.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-06T05:25:46.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf4015a360 con 0x7fdf40069690 2023-10-06T05:25:46.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf3cff9700 1 -- 172.21.15.29:0/1421120630 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf340509e0 con 0x7fdf40069690 2023-10-06T05:25:46.783 INFO:teuthology.orchestra.run.smithi029.stdout:55834574852 2023-10-06T05:25:46.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdf24060650 msgr2=0x7fdf24062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdf24060650 0x7fdf24062b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf4006af60 tx=0x7fdf2c017000 comp rx=0 tx=0).stop 2023-10-06T05:25:46.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf40069690 msgr2=0x7fdf400bf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:46.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf40069690 0x7fdf400bf930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400d890 tx=0x7fdf34008040 comp rx=0 tx=0).stop 2023-10-06T05:25:46.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 shutdown_connections 2023-10-06T05:25:46.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf400ad7c0 0x7fdf4013f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdf24060650 0x7fdf24062b00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf4006b9b0 0x7fdf4013f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 --2- 172.21.15.29:0/1421120630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf40069690 0x7fdf400bf930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:46.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 >> 172.21.15.29:0/1421120630 conn(0x7fdf400c9540 msgr2=0x7fdf4006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:46.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.777+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 shutdown_connections 2023-10-06T05:25:46.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:46.781+0000 7fdf45f13700 1 -- 172.21.15.29:0/1421120630 wait complete. 2023-10-06T05:25:46.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-06T05:25:47.761 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T05:25:47.770 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T05:25:47.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T05:25:47.775 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T05:25:47.777 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T05:25:47.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T05:25:47.783 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T05:25:47.794 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T05:25:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f22a114c700 1 Processor -- start 2023-10-06T05:25:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f22a114c700 1 -- start start 2023-10-06T05:25:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f22a114c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 0x7f229c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f22a114c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f229c06a270 0x7f229c06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f22a114c700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229c0cac30 con 0x7f229c152890 2023-10-06T05:25:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f22a114c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229c0c7720 con 0x7f229c06a270 2023-10-06T05:25:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f22a114c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c0c6b10 con 0x7f229c0ca280 2023-10-06T05:25:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f229ad9d700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f229c152890 0x7f229c0c8600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:38486/0 (socket says 172.21.15.29:38486) 2023-10-06T05:25:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f229ad9d700 1 -- 172.21.15.29:0/2898592401 learned_addr learned my addr 172.21.15.29:0/2898592401 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f229b59e700 1 --2- 172.21.15.29:0/2898592401 >> v2:172.21.15.173:3300/0 conn(0x7f229c06a270 0x7f229c06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.901+0000 7f229a59c700 1 --2- 172.21.15.29:0/2898592401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 0x7f229c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f229b59e700 1 -- 172.21.15.29:0/2898592401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 msgr2=0x7f229c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f229b59e700 1 --2- 172.21.15.29:0/2898592401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 0x7f229c0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f229b59e700 1 -- 172.21.15.29:0/2898592401 >> v1:172.21.15.173:6789/0 conn(0x7f229c152890 legacy=0x7f229c0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f229b59e700 1 -- 172.21.15.29:0/2898592401 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0c6df0 con 0x7f229c06a270 2023-10-06T05:25:47.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f229b59e700 1 --2- 172.21.15.29:0/2898592401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f229c06a270 0x7f229c06a6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f228c0098e0 tx=0x7f228c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce715143a95a6c42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f2299d9b700 1 -- 172.21.15.29:0/2898592401 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00f6b0 con 0x7f229c06a270 2023-10-06T05:25:47.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f2299d9b700 1 -- 172.21.15.29:0/2898592401 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c00f810 con 0x7f229c06a270 2023-10-06T05:25:47.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f2299d9b700 1 -- 172.21.15.29:0/2898592401 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00fbb0 con 0x7f229c06a270 2023-10-06T05:25:47.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f22a114c700 1 -- 172.21.15.29:0/2898592401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f229c06a270 msgr2=0x7f229c06a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f22a114c700 1 --2- 172.21.15.29:0/2898592401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f229c06a270 0x7f229c06a6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f228c0098e0 tx=0x7f228c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f22a114c700 1 -- 172.21.15.29:0/2898592401 shutdown_connections 2023-10-06T05:25:47.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f22a114c700 1 --2- 172.21.15.29:0/2898592401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f229c06a270 0x7f229c06a6b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f22a114c700 1 --2- 172.21.15.29:0/2898592401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 0x7f229c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f22a114c700 1 -- 172.21.15.29:0/2898592401 >> 172.21.15.29:0/2898592401 conn(0x7f229c06c6c0 msgr2=0x7f229c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:47.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f22a114c700 1 -- 172.21.15.29:0/2898592401 shutdown_connections 2023-10-06T05:25:47.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f6f424e2700 1 Processor -- start 2023-10-06T05:25:47.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f22a114c700 1 -- 172.21.15.29:0/2898592401 wait complete. 2023-10-06T05:25:47.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.905+0000 7f6f424e2700 1 -- start start 2023-10-06T05:25:47.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f909c88c700 1 Processor -- start 2023-10-06T05:25:47.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f424e2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f424e2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f3c06b780 0x7f6f3c161010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f424e2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c06b2f0 con 0x7f6f3c0ca060 2023-10-06T05:25:47.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f424e2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c161d90 con 0x7f6f3c06b780 2023-10-06T05:25:47.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f424e2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c06bbe0 con 0x7f6f3c15d3a0 2023-10-06T05:25:47.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f3b7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f3b7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c0ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52908/0 (socket says 172.21.15.29:52908) 2023-10-06T05:25:47.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f3b7fe700 1 -- 172.21.15.29:0/3591438463 learned_addr learned my addr 172.21.15.29:0/3591438463 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f22a114c700 1 Processor -- start 2023-10-06T05:25:47.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f22a114c700 1 -- start start 2023-10-06T05:25:47.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f22a114c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f229c06a270 0x7f229c0c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f40a7f700 1 --2- 172.21.15.29:0/3591438463 >> v2:172.21.15.29:3300/0 conn(0x7f6f3c06b780 0x7f6f3c161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f909c88c700 1 -- start start 2023-10-06T05:25:47.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f909c88c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90981581c0 0x7f90980c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f909c88c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f90980ca8c0 0x7f90980c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f909c88c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90980c9120 con 0x7f9098158590 2023-10-06T05:25:47.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f909c88c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90980c7d50 con 0x7f90980ca8c0 2023-10-06T05:25:47.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f909c88c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90980c6d30 con 0x7f90981581c0 2023-10-06T05:25:47.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f9096d9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90981581c0 0x7f90980c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f9096d9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90981581c0 0x7f90980c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52910/0 (socket says 172.21.15.29:52910) 2023-10-06T05:25:47.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f9096d9d700 1 -- 172.21.15.29:0/1518414735 learned_addr learned my addr 172.21.15.29:0/1518414735 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f909759e700 1 --2- 172.21.15.29:0/1518414735 >> v2:172.21.15.173:3300/0 conn(0x7f90980ca8c0 0x7f90980c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f229c06a270 0x7f229c0c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f229c06a270 0x7f229c0c2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51452/0 (socket says 172.21.15.29:51452) 2023-10-06T05:25:47.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f22a114c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 0x7f229c16a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f22a114c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f229c152890 0x7f229c16ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f22a114c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c1521a0 con 0x7f229c06a270 2023-10-06T05:25:47.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f22a114c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c16a940 con 0x7f229c152890 2023-10-06T05:25:47.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f22a114c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c0c3490 con 0x7f229c0ca280 2023-10-06T05:25:47.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229ad9d700 1 -- 172.21.15.29:0/1579689234 learned_addr learned my addr 172.21.15.29:0/1579689234 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f40a7f700 1 -- 172.21.15.29:0/3591438463 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 msgr2=0x7f6f3c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f40a7f700 1 --2- 172.21.15.29:0/3591438463 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c0ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f40a7f700 1 -- 172.21.15.29:0/3591438463 >> v1:172.21.15.29:6789/0 conn(0x7f6f3c0ca060 legacy=0x7f6f3c15cc90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T05:25:47.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229a59c700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 0x7f229c16a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f40a7f700 1 -- 172.21.15.29:0/3591438463 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c06a9c0 con 0x7f6f3c06b780 2023-10-06T05:25:47.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229b59e700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f229c152890 0x7f229c16ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f9096d9d700 1 -- 172.21.15.29:0/1518414735 >> v2:172.21.15.173:3300/0 conn(0x7f90980ca8c0 msgr2=0x7f90980c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f9096d9d700 1 --2- 172.21.15.29:0/1518414735 >> v2:172.21.15.173:3300/0 conn(0x7f90980ca8c0 0x7f90980c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229ad9d700 1 -- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 msgr2=0x7f229c16a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229ad9d700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 0x7f229c16a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229ad9d700 1 -- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f229c152890 msgr2=0x7f229c16ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229ad9d700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f229c152890 0x7f229c16ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229ad9d700 1 -- 172.21.15.29:0/1579689234 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c009420 con 0x7f229c06a270 2023-10-06T05:25:47.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f40a7f700 1 --2- 172.21.15.29:0/3591438463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 0x7f6f3c161010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009e60 tx=0x7f6f34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b96f829baa19818 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f9096d9d700 1 -- 172.21.15.29:0/1518414735 >> v1:172.21.15.29:6789/0 conn(0x7f9098158590 legacy=0x7f90980ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f9096d9d700 1 -- 172.21.15.29:0/1518414735 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90980c7010 con 0x7f90981581c0 2023-10-06T05:25:47.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f909759e700 1 --2- 172.21.15.29:0/1518414735 >> v2:172.21.15.173:3300/0 conn(0x7f90980ca8c0 0x7f90980c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:47.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f229ad9d700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f229c06a270 0x7f229c0c2e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f229400c900 tx=0x7f2294006470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f3affd700 1 -- 172.21.15.29:0/3591438463 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3400e070 con 0x7f6f3c06b780 2023-10-06T05:25:47.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f9096d9d700 1 --2- 172.21.15.29:0/1518414735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90981581c0 0x7f90980c7810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f90880089b0 tx=0x7f90880082d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3af31d18722ab259 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f2282ffd700 1 -- 172.21.15.29:0/1579689234 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229400cea0 con 0x7f229c06a270 2023-10-06T05:25:47.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f3affd700 1 -- 172.21.15.29:0/3591438463 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3400bb20 con 0x7f6f3c06b780 2023-10-06T05:25:47.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.909+0000 7f6f3affd700 1 -- 172.21.15.29:0/3591438463 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f34012430 con 0x7f6f3c06b780 2023-10-06T05:25:47.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f22a114c700 1 -- 172.21.15.29:0/1579689234 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229c0c3770 con 0x7f229c06a270 2023-10-06T05:25:47.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f22a114c700 1 -- 172.21.15.29:0/1579689234 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c0c3d30 con 0x7f229c06a270 2023-10-06T05:25:47.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f6f424e2700 1 -- 172.21.15.29:0/3591438463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 msgr2=0x7f6f3c161010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3591438463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 0x7f6f3c161010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009e60 tx=0x7f6f34009780 comp rx=0 tx=0).stop 2023-10-06T05:25:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f9095d9b700 1 -- 172.21.15.29:0/1518414735 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088010070 con 0x7f90981581c0 2023-10-06T05:25:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f9095d9b700 1 -- 172.21.15.29:0/1518414735 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908800da40 con 0x7f90981581c0 2023-10-06T05:25:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f9095d9b700 1 -- 172.21.15.29:0/1518414735 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800dde0 con 0x7f90981581c0 2023-10-06T05:25:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f909c88c700 1 -- 172.21.15.29:0/1518414735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90981581c0 msgr2=0x7f90980c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f909c88c700 1 --2- 172.21.15.29:0/1518414735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90981581c0 0x7f90980c7810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f90880089b0 tx=0x7f90880082d0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f2282ffd700 1 -- 172.21.15.29:0/1579689234 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294007020 con 0x7f229c06a270 2023-10-06T05:25:47.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f6f424e2700 1 -- 172.21.15.29:0/3591438463 shutdown_connections 2023-10-06T05:25:47.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3591438463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 0x7f6f3c161010 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3591438463 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f6f424e2700 1 -- 172.21.15.29:0/3591438463 >> 172.21.15.29:0/3591438463 conn(0x7f6f3c06c6c0 msgr2=0x7f6f3c06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:47.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f2282ffd700 1 -- 172.21.15.29:0/1579689234 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940073e0 con 0x7f229c06a270 2023-10-06T05:25:47.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f2282ffd700 1 -- 172.21.15.29:0/1579689234 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2294004d50 con 0x7f229c06a270 2023-10-06T05:25:47.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f6f424e2700 1 -- 172.21.15.29:0/3591438463 shutdown_connections 2023-10-06T05:25:47.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f6f424e2700 1 -- 172.21.15.29:0/3591438463 wait complete. 2023-10-06T05:25:47.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f22a114c700 1 -- 172.21.15.29:0/1579689234 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c0052b0 con 0x7f229c06a270 2023-10-06T05:25:47.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f2282ffd700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22880606a0 0x7f2288062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f2282ffd700 1 -- 172.21.15.29:0/1579689234 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f229407c770 con 0x7f229c06a270 2023-10-06T05:25:47.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f229a59c700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22880606a0 0x7f2288062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f909c88c700 1 -- 172.21.15.29:0/1518414735 shutdown_connections 2023-10-06T05:25:47.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f909c88c700 1 --2- 172.21.15.29:0/1518414735 >> v2:172.21.15.173:3300/0 conn(0x7f90980ca8c0 0x7f90980c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.913+0000 7f909c88c700 1 --2- 172.21.15.29:0/1518414735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90981581c0 0x7f90980c7810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 -- 172.21.15.29:0/1518414735 >> 172.21.15.29:0/1518414735 conn(0x7f90980670a0 msgr2=0x7f90980674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:47.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 -- 172.21.15.29:0/1518414735 shutdown_connections 2023-10-06T05:25:47.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 -- 172.21.15.29:0/1518414735 wait complete. 2023-10-06T05:25:47.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a71ac4700 1 Processor -- start 2023-10-06T05:25:47.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a71ac4700 1 -- start start 2023-10-06T05:25:47.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a71ac4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5a6c0cba00 0x7f5a6c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a71ac4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a6c161760 0x7f5a6c15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f424e2700 1 Processor -- start 2023-10-06T05:25:47.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f424e2700 1 -- start start 2023-10-06T05:25:47.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f424e2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 0x7f6f3c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 Processor -- start 2023-10-06T05:25:47.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f424e2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3c0ca060 0x7f6f3c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 0x7f6f3c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 0x7f6f3c14c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51462/0 (socket says 172.21.15.29:51462) 2023-10-06T05:25:47.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a71ac4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c15d180 0x7f5a6c0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a71ac4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c06b550 con 0x7f5a6c161760 2023-10-06T05:25:47.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a71ac4700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c06a940 con 0x7f5a6c0cba00 2023-10-06T05:25:47.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a71ac4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c06ac20 con 0x7f5a6c15d180 2023-10-06T05:25:47.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 -- start start 2023-10-06T05:25:47.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3bfff700 1 -- 172.21.15.29:0/3580051475 learned_addr learned my addr 172.21.15.29:0/3580051475 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a712c3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c15d180 0x7f5a6c0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a712c3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c15d180 0x7f5a6c0c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52930/0 (socket says 172.21.15.29:52930) 2023-10-06T05:25:47.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c171050 con 0x7f6f3c06b780 2023-10-06T05:25:47.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a712c3700 1 -- 172.21.15.29:0/2873351533 learned_addr learned my addr 172.21.15.29:0/2873351533 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f229a59c700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22880606a0 0x7f2288062b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f229000adc0 tx=0x7f2290008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a70ac2700 1 --2- 172.21.15.29:0/2873351533 >> v2:172.21.15.173:3300/0 conn(0x7f5a6c0cba00 0x7f5a6c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0b06e0 con 0x7f6f3c0ca060 2023-10-06T05:25:47.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f40a7f700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a6bfff700 1 --2- 172.21.15.29:0/2873351533 >> v2:172.21.15.29:3300/0 conn(0x7f5a6c161760 0x7f5a6c15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c170a00 con 0x7f6f3c15d3a0 2023-10-06T05:25:47.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a712c3700 1 -- 172.21.15.29:0/2873351533 >> v2:172.21.15.173:3300/0 conn(0x7f5a6c0cba00 msgr2=0x7f5a6c0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a712c3700 1 --2- 172.21.15.29:0/2873351533 >> v2:172.21.15.173:3300/0 conn(0x7f5a6c0cba00 0x7f5a6c0cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a712c3700 1 -- 172.21.15.29:0/2873351533 >> v2:172.21.15.29:3300/0 conn(0x7f5a6c161760 msgr2=0x7f5a6c15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a712c3700 1 --2- 172.21.15.29:0/2873351533 >> v2:172.21.15.29:3300/0 conn(0x7f5a6c161760 0x7f5a6c15cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3b7fe700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3c0ca060 0x7f6f3c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a712c3700 1 -- 172.21.15.29:0/2873351533 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c06af00 con 0x7f5a6c15d180 2023-10-06T05:25:47.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a6bfff700 1 --2- 172.21.15.29:0/2873351533 >> v2:172.21.15.29:3300/0 conn(0x7f5a6c161760 0x7f5a6c15cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:47.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90980ca8c0 0x7f9098157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90981581c0 0x7f90981249b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9098125530 0x7f90980accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098157b80 con 0x7f90981581c0 2023-10-06T05:25:47.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90980c29e0 con 0x7f90980ca8c0 2023-10-06T05:25:47.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909c88c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9098151030 con 0x7f9098125530 2023-10-06T05:25:47.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3bfff700 1 -- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 msgr2=0x7f6f3c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3bfff700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3bfff700 1 -- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3c0ca060 msgr2=0x7f6f3c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3bfff700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3c0ca060 0x7f6f3c1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3bfff700 1 -- 172.21.15.29:0/3580051475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f34009a20 con 0x7f6f3c06b780 2023-10-06T05:25:47.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90981581c0 0x7f90981249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f40a7f700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:47.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a712c3700 1 --2- 172.21.15.29:0/2873351533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c15d180 0x7f5a6c0c83d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c06e860 tx=0x7f5a64009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=962d68a9a5b16315 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90981581c0 0x7f90981249b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51476/0 (socket says 172.21.15.29:51476) 2023-10-06T05:25:47.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909659c700 1 -- 172.21.15.29:0/1173270266 learned_addr learned my addr 172.21.15.29:0/1173270266 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f6f3bfff700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 0x7f6f3c14c9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c5d0 tx=0x7f6f2c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f909759e700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9098125530 0x7f90980accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f9096d9d700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90980ca8c0 0x7f9098157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.917+0000 7f5a6b7fe700 1 -- 172.21.15.29:0/2873351533 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400e070 con 0x7f5a6c15d180 2023-10-06T05:25:47.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a6b7fe700 1 -- 172.21.15.29:0/2873351533 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6400ba20 con 0x7f5a6c15d180 2023-10-06T05:25:47.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a6b7fe700 1 -- 172.21.15.29:0/2873351533 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a640092e0 con 0x7f5a6c15d180 2023-10-06T05:25:47.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f909659c700 1 -- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9098125530 msgr2=0x7f90980accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f909659c700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9098125530 0x7f90980accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f909659c700 1 -- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90980ca8c0 msgr2=0x7f9098157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f909659c700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90980ca8c0 0x7f9098157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f909659c700 1 -- 172.21.15.29:0/1173270266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090009a20 con 0x7f90981581c0 2023-10-06T05:25:47.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 -- 172.21.15.29:0/2873351533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c15d180 msgr2=0x7f5a6c0c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 --2- 172.21.15.29:0/2873351533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c15d180 0x7f5a6c0c83d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c06e860 tx=0x7f5a64009840 comp rx=0 tx=0).stop 2023-10-06T05:25:47.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f909659c700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90981581c0 0x7f90981249b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f908c00b610 tx=0x7f908c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 -- 172.21.15.29:0/2873351533 shutdown_connections 2023-10-06T05:25:47.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 --2- 172.21.15.29:0/2873351533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c15d180 0x7f5a6c0c83d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 --2- 172.21.15.29:0/2873351533 >> v2:172.21.15.29:3300/0 conn(0x7f5a6c161760 0x7f5a6c15cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 --2- 172.21.15.29:0/2873351533 >> v2:172.21.15.173:3300/0 conn(0x7f5a6c0cba00 0x7f5a6c0cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 -- 172.21.15.29:0/2873351533 >> 172.21.15.29:0/2873351533 conn(0x7f5a6c0670a0 msgr2=0x7f5a6c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:47.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 -- 172.21.15.29:0/2873351533 shutdown_connections 2023-10-06T05:25:47.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 -- 172.21.15.29:0/2873351533 wait complete. 2023-10-06T05:25:47.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 Processor -- start 2023-10-06T05:25:47.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f5a71ac4700 1 -- start start 2023-10-06T05:25:47.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f2282ffd700 1 -- 172.21.15.29:0/1579689234 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f22940506f0 con 0x7f229c06a270 2023-10-06T05:25:47.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f9086ffd700 1 -- 172.21.15.29:0/1173270266 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c00f510 con 0x7f90981581c0 2023-10-06T05:25:47.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088008570 con 0x7f90981581c0 2023-10-06T05:25:47.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9098150420 con 0x7f90981581c0 2023-10-06T05:25:47.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f9086ffd700 1 -- 172.21.15.29:0/1173270266 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c00f670 con 0x7f90981581c0 2023-10-06T05:25:47.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f9086ffd700 1 -- 172.21.15.29:0/1173270266 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c00fa30 con 0x7f90981581c0 2023-10-06T05:25:47.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f6f23fff700 1 -- 172.21.15.29:0/3580051475 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011590 con 0x7f6f3c06b780 2023-10-06T05:25:47.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.921+0000 7f6f23fff700 1 -- 172.21.15.29:0/3580051475 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c011710 con 0x7f6f3c06b780 2023-10-06T05:25:47.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f6f23fff700 1 -- 172.21.15.29:0/3580051475 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011ad0 con 0x7f6f3c06b780 2023-10-06T05:25:47.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a71ac4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a6c0cba00 0x7f5a6c170160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a71ac4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a6c15d180 0x7f5a6c0c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a71ac4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c161760 0x7f5a6c0c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a71ac4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0b1480 con 0x7f5a6c15d180 2023-10-06T05:25:47.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a71ac4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c4510 con 0x7f5a6c0cba00 2023-10-06T05:25:47.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a71ac4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0ae980 con 0x7f5a6c161760 2023-10-06T05:25:47.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c170ce0 con 0x7f6f3c06b780 2023-10-06T05:25:47.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c14d050 con 0x7f6f3c06b780 2023-10-06T05:25:47.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a70ac2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a6c0cba00 0x7f5a6c170160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a70ac2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a6c0cba00 0x7f5a6c170160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45888/0 (socket says 172.21.15.29:45888) 2023-10-06T05:25:47.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a70ac2700 1 -- 172.21.15.29:0/3827615794 learned_addr learned my addr 172.21.15.29:0/3827615794 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a70ac2700 1 -- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c161760 msgr2=0x7f5a6c0c4f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T05:25:47.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a70ac2700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c161760 0x7f5a6c0c4f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a70ac2700 1 -- 172.21.15.29:0/3827615794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a6c15d180 msgr2=0x7f5a6c0c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a70ac2700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a6c15d180 0x7f5a6c0c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a70ac2700 1 -- 172.21.15.29:0/3827615794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a64009ae0 con 0x7f5a6c0cba00 2023-10-06T05:25:47.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a70ac2700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a6c0cba00 0x7f5a6c170160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00ec80 tx=0x7f5a5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a68ff9700 1 -- 172.21.15.29:0/3827615794 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00c9d0 con 0x7f5a6c0cba00 2023-10-06T05:25:47.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a68ff9700 1 -- 172.21.15.29:0/3827615794 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c00cb30 con 0x7f5a6c0cba00 2023-10-06T05:25:47.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a68ff9700 1 -- 172.21.15.29:0/3827615794 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c013470 con 0x7f5a6c0cba00 2023-10-06T05:25:47.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a71ac4700 1 -- 172.21.15.29:0/3827615794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c0aec60 con 0x7f5a6c0cba00 2023-10-06T05:25:47.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f5a71ac4700 1 -- 172.21.15.29:0/3827615794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c0af220 con 0x7f5a6c0cba00 2023-10-06T05:25:47.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c14d270 con 0x7f6f3c06b780 2023-10-06T05:25:47.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90740052b0 con 0x7f90981581c0 2023-10-06T05:25:47.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.925+0000 7f9086ffd700 1 -- 172.21.15.29:0/1173270266 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f908c01a400 con 0x7f90981581c0 2023-10-06T05:25:47.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f5a68ff9700 1 -- 172.21.15.29:0/3827615794 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5a5c0137e0 con 0x7f5a6c0cba00 2023-10-06T05:25:47.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f9086ffd700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f907c060520 0x7f907c0629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f9086ffd700 1 -- 172.21.15.29:0/1173270266 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f908c07c400 con 0x7f90981581c0 2023-10-06T05:25:47.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f5a68ff9700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5a580605d0 0x7f5a58062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f9096d9d700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f907c060520 0x7f907c0629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f5a68ff9700 1 -- 172.21.15.29:0/3827615794 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a5c07cd40 con 0x7f5a6c0cba00 2023-10-06T05:25:47.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f5a6bfff700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5a580605d0 0x7f5a58062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f5a527fc700 1 -- 172.21.15.29:0/3827615794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c0052b0 con 0x7f5a6c0cba00 2023-10-06T05:25:47.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f6f23fff700 1 -- 172.21.15.29:0/3580051475 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6f2c01c460 con 0x7f6f3c06b780 2023-10-06T05:25:47.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f9096d9d700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f907c060520 0x7f907c0629d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90880089b0 tx=0x7f908801b000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f5a6bfff700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5a580605d0 0x7f5a58062a80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a60006fd0 tx=0x7f5a60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f6f23fff700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f28060620 0x7f6f28062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f6f23fff700 1 -- 172.21.15.29:0/3580051475 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f2c07c660 con 0x7f6f3c06b780 2023-10-06T05:25:47.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.929+0000 7f6f3b7fe700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f28060620 0x7f6f28062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.933+0000 7f6f3b7fe700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f28060620 0x7f6f28062ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f30006fa0 tx=0x7f6f30008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.937+0000 7f9086ffd700 1 -- 172.21.15.29:0/1173270266 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f908c04c930 con 0x7f90981581c0 2023-10-06T05:25:47.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.941+0000 7f5a68ff9700 1 -- 172.21.15.29:0/3827615794 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5a5c04d150 con 0x7f5a6c0cba00 2023-10-06T05:25:47.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.945+0000 7f6f23fff700 1 -- 172.21.15.29:0/3580051475 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6f3c14d270 con 0x7f6f3c06b780 2023-10-06T05:25:47.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.945+0000 7fc6ee777700 1 Processor -- start 2023-10-06T05:25:47.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.945+0000 7fc6ee777700 1 -- start start 2023-10-06T05:25:47.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ee777700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6e8156be0 0x7fc6e80cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ee777700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc6e80c7090 0x7fc6e806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ee777700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e80cc2e0 con 0x7fc6e80cbe60 2023-10-06T05:25:47.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ee777700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e815a900 con 0x7fc6e8156be0 2023-10-06T05:25:47.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ee777700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e815abe0 con 0x7fc6e80c7090 2023-10-06T05:25:47.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ecf74700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc6e80cbe60 0x7fc6e80c6980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:38498/0 (socket says 172.21.15.29:38498) 2023-10-06T05:25:47.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ecf74700 1 -- 172.21.15.29:0/2816706920 learned_addr learned my addr 172.21.15.29:0/2816706920 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:47.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478552291 0 0) 0x7fc6e80cc2e0 con 0x7fc6e80cbe60 2023-10-06T05:25:47.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d4003570 con 0x7fc6e80cbe60 2023-10-06T05:25:47.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127392223 0 0) 0x7fc6d4003570 con 0x7fc6e80cbe60 2023-10-06T05:25:47.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 >> v2:172.21.15.173:3300/0 conn(0x7fc6e80c7090 msgr2=0x7fc6e806a760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 --2- 172.21.15.29:0/2816706920 >> v2:172.21.15.173:3300/0 conn(0x7fc6e80c7090 0x7fc6e806a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 >> v2:172.21.15.29:3300/0 conn(0x7fc6e8156be0 msgr2=0x7fc6e80cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 --2- 172.21.15.29:0/2816706920 >> v2:172.21.15.29:3300/0 conn(0x7fc6e8156be0 0x7fc6e80cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e815aec0 con 0x7fc6e80cbe60 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fc6e4001470 con 0x7fc6e80cbe60 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 >> v1:172.21.15.173:6789/0 conn(0x7fc6e80cbe60 legacy=0x7fc6e80c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d4003a60 0x7fc6d4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6d4004810 0x7fc6d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d40052e0 0x7fc6d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e815a900 con 0x7fc6d4004810 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e815abe0 con 0x7fc6d40052e0 2023-10-06T05:25:47.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4014b30 con 0x7fc6d4003a60 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ed775700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d4003a60 0x7fc6d4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ecf74700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6d4004810 0x7fc6d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ed775700 1 -- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d40052e0 msgr2=0x7fc6d400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6edf76700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d40052e0 0x7fc6d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ed775700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d40052e0 0x7fc6d400ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ed775700 1 -- 172.21.15.29:0/2816706920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6d4004810 msgr2=0x7fc6d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ed775700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6d4004810 0x7fc6d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ed775700 1 -- 172.21.15.29:0/2816706920 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e815aec0 con 0x7fc6d4003a60 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ecf74700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6d4004810 0x7fc6d4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:47.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6ed775700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d4003a60 0x7fc6d4003e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80099c0 tx=0x7fc6d8009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=151752b2880f9662 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6edf76700 1 -- 172.21.15.29:0/2816706920 reap_dead start 2023-10-06T05:25:47.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8015070 con 0x7fc6d4003a60 2023-10-06T05:25:47.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8011420 con 0x7fc6d4003a60 2023-10-06T05:25:47.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.949+0000 7fc6dffff700 1 -- 172.21.15.29:0/2816706920 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80117e0 con 0x7fc6d4003a60 2023-10-06T05:25:47.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.953+0000 7fc6ee777700 1 -- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d4003a60 msgr2=0x7fc6d4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.953+0000 7fc6ee777700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d4003a60 0x7fc6d4003e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80099c0 tx=0x7fc6d8009060 comp rx=0 tx=0).stop 2023-10-06T05:25:47.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.953+0000 7fc6ee777700 1 -- 172.21.15.29:0/2816706920 shutdown_connections 2023-10-06T05:25:47.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.953+0000 7fc6ee777700 1 --2- 172.21.15.29:0/2816706920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d4003a60 0x7fc6d4003e70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.953+0000 7fc6ee777700 1 -- 172.21.15.29:0/2816706920 >> 172.21.15.29:0/2816706920 conn(0x7fc6e80670a0 msgr2=0x7fc6e80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:47.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 -- 172.21.15.29:0/2816706920 shutdown_connections 2023-10-06T05:25:47.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 -- 172.21.15.29:0/2816706920 wait complete. 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 Processor -- start 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 -- start start 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4003a60 0x7fc6e80ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6e80abdf0 0x7fc6e8150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6e8141510 0x7fc6e80ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80ac260 con 0x7fc6e8141510 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8169280 con 0x7fc6d4003a60 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ee777700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8168d50 con 0x7fc6e80abdf0 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6edf76700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6e8141510 0x7fc6e80ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6edf76700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6e8141510 0x7fc6e80ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51510/0 (socket says 172.21.15.29:51510) 2023-10-06T05:25:47.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6edf76700 1 -- 172.21.15.29:0/3325944763 learned_addr learned my addr 172.21.15.29:0/3325944763 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ed775700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4003a60 0x7fc6e80ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6ecf74700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6e80abdf0 0x7fc6e8150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6edf76700 1 -- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6e80abdf0 msgr2=0x7fc6e8150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6edf76700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6e80abdf0 0x7fc6e8150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6edf76700 1 -- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4003a60 msgr2=0x7fc6e80ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6edf76700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4003a60 0x7fc6e80ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6edf76700 1 -- 172.21.15.29:0/3325944763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e814eb50 con 0x7fc6e8141510 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6edf76700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6e8141510 0x7fc6e80ca770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc6e806c4c0 tx=0x7fc6e00075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6dd7fa700 1 -- 172.21.15.29:0/3325944763 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000ce70 con 0x7fc6e8141510 2023-10-06T05:25:47.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.957+0000 7fc6dd7fa700 1 -- 172.21.15.29:0/3325944763 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e000a6f0 con 0x7fc6e8141510 2023-10-06T05:25:47.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7fc6dd7fa700 1 -- 172.21.15.29:0/3325944763 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000aab0 con 0x7fc6e8141510 2023-10-06T05:25:47.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e8141980 con 0x7fc6e8141510 2023-10-06T05:25:47.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd2ef7700 1 Processor -- start 2023-10-06T05:25:47.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e80adda0 con 0x7fc6e8141510 2023-10-06T05:25:47.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd2ef7700 1 -- start start 2023-10-06T05:25:47.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd2ef7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ccc154cc0 0x7f1ccc155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd2ef7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc06cf90 0x7f1ccc158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd2ef7700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc1592a0 con 0x7f1ccc0abac0 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd2ef7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc159b40 con 0x7f1ccc154cc0 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd2ef7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc06d410 con 0x7f1ccc06cf90 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd0c93700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ccc154cc0 0x7f1ccc155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd0c93700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ccc154cc0 0x7f1ccc155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51516/0 (socket says 172.21.15.29:51516) 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd0c93700 1 -- 172.21.15.29:0/2500999955 learned_addr learned my addr 172.21.15.29:0/2500999955 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd0c93700 1 -- 172.21.15.29:0/2500999955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc06cf90 msgr2=0x7f1ccc158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd0c93700 1 --2- 172.21.15.29:0/2500999955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc06cf90 0x7f1ccc158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd0c93700 1 -- 172.21.15.29:0/2500999955 >> v1:172.21.15.173:6789/0 conn(0x7f1ccc0abac0 legacy=0x7f1ccc0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd0c93700 1 -- 172.21.15.29:0/2500999955 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc159580 con 0x7f1ccc154cc0 2023-10-06T05:25:47.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1cd0c93700 1 --2- 172.21.15.29:0/2500999955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc154cc0 0x7f1ccc155090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc06d6a0 tx=0x7f1cc4007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cb6881cf491eb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7fc6dd7fa700 1 -- 172.21.15.29:0/3325944763 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc6e000d040 con 0x7fc6e8141510 2023-10-06T05:25:47.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7fc6dd7fa700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc6d4061e70 0x7fc6d4064320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1ccb7fe700 1 -- 172.21.15.29:0/2500999955 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4010070 con 0x7f1ccc154cc0 2023-10-06T05:25:47.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7fc6dd7fa700 1 -- 172.21.15.29:0/3325944763 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc6e0050860 con 0x7fc6e8141510 2023-10-06T05:25:47.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7f1ccb7fe700 1 -- 172.21.15.29:0/2500999955 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400dc30 con 0x7f1ccc154cc0 2023-10-06T05:25:47.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.961+0000 7fc6ed775700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc6d4061e70 0x7fc6d4064320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f1ccb7fe700 1 -- 172.21.15.29:0/2500999955 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4007b40 con 0x7f1ccc154cc0 2023-10-06T05:25:47.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7fc6ed775700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc6d4061e70 0x7fc6d4064320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009460 tx=0x7fc6d8015000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/2500999955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc154cc0 msgr2=0x7f1ccc155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f1cd2ef7700 1 --2- 172.21.15.29:0/2500999955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc154cc0 0x7f1ccc155090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc06d6a0 tx=0x7f1cc4007690 comp rx=0 tx=0).stop 2023-10-06T05:25:47.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/2500999955 shutdown_connections 2023-10-06T05:25:47.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f1cd2ef7700 1 --2- 172.21.15.29:0/2500999955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc06cf90 0x7f1ccc158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f1cd2ef7700 1 --2- 172.21.15.29:0/2500999955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc154cc0 0x7f1ccc155090 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/2500999955 >> 172.21.15.29:0/2500999955 conn(0x7f1ccc067b70 msgr2=0x7f1ccc06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:47.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54ff59e700 1 Processor -- start 2023-10-06T05:25:47.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e804be00 con 0x7fc6e8141510 2023-10-06T05:25:47.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54ff59e700 1 -- start start 2023-10-06T05:25:47.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/2500999955 shutdown_connections 2023-10-06T05:25:47.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54ff59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f55000add80 0x7f55000ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54ff59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550006a7b0 con 0x7f550015d6c0 2023-10-06T05:25:47.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54ff59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55000cc430 con 0x7f550006b810 2023-10-06T05:25:47.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54ff59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550006bc70 con 0x7f55000add80 2023-10-06T05:25:47.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54fed9d700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f550006b810 0x7f55000c9df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:38528/0 (socket says 172.21.15.29:38528) 2023-10-06T05:25:47.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54fed9d700 1 -- 172.21.15.29:0/1462177812 learned_addr learned my addr 172.21.15.29:0/1462177812 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:47.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921359351 0 0) 0x7f55000cc430 con 0x7f550006b810 2023-10-06T05:25:47.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e8003570 con 0x7f550006b810 2023-10-06T05:25:47.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/2500999955 wait complete. 2023-10-06T05:25:47.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd2ef7700 1 Processor -- start 2023-10-06T05:25:47.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f794ffff700 1 Processor -- start 2023-10-06T05:25:47.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.965+0000 7f794ffff700 1 -- start start 2023-10-06T05:25:47.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 0x7f79500c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f79500ca8c0 0x7f79500c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500c9120 con 0x7f7950158590 2023-10-06T05:25:47.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79500c7d50 con 0x7f79500ca8c0 2023-10-06T05:25:47.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c6d30 con 0x7f79501581c0 2023-10-06T05:25:47.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1854355130 0 0) 0x7f54e8003570 con 0x7f550006b810 2023-10-06T05:25:47.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 >> v2:172.21.15.173:3300/0 conn(0x7f55000add80 msgr2=0x7f55000ae150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T05:25:47.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 --2- 172.21.15.29:0/1462177812 >> v2:172.21.15.173:3300/0 conn(0x7f55000add80 0x7f55000ae150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 >> v1:172.21.15.29:6789/0 conn(0x7f550015d6c0 legacy=0x7f55000cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550006aa50 con 0x7f550006b810 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f54f80017f0 con 0x7f550006b810 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 >> v1:172.21.15.173:6789/0 conn(0x7f550006b810 legacy=0x7f55000c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f54e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54e8004810 0x7f54e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54e80053c0 0x7f54e8014270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8014a30 con 0x7f54e8004810 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8014ba0 con 0x7f54e80053c0 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8014d60 con 0x7f54e8003a60 2023-10-06T05:25:47.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794f7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f79500ca8c0 0x7f79500c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794f7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f79500ca8c0 0x7f79500c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45930/0 (socket says 172.21.15.29:45930) 2023-10-06T05:25:47.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794f7fe700 1 -- 172.21.15.29:0/4078324261 learned_addr learned my addr 172.21.15.29:0/4078324261 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794effd700 1 --2- 172.21.15.29:0/4078324261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 0x7f79500c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fe59c700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f54e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fdd9b700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54e8004810 0x7f54e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fed9d700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54e80053c0 0x7f54e8014270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fe59c700 1 -- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54e80053c0 msgr2=0x7f54e8014270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fe59c700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54e80053c0 0x7f54e8014270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fe59c700 1 -- 172.21.15.29:0/1462177812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54e8004810 msgr2=0x7f54e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fe59c700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54e8004810 0x7f54e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fe59c700 1 -- 172.21.15.29:0/1462177812 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550006aa50 con 0x7f54e8003a60 2023-10-06T05:25:47.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794f7fe700 1 -- 172.21.15.29:0/4078324261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 msgr2=0x7f79500c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:47.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794f7fe700 1 --2- 172.21.15.29:0/4078324261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 0x7f79500c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794f7fe700 1 -- 172.21.15.29:0/4078324261 >> v1:172.21.15.29:6789/0 conn(0x7f7950158590 legacy=0x7f79500ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794f7fe700 1 -- 172.21.15.29:0/4078324261 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500c7010 con 0x7f79500ca8c0 2023-10-06T05:25:47.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fed9d700 1 -- 172.21.15.29:0/1462177812 reap_dead start 2023-10-06T05:25:47.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794f7fe700 1 --2- 172.21.15.29:0/4078324261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 0x7f79500c83d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f794800d1a0 tx=0x7f7948007690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e0aceb096e5672b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fdd9b700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54e8004810 0x7f54e8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:47.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794dffb700 1 -- 172.21.15.29:0/4078324261 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948010070 con 0x7f79500ca8c0 2023-10-06T05:25:47.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fe59c700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f54e8003e70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009920 tx=0x7f54f4006ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b692833dbf857263 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794dffb700 1 -- 172.21.15.29:0/4078324261 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794800dc00 con 0x7f79500ca8c0 2023-10-06T05:25:47.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4011400 con 0x7f54e8003a60 2023-10-06T05:25:47.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f4011580 con 0x7f54e8003a60 2023-10-06T05:25:47.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54fd59a700 1 -- 172.21.15.29:0/1462177812 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4011940 con 0x7f54e8003a60 2023-10-06T05:25:47.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54ff59e700 1 -- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 msgr2=0x7f54e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54ff59e700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f54e8003e70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009920 tx=0x7f54f4006ef0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd2ef7700 1 -- start start 2023-10-06T05:25:47.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd2ef7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ccc06cf90 0x7f1ccc176ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd2ef7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc0abac0 0x7f1ccc173860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd2ef7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc154cc0 0x7f1ccc14f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd2ef7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc14e6e0 con 0x7f1ccc154cc0 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd2ef7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1773e0 con 0x7f1ccc06cf90 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd2ef7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc14dad0 con 0x7f1ccc0abac0 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1ccbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc0abac0 0x7f1ccc173860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1ccbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc0abac0 0x7f1ccc173860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:53000/0 (socket says 172.21.15.29:53000) 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1ccbfff700 1 -- 172.21.15.29:0/1113043677 learned_addr learned my addr 172.21.15.29:0/1113043677 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd1494700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc154cc0 0x7f1ccc14f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1cd0c93700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ccc06cf90 0x7f1ccc176ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794dffb700 1 -- 172.21.15.29:0/4078324261 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948007b40 con 0x7f79500ca8c0 2023-10-06T05:25:47.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 -- 172.21.15.29:0/4078324261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 msgr2=0x7f79500c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 --2- 172.21.15.29:0/4078324261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 0x7f79500c83d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f794800d1a0 tx=0x7f7948007690 comp rx=0 tx=0).stop 2023-10-06T05:25:47.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 -- 172.21.15.29:0/4078324261 shutdown_connections 2023-10-06T05:25:47.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 --2- 172.21.15.29:0/4078324261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 0x7f79500c83d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 --2- 172.21.15.29:0/4078324261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 0x7f79500c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f794ffff700 1 -- 172.21.15.29:0/4078324261 >> 172.21.15.29:0/4078324261 conn(0x7f79500670a0 msgr2=0x7f79500674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:47.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54ff59e700 1 -- 172.21.15.29:0/1462177812 shutdown_connections 2023-10-06T05:25:47.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54ff59e700 1 --2- 172.21.15.29:0/1462177812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f54e8003e70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f54ff59e700 1 -- 172.21.15.29:0/1462177812 >> 172.21.15.29:0/1462177812 conn(0x7f55000670a0 msgr2=0x7f55000674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 -- 172.21.15.29:0/1462177812 shutdown_connections 2023-10-06T05:25:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1ccbfff700 1 -- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ccc06cf90 msgr2=0x7f1ccc176ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1ccbfff700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ccc06cf90 0x7f1ccc176ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1ccbfff700 1 -- 172.21.15.29:0/1113043677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc154cc0 msgr2=0x7f1ccc14f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.969+0000 7f1ccbfff700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc154cc0 0x7f1ccc14f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f1ccbfff700 1 -- 172.21.15.29:0/1113043677 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc400be70 con 0x7f1ccc0abac0 2023-10-06T05:25:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f794ffff700 1 -- 172.21.15.29:0/4078324261 shutdown_connections 2023-10-06T05:25:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 -- 172.21.15.29:0/1462177812 wait complete. 2023-10-06T05:25:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 Processor -- start 2023-10-06T05:25:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 -- start start 2023-10-06T05:25:47.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f1ccbfff700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc0abac0 0x7f1ccc173860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000b810 tx=0x7f1cc00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f1cc8ff9700 1 -- 172.21.15.29:0/1113043677 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000f510 con 0x7f1ccc0abac0 2023-10-06T05:25:47.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc14ddb0 con 0x7f1ccc0abac0 2023-10-06T05:25:47.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc14e370 con 0x7f1ccc0abac0 2023-10-06T05:25:47.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f1cc8ff9700 1 -- 172.21.15.29:0/1113043677 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc000f670 con 0x7f1ccc0abac0 2023-10-06T05:25:47.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f1cc8ff9700 1 -- 172.21.15.29:0/1113043677 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000fa30 con 0x7f1ccc0abac0 2023-10-06T05:25:47.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f794ffff700 1 -- 172.21.15.29:0/4078324261 wait complete. 2023-10-06T05:25:47.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f794ffff700 1 Processor -- start 2023-10-06T05:25:47.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f5500148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55000c51f0 0x7f5500157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55001579c0 0x7f55000c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54fe59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f5500148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54fe59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f5500148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:53006/0 (socket says 172.21.15.29:53006) 2023-10-06T05:25:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54fe59c700 1 -- 172.21.15.29:0/4122781059 learned_addr learned my addr 172.21.15.29:0/4122781059 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5500157e30 con 0x7f55001579c0 2023-10-06T05:25:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5500149360 con 0x7f55000c51f0 2023-10-06T05:25:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5500151990 con 0x7f54e8003a60 2023-10-06T05:25:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54fdd9b700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55000c51f0 0x7f5500157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f54fed9d700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55001579c0 0x7f55000c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7fc6dd7fa700 1 -- 172.21.15.29:0/3325944763 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc6e004cbf0 con 0x7fc6e8141510 2023-10-06T05:25:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f54fe59c700 1 -- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55000c51f0 msgr2=0x7f5500157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f54fe59c700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55000c51f0 0x7f5500157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f54fe59c700 1 -- 172.21.15.29:0/4122781059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55001579c0 msgr2=0x7f55000c2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f54fe59c700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55001579c0 0x7f55000c2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f54fe59c700 1 -- 172.21.15.29:0/4122781059 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500150d80 con 0x7f54e8003a60 2023-10-06T05:25:47.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f1cc8ff9700 1 -- 172.21.15.29:0/1113043677 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1cc001a400 con 0x7f1ccc0abac0 2023-10-06T05:25:47.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.973+0000 7f794ffff700 1 -- start start 2023-10-06T05:25:47.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 0x7f79500c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 0x7f79500ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7950153ab0 0x7f79500af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c4dd0 con 0x7f7950153ab0 2023-10-06T05:25:47.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794ffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c41c0 con 0x7f79500ca8c0 2023-10-06T05:25:47.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c44a0 con 0x7f79501581c0 2023-10-06T05:25:47.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f54fe59c700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f5500148e20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54f4010f50 tx=0x7f54f4015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 0x7f79500c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 0x7f79500c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45968/0 (socket says 172.21.15.29:45968) 2023-10-06T05:25:47.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794effd700 1 -- 172.21.15.29:0/1439353659 learned_addr learned my addr 172.21.15.29:0/1439353659 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:47.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794e7fc700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 0x7f79500ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794f7fe700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7950153ab0 0x7f79500af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f1cc8ff9700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1cb0060520 0x7f1cb00629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f1cc8ff9700 1 -- 172.21.15.29:0/1113043677 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1cc007c380 con 0x7f1ccc0abac0 2023-10-06T05:25:47.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794effd700 1 -- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 msgr2=0x7f79500ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794effd700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 0x7f79500ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794effd700 1 -- 172.21.15.29:0/1439353659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7950153ab0 msgr2=0x7f79500af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:47.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794effd700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7950153ab0 0x7f79500af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:47.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794effd700 1 -- 172.21.15.29:0/1439353659 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794800be70 con 0x7f79500ca8c0 2023-10-06T05:25:47.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f1cd0c93700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1cb0060520 0x7f1cb00629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f794effd700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 0x7f79500c5260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f794000ec80 tx=0x7f79400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.977+0000 7f1cd0c93700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1cb0060520 0x7f1cb00629d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc06d6a0 tx=0x7f1cc401b000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f7936ffd700 1 -- 172.21.15.29:0/1439353659 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794000c850 con 0x7f79500ca8c0 2023-10-06T05:25:47.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f7936ffd700 1 -- 172.21.15.29:0/1439353659 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794000c9b0 con 0x7f79500ca8c0 2023-10-06T05:25:47.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f7936ffd700 1 -- 172.21.15.29:0/1439353659 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794000cd50 con 0x7f79500ca8c0 2023-10-06T05:25:47.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79500c4780 con 0x7f79500ca8c0 2023-10-06T05:25:47.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca80052b0 con 0x7f1ccc0abac0 2023-10-06T05:25:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500adf90 con 0x7f79500ca8c0 2023-10-06T05:25:47.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f7936ffd700 1 -- 172.21.15.29:0/1439353659 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7940013680 con 0x7f79500ca8c0 2023-10-06T05:25:47.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f7936ffd700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f793c060620 0x7f793c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:47.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f7936ffd700 1 -- 172.21.15.29:0/1439353659 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f794007cb90 con 0x7f79500ca8c0 2023-10-06T05:25:47.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.981+0000 7f794e7fc700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f793c060620 0x7f793c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:47.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.985+0000 7f794e7fc700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f793c060620 0x7f793c062ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79500ad6c0 tx=0x7f7944007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.989+0000 7f54ee7fc700 1 -- 172.21.15.29:0/4122781059 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4000c90 con 0x7f54e8003a60 2023-10-06T05:25:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.989+0000 7f54ee7fc700 1 -- 172.21.15.29:0/4122781059 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f40116f0 con 0x7f54e8003a60 2023-10-06T05:25:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.989+0000 7f54ee7fc700 1 -- 172.21.15.29:0/4122781059 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f401c420 con 0x7f54e8003a60 2023-10-06T05:25:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.989+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5500151060 con 0x7f54e8003a60 2023-10-06T05:25:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.989+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5500151620 con 0x7f54e8003a60 2023-10-06T05:25:47.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.989+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795004be00 con 0x7f79500ca8c0 2023-10-06T05:25:48.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.989+0000 7f1cc8ff9700 1 -- 172.21.15.29:0/1113043677 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1cc004c7f0 con 0x7f1ccc0abac0 2023-10-06T05:25:48.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.989+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550004be00 con 0x7f54e8003a60 2023-10-06T05:25:48.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.989+0000 7f54ee7fc700 1 -- 172.21.15.29:0/4122781059 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f54f401c850 con 0x7f54e8003a60 2023-10-06T05:25:48.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.993+0000 7f54ee7fc700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f54e00606d0 0x7f54e0062b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.993+0000 7f54ee7fc700 1 -- 172.21.15.29:0/4122781059 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f54f407e130 con 0x7f54e8003a60 2023-10-06T05:25:48.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.993+0000 7f54fdd9b700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f54e00606d0 0x7f54e0062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.993+0000 7f54fdd9b700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f54e00606d0 0x7f54e0062b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5500155980 tx=0x7f54f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:48.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:47.997+0000 7f54ee7fc700 1 -- 172.21.15.29:0/4122781059 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f54f404e620 con 0x7f54e8003a60 2023-10-06T05:25:48.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.001+0000 7f7936ffd700 1 -- 172.21.15.29:0/1439353659 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f794004d0a0 con 0x7f79500ca8c0 2023-10-06T05:25:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.233+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9074005560 con 0x7f90981581c0 2023-10-06T05:25:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.233+0000 7f9086ffd700 1 -- 172.21.15.29:0/1173270266 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f908c04ff50 con 0x7f90981581c0 2023-10-06T05:25:48.239 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.233+0000 7f22a114c700 1 -- 172.21.15.29:0/1579689234 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f227c005560 con 0x7f229c06a270 2023-10-06T05:25:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.233+0000 7f2282ffd700 1 -- 172.21.15.29:0/1579689234 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2294016020 con 0x7f229c06a270 2023-10-06T05:25:48.240 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f907c060520 msgr2=0x7f907c0629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f907c060520 0x7f907c0629d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90880089b0 tx=0x7f908801b000 comp rx=0 tx=0).stop 2023-10-06T05:25:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90981581c0 msgr2=0x7f90981249b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90981581c0 0x7f90981249b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f908c00b610 tx=0x7f908c009120 comp rx=0 tx=0).stop 2023-10-06T05:25:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 shutdown_connections 2023-10-06T05:25:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9098125530 0x7f90980accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90981581c0 0x7f90981249b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f907c060520 0x7f907c0629d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 --2- 172.21.15.29:0/1173270266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90980ca8c0 0x7f9098157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 >> 172.21.15.29:0/1173270266 conn(0x7f90980670a0 msgr2=0x7f90980c0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 shutdown_connections 2023-10-06T05:25:48.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.237+0000 7f909c88c700 1 -- 172.21.15.29:0/1173270266 wait complete. 2023-10-06T05:25:48.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f5a527fc700 1 -- 172.21.15.29:0/3827615794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a4c005560 con 0x7f5a6c0cba00 2023-10-06T05:25:48.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 -- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22880606a0 msgr2=0x7f2288062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22880606a0 0x7f2288062b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f229000adc0 tx=0x7f2290008040 comp rx=0 tx=0).stop 2023-10-06T05:25:48.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 -- 172.21.15.29:0/1579689234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f229c06a270 msgr2=0x7f229c0c2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f229c06a270 0x7f229c0c2e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f229400c900 tx=0x7f2294006470 comp rx=0 tx=0).stop 2023-10-06T05:25:48.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 -- 172.21.15.29:0/1579689234 shutdown_connections 2023-10-06T05:25:48.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f22880606a0 0x7f2288062b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f229c152890 0x7f229c16ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f229c0ca280 0x7f229c16a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 --2- 172.21.15.29:0/1579689234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f229c06a270 0x7f229c0c2e00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 -- 172.21.15.29:0/1579689234 >> 172.21.15.29:0/1579689234 conn(0x7f229c06c6c0 msgr2=0x7f229c0670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 -- 172.21.15.29:0/1579689234 shutdown_connections 2023-10-06T05:25:48.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f2280ff9700 1 -- 172.21.15.29:0/1579689234 wait complete. 2023-10-06T05:25:48.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.245+0000 7f5a68ff9700 1 -- 172.21.15.29:0/3827615794 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a5c051e60 con 0x7f5a6c0cba00 2023-10-06T05:25:48.251 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:48.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-06T05:25:48.257 DEBUG:teuthology.parallel:result is None 2023-10-06T05:25:48.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6f3c14d270 con 0x7f6f3c06b780 2023-10-06T05:25:48.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 -- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5a580605d0 msgr2=0x7f5a58062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5a580605d0 0x7f5a58062a80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a60006fd0 tx=0x7f5a60008040 comp rx=0 tx=0).stop 2023-10-06T05:25:48.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 -- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a6c0cba00 msgr2=0x7f5a6c170160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a6c0cba00 0x7f5a6c170160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00ec80 tx=0x7f5a5c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 -- 172.21.15.29:0/3827615794 shutdown_connections 2023-10-06T05:25:48.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5a6c161760 0x7f5a6c0c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a6c15d180 0x7f5a6c0c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5a580605d0 0x7f5a58062a80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 --2- 172.21.15.29:0/3827615794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a6c0cba00 0x7f5a6c170160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 -- 172.21.15.29:0/3827615794 >> 172.21.15.29:0/3827615794 conn(0x7f5a6c0670a0 msgr2=0x7f5a6c15b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f6f23fff700 1 -- 172.21.15.29:0/3580051475 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f3c14d270 con 0x7f6f3c06b780 2023-10-06T05:25:48.260 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:48.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 -- 172.21.15.29:0/3827615794 shutdown_connections 2023-10-06T05:25:48.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.253+0000 7f5a527fc700 1 -- 172.21.15.29:0/3827615794 wait complete. 2023-10-06T05:25:48.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f28060620 msgr2=0x7f6f28062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f28060620 0x7f6f28062ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6f30006fa0 tx=0x7f6f30008040 comp rx=0 tx=0).stop 2023-10-06T05:25:48.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 msgr2=0x7f6f3c14c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 0x7f6f3c14c9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c5d0 tx=0x7f6f2c007f60 comp rx=0 tx=0).stop 2023-10-06T05:25:48.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-06T05:25:48.267 DEBUG:teuthology.parallel:result is None 2023-10-06T05:25:48.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 shutdown_connections 2023-10-06T05:25:48.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f3c15d3a0 0x7f6f3c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f28060620 0x7f6f28062ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f3c0ca060 0x7f6f3c1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 --2- 172.21.15.29:0/3580051475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3c06b780 0x7f6f3c14c9d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 >> 172.21.15.29:0/3580051475 conn(0x7f6f3c06c6c0 msgr2=0x7f6f3c0c67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 shutdown_connections 2023-10-06T05:25:48.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.261+0000 7f6f424e2700 1 -- 172.21.15.29:0/3580051475 wait complete. 2023-10-06T05:25:48.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-10-06T05:25:48.273 DEBUG:teuthology.parallel:result is None 2023-10-06T05:25:48.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.269+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc6e80abbd0 con 0x7fc6e8141510 2023-10-06T05:25:48.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.269+0000 7fc6dd7fa700 1 -- 172.21.15.29:0/3325944763 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6e004cd90 con 0x7fc6e8141510 2023-10-06T05:25:48.275 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:48.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-06T05:25:48.276 DEBUG:teuthology.parallel:result is None 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc6d4061e70 msgr2=0x7fc6d4064320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc6d4061e70 0x7fc6d4064320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009460 tx=0x7fc6d8015000 comp rx=0 tx=0).stop 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6e8141510 msgr2=0x7fc6e80ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6e8141510 0x7fc6e80ca770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc6e806c4c0 tx=0x7fc6e00075c0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 shutdown_connections 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6e8141510 0x7fc6e80ca770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6e80abdf0 0x7fc6e8150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc6d4061e70 0x7fc6d4064320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 --2- 172.21.15.29:0/3325944763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d4003a60 0x7fc6e80ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 >> 172.21.15.29:0/3325944763 conn(0x7fc6e80670a0 msgr2=0x7fc6e8151fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 shutdown_connections 2023-10-06T05:25:48.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.273+0000 7fc6ee777700 1 -- 172.21.15.29:0/3325944763 wait complete. 2023-10-06T05:25:48.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.281+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5500157260 con 0x7f54e8003a60 2023-10-06T05:25:48.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-06T05:25:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.281+0000 7f54ee7fc700 1 -- 172.21.15.29:0/4122781059 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54f4051c40 con 0x7f54e8003a60 2023-10-06T05:25:48.289 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-06T05:25:48.289 DEBUG:teuthology.parallel:result is None 2023-10-06T05:25:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f54e00606d0 msgr2=0x7f54e0062b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f54e00606d0 0x7f54e0062b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5500155980 tx=0x7f54f0009040 comp rx=0 tx=0).stop 2023-10-06T05:25:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 msgr2=0x7f5500148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f5500148e20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54f4010f50 tx=0x7f54f4015000 comp rx=0 tx=0).stop 2023-10-06T05:25:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 shutdown_connections 2023-10-06T05:25:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55001579c0 0x7f55000c2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f54e00606d0 0x7f54e0062b80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55000c51f0 0x7f5500157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 --2- 172.21.15.29:0/4122781059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54e8003a60 0x7f5500148e20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 >> 172.21.15.29:0/4122781059 conn(0x7f55000670a0 msgr2=0x7f55001563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 shutdown_connections 2023-10-06T05:25:48.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f54ff59e700 1 -- 172.21.15.29:0/4122781059 wait complete. 2023-10-06T05:25:48.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79500c72f0 con 0x7f79500ca8c0 2023-10-06T05:25:48.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.285+0000 7f7936ffd700 1 -- 172.21.15.29:0/1439353659 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7940021020 con 0x7f79500ca8c0 2023-10-06T05:25:48.292 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:48.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ca8005560 con 0x7f1ccc0abac0 2023-10-06T05:25:48.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cc8ff9700 1 -- 172.21.15.29:0/1113043677 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cc004fe10 con 0x7f1ccc0abac0 2023-10-06T05:25:48.293 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-06T05:25:48.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f793c060620 msgr2=0x7f793c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f793c060620 0x7f793c062ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79500ad6c0 tx=0x7f7944007ec0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 msgr2=0x7f79500c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 0x7f79500c5260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f794000ec80 tx=0x7f79400091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 shutdown_connections 2023-10-06T05:25:48.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7950153ab0 0x7f79500af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79501581c0 0x7f79500ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f793c060620 0x7f793c062ad0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 --2- 172.21.15.29:0/1439353659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79500ca8c0 0x7f79500c5260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 >> 172.21.15.29:0/1439353659 conn(0x7f79500670a0 msgr2=0x7f79500c0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 shutdown_connections 2023-10-06T05:25:48.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f794ffff700 1 -- 172.21.15.29:0/1439353659 wait complete. 2023-10-06T05:25:48.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1cb0060520 msgr2=0x7f1cb00629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1cb0060520 0x7f1cb00629d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc06d6a0 tx=0x7f1cc401b000 comp rx=0 tx=0).stop 2023-10-06T05:25:48.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc0abac0 msgr2=0x7f1ccc173860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc0abac0 0x7f1ccc173860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000b810 tx=0x7f1cc00091d0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 shutdown_connections 2023-10-06T05:25:48.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc154cc0 0x7f1ccc14f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ccc0abac0 0x7f1ccc173860 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1cb0060520 0x7f1cb00629d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 --2- 172.21.15.29:0/1113043677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ccc06cf90 0x7f1ccc176ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 >> 172.21.15.29:0/1113043677 conn(0x7f1ccc067b70 msgr2=0x7f1ccc0af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 shutdown_connections 2023-10-06T05:25:48.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.289+0000 7f1cd2ef7700 1 -- 172.21.15.29:0/1113043677 wait complete. 2023-10-06T05:25:48.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-06T05:25:48.301 DEBUG:teuthology.parallel:result is None 2023-10-06T05:25:48.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-06T05:25:48.307 DEBUG:teuthology.parallel:result is None 2023-10-06T05:25:48.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-10-06T05:25:48.309 DEBUG:teuthology.parallel:result is None 2023-10-06T05:25:48.309 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T05:25:48.310 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:25:48.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f56f56700 1 Processor -- start 2023-10-06T05:25:48.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f56f56700 1 -- start start 2023-10-06T05:25:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f56f56700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f50159fe0 0x7f6f5006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f56f56700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6f500cfb60 0x7f6f500cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f56f56700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500cee50 con 0x7f6f50158c00 2023-10-06T05:25:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f56f56700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5006b250 con 0x7f6f50159fe0 2023-10-06T05:25:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f56f56700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5006a640 con 0x7f6f500cfb60 2023-10-06T05:25:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f55753700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f50159fe0 0x7f6f5006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f55753700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f50159fe0 0x7f6f5006b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51560/0 (socket says 172.21.15.29:51560) 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f55753700 1 -- 172.21.15.29:0/3965874566 learned_addr learned my addr 172.21.15.29:0/3965874566 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f56755700 1 --2- 172.21.15.29:0/3965874566 >> v2:172.21.15.173:3300/0 conn(0x7f6f500cfb60 0x7f6f500cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f55753700 1 -- 172.21.15.29:0/3965874566 >> v2:172.21.15.173:3300/0 conn(0x7f6f500cfb60 msgr2=0x7f6f500cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f55753700 1 --2- 172.21.15.29:0/3965874566 >> v2:172.21.15.173:3300/0 conn(0x7f6f500cfb60 0x7f6f500cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f55753700 1 -- 172.21.15.29:0/3965874566 >> v1:172.21.15.173:6789/0 conn(0x7f6f50158c00 legacy=0x7f6f500ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f55753700 1 -- 172.21.15.29:0/3965874566 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5006a920 con 0x7f6f50159fe0 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f55753700 1 --2- 172.21.15.29:0/3965874566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f50159fe0 0x7f6f5006b6e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6f500b5dd0 tx=0x7f6f38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb84c10003268db8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f54f52700 1 -- 172.21.15.29:0/3965874566 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38009e70 con 0x7f6f50159fe0 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f54f52700 1 -- 172.21.15.29:0/3965874566 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3800b860 con 0x7f6f50159fe0 2023-10-06T05:25:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.453+0000 7f6f54f52700 1 -- 172.21.15.29:0/3965874566 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800bc00 con 0x7f6f50159fe0 2023-10-06T05:25:48.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 -- 172.21.15.29:0/3965874566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f50159fe0 msgr2=0x7f6f5006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 --2- 172.21.15.29:0/3965874566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f50159fe0 0x7f6f5006b6e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6f500b5dd0 tx=0x7f6f38009250 comp rx=0 tx=0).stop 2023-10-06T05:25:48.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 -- 172.21.15.29:0/3965874566 shutdown_connections 2023-10-06T05:25:48.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 --2- 172.21.15.29:0/3965874566 >> v2:172.21.15.173:3300/0 conn(0x7f6f500cfb60 0x7f6f500cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 --2- 172.21.15.29:0/3965874566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f50159fe0 0x7f6f5006b6e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 -- 172.21.15.29:0/3965874566 >> 172.21.15.29:0/3965874566 conn(0x7f6f500670a0 msgr2=0x7f6f50067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 -- 172.21.15.29:0/3965874566 shutdown_connections 2023-10-06T05:25:48.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 -- 172.21.15.29:0/3965874566 wait complete. 2023-10-06T05:25:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 Processor -- start 2023-10-06T05:25:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.457+0000 7f6f56f56700 1 -- start start 2023-10-06T05:25:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56f56700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f500cfb60 0x7f6f500b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56f56700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f50158c00 0x7f6f50154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56f56700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f50159fe0 0x7f6f5014dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56f56700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500b3c00 con 0x7f6f500cfb60 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56f56700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500b41f0 con 0x7f6f50159fe0 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56f56700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5014e2c0 con 0x7f6f50158c00 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55f54700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f500cfb60 0x7f6f500b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55f54700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f500cfb60 0x7f6f500b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51562/0 (socket says 172.21.15.29:51562) 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55f54700 1 -- 172.21.15.29:0/2491625860 learned_addr learned my addr 172.21.15.29:0/2491625860 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56755700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f50159fe0 0x7f6f5014dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55753700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f50158c00 0x7f6f50154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55f54700 1 -- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f50158c00 msgr2=0x7f6f50154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55f54700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f50158c00 0x7f6f50154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55f54700 1 -- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f50159fe0 msgr2=0x7f6f5014dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55f54700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f50159fe0 0x7f6f5014dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55f54700 1 -- 172.21.15.29:0/2491625860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380094f0 con 0x7f6f500cfb60 2023-10-06T05:25:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56755700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f50159fe0 0x7f6f5014dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f55f54700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f500cfb60 0x7f6f500b2c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800cb10 tx=0x7f6f480017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f4dffb700 1 -- 172.21.15.29:0/2491625860 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800a760 con 0x7f6f500cfb60 2023-10-06T05:25:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f4dffb700 1 -- 172.21.15.29:0/2491625860 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800a8e0 con 0x7f6f500cfb60 2023-10-06T05:25:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f4dffb700 1 -- 172.21.15.29:0/2491625860 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800aca0 con 0x7f6f500cfb60 2023-10-06T05:25:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f500b3360 con 0x7f6f500cfb60 2023-10-06T05:25:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f500b3920 con 0x7f6f500cfb60 2023-10-06T05:25:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5004be00 con 0x7f6f500cfb60 2023-10-06T05:25:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.461+0000 7f6f4dffb700 1 -- 172.21.15.29:0/2491625860 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6f48003030 con 0x7f6f500cfb60 2023-10-06T05:25:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.465+0000 7f6f4dffb700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f30060580 0x7f6f30062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.465+0000 7f6f4dffb700 1 -- 172.21.15.29:0/2491625860 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f4807c900 con 0x7f6f500cfb60 2023-10-06T05:25:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.465+0000 7f6f55753700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f30060580 0x7f6f30062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.465+0000 7f6f55753700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f30060580 0x7f6f30062a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6f500b5dd0 tx=0x7f6f38017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:48.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.469+0000 7f6f4dffb700 1 -- 172.21.15.29:0/2491625860 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6f4804cd90 con 0x7f6f500cfb60 2023-10-06T05:25:48.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.617+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f500cee50 con 0x7f6f30060580 2023-10-06T05:25:48.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.637+0000 7f6f4dffb700 1 -- 172.21.15.29:0/2491625860 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286525 (secure 0 0 0) 0x7f6f500cee50 con 0x7f6f30060580 2023-10-06T05:25:48.644 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:48.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f30060580 msgr2=0x7f6f30062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f30060580 0x7f6f30062a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6f500b5dd0 tx=0x7f6f38017000 comp rx=0 tx=0).stop 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f500cfb60 msgr2=0x7f6f500b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f500cfb60 0x7f6f500b2c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800cb10 tx=0x7f6f480017b0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 shutdown_connections 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6f30060580 0x7f6f30062a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f50159fe0 0x7f6f5014dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f50158c00 0x7f6f50154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 --2- 172.21.15.29:0/2491625860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f500cfb60 0x7f6f500b2c80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 >> 172.21.15.29:0/2491625860 conn(0x7f6f500670a0 msgr2=0x7f6f500cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 shutdown_connections 2023-10-06T05:25:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.641+0000 7f6f56f56700 1 -- 172.21.15.29:0/2491625860 wait complete. 2023-10-06T05:25:48.648 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:25:48.659 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-06T05:25:46.650232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397896,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576824,"statfs":{"total":773094113280,"available":770638667776,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.025662"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662207+0000","last_change":"2023-10-06T05:25:40.648302+0000","last_active":"2023-10-06T05:25:40.662207+0000","last_peered":"2023-10-06T05:25:40.662207+0000","last_clean":"2023-10-06T05:25:40.662207+0000","last_became_active":"2023-10-06T05:25:40.647162+0000","last_became_peered":"2023-10-06T05:25:40.647162+0000","last_unstale":"2023-10-06T05:25:40.662207+0000","last_undegraded":"2023-10-06T05:25:40.662207+0000","last_fullsized":"2023-10-06T05:25:40.662207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:17.982392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.658161+0000","last_change":"2023-10-06T05:25:40.654236+0000","last_active":"2023-10-06T05:25:40.658161+0000","last_peered":"2023-10-06T05:25:40.658161+0000","last_clean":"2023-10-06T05:25:40.658161+0000","last_became_active":"2023-10-06T05:25:40.653899+0000","last_became_peered":"2023-10-06T05:25:40.653899+0000","last_unstale":"2023-10-06T05:25:40.658161+0000","last_undegraded":"2023-10-06T05:25:40.658161+0000","last_fullsized":"2023-10-06T05:25:40.658161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659366+0000","last_change":"2023-10-06T05:25:40.652315+0000","last_active":"2023-10-06T05:25:40.659366+0000","last_peered":"2023-10-06T05:25:40.659366+0000","last_clean":"2023-10-06T05:25:40.659366+0000","last_became_active":"2023-10-06T05:25:40.651958+0000","last_became_peered":"2023-10-06T05:25:40.651958+0000","last_unstale":"2023-10-06T05:25:40.659366+0000","last_undegraded":"2023-10-06T05:25:40.659366+0000","last_fullsized":"2023-10-06T05:25:40.659366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.536955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656801+0000","last_change":"2023-10-06T05:25:40.650525+0000","last_active":"2023-10-06T05:25:40.656801+0000","last_peered":"2023-10-06T05:25:40.656801+0000","last_clean":"2023-10-06T05:25:40.656801+0000","last_became_active":"2023-10-06T05:25:40.650064+0000","last_became_peered":"2023-10-06T05:25:40.650064+0000","last_unstale":"2023-10-06T05:25:40.656801+0000","last_undegraded":"2023-10-06T05:25:40.656801+0000","last_fullsized":"2023-10-06T05:25:40.656801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:19.825924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668443+0000","last_change":"2023-10-06T05:25:40.665445+0000","last_active":"2023-10-06T05:25:40.668443+0000","last_peered":"2023-10-06T05:25:40.668443+0000","last_clean":"2023-10-06T05:25:40.668443+0000","last_became_active":"2023-10-06T05:25:40.662917+0000","last_became_peered":"2023-10-06T05:25:40.662917+0000","last_unstale":"2023-10-06T05:25:40.668443+0000","last_undegraded":"2023-10-06T05:25:40.668443+0000","last_fullsized":"2023-10-06T05:25:40.668443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662747+0000","last_change":"2023-10-06T05:25:40.652496+0000","last_active":"2023-10-06T05:25:40.662747+0000","last_peered":"2023-10-06T05:25:40.662747+0000","last_clean":"2023-10-06T05:25:40.662747+0000","last_became_active":"2023-10-06T05:25:40.652182+0000","last_became_peered":"2023-10-06T05:25:40.652182+0000","last_unstale":"2023-10-06T05:25:40.662747+0000","last_undegraded":"2023-10-06T05:25:40.662747+0000","last_fullsized":"2023-10-06T05:25:40.662747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:14.458549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663020+0000","last_change":"2023-10-06T05:25:40.656290+0000","last_active":"2023-10-06T05:25:40.663020+0000","last_peered":"2023-10-06T05:25:40.663020+0000","last_clean":"2023-10-06T05:25:40.663020+0000","last_became_active":"2023-10-06T05:25:40.655918+0000","last_became_peered":"2023-10-06T05:25:40.655918+0000","last_unstale":"2023-10-06T05:25:40.663020+0000","last_undegraded":"2023-10-06T05:25:40.663020+0000","last_fullsized":"2023-10-06T05:25:40.663020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656714+0000","last_change":"2023-10-06T05:25:40.650564+0000","last_active":"2023-10-06T05:25:40.656714+0000","last_peered":"2023-10-06T05:25:40.656714+0000","last_clean":"2023-10-06T05:25:40.656714+0000","last_became_active":"2023-10-06T05:25:40.650224+0000","last_became_peered":"2023-10-06T05:25:40.650224+0000","last_unstale":"2023-10-06T05:25:40.656714+0000","last_undegraded":"2023-10-06T05:25:40.656714+0000","last_fullsized":"2023-10-06T05:25:40.656714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668613+0000","last_change":"2023-10-06T05:25:40.659416+0000","last_active":"2023-10-06T05:25:40.668613+0000","last_peered":"2023-10-06T05:25:40.668613+0000","last_clean":"2023-10-06T05:25:40.668613+0000","last_became_active":"2023-10-06T05:25:40.657687+0000","last_became_peered":"2023-10-06T05:25:40.657687+0000","last_unstale":"2023-10-06T05:25:40.668613+0000","last_undegraded":"2023-10-06T05:25:40.668613+0000","last_fullsized":"2023-10-06T05:25:40.668613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656221+0000","last_change":"2023-10-06T05:25:40.650557+0000","last_active":"2023-10-06T05:25:40.656221+0000","last_peered":"2023-10-06T05:25:40.656221+0000","last_clean":"2023-10-06T05:25:40.656221+0000","last_became_active":"2023-10-06T05:25:40.650254+0000","last_became_peered":"2023-10-06T05:25:40.650254+0000","last_unstale":"2023-10-06T05:25:40.656221+0000","last_undegraded":"2023-10-06T05:25:40.656221+0000","last_fullsized":"2023-10-06T05:25:40.656221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659455+0000","last_change":"2023-10-06T05:25:40.652762+0000","last_active":"2023-10-06T05:25:40.659455+0000","last_peered":"2023-10-06T05:25:40.659455+0000","last_clean":"2023-10-06T05:25:40.659455+0000","last_became_active":"2023-10-06T05:25:40.652458+0000","last_became_peered":"2023-10-06T05:25:40.652458+0000","last_unstale":"2023-10-06T05:25:40.659455+0000","last_undegraded":"2023-10-06T05:25:40.659455+0000","last_fullsized":"2023-10-06T05:25:40.659455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:12.635712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663186+0000","last_change":"2023-10-06T05:25:40.651354+0000","last_active":"2023-10-06T05:25:40.663186+0000","last_peered":"2023-10-06T05:25:40.663186+0000","last_clean":"2023-10-06T05:25:40.663186+0000","last_became_active":"2023-10-06T05:25:40.651057+0000","last_became_peered":"2023-10-06T05:25:40.651057+0000","last_unstale":"2023-10-06T05:25:40.663186+0000","last_undegraded":"2023-10-06T05:25:40.663186+0000","last_fullsized":"2023-10-06T05:25:40.663186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:37.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662132+0000","last_change":"2023-10-06T05:25:40.648238+0000","last_active":"2023-10-06T05:25:40.662132+0000","last_peered":"2023-10-06T05:25:40.662132+0000","last_clean":"2023-10-06T05:25:40.662132+0000","last_became_active":"2023-10-06T05:25:40.647824+0000","last_became_peered":"2023-10-06T05:25:40.647824+0000","last_unstale":"2023-10-06T05:25:40.662132+0000","last_undegraded":"2023-10-06T05:25:40.662132+0000","last_fullsized":"2023-10-06T05:25:40.662132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:33.454028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.652755+0000","last_change":"2023-10-06T05:25:40.647850+0000","last_active":"2023-10-06T05:25:40.652755+0000","last_peered":"2023-10-06T05:25:40.652755+0000","last_clean":"2023-10-06T05:25:40.652755+0000","last_became_active":"2023-10-06T05:25:40.647638+0000","last_became_peered":"2023-10-06T05:25:40.647638+0000","last_unstale":"2023-10-06T05:25:40.652755+0000","last_undegraded":"2023-10-06T05:25:40.652755+0000","last_fullsized":"2023-10-06T05:25:40.652755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663047+0000","last_change":"2023-10-06T05:25:40.657665+0000","last_active":"2023-10-06T05:25:40.663047+0000","last_peered":"2023-10-06T05:25:40.663047+0000","last_clean":"2023-10-06T05:25:40.663047+0000","last_became_active":"2023-10-06T05:25:40.656326+0000","last_became_peered":"2023-10-06T05:25:40.656326+0000","last_unstale":"2023-10-06T05:25:40.663047+0000","last_undegraded":"2023-10-06T05:25:40.663047+0000","last_fullsized":"2023-10-06T05:25:40.663047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:29.231778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659999+0000","last_change":"2023-10-06T05:25:40.654213+0000","last_active":"2023-10-06T05:25:40.659999+0000","last_peered":"2023-10-06T05:25:40.659999+0000","last_clean":"2023-10-06T05:25:40.659999+0000","last_became_active":"2023-10-06T05:25:40.653879+0000","last_became_peered":"2023-10-06T05:25:40.653879+0000","last_unstale":"2023-10-06T05:25:40.659999+0000","last_undegraded":"2023-10-06T05:25:40.659999+0000","last_fullsized":"2023-10-06T05:25:40.659999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:06.564230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668950+0000","last_change":"2023-10-06T05:25:40.664811+0000","last_active":"2023-10-06T05:25:40.668950+0000","last_peered":"2023-10-06T05:25:40.668950+0000","last_clean":"2023-10-06T05:25:40.668950+0000","last_became_active":"2023-10-06T05:25:40.662900+0000","last_became_peered":"2023-10-06T05:25:40.662900+0000","last_unstale":"2023-10-06T05:25:40.668950+0000","last_undegraded":"2023-10-06T05:25:40.668950+0000","last_fullsized":"2023-10-06T05:25:40.668950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657879+0000","last_change":"2023-10-06T05:25:40.649530+0000","last_active":"2023-10-06T05:25:40.657879+0000","last_peered":"2023-10-06T05:25:40.657879+0000","last_clean":"2023-10-06T05:25:40.657879+0000","last_became_active":"2023-10-06T05:25:40.649306+0000","last_became_peered":"2023-10-06T05:25:40.649306+0000","last_unstale":"2023-10-06T05:25:40.657879+0000","last_undegraded":"2023-10-06T05:25:40.657879+0000","last_fullsized":"2023-10-06T05:25:40.657879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:24.213618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663062+0000","last_change":"2023-10-06T05:25:40.656290+0000","last_active":"2023-10-06T05:25:40.663062+0000","last_peered":"2023-10-06T05:25:40.663062+0000","last_clean":"2023-10-06T05:25:40.663062+0000","last_became_active":"2023-10-06T05:25:40.655968+0000","last_became_peered":"2023-10-06T05:25:40.655968+0000","last_unstale":"2023-10-06T05:25:40.663062+0000","last_undegraded":"2023-10-06T05:25:40.663062+0000","last_fullsized":"2023-10-06T05:25:40.663062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:04.694861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.660496+0000","last_change":"2023-10-06T05:25:40.651544+0000","last_active":"2023-10-06T05:25:40.660496+0000","last_peered":"2023-10-06T05:25:40.660496+0000","last_clean":"2023-10-06T05:25:40.660496+0000","last_became_active":"2023-10-06T05:25:40.651160+0000","last_became_peered":"2023-10-06T05:25:40.651160+0000","last_unstale":"2023-10-06T05:25:40.660496+0000","last_undegraded":"2023-10-06T05:25:40.660496+0000","last_fullsized":"2023-10-06T05:25:40.660496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668308+0000","last_change":"2023-10-06T05:25:40.665366+0000","last_active":"2023-10-06T05:25:40.668308+0000","last_peered":"2023-10-06T05:25:40.668308+0000","last_clean":"2023-10-06T05:25:40.668308+0000","last_became_active":"2023-10-06T05:25:40.664987+0000","last_became_peered":"2023-10-06T05:25:40.664987+0000","last_unstale":"2023-10-06T05:25:40.668308+0000","last_undegraded":"2023-10-06T05:25:40.668308+0000","last_fullsized":"2023-10-06T05:25:40.668308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667832+0000","last_change":"2023-10-06T05:25:40.654793+0000","last_active":"2023-10-06T05:25:40.667832+0000","last_peered":"2023-10-06T05:25:40.667832+0000","last_clean":"2023-10-06T05:25:40.667832+0000","last_became_active":"2023-10-06T05:25:40.654476+0000","last_became_peered":"2023-10-06T05:25:40.654476+0000","last_unstale":"2023-10-06T05:25:40.667832+0000","last_undegraded":"2023-10-06T05:25:40.667832+0000","last_fullsized":"2023-10-06T05:25:40.667832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656922+0000","last_change":"2023-10-06T05:25:40.651368+0000","last_active":"2023-10-06T05:25:40.656922+0000","last_peered":"2023-10-06T05:25:40.656922+0000","last_clean":"2023-10-06T05:25:40.656922+0000","last_became_active":"2023-10-06T05:25:40.650938+0000","last_became_peered":"2023-10-06T05:25:40.650938+0000","last_unstale":"2023-10-06T05:25:40.656922+0000","last_undegraded":"2023-10-06T05:25:40.656922+0000","last_fullsized":"2023-10-06T05:25:40.656922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.581083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668218+0000","last_change":"2023-10-06T05:25:40.664677+0000","last_active":"2023-10-06T05:25:40.668218+0000","last_peered":"2023-10-06T05:25:40.668218+0000","last_clean":"2023-10-06T05:25:40.668218+0000","last_became_active":"2023-10-06T05:25:40.664171+0000","last_became_peered":"2023-10-06T05:25:40.664171+0000","last_unstale":"2023-10-06T05:25:40.668218+0000","last_undegraded":"2023-10-06T05:25:40.668218+0000","last_fullsized":"2023-10-06T05:25:40.668218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668224+0000","last_change":"2023-10-06T05:25:40.659304+0000","last_active":"2023-10-06T05:25:40.668224+0000","last_peered":"2023-10-06T05:25:40.668224+0000","last_clean":"2023-10-06T05:25:40.668224+0000","last_became_active":"2023-10-06T05:25:40.654657+0000","last_became_peered":"2023-10-06T05:25:40.654657+0000","last_unstale":"2023-10-06T05:25:40.668224+0000","last_undegraded":"2023-10-06T05:25:40.668224+0000","last_fullsized":"2023-10-06T05:25:40.668224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:55.603377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668210+0000","last_change":"2023-10-06T05:25:40.658604+0000","last_active":"2023-10-06T05:25:40.668210+0000","last_peered":"2023-10-06T05:25:40.668210+0000","last_clean":"2023-10-06T05:25:40.668210+0000","last_became_active":"2023-10-06T05:25:40.651895+0000","last_became_peered":"2023-10-06T05:25:40.651895+0000","last_unstale":"2023-10-06T05:25:40.668210+0000","last_undegraded":"2023-10-06T05:25:40.668210+0000","last_fullsized":"2023-10-06T05:25:40.668210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659944+0000","last_change":"2023-10-06T05:25:40.656488+0000","last_active":"2023-10-06T05:25:40.659944+0000","last_peered":"2023-10-06T05:25:40.659944+0000","last_clean":"2023-10-06T05:25:40.659944+0000","last_became_active":"2023-10-06T05:25:40.655672+0000","last_became_peered":"2023-10-06T05:25:40.655672+0000","last_unstale":"2023-10-06T05:25:40.659944+0000","last_undegraded":"2023-10-06T05:25:40.659944+0000","last_fullsized":"2023-10-06T05:25:40.659944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668507+0000","last_change":"2023-10-06T05:25:40.660602+0000","last_active":"2023-10-06T05:25:40.668507+0000","last_peered":"2023-10-06T05:25:40.668507+0000","last_clean":"2023-10-06T05:25:40.668507+0000","last_became_active":"2023-10-06T05:25:40.658211+0000","last_became_peered":"2023-10-06T05:25:40.658211+0000","last_unstale":"2023-10-06T05:25:40.668507+0000","last_undegraded":"2023-10-06T05:25:40.668507+0000","last_fullsized":"2023-10-06T05:25:40.668507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:29.231778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.664246+0000","last_change":"2023-10-06T05:25:40.657180+0000","last_active":"2023-10-06T05:25:40.664246+0000","last_peered":"2023-10-06T05:25:40.664246+0000","last_clean":"2023-10-06T05:25:40.664246+0000","last_became_active":"2023-10-06T05:25:40.656552+0000","last_became_peered":"2023-10-06T05:25:40.656552+0000","last_unstale":"2023-10-06T05:25:40.664246+0000","last_undegraded":"2023-10-06T05:25:40.664246+0000","last_fullsized":"2023-10-06T05:25:40.664246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662769+0000","last_change":"2023-10-06T05:25:40.653289+0000","last_active":"2023-10-06T05:25:40.662769+0000","last_peered":"2023-10-06T05:25:40.662769+0000","last_clean":"2023-10-06T05:25:40.662769+0000","last_became_active":"2023-10-06T05:25:40.652964+0000","last_became_peered":"2023-10-06T05:25:40.652964+0000","last_unstale":"2023-10-06T05:25:40.662769+0000","last_undegraded":"2023-10-06T05:25:40.662769+0000","last_fullsized":"2023-10-06T05:25:40.662769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662256+0000","last_change":"2023-10-06T05:25:40.654134+0000","last_active":"2023-10-06T05:25:40.662256+0000","last_peered":"2023-10-06T05:25:40.662256+0000","last_clean":"2023-10-06T05:25:40.662256+0000","last_became_active":"2023-10-06T05:25:40.653840+0000","last_became_peered":"2023-10-06T05:25:40.653840+0000","last_unstale":"2023-10-06T05:25:40.662256+0000","last_undegraded":"2023-10-06T05:25:40.662256+0000","last_fullsized":"2023-10-06T05:25:40.662256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667214+0000","last_change":"2023-10-06T05:25:40.657501+0000","last_active":"2023-10-06T05:25:40.667214+0000","last_peered":"2023-10-06T05:25:40.667214+0000","last_clean":"2023-10-06T05:25:40.667214+0000","last_became_active":"2023-10-06T05:25:40.657215+0000","last_became_peered":"2023-10-06T05:25:40.657215+0000","last_unstale":"2023-10-06T05:25:40.667214+0000","last_undegraded":"2023-10-06T05:25:40.667214+0000","last_fullsized":"2023-10-06T05:25:40.667214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:24.671427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662019+0000","last_change":"2023-10-06T05:25:40.653923+0000","last_active":"2023-10-06T05:25:40.662019+0000","last_peered":"2023-10-06T05:25:40.662019+0000","last_clean":"2023-10-06T05:25:40.662019+0000","last_became_active":"2023-10-06T05:25:40.653592+0000","last_became_peered":"2023-10-06T05:25:40.653592+0000","last_unstale":"2023-10-06T05:25:40.662019+0000","last_undegraded":"2023-10-06T05:25:40.662019+0000","last_fullsized":"2023-10-06T05:25:40.662019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:24.213618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668046+0000","last_change":"2023-10-06T05:25:39.646425+0000","last_active":"2023-10-06T05:25:40.668046+0000","last_peered":"2023-10-06T05:25:40.668046+0000","last_clean":"2023-10-06T05:25:40.668046+0000","last_became_active":"2023-10-06T05:25:39.646111+0000","last_became_peered":"2023-10-06T05:25:39.646111+0000","last_unstale":"2023-10-06T05:25:40.668046+0000","last_undegraded":"2023-10-06T05:25:40.668046+0000","last_fullsized":"2023-10-06T05:25:40.668046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:53:34.113340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659962+0000","last_change":"2023-10-06T05:25:40.656838+0000","last_active":"2023-10-06T05:25:40.659962+0000","last_peered":"2023-10-06T05:25:40.659962+0000","last_clean":"2023-10-06T05:25:40.659962+0000","last_became_active":"2023-10-06T05:25:40.656116+0000","last_became_peered":"2023-10-06T05:25:40.656116+0000","last_unstale":"2023-10-06T05:25:40.659962+0000","last_undegraded":"2023-10-06T05:25:40.659962+0000","last_fullsized":"2023-10-06T05:25:40.659962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640078+0000","last_change":"2023-10-06T05:25:39.650939+0000","last_active":"2023-10-06T05:25:40.640078+0000","last_peered":"2023-10-06T05:25:40.640078+0000","last_clean":"2023-10-06T05:25:40.640078+0000","last_became_active":"2023-10-06T05:25:39.650629+0000","last_became_peered":"2023-10-06T05:25:39.650629+0000","last_unstale":"2023-10-06T05:25:40.640078+0000","last_undegraded":"2023-10-06T05:25:40.640078+0000","last_fullsized":"2023-10-06T05:25:40.640078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668158+0000","last_change":"2023-10-06T05:25:40.657223+0000","last_active":"2023-10-06T05:25:40.668158+0000","last_peered":"2023-10-06T05:25:40.668158+0000","last_clean":"2023-10-06T05:25:40.668158+0000","last_became_active":"2023-10-06T05:25:40.656938+0000","last_became_peered":"2023-10-06T05:25:40.656938+0000","last_unstale":"2023-10-06T05:25:40.668158+0000","last_undegraded":"2023-10-06T05:25:40.668158+0000","last_fullsized":"2023-10-06T05:25:40.668158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642920+0000","last_change":"2023-10-06T05:25:39.649214+0000","last_active":"2023-10-06T05:25:40.642920+0000","last_peered":"2023-10-06T05:25:40.642920+0000","last_clean":"2023-10-06T05:25:40.642920+0000","last_became_active":"2023-10-06T05:25:39.648663+0000","last_became_peered":"2023-10-06T05:25:39.648663+0000","last_unstale":"2023-10-06T05:25:40.642920+0000","last_undegraded":"2023-10-06T05:25:40.642920+0000","last_fullsized":"2023-10-06T05:25:40.642920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:23.666945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.664350+0000","last_change":"2023-10-06T05:25:40.657849+0000","last_active":"2023-10-06T05:25:40.664350+0000","last_peered":"2023-10-06T05:25:40.664350+0000","last_clean":"2023-10-06T05:25:40.664350+0000","last_became_active":"2023-10-06T05:25:40.657491+0000","last_became_peered":"2023-10-06T05:25:40.657491+0000","last_unstale":"2023-10-06T05:25:40.664350+0000","last_undegraded":"2023-10-06T05:25:40.664350+0000","last_fullsized":"2023-10-06T05:25:40.664350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:56.403005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.670093+0000","last_change":"2023-10-06T05:25:39.649359+0000","last_active":"2023-10-06T05:25:40.670093+0000","last_peered":"2023-10-06T05:25:40.670093+0000","last_clean":"2023-10-06T05:25:40.670093+0000","last_became_active":"2023-10-06T05:25:39.649053+0000","last_became_peered":"2023-10-06T05:25:39.649053+0000","last_unstale":"2023-10-06T05:25:40.670093+0000","last_undegraded":"2023-10-06T05:25:40.670093+0000","last_fullsized":"2023-10-06T05:25:40.670093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:12.214301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667742+0000","last_change":"2023-10-06T05:25:39.649076+0000","last_active":"2023-10-06T05:25:40.667742+0000","last_peered":"2023-10-06T05:25:40.667742+0000","last_clean":"2023-10-06T05:25:40.667742+0000","last_became_active":"2023-10-06T05:25:39.648697+0000","last_became_peered":"2023-10-06T05:25:39.648697+0000","last_unstale":"2023-10-06T05:25:40.667742+0000","last_undegraded":"2023-10-06T05:25:40.667742+0000","last_fullsized":"2023-10-06T05:25:40.667742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:27.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.658270+0000","last_change":"2023-10-06T05:25:40.655308+0000","last_active":"2023-10-06T05:25:40.658270+0000","last_peered":"2023-10-06T05:25:40.658270+0000","last_clean":"2023-10-06T05:25:40.658270+0000","last_became_active":"2023-10-06T05:25:40.654916+0000","last_became_peered":"2023-10-06T05:25:40.654916+0000","last_unstale":"2023-10-06T05:25:40.658270+0000","last_undegraded":"2023-10-06T05:25:40.658270+0000","last_fullsized":"2023-10-06T05:25:40.658270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667897+0000","last_change":"2023-10-06T05:25:39.649974+0000","last_active":"2023-10-06T05:25:40.667897+0000","last_peered":"2023-10-06T05:25:40.667897+0000","last_clean":"2023-10-06T05:25:40.667897+0000","last_became_active":"2023-10-06T05:25:39.649670+0000","last_became_peered":"2023-10-06T05:25:39.649670+0000","last_unstale":"2023-10-06T05:25:40.667897+0000","last_undegraded":"2023-10-06T05:25:40.667897+0000","last_fullsized":"2023-10-06T05:25:40.667897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:53.879668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659599+0000","last_change":"2023-10-06T05:25:40.652556+0000","last_active":"2023-10-06T05:25:40.659599+0000","last_peered":"2023-10-06T05:25:40.659599+0000","last_clean":"2023-10-06T05:25:40.659599+0000","last_became_active":"2023-10-06T05:25:40.652257+0000","last_became_peered":"2023-10-06T05:25:40.652257+0000","last_unstale":"2023-10-06T05:25:40.659599+0000","last_undegraded":"2023-10-06T05:25:40.659599+0000","last_fullsized":"2023-10-06T05:25:40.659599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:56.403005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667980+0000","last_change":"2023-10-06T05:25:39.642832+0000","last_active":"2023-10-06T05:25:40.667980+0000","last_peered":"2023-10-06T05:25:40.667980+0000","last_clean":"2023-10-06T05:25:40.667980+0000","last_became_active":"2023-10-06T05:25:39.642583+0000","last_became_peered":"2023-10-06T05:25:39.642583+0000","last_unstale":"2023-10-06T05:25:40.667980+0000","last_undegraded":"2023-10-06T05:25:40.667980+0000","last_fullsized":"2023-10-06T05:25:40.667980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:18.821442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656884+0000","last_change":"2023-10-06T05:25:40.652099+0000","last_active":"2023-10-06T05:25:40.656884+0000","last_peered":"2023-10-06T05:25:40.656884+0000","last_clean":"2023-10-06T05:25:40.656884+0000","last_became_active":"2023-10-06T05:25:40.651805+0000","last_became_peered":"2023-10-06T05:25:40.651805+0000","last_unstale":"2023-10-06T05:25:40.656884+0000","last_undegraded":"2023-10-06T05:25:40.656884+0000","last_fullsized":"2023-10-06T05:25:40.656884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:35.122722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.634617+0000","last_change":"2023-10-06T05:25:39.647808+0000","last_active":"2023-10-06T05:25:40.634617+0000","last_peered":"2023-10-06T05:25:40.634617+0000","last_clean":"2023-10-06T05:25:40.634617+0000","last_became_active":"2023-10-06T05:25:39.647514+0000","last_became_peered":"2023-10-06T05:25:39.647514+0000","last_unstale":"2023-10-06T05:25:40.634617+0000","last_undegraded":"2023-10-06T05:25:40.634617+0000","last_fullsized":"2023-10-06T05:25:40.634617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:53.879668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667822+0000","last_change":"2023-10-06T05:25:40.654845+0000","last_active":"2023-10-06T05:25:40.667822+0000","last_peered":"2023-10-06T05:25:40.667822+0000","last_clean":"2023-10-06T05:25:40.667822+0000","last_became_active":"2023-10-06T05:25:40.654528+0000","last_became_peered":"2023-10-06T05:25:40.654528+0000","last_unstale":"2023-10-06T05:25:40.667822+0000","last_undegraded":"2023-10-06T05:25:40.667822+0000","last_fullsized":"2023-10-06T05:25:40.667822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:29.231778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668928+0000","last_change":"2023-10-06T05:25:39.654257+0000","last_active":"2023-10-06T05:25:40.668928+0000","last_peered":"2023-10-06T05:25:40.668928+0000","last_clean":"2023-10-06T05:25:40.668928+0000","last_became_active":"2023-10-06T05:25:39.653887+0000","last_became_peered":"2023-10-06T05:25:39.653887+0000","last_unstale":"2023-10-06T05:25:40.668928+0000","last_undegraded":"2023-10-06T05:25:40.668928+0000","last_fullsized":"2023-10-06T05:25:40.668928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:32.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.665508+0000","last_change":"2023-10-06T05:25:40.659413+0000","last_active":"2023-10-06T05:25:40.665508+0000","last_peered":"2023-10-06T05:25:40.665508+0000","last_clean":"2023-10-06T05:25:40.665508+0000","last_became_active":"2023-10-06T05:25:40.657813+0000","last_became_peered":"2023-10-06T05:25:40.657813+0000","last_unstale":"2023-10-06T05:25:40.665508+0000","last_undegraded":"2023-10-06T05:25:40.665508+0000","last_fullsized":"2023-10-06T05:25:40.665508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:14.451109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.634919+0000","last_change":"2023-10-06T05:25:39.645469+0000","last_active":"2023-10-06T05:25:40.634919+0000","last_peered":"2023-10-06T05:25:40.634919+0000","last_clean":"2023-10-06T05:25:40.634919+0000","last_became_active":"2023-10-06T05:25:39.645048+0000","last_became_peered":"2023-10-06T05:25:39.645048+0000","last_unstale":"2023-10-06T05:25:40.634919+0000","last_undegraded":"2023-10-06T05:25:40.634919+0000","last_fullsized":"2023-10-06T05:25:40.634919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:58.619912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657869+0000","last_change":"2023-10-06T05:25:40.650163+0000","last_active":"2023-10-06T05:25:40.657869+0000","last_peered":"2023-10-06T05:25:40.657869+0000","last_clean":"2023-10-06T05:25:40.657869+0000","last_became_active":"2023-10-06T05:25:40.649866+0000","last_became_peered":"2023-10-06T05:25:40.649866+0000","last_unstale":"2023-10-06T05:25:40.657869+0000","last_undegraded":"2023-10-06T05:25:40.657869+0000","last_fullsized":"2023-10-06T05:25:40.657869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.581083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.639533+0000","last_change":"2023-10-06T05:25:39.648409+0000","last_active":"2023-10-06T05:25:40.639533+0000","last_peered":"2023-10-06T05:25:40.639533+0000","last_clean":"2023-10-06T05:25:40.639533+0000","last_became_active":"2023-10-06T05:25:39.647601+0000","last_became_peered":"2023-10-06T05:25:39.647601+0000","last_unstale":"2023-10-06T05:25:40.639533+0000","last_undegraded":"2023-10-06T05:25:40.639533+0000","last_fullsized":"2023-10-06T05:25:40.639533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:58.619912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657848+0000","last_change":"2023-10-06T05:25:40.649485+0000","last_active":"2023-10-06T05:25:40.657848+0000","last_peered":"2023-10-06T05:25:40.657848+0000","last_clean":"2023-10-06T05:25:40.657848+0000","last_became_active":"2023-10-06T05:25:40.649196+0000","last_became_peered":"2023-10-06T05:25:40.649196+0000","last_unstale":"2023-10-06T05:25:40.657848+0000","last_undegraded":"2023-10-06T05:25:40.657848+0000","last_fullsized":"2023-10-06T05:25:40.657848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:13:45.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.633485+0000","last_change":"2023-10-06T05:25:39.645785+0000","last_active":"2023-10-06T05:25:40.633485+0000","last_peered":"2023-10-06T05:25:40.633485+0000","last_clean":"2023-10-06T05:25:40.633485+0000","last_became_active":"2023-10-06T05:25:39.645464+0000","last_became_peered":"2023-10-06T05:25:39.645464+0000","last_unstale":"2023-10-06T05:25:40.633485+0000","last_undegraded":"2023-10-06T05:25:40.633485+0000","last_fullsized":"2023-10-06T05:25:40.633485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.654959+0000","last_change":"2023-10-06T05:25:40.650246+0000","last_active":"2023-10-06T05:25:40.654959+0000","last_peered":"2023-10-06T05:25:40.654959+0000","last_clean":"2023-10-06T05:25:40.654959+0000","last_became_active":"2023-10-06T05:25:40.649077+0000","last_became_peered":"2023-10-06T05:25:40.649077+0000","last_unstale":"2023-10-06T05:25:40.654959+0000","last_undegraded":"2023-10-06T05:25:40.654959+0000","last_fullsized":"2023-10-06T05:25:40.654959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642551+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:25:40.642551+0000","last_peered":"2023-10-06T05:25:40.642551+0000","last_clean":"2023-10-06T05:25:40.642551+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:25:40.642551+0000","last_undegraded":"2023-10-06T05:25:40.642551+0000","last_fullsized":"2023-10-06T05:25:40.642551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.632788+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:25:40.632788+0000","last_peered":"2023-10-06T05:25:40.632788+0000","last_clean":"2023-10-06T05:25:40.632788+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:25:40.632788+0000","last_undegraded":"2023-10-06T05:25:40.632788+0000","last_fullsized":"2023-10-06T05:25:40.632788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.630148+0000","last_change":"2023-10-06T05:25:39.645950+0000","last_active":"2023-10-06T05:25:40.630148+0000","last_peered":"2023-10-06T05:25:40.630148+0000","last_clean":"2023-10-06T05:25:40.630148+0000","last_became_active":"2023-10-06T05:25:39.645615+0000","last_became_peered":"2023-10-06T05:25:39.645615+0000","last_unstale":"2023-10-06T05:25:40.630148+0000","last_undegraded":"2023-10-06T05:25:40.630148+0000","last_fullsized":"2023-10-06T05:25:40.630148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:53.879668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656838+0000","last_change":"2023-10-06T05:25:40.650348+0000","last_active":"2023-10-06T05:25:40.656838+0000","last_peered":"2023-10-06T05:25:40.656838+0000","last_clean":"2023-10-06T05:25:40.656838+0000","last_became_active":"2023-10-06T05:25:40.650054+0000","last_became_peered":"2023-10-06T05:25:40.650054+0000","last_unstale":"2023-10-06T05:25:40.656838+0000","last_undegraded":"2023-10-06T05:25:40.656838+0000","last_fullsized":"2023-10-06T05:25:40.656838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:07.043543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642450+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:25:40.642450+0000","last_peered":"2023-10-06T05:25:40.642450+0000","last_clean":"2023-10-06T05:25:40.642450+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:25:40.642450+0000","last_undegraded":"2023-10-06T05:25:40.642450+0000","last_fullsized":"2023-10-06T05:25:40.642450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.639797+0000","last_change":"2023-10-06T05:25:39.648749+0000","last_active":"2023-10-06T05:25:40.639797+0000","last_peered":"2023-10-06T05:25:40.639797+0000","last_clean":"2023-10-06T05:25:40.639797+0000","last_became_active":"2023-10-06T05:25:39.645268+0000","last_became_peered":"2023-10-06T05:25:39.645268+0000","last_unstale":"2023-10-06T05:25:40.639797+0000","last_undegraded":"2023-10-06T05:25:40.639797+0000","last_fullsized":"2023-10-06T05:25:40.639797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667879+0000","last_change":"2023-10-06T05:25:40.655542+0000","last_active":"2023-10-06T05:25:40.667879+0000","last_peered":"2023-10-06T05:25:40.667879+0000","last_clean":"2023-10-06T05:25:40.667879+0000","last_became_active":"2023-10-06T05:25:40.655243+0000","last_became_peered":"2023-10-06T05:25:40.655243+0000","last_unstale":"2023-10-06T05:25:40.667879+0000","last_undegraded":"2023-10-06T05:25:40.667879+0000","last_fullsized":"2023-10-06T05:25:40.667879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642698+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:25:40.642698+0000","last_peered":"2023-10-06T05:25:40.642698+0000","last_clean":"2023-10-06T05:25:40.642698+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:25:40.642698+0000","last_undegraded":"2023-10-06T05:25:40.642698+0000","last_fullsized":"2023-10-06T05:25:40.642698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640227+0000","last_change":"2023-10-06T05:25:39.650313+0000","last_active":"2023-10-06T05:25:40.640227+0000","last_peered":"2023-10-06T05:25:40.640227+0000","last_clean":"2023-10-06T05:25:40.640227+0000","last_became_active":"2023-10-06T05:25:39.650004+0000","last_became_peered":"2023-10-06T05:25:39.650004+0000","last_unstale":"2023-10-06T05:25:40.640227+0000","last_undegraded":"2023-10-06T05:25:40.640227+0000","last_fullsized":"2023-10-06T05:25:40.640227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.665445+0000","last_change":"2023-10-06T05:25:40.653499+0000","last_active":"2023-10-06T05:25:40.665445+0000","last_peered":"2023-10-06T05:25:40.665445+0000","last_clean":"2023-10-06T05:25:40.665445+0000","last_became_active":"2023-10-06T05:25:40.652683+0000","last_became_peered":"2023-10-06T05:25:40.652683+0000","last_unstale":"2023-10-06T05:25:40.665445+0000","last_undegraded":"2023-10-06T05:25:40.665445+0000","last_fullsized":"2023-10-06T05:25:40.665445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.634303+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:25:40.634303+0000","last_peered":"2023-10-06T05:25:40.634303+0000","last_clean":"2023-10-06T05:25:40.634303+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:25:40.634303+0000","last_undegraded":"2023-10-06T05:25:40.634303+0000","last_fullsized":"2023-10-06T05:25:40.634303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.645584+0000","last_change":"2023-10-06T05:25:39.653023+0000","last_active":"2023-10-06T05:25:40.645584+0000","last_peered":"2023-10-06T05:25:40.645584+0000","last_clean":"2023-10-06T05:25:40.645584+0000","last_became_active":"2023-10-06T05:25:39.652679+0000","last_became_peered":"2023-10-06T05:25:39.652679+0000","last_unstale":"2023-10-06T05:25:40.645584+0000","last_undegraded":"2023-10-06T05:25:40.645584+0000","last_fullsized":"2023-10-06T05:25:40.645584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.669116+0000","last_change":"2023-10-06T05:25:40.665644+0000","last_active":"2023-10-06T05:25:40.669116+0000","last_peered":"2023-10-06T05:25:40.669116+0000","last_clean":"2023-10-06T05:25:40.669116+0000","last_became_active":"2023-10-06T05:25:40.660838+0000","last_became_peered":"2023-10-06T05:25:40.660838+0000","last_unstale":"2023-10-06T05:25:40.669116+0000","last_undegraded":"2023-10-06T05:25:40.669116+0000","last_fullsized":"2023-10-06T05:25:40.669116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.636749+0000","last_change":"2023-10-06T05:25:39.648631+0000","last_active":"2023-10-06T05:25:40.636749+0000","last_peered":"2023-10-06T05:25:40.636749+0000","last_clean":"2023-10-06T05:25:40.636749+0000","last_became_active":"2023-10-06T05:25:39.648362+0000","last_became_peered":"2023-10-06T05:25:39.648362+0000","last_unstale":"2023-10-06T05:25:40.636749+0000","last_undegraded":"2023-10-06T05:25:40.636749+0000","last_fullsized":"2023-10-06T05:25:40.636749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:53:34.113340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.641183+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:25:40.641183+0000","last_peered":"2023-10-06T05:25:40.641183+0000","last_clean":"2023-10-06T05:25:40.641183+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:25:40.641183+0000","last_undegraded":"2023-10-06T05:25:40.641183+0000","last_fullsized":"2023-10-06T05:25:40.641183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.669146+0000","last_change":"2023-10-06T05:25:40.660343+0000","last_active":"2023-10-06T05:25:40.669146+0000","last_peered":"2023-10-06T05:25:40.669146+0000","last_clean":"2023-10-06T05:25:40.669146+0000","last_became_active":"2023-10-06T05:25:40.652927+0000","last_became_peered":"2023-10-06T05:25:40.652927+0000","last_unstale":"2023-10-06T05:25:40.669146+0000","last_undegraded":"2023-10-06T05:25:40.669146+0000","last_fullsized":"2023-10-06T05:25:40.669146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640731+0000","last_change":"2023-10-06T05:25:39.651074+0000","last_active":"2023-10-06T05:25:40.640731+0000","last_peered":"2023-10-06T05:25:40.640731+0000","last_clean":"2023-10-06T05:25:40.640731+0000","last_became_active":"2023-10-06T05:25:39.650792+0000","last_became_peered":"2023-10-06T05:25:39.650792+0000","last_unstale":"2023-10-06T05:25:40.640731+0000","last_undegraded":"2023-10-06T05:25:40.640731+0000","last_fullsized":"2023-10-06T05:25:40.640731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:36.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.644998+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:25:40.644998+0000","last_peered":"2023-10-06T05:25:40.644998+0000","last_clean":"2023-10-06T05:25:40.644998+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:25:40.644998+0000","last_undegraded":"2023-10-06T05:25:40.644998+0000","last_fullsized":"2023-10-06T05:25:40.644998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.651695+0000","last_change":"2023-10-06T05:25:40.647939+0000","last_active":"2023-10-06T05:25:40.651695+0000","last_peered":"2023-10-06T05:25:40.651695+0000","last_clean":"2023-10-06T05:25:40.651695+0000","last_became_active":"2023-10-06T05:25:40.647637+0000","last_became_peered":"2023-10-06T05:25:40.647637+0000","last_unstale":"2023-10-06T05:25:40.651695+0000","last_undegraded":"2023-10-06T05:25:40.651695+0000","last_fullsized":"2023-10-06T05:25:40.651695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:55.603377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667544+0000","last_change":"2023-10-06T05:25:39.646802+0000","last_active":"2023-10-06T05:25:40.667544+0000","last_peered":"2023-10-06T05:25:40.667544+0000","last_clean":"2023-10-06T05:25:40.667544+0000","last_became_active":"2023-10-06T05:25:39.646464+0000","last_became_peered":"2023-10-06T05:25:39.646464+0000","last_unstale":"2023-10-06T05:25:40.667544+0000","last_undegraded":"2023-10-06T05:25:40.667544+0000","last_fullsized":"2023-10-06T05:25:40.667544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.641083+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:25:40.641083+0000","last_peered":"2023-10-06T05:25:40.641083+0000","last_clean":"2023-10-06T05:25:40.641083+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:25:40.641083+0000","last_undegraded":"2023-10-06T05:25:40.641083+0000","last_fullsized":"2023-10-06T05:25:40.641083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.664530+0000","last_change":"2023-10-06T05:25:40.656613+0000","last_active":"2023-10-06T05:25:40.664530+0000","last_peered":"2023-10-06T05:25:40.664530+0000","last_clean":"2023-10-06T05:25:40.664530+0000","last_became_active":"2023-10-06T05:25:40.656295+0000","last_became_peered":"2023-10-06T05:25:40.656295+0000","last_unstale":"2023-10-06T05:25:40.664530+0000","last_undegraded":"2023-10-06T05:25:40.664530+0000","last_fullsized":"2023-10-06T05:25:40.664530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:13:45.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T05:25:42.028118+0000","last_change":"2023-10-06T05:25:39.648524+0000","last_active":"2023-10-06T05:25:42.028118+0000","last_peered":"2023-10-06T05:25:42.028118+0000","last_clean":"2023-10-06T05:25:42.028118+0000","last_became_active":"2023-10-06T05:25:39.648217+0000","last_became_peered":"2023-10-06T05:25:39.648217+0000","last_unstale":"2023-10-06T05:25:42.028118+0000","last_undegraded":"2023-10-06T05:25:42.028118+0000","last_fullsized":"2023-10-06T05:25:42.028118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:12.214301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.632885+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:25:40.632885+0000","last_peered":"2023-10-06T05:25:40.632885+0000","last_clean":"2023-10-06T05:25:40.632885+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:25:40.632885+0000","last_undegraded":"2023-10-06T05:25:40.632885+0000","last_fullsized":"2023-10-06T05:25:40.632885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.653834+0000","last_change":"2023-10-06T05:25:40.646109+0000","last_active":"2023-10-06T05:25:40.653834+0000","last_peered":"2023-10-06T05:25:40.653834+0000","last_clean":"2023-10-06T05:25:40.653834+0000","last_became_active":"2023-10-06T05:25:40.645670+0000","last_became_peered":"2023-10-06T05:25:40.645670+0000","last_unstale":"2023-10-06T05:25:40.653834+0000","last_undegraded":"2023-10-06T05:25:40.653834+0000","last_fullsized":"2023-10-06T05:25:40.653834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659523+0000","last_change":"2023-10-06T05:25:40.651457+0000","last_active":"2023-10-06T05:25:40.659523+0000","last_peered":"2023-10-06T05:25:40.659523+0000","last_clean":"2023-10-06T05:25:40.659523+0000","last_became_active":"2023-10-06T05:25:40.651136+0000","last_became_peered":"2023-10-06T05:25:40.651136+0000","last_unstale":"2023-10-06T05:25:40.659523+0000","last_undegraded":"2023-10-06T05:25:40.659523+0000","last_fullsized":"2023-10-06T05:25:40.659523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.671043+0000","last_change":"2023-10-06T05:25:39.642604+0000","last_active":"2023-10-06T05:25:40.671043+0000","last_peered":"2023-10-06T05:25:40.671043+0000","last_clean":"2023-10-06T05:25:40.671043+0000","last_became_active":"2023-10-06T05:25:39.642261+0000","last_became_peered":"2023-10-06T05:25:39.642261+0000","last_unstale":"2023-10-06T05:25:40.671043+0000","last_undegraded":"2023-10-06T05:25:40.671043+0000","last_fullsized":"2023-10-06T05:25:40.671043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:40.419929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668144+0000","last_change":"2023-10-06T05:25:40.658190+0000","last_active":"2023-10-06T05:25:40.668144+0000","last_peered":"2023-10-06T05:25:40.668144+0000","last_clean":"2023-10-06T05:25:40.668144+0000","last_became_active":"2023-10-06T05:25:40.652990+0000","last_became_peered":"2023-10-06T05:25:40.652990+0000","last_unstale":"2023-10-06T05:25:40.668144+0000","last_undegraded":"2023-10-06T05:25:40.668144+0000","last_fullsized":"2023-10-06T05:25:40.668144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:08.157544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667893+0000","last_change":"2023-10-06T05:25:39.648924+0000","last_active":"2023-10-06T05:25:40.667893+0000","last_peered":"2023-10-06T05:25:40.667893+0000","last_clean":"2023-10-06T05:25:40.667893+0000","last_became_active":"2023-10-06T05:25:39.648562+0000","last_became_peered":"2023-10-06T05:25:39.648562+0000","last_unstale":"2023-10-06T05:25:40.667893+0000","last_undegraded":"2023-10-06T05:25:40.667893+0000","last_fullsized":"2023-10-06T05:25:40.667893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:06.039061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.633764+0000","last_change":"2023-10-06T05:25:39.639616+0000","last_active":"2023-10-06T05:25:40.633764+0000","last_peered":"2023-10-06T05:25:40.633764+0000","last_clean":"2023-10-06T05:25:40.633764+0000","last_became_active":"2023-10-06T05:25:39.639332+0000","last_became_peered":"2023-10-06T05:25:39.639332+0000","last_unstale":"2023-10-06T05:25:40.633764+0000","last_undegraded":"2023-10-06T05:25:40.633764+0000","last_fullsized":"2023-10-06T05:25:40.633764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:32.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662281+0000","last_change":"2023-10-06T05:25:40.655147+0000","last_active":"2023-10-06T05:25:40.662281+0000","last_peered":"2023-10-06T05:25:40.662281+0000","last_clean":"2023-10-06T05:25:40.662281+0000","last_became_active":"2023-10-06T05:25:40.654858+0000","last_became_peered":"2023-10-06T05:25:40.654858+0000","last_unstale":"2023-10-06T05:25:40.662281+0000","last_undegraded":"2023-10-06T05:25:40.662281+0000","last_fullsized":"2023-10-06T05:25:40.662281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:12.635712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640870+0000","last_change":"2023-10-06T05:25:39.644781+0000","last_active":"2023-10-06T05:25:40.640870+0000","last_peered":"2023-10-06T05:25:40.640870+0000","last_clean":"2023-10-06T05:25:40.640870+0000","last_became_active":"2023-10-06T05:25:39.643752+0000","last_became_peered":"2023-10-06T05:25:39.643752+0000","last_unstale":"2023-10-06T05:25:40.640870+0000","last_undegraded":"2023-10-06T05:25:40.640870+0000","last_fullsized":"2023-10-06T05:25:40.640870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:58.619912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.652623+0000","last_change":"2023-10-06T05:25:40.646184+0000","last_active":"2023-10-06T05:25:40.652623+0000","last_peered":"2023-10-06T05:25:40.652623+0000","last_clean":"2023-10-06T05:25:40.652623+0000","last_became_active":"2023-10-06T05:25:40.645885+0000","last_became_peered":"2023-10-06T05:25:40.645885+0000","last_unstale":"2023-10-06T05:25:40.652623+0000","last_undegraded":"2023-10-06T05:25:40.652623+0000","last_fullsized":"2023-10-06T05:25:40.652623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.652805+0000","last_change":"2023-10-06T05:25:40.645235+0000","last_active":"2023-10-06T05:25:40.652805+0000","last_peered":"2023-10-06T05:25:40.652805+0000","last_clean":"2023-10-06T05:25:40.652805+0000","last_became_active":"2023-10-06T05:25:40.644011+0000","last_became_peered":"2023-10-06T05:25:40.644011+0000","last_unstale":"2023-10-06T05:25:40.652805+0000","last_undegraded":"2023-10-06T05:25:40.652805+0000","last_fullsized":"2023-10-06T05:25:40.652805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:53:35.117823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.633175+0000","last_change":"2023-10-06T05:25:39.653597+0000","last_active":"2023-10-06T05:25:40.633175+0000","last_peered":"2023-10-06T05:25:40.633175+0000","last_clean":"2023-10-06T05:25:40.633175+0000","last_became_active":"2023-10-06T05:25:39.653182+0000","last_became_peered":"2023-10-06T05:25:39.653182+0000","last_unstale":"2023-10-06T05:25:40.633175+0000","last_undegraded":"2023-10-06T05:25:40.633175+0000","last_fullsized":"2023-10-06T05:25:40.633175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:27.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668115+0000","last_change":"2023-10-06T05:25:40.656142+0000","last_active":"2023-10-06T05:25:40.668115+0000","last_peered":"2023-10-06T05:25:40.668115+0000","last_clean":"2023-10-06T05:25:40.668115+0000","last_became_active":"2023-10-06T05:25:40.655855+0000","last_became_peered":"2023-10-06T05:25:40.655855+0000","last_unstale":"2023-10-06T05:25:40.668115+0000","last_undegraded":"2023-10-06T05:25:40.668115+0000","last_fullsized":"2023-10-06T05:25:40.668115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.639959+0000","last_change":"2023-10-06T05:25:39.647617+0000","last_active":"2023-10-06T05:25:40.639959+0000","last_peered":"2023-10-06T05:25:40.639959+0000","last_clean":"2023-10-06T05:25:40.639959+0000","last_became_active":"2023-10-06T05:25:39.647339+0000","last_became_peered":"2023-10-06T05:25:39.647339+0000","last_unstale":"2023-10-06T05:25:40.639959+0000","last_undegraded":"2023-10-06T05:25:40.639959+0000","last_fullsized":"2023-10-06T05:25:40.639959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662166+0000","last_change":"2023-10-06T05:25:40.654281+0000","last_active":"2023-10-06T05:25:40.662166+0000","last_peered":"2023-10-06T05:25:40.662166+0000","last_clean":"2023-10-06T05:25:40.662166+0000","last_became_active":"2023-10-06T05:25:40.653887+0000","last_became_peered":"2023-10-06T05:25:40.653887+0000","last_unstale":"2023-10-06T05:25:40.662166+0000","last_undegraded":"2023-10-06T05:25:40.662166+0000","last_fullsized":"2023-10-06T05:25:40.662166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.670357+0000","last_change":"2023-10-06T05:25:39.650088+0000","last_active":"2023-10-06T05:25:40.670357+0000","last_peered":"2023-10-06T05:25:40.670357+0000","last_clean":"2023-10-06T05:25:40.670357+0000","last_became_active":"2023-10-06T05:25:39.649849+0000","last_became_peered":"2023-10-06T05:25:39.649849+0000","last_unstale":"2023-10-06T05:25:40.670357+0000","last_undegraded":"2023-10-06T05:25:40.670357+0000","last_fullsized":"2023-10-06T05:25:40.670357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:12.214301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663216+0000","last_change":"2023-10-06T05:25:40.656643+0000","last_active":"2023-10-06T05:25:40.663216+0000","last_peered":"2023-10-06T05:25:40.663216+0000","last_clean":"2023-10-06T05:25:40.663216+0000","last_became_active":"2023-10-06T05:25:40.656184+0000","last_became_peered":"2023-10-06T05:25:40.656184+0000","last_unstale":"2023-10-06T05:25:40.663216+0000","last_undegraded":"2023-10-06T05:25:40.663216+0000","last_fullsized":"2023-10-06T05:25:40.663216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:28.259232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668354+0000","last_change":"2023-10-06T05:25:39.650188+0000","last_active":"2023-10-06T05:25:40.668354+0000","last_peered":"2023-10-06T05:25:40.668354+0000","last_clean":"2023-10-06T05:25:40.668354+0000","last_became_active":"2023-10-06T05:25:39.649862+0000","last_became_peered":"2023-10-06T05:25:39.649862+0000","last_unstale":"2023-10-06T05:25:40.668354+0000","last_undegraded":"2023-10-06T05:25:40.668354+0000","last_fullsized":"2023-10-06T05:25:40.668354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:36.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667272+0000","last_change":"2023-10-06T05:25:40.664421+0000","last_active":"2023-10-06T05:25:40.667272+0000","last_peered":"2023-10-06T05:25:40.667272+0000","last_clean":"2023-10-06T05:25:40.667272+0000","last_became_active":"2023-10-06T05:25:40.664125+0000","last_became_peered":"2023-10-06T05:25:40.664125+0000","last_unstale":"2023-10-06T05:25:40.667272+0000","last_undegraded":"2023-10-06T05:25:40.667272+0000","last_fullsized":"2023-10-06T05:25:40.667272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:28.190832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667628+0000","last_change":"2023-10-06T05:25:39.646681+0000","last_active":"2023-10-06T05:25:40.667628+0000","last_peered":"2023-10-06T05:25:40.667628+0000","last_clean":"2023-10-06T05:25:40.667628+0000","last_became_active":"2023-10-06T05:25:39.646351+0000","last_became_peered":"2023-10-06T05:25:39.646351+0000","last_unstale":"2023-10-06T05:25:40.667628+0000","last_undegraded":"2023-10-06T05:25:40.667628+0000","last_fullsized":"2023-10-06T05:25:40.667628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:27.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662786+0000","last_change":"2023-10-06T05:25:40.658180+0000","last_active":"2023-10-06T05:25:40.662786+0000","last_peered":"2023-10-06T05:25:40.662786+0000","last_clean":"2023-10-06T05:25:40.662786+0000","last_became_active":"2023-10-06T05:25:40.657860+0000","last_became_peered":"2023-10-06T05:25:40.657860+0000","last_unstale":"2023-10-06T05:25:40.662786+0000","last_undegraded":"2023-10-06T05:25:40.662786+0000","last_fullsized":"2023-10-06T05:25:40.662786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:16.418406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667622+0000","last_change":"2023-10-06T05:25:39.645234+0000","last_active":"2023-10-06T05:25:40.667622+0000","last_peered":"2023-10-06T05:25:40.667622+0000","last_clean":"2023-10-06T05:25:40.667622+0000","last_became_active":"2023-10-06T05:25:39.644921+0000","last_became_peered":"2023-10-06T05:25:39.644921+0000","last_unstale":"2023-10-06T05:25:40.667622+0000","last_undegraded":"2023-10-06T05:25:40.667622+0000","last_fullsized":"2023-10-06T05:25:40.667622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.651655+0000","last_change":"2023-10-06T05:25:40.647515+0000","last_active":"2023-10-06T05:25:40.651655+0000","last_peered":"2023-10-06T05:25:40.651655+0000","last_clean":"2023-10-06T05:25:40.651655+0000","last_became_active":"2023-10-06T05:25:40.647229+0000","last_became_peered":"2023-10-06T05:25:40.647229+0000","last_unstale":"2023-10-06T05:25:40.651655+0000","last_undegraded":"2023-10-06T05:25:40.651655+0000","last_fullsized":"2023-10-06T05:25:40.651655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.666635+0000","last_change":"2023-10-06T05:25:39.646056+0000","last_active":"2023-10-06T05:25:40.666635+0000","last_peered":"2023-10-06T05:25:40.666635+0000","last_clean":"2023-10-06T05:25:40.666635+0000","last_became_active":"2023-10-06T05:25:39.645679+0000","last_became_peered":"2023-10-06T05:25:39.645679+0000","last_unstale":"2023-10-06T05:25:40.666635+0000","last_undegraded":"2023-10-06T05:25:40.666635+0000","last_fullsized":"2023-10-06T05:25:40.666635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:36.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657934+0000","last_change":"2023-10-06T05:25:40.649520+0000","last_active":"2023-10-06T05:25:40.657934+0000","last_peered":"2023-10-06T05:25:40.657934+0000","last_clean":"2023-10-06T05:25:40.657934+0000","last_became_active":"2023-10-06T05:25:40.649109+0000","last_became_peered":"2023-10-06T05:25:40.649109+0000","last_unstale":"2023-10-06T05:25:40.657934+0000","last_undegraded":"2023-10-06T05:25:40.657934+0000","last_fullsized":"2023-10-06T05:25:40.657934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668977+0000","last_change":"2023-10-06T05:25:39.652715+0000","last_active":"2023-10-06T05:25:40.668977+0000","last_peered":"2023-10-06T05:25:40.668977+0000","last_clean":"2023-10-06T05:25:40.668977+0000","last_became_active":"2023-10-06T05:25:39.652403+0000","last_became_peered":"2023-10-06T05:25:39.652403+0000","last_unstale":"2023-10-06T05:25:40.668977+0000","last_undegraded":"2023-10-06T05:25:40.668977+0000","last_fullsized":"2023-10-06T05:25:40.668977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:32.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301636,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070204,"statfs":{"total":96636764160,"available":96327888896,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301632,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070208,"statfs":{"total":96636764160,"available":96327892992,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301632,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070208,"statfs":{"total":96636764160,"available":96327892992,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302216,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069624,"statfs":{"total":96636764160,"available":96327294976,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:25:48.665 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:25:48.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98f1eeb700 1 Processor -- start 2023-10-06T05:25:48.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98f1eeb700 1 -- start start 2023-10-06T05:25:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98f1eeb700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f98ec159fe0 0x7f98ec06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98f1eeb700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec0cee50 con 0x7f98ec0cfb60 2023-10-06T05:25:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98f1eeb700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec06b250 con 0x7f98ec158c00 2023-10-06T05:25:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98f1eeb700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec06a640 con 0x7f98ec159fe0 2023-10-06T05:25:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98f16ea700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f98ec0cfb60 0x7f98ec0cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50634/0 (socket says 172.21.15.29:50634) 2023-10-06T05:25:48.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98f16ea700 1 -- 172.21.15.29:0/2948241300 learned_addr learned my addr 172.21.15.29:0/2948241300 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98ebfff700 1 --2- 172.21.15.29:0/2948241300 >> v2:172.21.15.173:3300/0 conn(0x7f98ec159fe0 0x7f98ec06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.757+0000 7f98eb7fe700 1 -- 172.21.15.29:0/2948241300 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660636469 0 0) 0x7f98dc001110 con 0x7f98ec0cfb60 2023-10-06T05:25:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98eb7fe700 1 -- 172.21.15.29:0/2948241300 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98cc003570 con 0x7f98ec0cfb60 2023-10-06T05:25:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98eb7fe700 1 -- 172.21.15.29:0/2948241300 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855532701 0 0) 0x7f98ec06b250 con 0x7f98ec158c00 2023-10-06T05:25:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98eb7fe700 1 -- 172.21.15.29:0/2948241300 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98dc001110 con 0x7f98ec158c00 2023-10-06T05:25:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98eb7fe700 1 -- 172.21.15.29:0/2948241300 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 180537461 0 0) 0x7f98cc003570 con 0x7f98ec0cfb60 2023-10-06T05:25:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98ebfff700 1 -- 172.21.15.29:0/2948241300 >> v1:172.21.15.173:6789/0 conn(0x7f98ec158c00 legacy=0x7f98ec0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98ebfff700 1 -- 172.21.15.29:0/2948241300 >> v1:172.21.15.29:6789/0 conn(0x7f98ec0cfb60 legacy=0x7f98ec0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98ebfff700 1 -- 172.21.15.29:0/2948241300 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec06a920 con 0x7f98ec159fe0 2023-10-06T05:25:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98ebfff700 1 --2- 172.21.15.29:0/2948241300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ec159fe0 0x7f98ec06b6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98d40098e0 tx=0x7f98d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e851c144fdaf929 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98eb7fe700 1 -- 172.21.15.29:0/2948241300 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc001600 con 0x7f98ec159fe0 2023-10-06T05:25:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98eb7fe700 1 -- 172.21.15.29:0/2948241300 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4011420 con 0x7f98ec159fe0 2023-10-06T05:25:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98eb7fe700 1 -- 172.21.15.29:0/2948241300 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40117c0 con 0x7f98ec159fe0 2023-10-06T05:25:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948241300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ec159fe0 msgr2=0x7f98ec06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98f1eeb700 1 --2- 172.21.15.29:0/2948241300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ec159fe0 0x7f98ec06b6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98d40098e0 tx=0x7f98d40091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948241300 shutdown_connections 2023-10-06T05:25:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98f1eeb700 1 --2- 172.21.15.29:0/2948241300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ec159fe0 0x7f98ec06b6e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948241300 >> 172.21.15.29:0/2948241300 conn(0x7f98ec0670a0 msgr2=0x7f98ec067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948241300 shutdown_connections 2023-10-06T05:25:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948241300 wait complete. 2023-10-06T05:25:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98f1eeb700 1 Processor -- start 2023-10-06T05:25:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.761+0000 7f98f1eeb700 1 -- start start 2023-10-06T05:25:48.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f1eeb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ec0cfb60 0x7f98ec0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f1eeb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98ec158c00 0x7f98ec145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f1eeb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98ec159fe0 0x7f98ec0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f1eeb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0b4900 con 0x7f98ec159fe0 2023-10-06T05:25:48.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f1eeb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec157c20 con 0x7f98ec0cfb60 2023-10-06T05:25:48.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f1eeb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec157f00 con 0x7f98ec158c00 2023-10-06T05:25:48.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f16ea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98ec159fe0 0x7f98ec0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f16ea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98ec159fe0 0x7f98ec0b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51568/0 (socket says 172.21.15.29:51568) 2023-10-06T05:25:48.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f16ea700 1 -- 172.21.15.29:0/2948027604 learned_addr learned my addr 172.21.15.29:0/2948027604 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:48.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f0ee9700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ec0cfb60 0x7f98ec0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98ebfff700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98ec158c00 0x7f98ec145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f16ea700 1 -- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98ec158c00 msgr2=0x7f98ec145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f16ea700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98ec158c00 0x7f98ec145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f16ea700 1 -- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ec0cfb60 msgr2=0x7f98ec0c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f16ea700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ec0cfb60 0x7f98ec0c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f16ea700 1 -- 172.21.15.29:0/2948027604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4009420 con 0x7f98ec159fe0 2023-10-06T05:25:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f16ea700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98ec159fe0 0x7f98ec0b3d00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00cb90 tx=0x7f98dc001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98e8ff9700 1 -- 172.21.15.29:0/2948027604 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc007e10 con 0x7f98ec159fe0 2023-10-06T05:25:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98e8ff9700 1 -- 172.21.15.29:0/2948027604 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc007360 con 0x7f98ec159fe0 2023-10-06T05:25:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec1581e0 con 0x7f98ec159fe0 2023-10-06T05:25:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98e8ff9700 1 -- 172.21.15.29:0/2948027604 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc004830 con 0x7f98ec159fe0 2023-10-06T05:25:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec154810 con 0x7f98ec159fe0 2023-10-06T05:25:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.765+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec0b46d0 con 0x7f98ec159fe0 2023-10-06T05:25:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.769+0000 7f98e8ff9700 1 -- 172.21.15.29:0/2948027604 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f98dc004c20 con 0x7f98ec159fe0 2023-10-06T05:25:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.769+0000 7f98e8ff9700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f98d0060550 0x7f98d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.769+0000 7f98e8ff9700 1 -- 172.21.15.29:0/2948027604 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98dc07bbd0 con 0x7f98ec159fe0 2023-10-06T05:25:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.769+0000 7f98f0ee9700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f98d0060550 0x7f98d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:48.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.769+0000 7f98f0ee9700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f98d0060550 0x7f98d0062a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98e4004140 tx=0x7f98e4007f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.781+0000 7f98e8ff9700 1 -- 172.21.15.29:0/2948027604 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f98ec0b46d0 con 0x7f98ec159fe0 2023-10-06T05:25:48.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.933+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98ec145df0 con 0x7f98d0060550 2023-10-06T05:25:48.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.949+0000 7f98e8ff9700 1 -- 172.21.15.29:0/2948027604 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286457 (secure 0 0 0) 0x7f98ec145df0 con 0x7f98d0060550 2023-10-06T05:25:48.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:48.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f98d0060550 msgr2=0x7f98d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f98d0060550 0x7f98d0062a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98e4004140 tx=0x7f98e4007f90 comp rx=0 tx=0).stop 2023-10-06T05:25:48.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98ec159fe0 msgr2=0x7f98ec0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98ec159fe0 0x7f98ec0b3d00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00cb90 tx=0x7f98dc001bc0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 shutdown_connections 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98ec159fe0 0x7f98ec0b3d00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98ec158c00 0x7f98ec145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f98d0060550 0x7f98d0062a00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 --2- 172.21.15.29:0/2948027604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98ec0cfb60 0x7f98ec0c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 >> 172.21.15.29:0/2948027604 conn(0x7f98ec0670a0 msgr2=0x7f98ec0cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 shutdown_connections 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:48.957+0000 7f98f1eeb700 1 -- 172.21.15.29:0/2948027604 wait complete. 2023-10-06T05:25:48.963 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:25:48.976 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-06T05:25:48.651174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397896,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576824,"statfs":{"total":773094113280,"available":770638667776,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.022320"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662207+0000","last_change":"2023-10-06T05:25:40.648302+0000","last_active":"2023-10-06T05:25:40.662207+0000","last_peered":"2023-10-06T05:25:40.662207+0000","last_clean":"2023-10-06T05:25:40.662207+0000","last_became_active":"2023-10-06T05:25:40.647162+0000","last_became_peered":"2023-10-06T05:25:40.647162+0000","last_unstale":"2023-10-06T05:25:40.662207+0000","last_undegraded":"2023-10-06T05:25:40.662207+0000","last_fullsized":"2023-10-06T05:25:40.662207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:17.982392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.658161+0000","last_change":"2023-10-06T05:25:40.654236+0000","last_active":"2023-10-06T05:25:40.658161+0000","last_peered":"2023-10-06T05:25:40.658161+0000","last_clean":"2023-10-06T05:25:40.658161+0000","last_became_active":"2023-10-06T05:25:40.653899+0000","last_became_peered":"2023-10-06T05:25:40.653899+0000","last_unstale":"2023-10-06T05:25:40.658161+0000","last_undegraded":"2023-10-06T05:25:40.658161+0000","last_fullsized":"2023-10-06T05:25:40.658161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659366+0000","last_change":"2023-10-06T05:25:40.652315+0000","last_active":"2023-10-06T05:25:40.659366+0000","last_peered":"2023-10-06T05:25:40.659366+0000","last_clean":"2023-10-06T05:25:40.659366+0000","last_became_active":"2023-10-06T05:25:40.651958+0000","last_became_peered":"2023-10-06T05:25:40.651958+0000","last_unstale":"2023-10-06T05:25:40.659366+0000","last_undegraded":"2023-10-06T05:25:40.659366+0000","last_fullsized":"2023-10-06T05:25:40.659366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.536955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656801+0000","last_change":"2023-10-06T05:25:40.650525+0000","last_active":"2023-10-06T05:25:40.656801+0000","last_peered":"2023-10-06T05:25:40.656801+0000","last_clean":"2023-10-06T05:25:40.656801+0000","last_became_active":"2023-10-06T05:25:40.650064+0000","last_became_peered":"2023-10-06T05:25:40.650064+0000","last_unstale":"2023-10-06T05:25:40.656801+0000","last_undegraded":"2023-10-06T05:25:40.656801+0000","last_fullsized":"2023-10-06T05:25:40.656801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:19.825924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668443+0000","last_change":"2023-10-06T05:25:40.665445+0000","last_active":"2023-10-06T05:25:40.668443+0000","last_peered":"2023-10-06T05:25:40.668443+0000","last_clean":"2023-10-06T05:25:40.668443+0000","last_became_active":"2023-10-06T05:25:40.662917+0000","last_became_peered":"2023-10-06T05:25:40.662917+0000","last_unstale":"2023-10-06T05:25:40.668443+0000","last_undegraded":"2023-10-06T05:25:40.668443+0000","last_fullsized":"2023-10-06T05:25:40.668443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662747+0000","last_change":"2023-10-06T05:25:40.652496+0000","last_active":"2023-10-06T05:25:40.662747+0000","last_peered":"2023-10-06T05:25:40.662747+0000","last_clean":"2023-10-06T05:25:40.662747+0000","last_became_active":"2023-10-06T05:25:40.652182+0000","last_became_peered":"2023-10-06T05:25:40.652182+0000","last_unstale":"2023-10-06T05:25:40.662747+0000","last_undegraded":"2023-10-06T05:25:40.662747+0000","last_fullsized":"2023-10-06T05:25:40.662747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:14.458549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663020+0000","last_change":"2023-10-06T05:25:40.656290+0000","last_active":"2023-10-06T05:25:40.663020+0000","last_peered":"2023-10-06T05:25:40.663020+0000","last_clean":"2023-10-06T05:25:40.663020+0000","last_became_active":"2023-10-06T05:25:40.655918+0000","last_became_peered":"2023-10-06T05:25:40.655918+0000","last_unstale":"2023-10-06T05:25:40.663020+0000","last_undegraded":"2023-10-06T05:25:40.663020+0000","last_fullsized":"2023-10-06T05:25:40.663020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656714+0000","last_change":"2023-10-06T05:25:40.650564+0000","last_active":"2023-10-06T05:25:40.656714+0000","last_peered":"2023-10-06T05:25:40.656714+0000","last_clean":"2023-10-06T05:25:40.656714+0000","last_became_active":"2023-10-06T05:25:40.650224+0000","last_became_peered":"2023-10-06T05:25:40.650224+0000","last_unstale":"2023-10-06T05:25:40.656714+0000","last_undegraded":"2023-10-06T05:25:40.656714+0000","last_fullsized":"2023-10-06T05:25:40.656714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668613+0000","last_change":"2023-10-06T05:25:40.659416+0000","last_active":"2023-10-06T05:25:40.668613+0000","last_peered":"2023-10-06T05:25:40.668613+0000","last_clean":"2023-10-06T05:25:40.668613+0000","last_became_active":"2023-10-06T05:25:40.657687+0000","last_became_peered":"2023-10-06T05:25:40.657687+0000","last_unstale":"2023-10-06T05:25:40.668613+0000","last_undegraded":"2023-10-06T05:25:40.668613+0000","last_fullsized":"2023-10-06T05:25:40.668613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656221+0000","last_change":"2023-10-06T05:25:40.650557+0000","last_active":"2023-10-06T05:25:40.656221+0000","last_peered":"2023-10-06T05:25:40.656221+0000","last_clean":"2023-10-06T05:25:40.656221+0000","last_became_active":"2023-10-06T05:25:40.650254+0000","last_became_peered":"2023-10-06T05:25:40.650254+0000","last_unstale":"2023-10-06T05:25:40.656221+0000","last_undegraded":"2023-10-06T05:25:40.656221+0000","last_fullsized":"2023-10-06T05:25:40.656221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659455+0000","last_change":"2023-10-06T05:25:40.652762+0000","last_active":"2023-10-06T05:25:40.659455+0000","last_peered":"2023-10-06T05:25:40.659455+0000","last_clean":"2023-10-06T05:25:40.659455+0000","last_became_active":"2023-10-06T05:25:40.652458+0000","last_became_peered":"2023-10-06T05:25:40.652458+0000","last_unstale":"2023-10-06T05:25:40.659455+0000","last_undegraded":"2023-10-06T05:25:40.659455+0000","last_fullsized":"2023-10-06T05:25:40.659455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:12.635712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663186+0000","last_change":"2023-10-06T05:25:40.651354+0000","last_active":"2023-10-06T05:25:40.663186+0000","last_peered":"2023-10-06T05:25:40.663186+0000","last_clean":"2023-10-06T05:25:40.663186+0000","last_became_active":"2023-10-06T05:25:40.651057+0000","last_became_peered":"2023-10-06T05:25:40.651057+0000","last_unstale":"2023-10-06T05:25:40.663186+0000","last_undegraded":"2023-10-06T05:25:40.663186+0000","last_fullsized":"2023-10-06T05:25:40.663186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:37.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662132+0000","last_change":"2023-10-06T05:25:40.648238+0000","last_active":"2023-10-06T05:25:40.662132+0000","last_peered":"2023-10-06T05:25:40.662132+0000","last_clean":"2023-10-06T05:25:40.662132+0000","last_became_active":"2023-10-06T05:25:40.647824+0000","last_became_peered":"2023-10-06T05:25:40.647824+0000","last_unstale":"2023-10-06T05:25:40.662132+0000","last_undegraded":"2023-10-06T05:25:40.662132+0000","last_fullsized":"2023-10-06T05:25:40.662132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:33.454028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.652755+0000","last_change":"2023-10-06T05:25:40.647850+0000","last_active":"2023-10-06T05:25:40.652755+0000","last_peered":"2023-10-06T05:25:40.652755+0000","last_clean":"2023-10-06T05:25:40.652755+0000","last_became_active":"2023-10-06T05:25:40.647638+0000","last_became_peered":"2023-10-06T05:25:40.647638+0000","last_unstale":"2023-10-06T05:25:40.652755+0000","last_undegraded":"2023-10-06T05:25:40.652755+0000","last_fullsized":"2023-10-06T05:25:40.652755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663047+0000","last_change":"2023-10-06T05:25:40.657665+0000","last_active":"2023-10-06T05:25:40.663047+0000","last_peered":"2023-10-06T05:25:40.663047+0000","last_clean":"2023-10-06T05:25:40.663047+0000","last_became_active":"2023-10-06T05:25:40.656326+0000","last_became_peered":"2023-10-06T05:25:40.656326+0000","last_unstale":"2023-10-06T05:25:40.663047+0000","last_undegraded":"2023-10-06T05:25:40.663047+0000","last_fullsized":"2023-10-06T05:25:40.663047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:29.231778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659999+0000","last_change":"2023-10-06T05:25:40.654213+0000","last_active":"2023-10-06T05:25:40.659999+0000","last_peered":"2023-10-06T05:25:40.659999+0000","last_clean":"2023-10-06T05:25:40.659999+0000","last_became_active":"2023-10-06T05:25:40.653879+0000","last_became_peered":"2023-10-06T05:25:40.653879+0000","last_unstale":"2023-10-06T05:25:40.659999+0000","last_undegraded":"2023-10-06T05:25:40.659999+0000","last_fullsized":"2023-10-06T05:25:40.659999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:06.564230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668950+0000","last_change":"2023-10-06T05:25:40.664811+0000","last_active":"2023-10-06T05:25:40.668950+0000","last_peered":"2023-10-06T05:25:40.668950+0000","last_clean":"2023-10-06T05:25:40.668950+0000","last_became_active":"2023-10-06T05:25:40.662900+0000","last_became_peered":"2023-10-06T05:25:40.662900+0000","last_unstale":"2023-10-06T05:25:40.668950+0000","last_undegraded":"2023-10-06T05:25:40.668950+0000","last_fullsized":"2023-10-06T05:25:40.668950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657879+0000","last_change":"2023-10-06T05:25:40.649530+0000","last_active":"2023-10-06T05:25:40.657879+0000","last_peered":"2023-10-06T05:25:40.657879+0000","last_clean":"2023-10-06T05:25:40.657879+0000","last_became_active":"2023-10-06T05:25:40.649306+0000","last_became_peered":"2023-10-06T05:25:40.649306+0000","last_unstale":"2023-10-06T05:25:40.657879+0000","last_undegraded":"2023-10-06T05:25:40.657879+0000","last_fullsized":"2023-10-06T05:25:40.657879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:24.213618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663062+0000","last_change":"2023-10-06T05:25:40.656290+0000","last_active":"2023-10-06T05:25:40.663062+0000","last_peered":"2023-10-06T05:25:40.663062+0000","last_clean":"2023-10-06T05:25:40.663062+0000","last_became_active":"2023-10-06T05:25:40.655968+0000","last_became_peered":"2023-10-06T05:25:40.655968+0000","last_unstale":"2023-10-06T05:25:40.663062+0000","last_undegraded":"2023-10-06T05:25:40.663062+0000","last_fullsized":"2023-10-06T05:25:40.663062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:04.694861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.660496+0000","last_change":"2023-10-06T05:25:40.651544+0000","last_active":"2023-10-06T05:25:40.660496+0000","last_peered":"2023-10-06T05:25:40.660496+0000","last_clean":"2023-10-06T05:25:40.660496+0000","last_became_active":"2023-10-06T05:25:40.651160+0000","last_became_peered":"2023-10-06T05:25:40.651160+0000","last_unstale":"2023-10-06T05:25:40.660496+0000","last_undegraded":"2023-10-06T05:25:40.660496+0000","last_fullsized":"2023-10-06T05:25:40.660496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668308+0000","last_change":"2023-10-06T05:25:40.665366+0000","last_active":"2023-10-06T05:25:40.668308+0000","last_peered":"2023-10-06T05:25:40.668308+0000","last_clean":"2023-10-06T05:25:40.668308+0000","last_became_active":"2023-10-06T05:25:40.664987+0000","last_became_peered":"2023-10-06T05:25:40.664987+0000","last_unstale":"2023-10-06T05:25:40.668308+0000","last_undegraded":"2023-10-06T05:25:40.668308+0000","last_fullsized":"2023-10-06T05:25:40.668308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667832+0000","last_change":"2023-10-06T05:25:40.654793+0000","last_active":"2023-10-06T05:25:40.667832+0000","last_peered":"2023-10-06T05:25:40.667832+0000","last_clean":"2023-10-06T05:25:40.667832+0000","last_became_active":"2023-10-06T05:25:40.654476+0000","last_became_peered":"2023-10-06T05:25:40.654476+0000","last_unstale":"2023-10-06T05:25:40.667832+0000","last_undegraded":"2023-10-06T05:25:40.667832+0000","last_fullsized":"2023-10-06T05:25:40.667832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656922+0000","last_change":"2023-10-06T05:25:40.651368+0000","last_active":"2023-10-06T05:25:40.656922+0000","last_peered":"2023-10-06T05:25:40.656922+0000","last_clean":"2023-10-06T05:25:40.656922+0000","last_became_active":"2023-10-06T05:25:40.650938+0000","last_became_peered":"2023-10-06T05:25:40.650938+0000","last_unstale":"2023-10-06T05:25:40.656922+0000","last_undegraded":"2023-10-06T05:25:40.656922+0000","last_fullsized":"2023-10-06T05:25:40.656922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.581083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668218+0000","last_change":"2023-10-06T05:25:40.664677+0000","last_active":"2023-10-06T05:25:40.668218+0000","last_peered":"2023-10-06T05:25:40.668218+0000","last_clean":"2023-10-06T05:25:40.668218+0000","last_became_active":"2023-10-06T05:25:40.664171+0000","last_became_peered":"2023-10-06T05:25:40.664171+0000","last_unstale":"2023-10-06T05:25:40.668218+0000","last_undegraded":"2023-10-06T05:25:40.668218+0000","last_fullsized":"2023-10-06T05:25:40.668218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668224+0000","last_change":"2023-10-06T05:25:40.659304+0000","last_active":"2023-10-06T05:25:40.668224+0000","last_peered":"2023-10-06T05:25:40.668224+0000","last_clean":"2023-10-06T05:25:40.668224+0000","last_became_active":"2023-10-06T05:25:40.654657+0000","last_became_peered":"2023-10-06T05:25:40.654657+0000","last_unstale":"2023-10-06T05:25:40.668224+0000","last_undegraded":"2023-10-06T05:25:40.668224+0000","last_fullsized":"2023-10-06T05:25:40.668224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:55.603377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668210+0000","last_change":"2023-10-06T05:25:40.658604+0000","last_active":"2023-10-06T05:25:40.668210+0000","last_peered":"2023-10-06T05:25:40.668210+0000","last_clean":"2023-10-06T05:25:40.668210+0000","last_became_active":"2023-10-06T05:25:40.651895+0000","last_became_peered":"2023-10-06T05:25:40.651895+0000","last_unstale":"2023-10-06T05:25:40.668210+0000","last_undegraded":"2023-10-06T05:25:40.668210+0000","last_fullsized":"2023-10-06T05:25:40.668210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659944+0000","last_change":"2023-10-06T05:25:40.656488+0000","last_active":"2023-10-06T05:25:40.659944+0000","last_peered":"2023-10-06T05:25:40.659944+0000","last_clean":"2023-10-06T05:25:40.659944+0000","last_became_active":"2023-10-06T05:25:40.655672+0000","last_became_peered":"2023-10-06T05:25:40.655672+0000","last_unstale":"2023-10-06T05:25:40.659944+0000","last_undegraded":"2023-10-06T05:25:40.659944+0000","last_fullsized":"2023-10-06T05:25:40.659944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668507+0000","last_change":"2023-10-06T05:25:40.660602+0000","last_active":"2023-10-06T05:25:40.668507+0000","last_peered":"2023-10-06T05:25:40.668507+0000","last_clean":"2023-10-06T05:25:40.668507+0000","last_became_active":"2023-10-06T05:25:40.658211+0000","last_became_peered":"2023-10-06T05:25:40.658211+0000","last_unstale":"2023-10-06T05:25:40.668507+0000","last_undegraded":"2023-10-06T05:25:40.668507+0000","last_fullsized":"2023-10-06T05:25:40.668507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:29.231778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.664246+0000","last_change":"2023-10-06T05:25:40.657180+0000","last_active":"2023-10-06T05:25:40.664246+0000","last_peered":"2023-10-06T05:25:40.664246+0000","last_clean":"2023-10-06T05:25:40.664246+0000","last_became_active":"2023-10-06T05:25:40.656552+0000","last_became_peered":"2023-10-06T05:25:40.656552+0000","last_unstale":"2023-10-06T05:25:40.664246+0000","last_undegraded":"2023-10-06T05:25:40.664246+0000","last_fullsized":"2023-10-06T05:25:40.664246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662769+0000","last_change":"2023-10-06T05:25:40.653289+0000","last_active":"2023-10-06T05:25:40.662769+0000","last_peered":"2023-10-06T05:25:40.662769+0000","last_clean":"2023-10-06T05:25:40.662769+0000","last_became_active":"2023-10-06T05:25:40.652964+0000","last_became_peered":"2023-10-06T05:25:40.652964+0000","last_unstale":"2023-10-06T05:25:40.662769+0000","last_undegraded":"2023-10-06T05:25:40.662769+0000","last_fullsized":"2023-10-06T05:25:40.662769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:11.037317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662256+0000","last_change":"2023-10-06T05:25:40.654134+0000","last_active":"2023-10-06T05:25:40.662256+0000","last_peered":"2023-10-06T05:25:40.662256+0000","last_clean":"2023-10-06T05:25:40.662256+0000","last_became_active":"2023-10-06T05:25:40.653840+0000","last_became_peered":"2023-10-06T05:25:40.653840+0000","last_unstale":"2023-10-06T05:25:40.662256+0000","last_undegraded":"2023-10-06T05:25:40.662256+0000","last_fullsized":"2023-10-06T05:25:40.662256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667214+0000","last_change":"2023-10-06T05:25:40.657501+0000","last_active":"2023-10-06T05:25:40.667214+0000","last_peered":"2023-10-06T05:25:40.667214+0000","last_clean":"2023-10-06T05:25:40.667214+0000","last_became_active":"2023-10-06T05:25:40.657215+0000","last_became_peered":"2023-10-06T05:25:40.657215+0000","last_unstale":"2023-10-06T05:25:40.667214+0000","last_undegraded":"2023-10-06T05:25:40.667214+0000","last_fullsized":"2023-10-06T05:25:40.667214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:24.671427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662019+0000","last_change":"2023-10-06T05:25:40.653923+0000","last_active":"2023-10-06T05:25:40.662019+0000","last_peered":"2023-10-06T05:25:40.662019+0000","last_clean":"2023-10-06T05:25:40.662019+0000","last_became_active":"2023-10-06T05:25:40.653592+0000","last_became_peered":"2023-10-06T05:25:40.653592+0000","last_unstale":"2023-10-06T05:25:40.662019+0000","last_undegraded":"2023-10-06T05:25:40.662019+0000","last_fullsized":"2023-10-06T05:25:40.662019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:24.213618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668046+0000","last_change":"2023-10-06T05:25:39.646425+0000","last_active":"2023-10-06T05:25:40.668046+0000","last_peered":"2023-10-06T05:25:40.668046+0000","last_clean":"2023-10-06T05:25:40.668046+0000","last_became_active":"2023-10-06T05:25:39.646111+0000","last_became_peered":"2023-10-06T05:25:39.646111+0000","last_unstale":"2023-10-06T05:25:40.668046+0000","last_undegraded":"2023-10-06T05:25:40.668046+0000","last_fullsized":"2023-10-06T05:25:40.668046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:53:34.113340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659962+0000","last_change":"2023-10-06T05:25:40.656838+0000","last_active":"2023-10-06T05:25:40.659962+0000","last_peered":"2023-10-06T05:25:40.659962+0000","last_clean":"2023-10-06T05:25:40.659962+0000","last_became_active":"2023-10-06T05:25:40.656116+0000","last_became_peered":"2023-10-06T05:25:40.656116+0000","last_unstale":"2023-10-06T05:25:40.659962+0000","last_undegraded":"2023-10-06T05:25:40.659962+0000","last_fullsized":"2023-10-06T05:25:40.659962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640078+0000","last_change":"2023-10-06T05:25:39.650939+0000","last_active":"2023-10-06T05:25:40.640078+0000","last_peered":"2023-10-06T05:25:40.640078+0000","last_clean":"2023-10-06T05:25:40.640078+0000","last_became_active":"2023-10-06T05:25:39.650629+0000","last_became_peered":"2023-10-06T05:25:39.650629+0000","last_unstale":"2023-10-06T05:25:40.640078+0000","last_undegraded":"2023-10-06T05:25:40.640078+0000","last_fullsized":"2023-10-06T05:25:40.640078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668158+0000","last_change":"2023-10-06T05:25:40.657223+0000","last_active":"2023-10-06T05:25:40.668158+0000","last_peered":"2023-10-06T05:25:40.668158+0000","last_clean":"2023-10-06T05:25:40.668158+0000","last_became_active":"2023-10-06T05:25:40.656938+0000","last_became_peered":"2023-10-06T05:25:40.656938+0000","last_unstale":"2023-10-06T05:25:40.668158+0000","last_undegraded":"2023-10-06T05:25:40.668158+0000","last_fullsized":"2023-10-06T05:25:40.668158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642920+0000","last_change":"2023-10-06T05:25:39.649214+0000","last_active":"2023-10-06T05:25:40.642920+0000","last_peered":"2023-10-06T05:25:40.642920+0000","last_clean":"2023-10-06T05:25:40.642920+0000","last_became_active":"2023-10-06T05:25:39.648663+0000","last_became_peered":"2023-10-06T05:25:39.648663+0000","last_unstale":"2023-10-06T05:25:40.642920+0000","last_undegraded":"2023-10-06T05:25:40.642920+0000","last_fullsized":"2023-10-06T05:25:40.642920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:23.666945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.664350+0000","last_change":"2023-10-06T05:25:40.657849+0000","last_active":"2023-10-06T05:25:40.664350+0000","last_peered":"2023-10-06T05:25:40.664350+0000","last_clean":"2023-10-06T05:25:40.664350+0000","last_became_active":"2023-10-06T05:25:40.657491+0000","last_became_peered":"2023-10-06T05:25:40.657491+0000","last_unstale":"2023-10-06T05:25:40.664350+0000","last_undegraded":"2023-10-06T05:25:40.664350+0000","last_fullsized":"2023-10-06T05:25:40.664350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:56.403005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.670093+0000","last_change":"2023-10-06T05:25:39.649359+0000","last_active":"2023-10-06T05:25:40.670093+0000","last_peered":"2023-10-06T05:25:40.670093+0000","last_clean":"2023-10-06T05:25:40.670093+0000","last_became_active":"2023-10-06T05:25:39.649053+0000","last_became_peered":"2023-10-06T05:25:39.649053+0000","last_unstale":"2023-10-06T05:25:40.670093+0000","last_undegraded":"2023-10-06T05:25:40.670093+0000","last_fullsized":"2023-10-06T05:25:40.670093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:12.214301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667742+0000","last_change":"2023-10-06T05:25:39.649076+0000","last_active":"2023-10-06T05:25:40.667742+0000","last_peered":"2023-10-06T05:25:40.667742+0000","last_clean":"2023-10-06T05:25:40.667742+0000","last_became_active":"2023-10-06T05:25:39.648697+0000","last_became_peered":"2023-10-06T05:25:39.648697+0000","last_unstale":"2023-10-06T05:25:40.667742+0000","last_undegraded":"2023-10-06T05:25:40.667742+0000","last_fullsized":"2023-10-06T05:25:40.667742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:27.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.658270+0000","last_change":"2023-10-06T05:25:40.655308+0000","last_active":"2023-10-06T05:25:40.658270+0000","last_peered":"2023-10-06T05:25:40.658270+0000","last_clean":"2023-10-06T05:25:40.658270+0000","last_became_active":"2023-10-06T05:25:40.654916+0000","last_became_peered":"2023-10-06T05:25:40.654916+0000","last_unstale":"2023-10-06T05:25:40.658270+0000","last_undegraded":"2023-10-06T05:25:40.658270+0000","last_fullsized":"2023-10-06T05:25:40.658270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667897+0000","last_change":"2023-10-06T05:25:39.649974+0000","last_active":"2023-10-06T05:25:40.667897+0000","last_peered":"2023-10-06T05:25:40.667897+0000","last_clean":"2023-10-06T05:25:40.667897+0000","last_became_active":"2023-10-06T05:25:39.649670+0000","last_became_peered":"2023-10-06T05:25:39.649670+0000","last_unstale":"2023-10-06T05:25:40.667897+0000","last_undegraded":"2023-10-06T05:25:40.667897+0000","last_fullsized":"2023-10-06T05:25:40.667897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:53.879668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659599+0000","last_change":"2023-10-06T05:25:40.652556+0000","last_active":"2023-10-06T05:25:40.659599+0000","last_peered":"2023-10-06T05:25:40.659599+0000","last_clean":"2023-10-06T05:25:40.659599+0000","last_became_active":"2023-10-06T05:25:40.652257+0000","last_became_peered":"2023-10-06T05:25:40.652257+0000","last_unstale":"2023-10-06T05:25:40.659599+0000","last_undegraded":"2023-10-06T05:25:40.659599+0000","last_fullsized":"2023-10-06T05:25:40.659599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:56.403005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667980+0000","last_change":"2023-10-06T05:25:39.642832+0000","last_active":"2023-10-06T05:25:40.667980+0000","last_peered":"2023-10-06T05:25:40.667980+0000","last_clean":"2023-10-06T05:25:40.667980+0000","last_became_active":"2023-10-06T05:25:39.642583+0000","last_became_peered":"2023-10-06T05:25:39.642583+0000","last_unstale":"2023-10-06T05:25:40.667980+0000","last_undegraded":"2023-10-06T05:25:40.667980+0000","last_fullsized":"2023-10-06T05:25:40.667980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:18.821442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656884+0000","last_change":"2023-10-06T05:25:40.652099+0000","last_active":"2023-10-06T05:25:40.656884+0000","last_peered":"2023-10-06T05:25:40.656884+0000","last_clean":"2023-10-06T05:25:40.656884+0000","last_became_active":"2023-10-06T05:25:40.651805+0000","last_became_peered":"2023-10-06T05:25:40.651805+0000","last_unstale":"2023-10-06T05:25:40.656884+0000","last_undegraded":"2023-10-06T05:25:40.656884+0000","last_fullsized":"2023-10-06T05:25:40.656884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:35.122722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.634617+0000","last_change":"2023-10-06T05:25:39.647808+0000","last_active":"2023-10-06T05:25:40.634617+0000","last_peered":"2023-10-06T05:25:40.634617+0000","last_clean":"2023-10-06T05:25:40.634617+0000","last_became_active":"2023-10-06T05:25:39.647514+0000","last_became_peered":"2023-10-06T05:25:39.647514+0000","last_unstale":"2023-10-06T05:25:40.634617+0000","last_undegraded":"2023-10-06T05:25:40.634617+0000","last_fullsized":"2023-10-06T05:25:40.634617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:53.879668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667822+0000","last_change":"2023-10-06T05:25:40.654845+0000","last_active":"2023-10-06T05:25:40.667822+0000","last_peered":"2023-10-06T05:25:40.667822+0000","last_clean":"2023-10-06T05:25:40.667822+0000","last_became_active":"2023-10-06T05:25:40.654528+0000","last_became_peered":"2023-10-06T05:25:40.654528+0000","last_unstale":"2023-10-06T05:25:40.667822+0000","last_undegraded":"2023-10-06T05:25:40.667822+0000","last_fullsized":"2023-10-06T05:25:40.667822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:29.231778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668928+0000","last_change":"2023-10-06T05:25:39.654257+0000","last_active":"2023-10-06T05:25:40.668928+0000","last_peered":"2023-10-06T05:25:40.668928+0000","last_clean":"2023-10-06T05:25:40.668928+0000","last_became_active":"2023-10-06T05:25:39.653887+0000","last_became_peered":"2023-10-06T05:25:39.653887+0000","last_unstale":"2023-10-06T05:25:40.668928+0000","last_undegraded":"2023-10-06T05:25:40.668928+0000","last_fullsized":"2023-10-06T05:25:40.668928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:32.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.665508+0000","last_change":"2023-10-06T05:25:40.659413+0000","last_active":"2023-10-06T05:25:40.665508+0000","last_peered":"2023-10-06T05:25:40.665508+0000","last_clean":"2023-10-06T05:25:40.665508+0000","last_became_active":"2023-10-06T05:25:40.657813+0000","last_became_peered":"2023-10-06T05:25:40.657813+0000","last_unstale":"2023-10-06T05:25:40.665508+0000","last_undegraded":"2023-10-06T05:25:40.665508+0000","last_fullsized":"2023-10-06T05:25:40.665508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:14.451109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.634919+0000","last_change":"2023-10-06T05:25:39.645469+0000","last_active":"2023-10-06T05:25:40.634919+0000","last_peered":"2023-10-06T05:25:40.634919+0000","last_clean":"2023-10-06T05:25:40.634919+0000","last_became_active":"2023-10-06T05:25:39.645048+0000","last_became_peered":"2023-10-06T05:25:39.645048+0000","last_unstale":"2023-10-06T05:25:40.634919+0000","last_undegraded":"2023-10-06T05:25:40.634919+0000","last_fullsized":"2023-10-06T05:25:40.634919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:58.619912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657869+0000","last_change":"2023-10-06T05:25:40.650163+0000","last_active":"2023-10-06T05:25:40.657869+0000","last_peered":"2023-10-06T05:25:40.657869+0000","last_clean":"2023-10-06T05:25:40.657869+0000","last_became_active":"2023-10-06T05:25:40.649866+0000","last_became_peered":"2023-10-06T05:25:40.649866+0000","last_unstale":"2023-10-06T05:25:40.657869+0000","last_undegraded":"2023-10-06T05:25:40.657869+0000","last_fullsized":"2023-10-06T05:25:40.657869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:54.581083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.639533+0000","last_change":"2023-10-06T05:25:39.648409+0000","last_active":"2023-10-06T05:25:40.639533+0000","last_peered":"2023-10-06T05:25:40.639533+0000","last_clean":"2023-10-06T05:25:40.639533+0000","last_became_active":"2023-10-06T05:25:39.647601+0000","last_became_peered":"2023-10-06T05:25:39.647601+0000","last_unstale":"2023-10-06T05:25:40.639533+0000","last_undegraded":"2023-10-06T05:25:40.639533+0000","last_fullsized":"2023-10-06T05:25:40.639533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:58.619912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657848+0000","last_change":"2023-10-06T05:25:40.649485+0000","last_active":"2023-10-06T05:25:40.657848+0000","last_peered":"2023-10-06T05:25:40.657848+0000","last_clean":"2023-10-06T05:25:40.657848+0000","last_became_active":"2023-10-06T05:25:40.649196+0000","last_became_peered":"2023-10-06T05:25:40.649196+0000","last_unstale":"2023-10-06T05:25:40.657848+0000","last_undegraded":"2023-10-06T05:25:40.657848+0000","last_fullsized":"2023-10-06T05:25:40.657848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:13:45.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.633485+0000","last_change":"2023-10-06T05:25:39.645785+0000","last_active":"2023-10-06T05:25:40.633485+0000","last_peered":"2023-10-06T05:25:40.633485+0000","last_clean":"2023-10-06T05:25:40.633485+0000","last_became_active":"2023-10-06T05:25:39.645464+0000","last_became_peered":"2023-10-06T05:25:39.645464+0000","last_unstale":"2023-10-06T05:25:40.633485+0000","last_undegraded":"2023-10-06T05:25:40.633485+0000","last_fullsized":"2023-10-06T05:25:40.633485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.654959+0000","last_change":"2023-10-06T05:25:40.650246+0000","last_active":"2023-10-06T05:25:40.654959+0000","last_peered":"2023-10-06T05:25:40.654959+0000","last_clean":"2023-10-06T05:25:40.654959+0000","last_became_active":"2023-10-06T05:25:40.649077+0000","last_became_peered":"2023-10-06T05:25:40.649077+0000","last_unstale":"2023-10-06T05:25:40.654959+0000","last_undegraded":"2023-10-06T05:25:40.654959+0000","last_fullsized":"2023-10-06T05:25:40.654959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642551+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:25:40.642551+0000","last_peered":"2023-10-06T05:25:40.642551+0000","last_clean":"2023-10-06T05:25:40.642551+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:25:40.642551+0000","last_undegraded":"2023-10-06T05:25:40.642551+0000","last_fullsized":"2023-10-06T05:25:40.642551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.632788+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:25:40.632788+0000","last_peered":"2023-10-06T05:25:40.632788+0000","last_clean":"2023-10-06T05:25:40.632788+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:25:40.632788+0000","last_undegraded":"2023-10-06T05:25:40.632788+0000","last_fullsized":"2023-10-06T05:25:40.632788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.630148+0000","last_change":"2023-10-06T05:25:39.645950+0000","last_active":"2023-10-06T05:25:40.630148+0000","last_peered":"2023-10-06T05:25:40.630148+0000","last_clean":"2023-10-06T05:25:40.630148+0000","last_became_active":"2023-10-06T05:25:39.645615+0000","last_became_peered":"2023-10-06T05:25:39.645615+0000","last_unstale":"2023-10-06T05:25:40.630148+0000","last_undegraded":"2023-10-06T05:25:40.630148+0000","last_fullsized":"2023-10-06T05:25:40.630148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:53.879668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.656838+0000","last_change":"2023-10-06T05:25:40.650348+0000","last_active":"2023-10-06T05:25:40.656838+0000","last_peered":"2023-10-06T05:25:40.656838+0000","last_clean":"2023-10-06T05:25:40.656838+0000","last_became_active":"2023-10-06T05:25:40.650054+0000","last_became_peered":"2023-10-06T05:25:40.650054+0000","last_unstale":"2023-10-06T05:25:40.656838+0000","last_undegraded":"2023-10-06T05:25:40.656838+0000","last_fullsized":"2023-10-06T05:25:40.656838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:07.043543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642450+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:25:40.642450+0000","last_peered":"2023-10-06T05:25:40.642450+0000","last_clean":"2023-10-06T05:25:40.642450+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:25:40.642450+0000","last_undegraded":"2023-10-06T05:25:40.642450+0000","last_fullsized":"2023-10-06T05:25:40.642450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.639797+0000","last_change":"2023-10-06T05:25:39.648749+0000","last_active":"2023-10-06T05:25:40.639797+0000","last_peered":"2023-10-06T05:25:40.639797+0000","last_clean":"2023-10-06T05:25:40.639797+0000","last_became_active":"2023-10-06T05:25:39.645268+0000","last_became_peered":"2023-10-06T05:25:39.645268+0000","last_unstale":"2023-10-06T05:25:40.639797+0000","last_undegraded":"2023-10-06T05:25:40.639797+0000","last_fullsized":"2023-10-06T05:25:40.639797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667879+0000","last_change":"2023-10-06T05:25:40.655542+0000","last_active":"2023-10-06T05:25:40.667879+0000","last_peered":"2023-10-06T05:25:40.667879+0000","last_clean":"2023-10-06T05:25:40.667879+0000","last_became_active":"2023-10-06T05:25:40.655243+0000","last_became_peered":"2023-10-06T05:25:40.655243+0000","last_unstale":"2023-10-06T05:25:40.667879+0000","last_undegraded":"2023-10-06T05:25:40.667879+0000","last_fullsized":"2023-10-06T05:25:40.667879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:58.537139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.642698+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:25:40.642698+0000","last_peered":"2023-10-06T05:25:40.642698+0000","last_clean":"2023-10-06T05:25:40.642698+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:25:40.642698+0000","last_undegraded":"2023-10-06T05:25:40.642698+0000","last_fullsized":"2023-10-06T05:25:40.642698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640227+0000","last_change":"2023-10-06T05:25:39.650313+0000","last_active":"2023-10-06T05:25:40.640227+0000","last_peered":"2023-10-06T05:25:40.640227+0000","last_clean":"2023-10-06T05:25:40.640227+0000","last_became_active":"2023-10-06T05:25:39.650004+0000","last_became_peered":"2023-10-06T05:25:39.650004+0000","last_unstale":"2023-10-06T05:25:40.640227+0000","last_undegraded":"2023-10-06T05:25:40.640227+0000","last_fullsized":"2023-10-06T05:25:40.640227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.665445+0000","last_change":"2023-10-06T05:25:40.653499+0000","last_active":"2023-10-06T05:25:40.665445+0000","last_peered":"2023-10-06T05:25:40.665445+0000","last_clean":"2023-10-06T05:25:40.665445+0000","last_became_active":"2023-10-06T05:25:40.652683+0000","last_became_peered":"2023-10-06T05:25:40.652683+0000","last_unstale":"2023-10-06T05:25:40.665445+0000","last_undegraded":"2023-10-06T05:25:40.665445+0000","last_fullsized":"2023-10-06T05:25:40.665445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:00.195806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.634303+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:25:40.634303+0000","last_peered":"2023-10-06T05:25:40.634303+0000","last_clean":"2023-10-06T05:25:40.634303+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:25:40.634303+0000","last_undegraded":"2023-10-06T05:25:40.634303+0000","last_fullsized":"2023-10-06T05:25:40.634303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.645584+0000","last_change":"2023-10-06T05:25:39.653023+0000","last_active":"2023-10-06T05:25:40.645584+0000","last_peered":"2023-10-06T05:25:40.645584+0000","last_clean":"2023-10-06T05:25:40.645584+0000","last_became_active":"2023-10-06T05:25:39.652679+0000","last_became_peered":"2023-10-06T05:25:39.652679+0000","last_unstale":"2023-10-06T05:25:40.645584+0000","last_undegraded":"2023-10-06T05:25:40.645584+0000","last_fullsized":"2023-10-06T05:25:40.645584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.669116+0000","last_change":"2023-10-06T05:25:40.665644+0000","last_active":"2023-10-06T05:25:40.669116+0000","last_peered":"2023-10-06T05:25:40.669116+0000","last_clean":"2023-10-06T05:25:40.669116+0000","last_became_active":"2023-10-06T05:25:40.660838+0000","last_became_peered":"2023-10-06T05:25:40.660838+0000","last_unstale":"2023-10-06T05:25:40.669116+0000","last_undegraded":"2023-10-06T05:25:40.669116+0000","last_fullsized":"2023-10-06T05:25:40.669116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.636749+0000","last_change":"2023-10-06T05:25:39.648631+0000","last_active":"2023-10-06T05:25:40.636749+0000","last_peered":"2023-10-06T05:25:40.636749+0000","last_clean":"2023-10-06T05:25:40.636749+0000","last_became_active":"2023-10-06T05:25:39.648362+0000","last_became_peered":"2023-10-06T05:25:39.648362+0000","last_unstale":"2023-10-06T05:25:40.636749+0000","last_undegraded":"2023-10-06T05:25:40.636749+0000","last_fullsized":"2023-10-06T05:25:40.636749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:53:34.113340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.641183+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:25:40.641183+0000","last_peered":"2023-10-06T05:25:40.641183+0000","last_clean":"2023-10-06T05:25:40.641183+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:25:40.641183+0000","last_undegraded":"2023-10-06T05:25:40.641183+0000","last_fullsized":"2023-10-06T05:25:40.641183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.669146+0000","last_change":"2023-10-06T05:25:40.660343+0000","last_active":"2023-10-06T05:25:40.669146+0000","last_peered":"2023-10-06T05:25:40.669146+0000","last_clean":"2023-10-06T05:25:40.669146+0000","last_became_active":"2023-10-06T05:25:40.652927+0000","last_became_peered":"2023-10-06T05:25:40.652927+0000","last_unstale":"2023-10-06T05:25:40.669146+0000","last_undegraded":"2023-10-06T05:25:40.669146+0000","last_fullsized":"2023-10-06T05:25:40.669146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640731+0000","last_change":"2023-10-06T05:25:39.651074+0000","last_active":"2023-10-06T05:25:40.640731+0000","last_peered":"2023-10-06T05:25:40.640731+0000","last_clean":"2023-10-06T05:25:40.640731+0000","last_became_active":"2023-10-06T05:25:39.650792+0000","last_became_peered":"2023-10-06T05:25:39.650792+0000","last_unstale":"2023-10-06T05:25:40.640731+0000","last_undegraded":"2023-10-06T05:25:40.640731+0000","last_fullsized":"2023-10-06T05:25:40.640731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:36.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.644998+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:25:40.644998+0000","last_peered":"2023-10-06T05:25:40.644998+0000","last_clean":"2023-10-06T05:25:40.644998+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:25:40.644998+0000","last_undegraded":"2023-10-06T05:25:40.644998+0000","last_fullsized":"2023-10-06T05:25:40.644998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.651695+0000","last_change":"2023-10-06T05:25:40.647939+0000","last_active":"2023-10-06T05:25:40.651695+0000","last_peered":"2023-10-06T05:25:40.651695+0000","last_clean":"2023-10-06T05:25:40.651695+0000","last_became_active":"2023-10-06T05:25:40.647637+0000","last_became_peered":"2023-10-06T05:25:40.647637+0000","last_unstale":"2023-10-06T05:25:40.651695+0000","last_undegraded":"2023-10-06T05:25:40.651695+0000","last_fullsized":"2023-10-06T05:25:40.651695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:55.603377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667544+0000","last_change":"2023-10-06T05:25:39.646802+0000","last_active":"2023-10-06T05:25:40.667544+0000","last_peered":"2023-10-06T05:25:40.667544+0000","last_clean":"2023-10-06T05:25:40.667544+0000","last_became_active":"2023-10-06T05:25:39.646464+0000","last_became_peered":"2023-10-06T05:25:39.646464+0000","last_unstale":"2023-10-06T05:25:40.667544+0000","last_undegraded":"2023-10-06T05:25:40.667544+0000","last_fullsized":"2023-10-06T05:25:40.667544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:03.690378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.641083+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:25:40.641083+0000","last_peered":"2023-10-06T05:25:40.641083+0000","last_clean":"2023-10-06T05:25:40.641083+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:25:40.641083+0000","last_undegraded":"2023-10-06T05:25:40.641083+0000","last_fullsized":"2023-10-06T05:25:40.641083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.664530+0000","last_change":"2023-10-06T05:25:40.656613+0000","last_active":"2023-10-06T05:25:40.664530+0000","last_peered":"2023-10-06T05:25:40.664530+0000","last_clean":"2023-10-06T05:25:40.664530+0000","last_became_active":"2023-10-06T05:25:40.656295+0000","last_became_peered":"2023-10-06T05:25:40.656295+0000","last_unstale":"2023-10-06T05:25:40.664530+0000","last_undegraded":"2023-10-06T05:25:40.664530+0000","last_fullsized":"2023-10-06T05:25:40.664530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:13:45.959958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T05:25:42.028118+0000","last_change":"2023-10-06T05:25:39.648524+0000","last_active":"2023-10-06T05:25:42.028118+0000","last_peered":"2023-10-06T05:25:42.028118+0000","last_clean":"2023-10-06T05:25:42.028118+0000","last_became_active":"2023-10-06T05:25:39.648217+0000","last_became_peered":"2023-10-06T05:25:39.648217+0000","last_unstale":"2023-10-06T05:25:42.028118+0000","last_undegraded":"2023-10-06T05:25:42.028118+0000","last_fullsized":"2023-10-06T05:25:42.028118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:12.214301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.632885+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:25:40.632885+0000","last_peered":"2023-10-06T05:25:40.632885+0000","last_clean":"2023-10-06T05:25:40.632885+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:25:40.632885+0000","last_undegraded":"2023-10-06T05:25:40.632885+0000","last_fullsized":"2023-10-06T05:25:40.632885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.653834+0000","last_change":"2023-10-06T05:25:40.646109+0000","last_active":"2023-10-06T05:25:40.653834+0000","last_peered":"2023-10-06T05:25:40.653834+0000","last_clean":"2023-10-06T05:25:40.653834+0000","last_became_active":"2023-10-06T05:25:40.645670+0000","last_became_peered":"2023-10-06T05:25:40.645670+0000","last_unstale":"2023-10-06T05:25:40.653834+0000","last_undegraded":"2023-10-06T05:25:40.653834+0000","last_fullsized":"2023-10-06T05:25:40.653834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.659523+0000","last_change":"2023-10-06T05:25:40.651457+0000","last_active":"2023-10-06T05:25:40.659523+0000","last_peered":"2023-10-06T05:25:40.659523+0000","last_clean":"2023-10-06T05:25:40.659523+0000","last_became_active":"2023-10-06T05:25:40.651136+0000","last_became_peered":"2023-10-06T05:25:40.651136+0000","last_unstale":"2023-10-06T05:25:40.659523+0000","last_undegraded":"2023-10-06T05:25:40.659523+0000","last_fullsized":"2023-10-06T05:25:40.659523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:15.771362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.671043+0000","last_change":"2023-10-06T05:25:39.642604+0000","last_active":"2023-10-06T05:25:40.671043+0000","last_peered":"2023-10-06T05:25:40.671043+0000","last_clean":"2023-10-06T05:25:40.671043+0000","last_became_active":"2023-10-06T05:25:39.642261+0000","last_became_peered":"2023-10-06T05:25:39.642261+0000","last_unstale":"2023-10-06T05:25:40.671043+0000","last_undegraded":"2023-10-06T05:25:40.671043+0000","last_fullsized":"2023-10-06T05:25:40.671043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:40.419929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668144+0000","last_change":"2023-10-06T05:25:40.658190+0000","last_active":"2023-10-06T05:25:40.668144+0000","last_peered":"2023-10-06T05:25:40.668144+0000","last_clean":"2023-10-06T05:25:40.668144+0000","last_became_active":"2023-10-06T05:25:40.652990+0000","last_became_peered":"2023-10-06T05:25:40.652990+0000","last_unstale":"2023-10-06T05:25:40.668144+0000","last_undegraded":"2023-10-06T05:25:40.668144+0000","last_fullsized":"2023-10-06T05:25:40.668144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:08.157544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667893+0000","last_change":"2023-10-06T05:25:39.648924+0000","last_active":"2023-10-06T05:25:40.667893+0000","last_peered":"2023-10-06T05:25:40.667893+0000","last_clean":"2023-10-06T05:25:40.667893+0000","last_became_active":"2023-10-06T05:25:39.648562+0000","last_became_peered":"2023-10-06T05:25:39.648562+0000","last_unstale":"2023-10-06T05:25:40.667893+0000","last_undegraded":"2023-10-06T05:25:40.667893+0000","last_fullsized":"2023-10-06T05:25:40.667893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:06.039061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.633764+0000","last_change":"2023-10-06T05:25:39.639616+0000","last_active":"2023-10-06T05:25:40.633764+0000","last_peered":"2023-10-06T05:25:40.633764+0000","last_clean":"2023-10-06T05:25:40.633764+0000","last_became_active":"2023-10-06T05:25:39.639332+0000","last_became_peered":"2023-10-06T05:25:39.639332+0000","last_unstale":"2023-10-06T05:25:40.633764+0000","last_undegraded":"2023-10-06T05:25:40.633764+0000","last_fullsized":"2023-10-06T05:25:40.633764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:32.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662281+0000","last_change":"2023-10-06T05:25:40.655147+0000","last_active":"2023-10-06T05:25:40.662281+0000","last_peered":"2023-10-06T05:25:40.662281+0000","last_clean":"2023-10-06T05:25:40.662281+0000","last_became_active":"2023-10-06T05:25:40.654858+0000","last_became_peered":"2023-10-06T05:25:40.654858+0000","last_unstale":"2023-10-06T05:25:40.662281+0000","last_undegraded":"2023-10-06T05:25:40.662281+0000","last_fullsized":"2023-10-06T05:25:40.662281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:12.635712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.640870+0000","last_change":"2023-10-06T05:25:39.644781+0000","last_active":"2023-10-06T05:25:40.640870+0000","last_peered":"2023-10-06T05:25:40.640870+0000","last_clean":"2023-10-06T05:25:40.640870+0000","last_became_active":"2023-10-06T05:25:39.643752+0000","last_became_peered":"2023-10-06T05:25:39.643752+0000","last_unstale":"2023-10-06T05:25:40.640870+0000","last_undegraded":"2023-10-06T05:25:40.640870+0000","last_fullsized":"2023-10-06T05:25:40.640870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:58.619912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.652623+0000","last_change":"2023-10-06T05:25:40.646184+0000","last_active":"2023-10-06T05:25:40.652623+0000","last_peered":"2023-10-06T05:25:40.652623+0000","last_clean":"2023-10-06T05:25:40.652623+0000","last_became_active":"2023-10-06T05:25:40.645885+0000","last_became_peered":"2023-10-06T05:25:40.645885+0000","last_unstale":"2023-10-06T05:25:40.652623+0000","last_undegraded":"2023-10-06T05:25:40.652623+0000","last_fullsized":"2023-10-06T05:25:40.652623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:15.355580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.652805+0000","last_change":"2023-10-06T05:25:40.645235+0000","last_active":"2023-10-06T05:25:40.652805+0000","last_peered":"2023-10-06T05:25:40.652805+0000","last_clean":"2023-10-06T05:25:40.652805+0000","last_became_active":"2023-10-06T05:25:40.644011+0000","last_became_peered":"2023-10-06T05:25:40.644011+0000","last_unstale":"2023-10-06T05:25:40.652805+0000","last_undegraded":"2023-10-06T05:25:40.652805+0000","last_fullsized":"2023-10-06T05:25:40.652805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:53:35.117823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.633175+0000","last_change":"2023-10-06T05:25:39.653597+0000","last_active":"2023-10-06T05:25:40.633175+0000","last_peered":"2023-10-06T05:25:40.633175+0000","last_clean":"2023-10-06T05:25:40.633175+0000","last_became_active":"2023-10-06T05:25:39.653182+0000","last_became_peered":"2023-10-06T05:25:39.653182+0000","last_unstale":"2023-10-06T05:25:40.633175+0000","last_undegraded":"2023-10-06T05:25:40.633175+0000","last_fullsized":"2023-10-06T05:25:40.633175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:27.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668115+0000","last_change":"2023-10-06T05:25:40.656142+0000","last_active":"2023-10-06T05:25:40.668115+0000","last_peered":"2023-10-06T05:25:40.668115+0000","last_clean":"2023-10-06T05:25:40.668115+0000","last_became_active":"2023-10-06T05:25:40.655855+0000","last_became_peered":"2023-10-06T05:25:40.655855+0000","last_unstale":"2023-10-06T05:25:40.668115+0000","last_undegraded":"2023-10-06T05:25:40.668115+0000","last_fullsized":"2023-10-06T05:25:40.668115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.639959+0000","last_change":"2023-10-06T05:25:39.647617+0000","last_active":"2023-10-06T05:25:40.639959+0000","last_peered":"2023-10-06T05:25:40.639959+0000","last_clean":"2023-10-06T05:25:40.639959+0000","last_became_active":"2023-10-06T05:25:39.647339+0000","last_became_peered":"2023-10-06T05:25:39.647339+0000","last_unstale":"2023-10-06T05:25:40.639959+0000","last_undegraded":"2023-10-06T05:25:40.639959+0000","last_fullsized":"2023-10-06T05:25:40.639959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662166+0000","last_change":"2023-10-06T05:25:40.654281+0000","last_active":"2023-10-06T05:25:40.662166+0000","last_peered":"2023-10-06T05:25:40.662166+0000","last_clean":"2023-10-06T05:25:40.662166+0000","last_became_active":"2023-10-06T05:25:40.653887+0000","last_became_peered":"2023-10-06T05:25:40.653887+0000","last_unstale":"2023-10-06T05:25:40.662166+0000","last_undegraded":"2023-10-06T05:25:40.662166+0000","last_fullsized":"2023-10-06T05:25:40.662166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:02.429685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.670357+0000","last_change":"2023-10-06T05:25:39.650088+0000","last_active":"2023-10-06T05:25:40.670357+0000","last_peered":"2023-10-06T05:25:40.670357+0000","last_clean":"2023-10-06T05:25:40.670357+0000","last_became_active":"2023-10-06T05:25:39.649849+0000","last_became_peered":"2023-10-06T05:25:39.649849+0000","last_unstale":"2023-10-06T05:25:40.670357+0000","last_undegraded":"2023-10-06T05:25:40.670357+0000","last_fullsized":"2023-10-06T05:25:40.670357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:12.214301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.663216+0000","last_change":"2023-10-06T05:25:40.656643+0000","last_active":"2023-10-06T05:25:40.663216+0000","last_peered":"2023-10-06T05:25:40.663216+0000","last_clean":"2023-10-06T05:25:40.663216+0000","last_became_active":"2023-10-06T05:25:40.656184+0000","last_became_peered":"2023-10-06T05:25:40.656184+0000","last_unstale":"2023-10-06T05:25:40.663216+0000","last_undegraded":"2023-10-06T05:25:40.663216+0000","last_fullsized":"2023-10-06T05:25:40.663216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:28.259232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668354+0000","last_change":"2023-10-06T05:25:39.650188+0000","last_active":"2023-10-06T05:25:40.668354+0000","last_peered":"2023-10-06T05:25:40.668354+0000","last_clean":"2023-10-06T05:25:40.668354+0000","last_became_active":"2023-10-06T05:25:39.649862+0000","last_became_peered":"2023-10-06T05:25:39.649862+0000","last_unstale":"2023-10-06T05:25:40.668354+0000","last_undegraded":"2023-10-06T05:25:40.668354+0000","last_fullsized":"2023-10-06T05:25:40.668354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:36.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667272+0000","last_change":"2023-10-06T05:25:40.664421+0000","last_active":"2023-10-06T05:25:40.667272+0000","last_peered":"2023-10-06T05:25:40.667272+0000","last_clean":"2023-10-06T05:25:40.667272+0000","last_became_active":"2023-10-06T05:25:40.664125+0000","last_became_peered":"2023-10-06T05:25:40.664125+0000","last_unstale":"2023-10-06T05:25:40.667272+0000","last_undegraded":"2023-10-06T05:25:40.667272+0000","last_fullsized":"2023-10-06T05:25:40.667272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:28.190832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667628+0000","last_change":"2023-10-06T05:25:39.646681+0000","last_active":"2023-10-06T05:25:40.667628+0000","last_peered":"2023-10-06T05:25:40.667628+0000","last_clean":"2023-10-06T05:25:40.667628+0000","last_became_active":"2023-10-06T05:25:39.646351+0000","last_became_peered":"2023-10-06T05:25:39.646351+0000","last_unstale":"2023-10-06T05:25:40.667628+0000","last_undegraded":"2023-10-06T05:25:40.667628+0000","last_fullsized":"2023-10-06T05:25:40.667628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:27.254750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.662786+0000","last_change":"2023-10-06T05:25:40.658180+0000","last_active":"2023-10-06T05:25:40.662786+0000","last_peered":"2023-10-06T05:25:40.662786+0000","last_clean":"2023-10-06T05:25:40.662786+0000","last_became_active":"2023-10-06T05:25:40.657860+0000","last_became_peered":"2023-10-06T05:25:40.657860+0000","last_unstale":"2023-10-06T05:25:40.662786+0000","last_undegraded":"2023-10-06T05:25:40.662786+0000","last_fullsized":"2023-10-06T05:25:40.662786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:16.418406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.667622+0000","last_change":"2023-10-06T05:25:39.645234+0000","last_active":"2023-10-06T05:25:40.667622+0000","last_peered":"2023-10-06T05:25:40.667622+0000","last_clean":"2023-10-06T05:25:40.667622+0000","last_became_active":"2023-10-06T05:25:39.644921+0000","last_became_peered":"2023-10-06T05:25:39.644921+0000","last_unstale":"2023-10-06T05:25:40.667622+0000","last_undegraded":"2023-10-06T05:25:40.667622+0000","last_fullsized":"2023-10-06T05:25:40.667622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:16.977910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.651655+0000","last_change":"2023-10-06T05:25:40.647515+0000","last_active":"2023-10-06T05:25:40.651655+0000","last_peered":"2023-10-06T05:25:40.651655+0000","last_clean":"2023-10-06T05:25:40.651655+0000","last_became_active":"2023-10-06T05:25:40.647229+0000","last_became_peered":"2023-10-06T05:25:40.647229+0000","last_unstale":"2023-10-06T05:25:40.651655+0000","last_undegraded":"2023-10-06T05:25:40.651655+0000","last_fullsized":"2023-10-06T05:25:40.651655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.666635+0000","last_change":"2023-10-06T05:25:39.646056+0000","last_active":"2023-10-06T05:25:40.666635+0000","last_peered":"2023-10-06T05:25:40.666635+0000","last_clean":"2023-10-06T05:25:40.666635+0000","last_became_active":"2023-10-06T05:25:39.645679+0000","last_became_peered":"2023-10-06T05:25:39.645679+0000","last_unstale":"2023-10-06T05:25:40.666635+0000","last_undegraded":"2023-10-06T05:25:40.666635+0000","last_fullsized":"2023-10-06T05:25:40.666635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:36.644695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.657934+0000","last_change":"2023-10-06T05:25:40.649520+0000","last_active":"2023-10-06T05:25:40.657934+0000","last_peered":"2023-10-06T05:25:40.657934+0000","last_clean":"2023-10-06T05:25:40.657934+0000","last_became_active":"2023-10-06T05:25:40.649109+0000","last_became_peered":"2023-10-06T05:25:40.649109+0000","last_unstale":"2023-10-06T05:25:40.657934+0000","last_undegraded":"2023-10-06T05:25:40.657934+0000","last_fullsized":"2023-10-06T05:25:40.657934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:39.609014+0000","last_clean_scrub_stamp":"2023-10-06T05:25:39.609014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:08.074276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T05:25:40.668977+0000","last_change":"2023-10-06T05:25:39.652715+0000","last_active":"2023-10-06T05:25:40.668977+0000","last_peered":"2023-10-06T05:25:40.668977+0000","last_clean":"2023-10-06T05:25:40.668977+0000","last_became_active":"2023-10-06T05:25:39.652403+0000","last_became_peered":"2023-10-06T05:25:39.652403+0000","last_unstale":"2023-10-06T05:25:40.668977+0000","last_undegraded":"2023-10-06T05:25:40.668977+0000","last_fullsized":"2023-10-06T05:25:40.668977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:38.604532+0000","last_clean_scrub_stamp":"2023-10-06T05:25:38.604532+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:32.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301636,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070204,"statfs":{"total":96636764160,"available":96327888896,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301632,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070208,"statfs":{"total":96636764160,"available":96327892992,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301632,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070208,"statfs":{"total":96636764160,"available":96327892992,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302216,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069624,"statfs":{"total":96636764160,"available":96327294976,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:25:48.984 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T05:25:48.984 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T05:25:48.985 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T05:25:48.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T05:25:49.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.081+0000 7fd36cb37700 1 Processor -- start 2023-10-06T05:25:49.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.081+0000 7fd36cb37700 1 -- start start 2023-10-06T05:25:49.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.081+0000 7fd36cb37700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd368159140 0x7fd36806a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.081+0000 7fd36cb37700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3680ae870 con 0x7fd368159620 2023-10-06T05:25:49.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.081+0000 7fd36cb37700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3680caec0 con 0x7fd368158d70 2023-10-06T05:25:49.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.081+0000 7fd36cb37700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3680c6df0 con 0x7fd368159140 2023-10-06T05:25:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.081+0000 7fd367fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd368159620 0x7fd3680cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50648/0 (socket says 172.21.15.29:50648) 2023-10-06T05:25:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.081+0000 7fd367fff700 1 -- 172.21.15.29:0/1012882812 learned_addr learned my addr 172.21.15.29:0/1012882812 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.081+0000 7fd366ffd700 1 --2- 172.21.15.29:0/1012882812 >> v2:172.21.15.29:3300/0 conn(0x7fd368159140 0x7fd36806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd3667fc700 1 -- 172.21.15.29:0/1012882812 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962829190 0 0) 0x7fd3680ae870 con 0x7fd368159620 2023-10-06T05:25:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd3667fc700 1 -- 172.21.15.29:0/1012882812 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd354003570 con 0x7fd368159620 2023-10-06T05:25:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd366ffd700 1 -- 172.21.15.29:0/1012882812 >> v1:172.21.15.173:6789/0 conn(0x7fd368158d70 legacy=0x7fd3680c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd366ffd700 1 -- 172.21.15.29:0/1012882812 >> v1:172.21.15.29:6789/0 conn(0x7fd368159620 legacy=0x7fd3680cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd366ffd700 1 -- 172.21.15.29:0/1012882812 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36806b2a0 con 0x7fd368159140 2023-10-06T05:25:49.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd366ffd700 1 --2- 172.21.15.29:0/1012882812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368159140 0x7fd36806a300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd3500098e0 tx=0x7fd3500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7f1f1f67ace209 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:49.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd3667fc700 1 -- 172.21.15.29:0/1012882812 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000b640 con 0x7fd368159140 2023-10-06T05:25:49.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd3667fc700 1 -- 172.21.15.29:0/1012882812 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35000b7a0 con 0x7fd368159140 2023-10-06T05:25:49.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd3667fc700 1 -- 172.21.15.29:0/1012882812 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000bb40 con 0x7fd368159140 2023-10-06T05:25:49.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd36cb37700 1 -- 172.21.15.29:0/1012882812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368159140 msgr2=0x7fd36806a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd36cb37700 1 --2- 172.21.15.29:0/1012882812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368159140 0x7fd36806a300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd3500098e0 tx=0x7fd3500091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd36cb37700 1 -- 172.21.15.29:0/1012882812 shutdown_connections 2023-10-06T05:25:49.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd36cb37700 1 --2- 172.21.15.29:0/1012882812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368159140 0x7fd36806a300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd36cb37700 1 -- 172.21.15.29:0/1012882812 >> 172.21.15.29:0/1012882812 conn(0x7fd3680670a0 msgr2=0x7fd3680674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd36cb37700 1 -- 172.21.15.29:0/1012882812 shutdown_connections 2023-10-06T05:25:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd36cb37700 1 -- 172.21.15.29:0/1012882812 wait complete. 2023-10-06T05:25:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd36cb37700 1 Processor -- start 2023-10-06T05:25:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.085+0000 7fd36cb37700 1 -- start start 2023-10-06T05:25:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd36cb37700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368158d70 0x7fd368151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd36cb37700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd368159140 0x7fd36813a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd36cb37700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd368159620 0x7fd3681535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd36cb37700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd368152270 con 0x7fd368158d70 2023-10-06T05:25:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd36cb37700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd368151f90 con 0x7fd368159620 2023-10-06T05:25:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd36cb37700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36814cb30 con 0x7fd368159140 2023-10-06T05:25:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd3677fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368158d70 0x7fd368151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd3677fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368158d70 0x7fd368151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51586/0 (socket says 172.21.15.29:51586) 2023-10-06T05:25:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd3677fe700 1 -- 172.21.15.29:0/1469312778 learned_addr learned my addr 172.21.15.29:0/1469312778 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd367fff700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd368159620 0x7fd3681535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd366ffd700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd368159140 0x7fd36813a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd3677fe700 1 -- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd368159140 msgr2=0x7fd36813a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd3677fe700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd368159140 0x7fd36813a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd3677fe700 1 -- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd368159620 msgr2=0x7fd3681535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd3677fe700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd368159620 0x7fd3681535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd3677fe700 1 -- 172.21.15.29:0/1469312778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350009420 con 0x7fd368158d70 2023-10-06T05:25:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd3677fe700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368158d70 0x7fd368151740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c590 tx=0x7fd35800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd35f7fe700 1 -- 172.21.15.29:0/1469312778 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358011590 con 0x7fd368158d70 2023-10-06T05:25:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd35f7fe700 1 -- 172.21.15.29:0/1469312778 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3580116f0 con 0x7fd368158d70 2023-10-06T05:25:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36814ce10 con 0x7fd368158d70 2023-10-06T05:25:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd35f7fe700 1 -- 172.21.15.29:0/1469312778 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358011ab0 con 0x7fd368158d70 2023-10-06T05:25:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd368151c80 con 0x7fd368158d70 2023-10-06T05:25:49.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.089+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36814c990 con 0x7fd368158d70 2023-10-06T05:25:49.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.093+0000 7fd35f7fe700 1 -- 172.21.15.29:0/1469312778 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd35801b3b0 con 0x7fd368158d70 2023-10-06T05:25:49.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.093+0000 7fd35f7fe700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd348060550 0x7fd348062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.093+0000 7fd35f7fe700 1 -- 172.21.15.29:0/1469312778 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd35807bf80 con 0x7fd368158d70 2023-10-06T05:25:49.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.093+0000 7fd366ffd700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd348060550 0x7fd348062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.093+0000 7fd366ffd700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd348060550 0x7fd348062a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3500093f0 tx=0x7fd350017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:49.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.101+0000 7fd35f7fe700 1 -- 172.21.15.29:0/1469312778 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd36814c990 con 0x7fd368158d70 2023-10-06T05:25:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd36814c990 con 0x7fd368158d70 2023-10-06T05:25:49.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd35f7fe700 1 -- 172.21.15.29:0/1469312778 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd36814c990 con 0x7fd368158d70 2023-10-06T05:25:49.294 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:49.294 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T05:25:49.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd348060550 msgr2=0x7fd348062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd348060550 0x7fd348062a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3500093f0 tx=0x7fd350017000 comp rx=0 tx=0).stop 2023-10-06T05:25:49.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368158d70 msgr2=0x7fd368151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368158d70 0x7fd368151740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c590 tx=0x7fd35800c950 comp rx=0 tx=0).stop 2023-10-06T05:25:49.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 shutdown_connections 2023-10-06T05:25:49.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd348060550 0x7fd348062a00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd368159620 0x7fd3681535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd368159140 0x7fd36813a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.289+0000 7fd36cb37700 1 --2- 172.21.15.29:0/1469312778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368158d70 0x7fd368151740 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.293+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 >> 172.21.15.29:0/1469312778 conn(0x7fd3680670a0 msgr2=0x7fd3680c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:49.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.293+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 shutdown_connections 2023-10-06T05:25:49.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.293+0000 7fd36cb37700 1 -- 172.21.15.29:0/1469312778 wait complete. 2023-10-06T05:25:49.307 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T05:25:49.307 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.405+0000 7ff9c2236700 1 Processor -- start 2023-10-06T05:25:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.405+0000 7ff9c2236700 1 -- start start 2023-10-06T05:25:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff9bc0b0de0 0x7ff9bc0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff9bc0cc460 0x7ff9bc06ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc06a970 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc06f6e0 con 0x7ff9bc0cc460 2023-10-06T05:25:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc06ee70 con 0x7ff9bc0b0de0 2023-10-06T05:25:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9baffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff9bc06e9f0 0x7ff9bc0ca070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50652/0 (socket says 172.21.15.29:50652) 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9baffd700 1 -- 172.21.15.29:0/1468633677 learned_addr learned my addr 172.21.15.29:0/1468633677 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9bbfff700 1 --2- 172.21.15.29:0/1468633677 >> v2:172.21.15.29:3300/0 conn(0x7ff9bc0cc460 0x7ff9bc06ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9bb7fe700 1 --2- 172.21.15.29:0/1468633677 >> v2:172.21.15.173:3300/0 conn(0x7ff9bc0b0de0 0x7ff9bc0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9ba7fc700 1 -- 172.21.15.29:0/1468633677 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503906826 0 0) 0x7ff9bc06a970 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9ba7fc700 1 -- 172.21.15.29:0/1468633677 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a8003570 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9bbfff700 1 -- 172.21.15.29:0/1468633677 >> v2:172.21.15.173:3300/0 conn(0x7ff9bc0b0de0 msgr2=0x7ff9bc0b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9bbfff700 1 --2- 172.21.15.29:0/1468633677 >> v2:172.21.15.173:3300/0 conn(0x7ff9bc0b0de0 0x7ff9bc0b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9bbfff700 1 -- 172.21.15.29:0/1468633677 >> v1:172.21.15.29:6789/0 conn(0x7ff9bc06e9f0 legacy=0x7ff9bc0ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9bbfff700 1 -- 172.21.15.29:0/1468633677 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc06f120 con 0x7ff9bc0cc460 2023-10-06T05:25:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9bbfff700 1 --2- 172.21.15.29:0/1468633677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc0cc460 0x7ff9bc06ae00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06d6a0 tx=0x7ff9b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d37719191398e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9ba7fc700 1 -- 172.21.15.29:0/1468633677 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400e070 con 0x7ff9bc0cc460 2023-10-06T05:25:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9ba7fc700 1 -- 172.21.15.29:0/1468633677 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b400bab0 con 0x7ff9bc0cc460 2023-10-06T05:25:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9ba7fc700 1 -- 172.21.15.29:0/1468633677 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400be30 con 0x7ff9bc0cc460 2023-10-06T05:25:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 -- 172.21.15.29:0/1468633677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc0cc460 msgr2=0x7ff9bc06ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 --2- 172.21.15.29:0/1468633677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc0cc460 0x7ff9bc06ae00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06d6a0 tx=0x7ff9b4009780 comp rx=0 tx=0).stop 2023-10-06T05:25:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 -- 172.21.15.29:0/1468633677 shutdown_connections 2023-10-06T05:25:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 --2- 172.21.15.29:0/1468633677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc0cc460 0x7ff9bc06ae00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 --2- 172.21.15.29:0/1468633677 >> v2:172.21.15.173:3300/0 conn(0x7ff9bc0b0de0 0x7ff9bc0b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 -- 172.21.15.29:0/1468633677 >> 172.21.15.29:0/1468633677 conn(0x7ff9bc067b70 msgr2=0x7ff9bc06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 -- 172.21.15.29:0/1468633677 shutdown_connections 2023-10-06T05:25:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.409+0000 7ff9c2236700 1 -- 172.21.15.29:0/1468633677 wait complete. 2023-10-06T05:25:49.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9c2236700 1 Processor -- start 2023-10-06T05:25:49.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9c2236700 1 -- start start 2023-10-06T05:25:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9c2236700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc06e9f0 0x7ff9bc14a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9c2236700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9bc0b0de0 0x7ff9bc146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9c2236700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9bc0cc460 0x7ff9bc147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9c2236700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc14a9c0 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9c2236700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0ac350 con 0x7ff9bc0cc460 2023-10-06T05:25:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9c2236700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0ac630 con 0x7ff9bc0b0de0 2023-10-06T05:25:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9bb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc06e9f0 0x7ff9bc14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9bb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc06e9f0 0x7ff9bc14a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51604/0 (socket says 172.21.15.29:51604) 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.413+0000 7ff9bb7fe700 1 -- 172.21.15.29:0/2924833072 learned_addr learned my addr 172.21.15.29:0/2924833072 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9baffd700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9bc0b0de0 0x7ff9bc146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9bbfff700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9bc0cc460 0x7ff9bc147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9bb7fe700 1 -- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9bc0b0de0 msgr2=0x7ff9bc146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9bb7fe700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9bc0b0de0 0x7ff9bc146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9bb7fe700 1 -- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9bc0cc460 msgr2=0x7ff9bc147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9bb7fe700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9bc0cc460 0x7ff9bc147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9bb7fe700 1 -- 172.21.15.29:0/2924833072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b4009a20 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9bb7fe700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc06e9f0 0x7ff9bc14a480 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00ecb0 tx=0x7ff9ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9b37fe700 1 -- 172.21.15.29:0/2924833072 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00c9d0 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9b37fe700 1 -- 172.21.15.29:0/2924833072 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac00cb30 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc1469b0 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9b37fe700 1 -- 172.21.15.29:0/2924833072 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00ced0 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc1490e0 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc04be00 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.417+0000 7ff9b37fe700 1 -- 172.21.15.29:0/2924833072 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff9ac013680 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.421+0000 7ff9b37fe700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff99c060550 0x7ff99c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.421+0000 7ff9b37fe700 1 -- 172.21.15.29:0/2924833072 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff9ac07cc70 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.421+0000 7ff9baffd700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff99c060550 0x7ff99c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.421+0000 7ff9baffd700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff99c060550 0x7ff99c062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc14e100 tx=0x7ff9a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:49.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.425+0000 7ff9b37fe700 1 -- 172.21.15.29:0/2924833072 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff9ac04d100 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.589+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9bc06f400 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9b37fe700 1 -- 172.21.15.29:0/2924833072 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7ff9ac050720 con 0x7ff9bc06e9f0 2023-10-06T05:25:49.597 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:49.597 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff99c060550 msgr2=0x7ff99c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff99c060550 0x7ff99c062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc14e100 tx=0x7ff9a4009040 comp rx=0 tx=0).stop 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc06e9f0 msgr2=0x7ff9bc14a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc06e9f0 0x7ff9bc14a480 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00ecb0 tx=0x7ff9ac0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 shutdown_connections 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff99c060550 0x7ff99c062a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9bc0cc460 0x7ff9bc147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9bc0b0de0 0x7ff9bc146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 --2- 172.21.15.29:0/2924833072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9bc06e9f0 0x7ff9bc14a480 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 >> 172.21.15.29:0/2924833072 conn(0x7ff9bc067b70 msgr2=0x7ff9bc0aa740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:49.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 shutdown_connections 2023-10-06T05:25:49.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.593+0000 7ff9c2236700 1 -- 172.21.15.29:0/2924833072 wait complete. 2023-10-06T05:25:49.611 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:25:38.347316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:25:38.976583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:25:49.612 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:25:49.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e215b2700 1 Processor -- start 2023-10-06T05:25:49.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e215b2700 1 -- start start 2023-10-06T05:25:49.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e215b2700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e1c15d730 0x7f2e1c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e215b2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2e1c06cc00 0x7f2e1c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e215b2700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c06d040 con 0x7f2e1c158f10 2023-10-06T05:25:49.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e215b2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c06a600 con 0x7f2e1c06cc00 2023-10-06T05:25:49.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e215b2700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c0cacd0 con 0x7f2e1c15d730 2023-10-06T05:25:49.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e20db1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2e1c06cc00 0x7f2e1c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e20db1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2e1c06cc00 0x7f2e1c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51618/0 (socket says 172.21.15.29:51618) 2023-10-06T05:25:49.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e20db1700 1 -- 172.21.15.29:0/303267010 learned_addr learned my addr 172.21.15.29:0/303267010 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:49.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.721+0000 7f2e13fff700 1 --2- 172.21.15.29:0/303267010 >> v2:172.21.15.173:3300/0 conn(0x7f2e1c15d730 0x7f2e1c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e20db1700 1 -- 172.21.15.29:0/303267010 >> v2:172.21.15.173:3300/0 conn(0x7f2e1c15d730 msgr2=0x7f2e1c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:49.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e20db1700 1 --2- 172.21.15.29:0/303267010 >> v2:172.21.15.173:3300/0 conn(0x7f2e1c15d730 0x7f2e1c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e20db1700 1 -- 172.21.15.29:0/303267010 >> v1:172.21.15.173:6789/0 conn(0x7f2e1c158f10 legacy=0x7f2e1c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e20db1700 1 -- 172.21.15.29:0/303267010 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0cafb0 con 0x7f2e1c06cc00 2023-10-06T05:25:49.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e20db1700 1 --2- 172.21.15.29:0/303267010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c06cc00 0x7f2e1c06aa50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0c3600 tx=0x7f2e14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ee14932b59c549 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:49.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e1b7fe700 1 -- 172.21.15.29:0/303267010 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400e070 con 0x7f2e1c06cc00 2023-10-06T05:25:49.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e1b7fe700 1 -- 172.21.15.29:0/303267010 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1400ba20 con 0x7f2e1c06cc00 2023-10-06T05:25:49.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e1b7fe700 1 -- 172.21.15.29:0/303267010 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140092e0 con 0x7f2e1c06cc00 2023-10-06T05:25:49.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e215b2700 1 -- 172.21.15.29:0/303267010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c06cc00 msgr2=0x7f2e1c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e215b2700 1 --2- 172.21.15.29:0/303267010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c06cc00 0x7f2e1c06aa50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0c3600 tx=0x7f2e14009840 comp rx=0 tx=0).stop 2023-10-06T05:25:49.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e215b2700 1 -- 172.21.15.29:0/303267010 shutdown_connections 2023-10-06T05:25:49.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e215b2700 1 --2- 172.21.15.29:0/303267010 >> v2:172.21.15.173:3300/0 conn(0x7f2e1c15d730 0x7f2e1c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e215b2700 1 --2- 172.21.15.29:0/303267010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c06cc00 0x7f2e1c06aa50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e215b2700 1 -- 172.21.15.29:0/303267010 >> 172.21.15.29:0/303267010 conn(0x7f2e1c062b60 msgr2=0x7f2e1c062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:49.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e215b2700 1 -- 172.21.15.29:0/303267010 shutdown_connections 2023-10-06T05:25:49.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.725+0000 7f2e215b2700 1 -- 172.21.15.29:0/303267010 wait complete. 2023-10-06T05:25:49.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 Processor -- start 2023-10-06T05:25:49.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 -- start start 2023-10-06T05:25:49.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e1c06cc00 0x7f2e1c0c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c158f10 0x7f2e1c156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c15d730 0x7f2e1c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0b5120 con 0x7f2e1c158f10 2023-10-06T05:25:49.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c157340 con 0x7f2e1c15d730 2023-10-06T05:25:49.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0b5af0 con 0x7f2e1c06cc00 2023-10-06T05:25:49.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e13fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c158f10 0x7f2e1c156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e13fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c158f10 0x7f2e1c156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51632/0 (socket says 172.21.15.29:51632) 2023-10-06T05:25:49.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e13fff700 1 -- 172.21.15.29:0/3558825746 learned_addr learned my addr 172.21.15.29:0/3558825746 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:49.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e1bfff700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e1c06cc00 0x7f2e1c0c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e20db1700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c15d730 0x7f2e1c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e13fff700 1 -- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e1c06cc00 msgr2=0x7f2e1c0c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e13fff700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e1c06cc00 0x7f2e1c0c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e13fff700 1 -- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c15d730 msgr2=0x7f2e1c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e13fff700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c15d730 0x7f2e1c0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e13fff700 1 -- 172.21.15.29:0/3558825746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e14009ae0 con 0x7f2e1c158f10 2023-10-06T05:25:49.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e13fff700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c158f10 0x7f2e1c156e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400ecb0 tx=0x7f2e040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:49.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e18ff9700 1 -- 172.21.15.29:0/3558825746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400c850 con 0x7f2e1c158f10 2023-10-06T05:25:49.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e18ff9700 1 -- 172.21.15.29:0/3558825746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0400c9b0 con 0x7f2e1c158f10 2023-10-06T05:25:49.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c0b4510 con 0x7f2e1c158f10 2023-10-06T05:25:49.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e18ff9700 1 -- 172.21.15.29:0/3558825746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400cd50 con 0x7f2e1c158f10 2023-10-06T05:25:49.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.729+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c0b4ad0 con 0x7f2e1c158f10 2023-10-06T05:25:49.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.733+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1c04be00 con 0x7f2e1c158f10 2023-10-06T05:25:49.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.733+0000 7f2e18ff9700 1 -- 172.21.15.29:0/3558825746 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2e04013680 con 0x7f2e1c158f10 2023-10-06T05:25:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.733+0000 7f2e18ff9700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2dfc060550 0x7f2dfc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.733+0000 7f2e18ff9700 1 -- 172.21.15.29:0/3558825746 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e0407cb00 con 0x7f2e1c158f10 2023-10-06T05:25:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.733+0000 7f2e1bfff700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2dfc060550 0x7f2dfc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:49.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.737+0000 7f2e1bfff700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2dfc060550 0x7f2dfc062a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0c63f0 tx=0x7f2e0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:49.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.741+0000 7f2e18ff9700 1 -- 172.21.15.29:0/3558825746 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2e0404cf90 con 0x7f2e1c158f10 2023-10-06T05:25:49.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.893+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e1c0aeaf0 con 0x7f2e1c158f10 2023-10-06T05:25:49.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.893+0000 7f2e18ff9700 1 -- 172.21.15.29:0/3558825746 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e040505b0 con 0x7f2e1c158f10 2023-10-06T05:25:49.900 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:25:49.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2dfc060550 msgr2=0x7f2dfc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2dfc060550 0x7f2dfc062a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0c63f0 tx=0x7f2e0c009040 comp rx=0 tx=0).stop 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c158f10 msgr2=0x7f2e1c156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c158f10 0x7f2e1c156e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400ecb0 tx=0x7f2e040091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 shutdown_connections 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2dfc060550 0x7f2dfc062a00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c15d730 0x7f2e1c0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e1c158f10 0x7f2e1c156e00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 --2- 172.21.15.29:0/3558825746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e1c06cc00 0x7f2e1c0c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 >> 172.21.15.29:0/3558825746 conn(0x7f2e1c062b60 msgr2=0x7f2e1c158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 shutdown_connections 2023-10-06T05:25:49.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:49.897+0000 7f2e215b2700 1 -- 172.21.15.29:0/3558825746 wait complete. 2023-10-06T05:25:49.915 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:25:50.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.021+0000 7f962dce3700 1 Processor -- start 2023-10-06T05:25:50.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.021+0000 7f962dce3700 1 -- start start 2023-10-06T05:25:50.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9628155bf0 0x7f96280c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f96280cb6a0 0x7f96280cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 0x7f9628156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962806c6c0 con 0x7f9628155bf0 2023-10-06T05:25:50.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96280cc060 con 0x7f96280cb6a0 2023-10-06T05:25:50.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9628156960 con 0x7f9628155fc0 2023-10-06T05:25:50.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96277fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9628155bf0 0x7f96280c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96277fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9628155bf0 0x7f96280c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51636/0 (socket says 172.21.15.29:51636) 2023-10-06T05:25:50.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96277fe700 1 -- 172.21.15.29:0/1278480026 learned_addr learned my addr 172.21.15.29:0/1278480026 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:50.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f9627fff700 1 --2- 172.21.15.29:0/1278480026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 0x7f9628156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f9626ffd700 1 --2- 172.21.15.29:0/1278480026 >> v2:172.21.15.173:3300/0 conn(0x7f96280cb6a0 0x7f96280cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96277fe700 1 -- 172.21.15.29:0/1278480026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 msgr2=0x7f9628156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:50.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96277fe700 1 --2- 172.21.15.29:0/1278480026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 0x7f9628156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96277fe700 1 -- 172.21.15.29:0/1278480026 >> v2:172.21.15.173:3300/0 conn(0x7f96280cb6a0 msgr2=0x7f96280cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:50.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96277fe700 1 --2- 172.21.15.29:0/1278480026 >> v2:172.21.15.173:3300/0 conn(0x7f96280cb6a0 0x7f96280cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96277fe700 1 -- 172.21.15.29:0/1278480026 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628156c10 con 0x7f9628155bf0 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f9626ffd700 1 --2- 172.21.15.29:0/1278480026 >> v2:172.21.15.173:3300/0 conn(0x7f96280cb6a0 0x7f96280cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96277fe700 1 --2- 172.21.15.29:0/1278480026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 0x7f96280c9800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f962806a630 tx=0x7f9618009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e146a11246875f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96267fc700 1 -- 172.21.15.29:0/1278480026 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800b640 con 0x7f9628155bf0 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96267fc700 1 -- 172.21.15.29:0/1278480026 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961800b7a0 con 0x7f9628155bf0 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f96267fc700 1 -- 172.21.15.29:0/1278480026 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800bb40 con 0x7f9628155bf0 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 -- 172.21.15.29:0/1278480026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 msgr2=0x7f96280c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 --2- 172.21.15.29:0/1278480026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 0x7f96280c9800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f962806a630 tx=0x7f9618009250 comp rx=0 tx=0).stop 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 -- 172.21.15.29:0/1278480026 shutdown_connections 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 --2- 172.21.15.29:0/1278480026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 0x7f9628156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 --2- 172.21.15.29:0/1278480026 >> v2:172.21.15.173:3300/0 conn(0x7f96280cb6a0 0x7f96280cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 --2- 172.21.15.29:0/1278480026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 0x7f96280c9800 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 -- 172.21.15.29:0/1278480026 >> 172.21.15.29:0/1278480026 conn(0x7f96280cd0e0 msgr2=0x7f96280c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:50.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 -- 172.21.15.29:0/1278480026 shutdown_connections 2023-10-06T05:25:50.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.025+0000 7f962dce3700 1 -- 172.21.15.29:0/1278480026 wait complete. 2023-10-06T05:25:50.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.029+0000 7f962dce3700 1 Processor -- start 2023-10-06T05:25:50.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.029+0000 7f962dce3700 1 -- start start 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.029+0000 7f962dce3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96280cb6a0 0x7f9628143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.029+0000 7f962dce3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 0x7f96280c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.029+0000 7f962dce3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 0x7f9628142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.029+0000 7f962dce3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9628144430 con 0x7f9628155bf0 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.029+0000 7f962dce3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96280c5b10 con 0x7f96280cb6a0 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.029+0000 7f962dce3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96280c6e00 con 0x7f9628155fc0 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.029+0000 7f9626ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 0x7f96280c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f9626ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 0x7f96280c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51642/0 (socket says 172.21.15.29:51642) 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f9626ffd700 1 -- 172.21.15.29:0/975889197 learned_addr learned my addr 172.21.15.29:0/975889197 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f96277fe700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96280cb6a0 0x7f9628143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f9627fff700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 0x7f9628142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f9626ffd700 1 -- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 msgr2=0x7f9628142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f9626ffd700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 0x7f9628142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f9626ffd700 1 -- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96280cb6a0 msgr2=0x7f9628143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f9626ffd700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96280cb6a0 0x7f9628143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f9626ffd700 1 -- 172.21.15.29:0/975889197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c009420 con 0x7f9628155bf0 2023-10-06T05:25:50.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f96277fe700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96280cb6a0 0x7f9628143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:50.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f9626ffd700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 0x7f96280c55d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f961c00ec80 tx=0x7f961c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f960f7fe700 1 -- 172.21.15.29:0/975889197 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c00c920 con 0x7f9628155bf0 2023-10-06T05:25:50.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f960f7fe700 1 -- 172.21.15.29:0/975889197 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c00ca80 con 0x7f9628155bf0 2023-10-06T05:25:50.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96180094f0 con 0x7f9628155bf0 2023-10-06T05:25:50.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f960f7fe700 1 -- 172.21.15.29:0/975889197 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c00ce00 con 0x7f9628155bf0 2023-10-06T05:25:50.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96280c60c0 con 0x7f9628155bf0 2023-10-06T05:25:50.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f960f7fe700 1 -- 172.21.15.29:0/975889197 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f961c013680 con 0x7f9628155bf0 2023-10-06T05:25:50.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.033+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9628071120 con 0x7f9628155bf0 2023-10-06T05:25:50.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.037+0000 7f960f7fe700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9614060550 0x7f9614062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.037+0000 7f960f7fe700 1 -- 172.21.15.29:0/975889197 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f961c07cfc0 con 0x7f9628155bf0 2023-10-06T05:25:50.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.037+0000 7f96277fe700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9614060550 0x7f9614062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.037+0000 7f96277fe700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9614060550 0x7f9614062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f962806a630 tx=0x7f9618017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.045+0000 7f960f7fe700 1 -- 172.21.15.29:0/975889197 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f961c0acbe0 con 0x7f9628155bf0 2023-10-06T05:25:50.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.205+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9628152e50 con 0x7f9628155bf0 2023-10-06T05:25:50.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f960f7fe700 1 -- 172.21.15.29:0/975889197 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f961c0170a0 con 0x7f9628155bf0 2023-10-06T05:25:50.213 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:25:50.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9614060550 msgr2=0x7f9614062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9614060550 0x7f9614062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f962806a630 tx=0x7f9618017000 comp rx=0 tx=0).stop 2023-10-06T05:25:50.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 msgr2=0x7f96280c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 0x7f96280c55d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f961c00ec80 tx=0x7f961c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 shutdown_connections 2023-10-06T05:25:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9628155fc0 0x7f9628142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9628155bf0 0x7f96280c55d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9614060550 0x7f9614062a00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 --2- 172.21.15.29:0/975889197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96280cb6a0 0x7f9628143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 >> 172.21.15.29:0/975889197 conn(0x7f96280cd0e0 msgr2=0x7f96280c2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 shutdown_connections 2023-10-06T05:25:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.209+0000 7f962dce3700 1 -- 172.21.15.29:0/975889197 wait complete. 2023-10-06T05:25:50.227 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:25:50.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 Processor -- start 2023-10-06T05:25:50.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 -- start start 2023-10-06T05:25:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c15d730 0x7f7c2c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c2c06cc00 0x7f7c2c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0cacd0 con 0x7f7c2c158f10 2023-10-06T05:25:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c06a600 con 0x7f7c2c06cc00 2023-10-06T05:25:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c06d080 con 0x7f7c2c15d730 2023-10-06T05:25:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c2c06cc00 0x7f7c2c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c2c06cc00 0x7f7c2c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51654/0 (socket says 172.21.15.29:51654) 2023-10-06T05:25:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2b7fe700 1 -- 172.21.15.29:0/1800621773 learned_addr learned my addr 172.21.15.29:0/1800621773 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:50.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2a7fc700 1 --2- 172.21.15.29:0/1800621773 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c15d730 0x7f7c2c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2b7fe700 1 -- 172.21.15.29:0/1800621773 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c15d730 msgr2=0x7f7c2c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:50.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c29ffb700 1 -- 172.21.15.29:0/1800621773 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599144963 0 0) 0x7f7c2c0cacd0 con 0x7f7c2c158f10 2023-10-06T05:25:50.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2b7fe700 1 --2- 172.21.15.29:0/1800621773 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c15d730 0x7f7c2c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2b7fe700 1 -- 172.21.15.29:0/1800621773 >> v1:172.21.15.173:6789/0 conn(0x7f7c2c158f10 legacy=0x7f7c2c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2b7fe700 1 -- 172.21.15.29:0/1800621773 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0cafb0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2b7fe700 1 --2- 172.21.15.29:0/1800621773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 0x7f7c2c06aa50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009f50 tx=0x7f7c1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c34db7533a13e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c29ffb700 1 -- 172.21.15.29:0/1800621773 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00e070 con 0x7f7c2c06cc00 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c29ffb700 1 -- 172.21.15.29:0/1800621773 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00b9c0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c29ffb700 1 -- 172.21.15.29:0/1800621773 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0092e0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 -- 172.21.15.29:0/1800621773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 msgr2=0x7f7c2c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 --2- 172.21.15.29:0/1800621773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 0x7f7c2c06aa50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009f50 tx=0x7f7c1c009840 comp rx=0 tx=0).stop 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 -- 172.21.15.29:0/1800621773 shutdown_connections 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 --2- 172.21.15.29:0/1800621773 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c15d730 0x7f7c2c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 --2- 172.21.15.29:0/1800621773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 0x7f7c2c06aa50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 -- 172.21.15.29:0/1800621773 >> 172.21.15.29:0/1800621773 conn(0x7f7c2c062b60 msgr2=0x7f7c2c062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.337+0000 7f7c2bfff700 1 -- 172.21.15.29:0/1800621773 shutdown_connections 2023-10-06T05:25:50.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2bfff700 1 -- 172.21.15.29:0/1800621773 wait complete. 2023-10-06T05:25:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2bfff700 1 Processor -- start 2023-10-06T05:25:50.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2bfff700 1 -- start start 2023-10-06T05:25:50.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 0x7f7c2c158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c158f10 0x7f7c2c0c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c15d730 0x7f7c2c0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0b52b0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0c9930 con 0x7f7c2c15d730 2023-10-06T05:25:50.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0b5500 con 0x7f7c2c158f10 2023-10-06T05:25:50.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 0x7f7c2c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 0x7f7c2c158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51656/0 (socket says 172.21.15.29:51656) 2023-10-06T05:25:50.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2affd700 1 -- 172.21.15.29:0/3790249514 learned_addr learned my addr 172.21.15.29:0/3790249514 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:50.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2a7fc700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c158f10 0x7f7c2c0c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2b7fe700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c15d730 0x7f7c2c0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2affd700 1 -- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c158f10 msgr2=0x7f7c2c0c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2affd700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c158f10 0x7f7c2c0c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2affd700 1 -- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c15d730 msgr2=0x7f7c2c0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2affd700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c15d730 0x7f7c2c0c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2affd700 1 -- 172.21.15.29:0/3790249514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c009ae0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.341+0000 7f7c2affd700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 0x7f7c2c158140 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400c7e0 tx=0x7f7c24007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c22ffd700 1 -- 172.21.15.29:0/3790249514 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240105c0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c22ffd700 1 -- 172.21.15.29:0/3790249514 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24010740 con 0x7f7c2c06cc00 2023-10-06T05:25:50.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c0b57e0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c22ffd700 1 -- 172.21.15.29:0/3790249514 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24010b00 con 0x7f7c2c06cc00 2023-10-06T05:25:50.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c1588a0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c0b36a0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c22ffd700 1 -- 172.21.15.29:0/3790249514 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7c2401b3b0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c22ffd700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c0c060550 0x7f7c0c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c22ffd700 1 -- 172.21.15.29:0/3790249514 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7c2407bd90 con 0x7f7c2c06cc00 2023-10-06T05:25:50.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.345+0000 7f7c2a7fc700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c0c060550 0x7f7c0c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.349+0000 7f7c2a7fc700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c0c060550 0x7f7c0c062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0b1680 tx=0x7f7c140091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.353+0000 7f7c22ffd700 1 -- 172.21.15.29:0/3790249514 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7c2404c180 con 0x7f7c2c06cc00 2023-10-06T05:25:50.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.513+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c2c1588a0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c22ffd700 1 -- 172.21.15.29:0/3790249514 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c2c1588a0 con 0x7f7c2c06cc00 2023-10-06T05:25:50.521 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:25:50.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c0c060550 msgr2=0x7f7c0c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c0c060550 0x7f7c0c062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0b1680 tx=0x7f7c140091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 msgr2=0x7f7c2c158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 0x7f7c2c158140 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400c7e0 tx=0x7f7c24007df0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 shutdown_connections 2023-10-06T05:25:50.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c0c060550 0x7f7c0c062a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c15d730 0x7f7c2c0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c2c158f10 0x7f7c2c0c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 --2- 172.21.15.29:0/3790249514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c2c06cc00 0x7f7c2c158140 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 >> 172.21.15.29:0/3790249514 conn(0x7f7c2c062b60 msgr2=0x7f7c2c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:50.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 shutdown_connections 2023-10-06T05:25:50.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.517+0000 7f7c2bfff700 1 -- 172.21.15.29:0/3790249514 wait complete. 2023-10-06T05:25:50.535 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:25:50.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.641+0000 7fc365dc0700 1 Processor -- start 2023-10-06T05:25:50.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.641+0000 7fc365dc0700 1 -- start start 2023-10-06T05:25:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 0x7fc3600c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc36006ceb0 0x7fc3600c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3600c9500 con 0x7fc3600c3490 2023-10-06T05:25:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3600cb880 con 0x7fc36006ceb0 2023-10-06T05:25:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600ca080 con 0x7fc36015c450 2023-10-06T05:25:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc35ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc3600c3490 0x7fc36006c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50666/0 (socket says 172.21.15.29:50666) 2023-10-06T05:25:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc35ffff700 1 -- 172.21.15.29:0/3474009468 learned_addr learned my addr 172.21.15.29:0/3474009468 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:50.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc3655bf700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc36006ceb0 0x7fc3600c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc364dbe700 1 --2- 172.21.15.29:0/3474009468 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 0x7fc3600c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc35f7fe700 1 -- 172.21.15.29:0/3474009468 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776080498 0 0) 0x7fc3600c9500 con 0x7fc3600c3490 2023-10-06T05:25:50.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc35f7fe700 1 -- 172.21.15.29:0/3474009468 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc34c003570 con 0x7fc3600c3490 2023-10-06T05:25:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc3655bf700 1 -- 172.21.15.29:0/3474009468 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 msgr2=0x7fc3600c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc3655bf700 1 --2- 172.21.15.29:0/3474009468 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 0x7fc3600c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc3655bf700 1 -- 172.21.15.29:0/3474009468 >> v1:172.21.15.29:6789/0 conn(0x7fc3600c3490 legacy=0x7fc36006c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc3655bf700 1 -- 172.21.15.29:0/3474009468 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600c38e0 con 0x7fc36006ceb0 2023-10-06T05:25:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc3655bf700 1 --2- 172.21.15.29:0/3474009468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36006ceb0 0x7fc3600c71e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc358009e60 tx=0x7fc358009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74c4e5fe82c808c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc35f7fe700 1 -- 172.21.15.29:0/3474009468 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800e070 con 0x7fc36006ceb0 2023-10-06T05:25:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc35f7fe700 1 -- 172.21.15.29:0/3474009468 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35800bab0 con 0x7fc36006ceb0 2023-10-06T05:25:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc35f7fe700 1 -- 172.21.15.29:0/3474009468 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800be50 con 0x7fc36006ceb0 2023-10-06T05:25:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 -- 172.21.15.29:0/3474009468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36006ceb0 msgr2=0x7fc3600c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 --2- 172.21.15.29:0/3474009468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36006ceb0 0x7fc3600c71e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc358009e60 tx=0x7fc358009780 comp rx=0 tx=0).stop 2023-10-06T05:25:50.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 -- 172.21.15.29:0/3474009468 shutdown_connections 2023-10-06T05:25:50.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 --2- 172.21.15.29:0/3474009468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc36006ceb0 0x7fc3600c71e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 --2- 172.21.15.29:0/3474009468 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 0x7fc3600c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 -- 172.21.15.29:0/3474009468 >> 172.21.15.29:0/3474009468 conn(0x7fc36006ba30 msgr2=0x7fc360095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:50.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 -- 172.21.15.29:0/3474009468 shutdown_connections 2023-10-06T05:25:50.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.645+0000 7fc365dc0700 1 -- 172.21.15.29:0/3474009468 wait complete. 2023-10-06T05:25:50.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc365dc0700 1 Processor -- start 2023-10-06T05:25:50.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc365dc0700 1 -- start start 2023-10-06T05:25:50.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc365dc0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc36006ceb0 0x7fc3600677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc365dc0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3600c3490 0x7fc36015af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc365dc0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 0x7fc3600b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc365dc0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36015d360 con 0x7fc3600c3490 2023-10-06T05:25:50.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc365dc0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600c4400 con 0x7fc36006ceb0 2023-10-06T05:25:50.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc365dc0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600c46e0 con 0x7fc36015c450 2023-10-06T05:25:50.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc35ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3600c3490 0x7fc36015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc35ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3600c3490 0x7fc36015af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51676/0 (socket says 172.21.15.29:51676) 2023-10-06T05:25:50.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc364dbe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc36006ceb0 0x7fc3600677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc35ffff700 1 -- 172.21.15.29:0/236051431 learned_addr learned my addr 172.21.15.29:0/236051431 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:50.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc3655bf700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 0x7fc3600b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.649+0000 7fc35ffff700 1 -- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 msgr2=0x7fc3600b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc35ffff700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 0x7fc3600b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc35ffff700 1 -- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc36006ceb0 msgr2=0x7fc3600677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc35ffff700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc36006ceb0 0x7fc3600677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc35ffff700 1 -- 172.21.15.29:0/236051431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358009a20 con 0x7fc3600c3490 2023-10-06T05:25:50.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc35ffff700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3600c3490 0x7fc36015af40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c7c0 tx=0x7fc350007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc35cff9700 1 -- 172.21.15.29:0/236051431 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350005cd0 con 0x7fc3600c3490 2023-10-06T05:25:50.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc35cff9700 1 -- 172.21.15.29:0/236051431 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350005e30 con 0x7fc3600c3490 2023-10-06T05:25:50.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3600c49c0 con 0x7fc3600c3490 2023-10-06T05:25:50.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc35cff9700 1 -- 172.21.15.29:0/236051431 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350007320 con 0x7fc3600c3490 2023-10-06T05:25:50.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3600c4020 con 0x7fc3600c3490 2023-10-06T05:25:50.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3600c4db0 con 0x7fc3600c3490 2023-10-06T05:25:50.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.653+0000 7fc35cff9700 1 -- 172.21.15.29:0/236051431 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc35001b3b0 con 0x7fc3600c3490 2023-10-06T05:25:50.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.657+0000 7fc35cff9700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc340060550 0x7fc340062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.657+0000 7fc35cff9700 1 -- 172.21.15.29:0/236051431 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc35007bfc0 con 0x7fc3600c3490 2023-10-06T05:25:50.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.657+0000 7fc364dbe700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc340060550 0x7fc340062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.657+0000 7fc364dbe700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc340060550 0x7fc340062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc348009d00 tx=0x7fc348009120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.661+0000 7fc35cff9700 1 -- 172.21.15.29:0/236051431 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc35004c450 con 0x7fc3600c3490 2023-10-06T05:25:50.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.825+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3600c4bb0 con 0x7fc3600c3490 2023-10-06T05:25:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc35cff9700 1 -- 172.21.15.29:0/236051431 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc350017020 con 0x7fc3600c3490 2023-10-06T05:25:50.832 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:25:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc340060550 msgr2=0x7fc340062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc340060550 0x7fc340062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc348009d00 tx=0x7fc348009120 comp rx=0 tx=0).stop 2023-10-06T05:25:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3600c3490 msgr2=0x7fc36015af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3600c3490 0x7fc36015af40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c7c0 tx=0x7fc350007e00 comp rx=0 tx=0).stop 2023-10-06T05:25:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 shutdown_connections 2023-10-06T05:25:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc36015c450 0x7fc3600b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3600c3490 0x7fc36015af40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc340060550 0x7fc340062a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 --2- 172.21.15.29:0/236051431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc36006ceb0 0x7fc3600677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 >> 172.21.15.29:0/236051431 conn(0x7fc36006ba30 msgr2=0x7fc3600c7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 shutdown_connections 2023-10-06T05:25:50.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.829+0000 7fc365dc0700 1 -- 172.21.15.29:0/236051431 wait complete. 2023-10-06T05:25:50.847 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:25:50.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84ef3bc700 1 Processor -- start 2023-10-06T05:25:50.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84ef3bc700 1 -- start start 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84ef3bc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f84e8158ce0 0x7f84e80ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84ef3bc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e81590b0 0x7f84e80ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84ef3bc700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e806a200 con 0x7f84e80cacb0 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84ef3bc700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e80cb840 con 0x7f84e8158ce0 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84ef3bc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e806a4e0 con 0x7f84e81590b0 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84ee3ba700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f84e8158ce0 0x7f84e80ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84edbb9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e81590b0 0x7f84e80ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84edbb9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e81590b0 0x7f84e80ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:53134/0 (socket says 172.21.15.29:53134) 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84eebbb700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f84e80cacb0 0x7f84e80cb130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:38564/0 (socket says 172.21.15.29:38564) 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84edbb9700 1 -- 172.21.15.29:0/1448003401 learned_addr learned my addr 172.21.15.29:0/1448003401 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:50.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.953+0000 7f84ee3ba700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f84e8158ce0 0x7f84e80ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51692/0 (socket says 172.21.15.29:51692) 2023-10-06T05:25:50.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ee3ba700 1 -- 172.21.15.29:0/1448003401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e81590b0 msgr2=0x7f84e80ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:50.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ee3ba700 1 --2- 172.21.15.29:0/1448003401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e81590b0 0x7f84e80ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ee3ba700 1 -- 172.21.15.29:0/1448003401 >> v1:172.21.15.173:6789/0 conn(0x7f84e80cacb0 legacy=0x7f84e80cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ee3ba700 1 -- 172.21.15.29:0/1448003401 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80cba20 con 0x7f84e8158ce0 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ed3b8700 1 -- 172.21.15.29:0/1448003401 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739002272 0 0) 0x7f84e806a200 con 0x7f84e80cacb0 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84edbb9700 1 --2- 172.21.15.29:0/1448003401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e81590b0 0x7f84e80ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ee3ba700 1 --2- 172.21.15.29:0/1448003401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e8158ce0 0x7f84e80ce490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84e40098e0 tx=0x7f84e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c765b7a6b07d869 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ed3b8700 1 -- 172.21.15.29:0/1448003401 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400b640 con 0x7f84e8158ce0 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ed3b8700 1 -- 172.21.15.29:0/1448003401 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e400b7a0 con 0x7f84e8158ce0 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ed3b8700 1 -- 172.21.15.29:0/1448003401 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400bb40 con 0x7f84e8158ce0 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1448003401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e8158ce0 msgr2=0x7f84e80ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ef3bc700 1 --2- 172.21.15.29:0/1448003401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e8158ce0 0x7f84e80ce490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84e40098e0 tx=0x7f84e40091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1448003401 shutdown_connections 2023-10-06T05:25:50.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ef3bc700 1 --2- 172.21.15.29:0/1448003401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e81590b0 0x7f84e80ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ef3bc700 1 --2- 172.21.15.29:0/1448003401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e8158ce0 0x7f84e80ce490 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1448003401 >> 172.21.15.29:0/1448003401 conn(0x7f84e80670a0 msgr2=0x7f84e8067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:50.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1448003401 shutdown_connections 2023-10-06T05:25:50.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.957+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1448003401 wait complete. 2023-10-06T05:25:50.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84ef3bc700 1 Processor -- start 2023-10-06T05:25:50.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84ef3bc700 1 -- start start 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84ef3bc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84e80cacb0 0x7f84e8159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84ef3bc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e8158ce0 0x7f84e8168610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84ef3bc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e81590b0 0x7f84e81572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84ef3bc700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80c7200 con 0x7f84e81590b0 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84ef3bc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8159a40 con 0x7f84e80cacb0 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84ef3bc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80b3520 con 0x7f84e8158ce0 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84eebbb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e81590b0 0x7f84e81572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84eebbb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e81590b0 0x7f84e81572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51698/0 (socket says 172.21.15.29:51698) 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84eebbb700 1 -- 172.21.15.29:0/1184682980 learned_addr learned my addr 172.21.15.29:0/1184682980 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84ee3ba700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84e80cacb0 0x7f84e8159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84edbb9700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e8158ce0 0x7f84e8168610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84eebbb700 1 -- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e8158ce0 msgr2=0x7f84e8168610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84eebbb700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e8158ce0 0x7f84e8168610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84eebbb700 1 -- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84e80cacb0 msgr2=0x7f84e8159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:50.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84eebbb700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84e80cacb0 0x7f84e8159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:50.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.961+0000 7f84eebbb700 1 -- 172.21.15.29:0/1184682980 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d80094f0 con 0x7f84e81590b0 2023-10-06T05:25:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.965+0000 7f84eebbb700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e81590b0 0x7f84e81572d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f84e000cd50 tx=0x7f84e0001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.965+0000 7f84de7fc700 1 -- 172.21.15.29:0/1184682980 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0005df0 con 0x7f84e81590b0 2023-10-06T05:25:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.965+0000 7f84de7fc700 1 -- 172.21.15.29:0/1184682980 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e000a8b0 con 0x7f84e81590b0 2023-10-06T05:25:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.965+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e4009420 con 0x7f84e81590b0 2023-10-06T05:25:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.965+0000 7f84de7fc700 1 -- 172.21.15.29:0/1184682980 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000ac70 con 0x7f84e81590b0 2023-10-06T05:25:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.965+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e80b2f60 con 0x7f84e81590b0 2023-10-06T05:25:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.965+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e80c7370 con 0x7f84e81590b0 2023-10-06T05:25:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.965+0000 7f84de7fc700 1 -- 172.21.15.29:0/1184682980 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f84e00070f0 con 0x7f84e81590b0 2023-10-06T05:25:50.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.965+0000 7f84de7fc700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84cc060580 0x7f84cc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:50.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.969+0000 7f84de7fc700 1 -- 172.21.15.29:0/1184682980 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f84e007cb20 con 0x7f84e81590b0 2023-10-06T05:25:50.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.969+0000 7f84ee3ba700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84cc060580 0x7f84cc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:50.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.969+0000 7f84ee3ba700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84cc060580 0x7f84cc062a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f84e40093f0 tx=0x7f84e4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:50.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:50.973+0000 7f84de7fc700 1 -- 172.21.15.29:0/1184682980 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f84e004cf10 con 0x7f84e81590b0 2023-10-06T05:25:51.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.165+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84e804be00 con 0x7f84e81590b0 2023-10-06T05:25:51.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.165+0000 7f84de7fc700 1 -- 172.21.15.29:0/1184682980 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f84e0050530 con 0x7f84e81590b0 2023-10-06T05:25:51.172 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:51.172 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/320155266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":320155266},{"type":"v1","addr":"172.21.15.29:6833","nonce":320155266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3562424943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3562424943},{"type":"v1","addr":"172.21.15.173:6836","nonce":3562424943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2321165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2321165769},{"type":"v1","addr":"172.21.15.173:6837","nonce":2321165769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:25:39.986226+0000","modified":"2023-10-06T05:25:43.642085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3557282345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3557282345},{"type":"v1","addr":"172.21.15.29:6835","nonce":3557282345}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T05:25:51.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84cc060580 msgr2=0x7f84cc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84cc060580 0x7f84cc062a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f84e40093f0 tx=0x7f84e4017000 comp rx=0 tx=0).stop 2023-10-06T05:25:51.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e81590b0 msgr2=0x7f84e81572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e81590b0 0x7f84e81572d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f84e000cd50 tx=0x7f84e0001b10 comp rx=0 tx=0).stop 2023-10-06T05:25:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 shutdown_connections 2023-10-06T05:25:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84e81590b0 0x7f84e81572d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84e8158ce0 0x7f84e8168610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84cc060580 0x7f84cc062a30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 --2- 172.21.15.29:0/1184682980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84e80cacb0 0x7f84e8159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 >> 172.21.15.29:0/1184682980 conn(0x7f84e80670a0 msgr2=0x7f84e80c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:51.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 shutdown_connections 2023-10-06T05:25:51.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.169+0000 7f84ef3bc700 1 -- 172.21.15.29:0/1184682980 wait complete. 2023-10-06T05:25:51.178 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-06T05:25:51.187 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:51.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 Processor -- start 2023-10-06T05:25:51.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 -- start start 2023-10-06T05:25:51.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f43800af5c0 0x7f43800af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43801614c0 con 0x7f4380161950 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438006d420 con 0x7f438015cd80 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4380160f40 con 0x7f43800af5c0 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4385b66700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f43800af5c0 0x7f43800af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4385b66700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f43800af5c0 0x7f43800af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51706/0 (socket says 172.21.15.29:51706) 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4385b66700 1 -- 172.21.15.29:0/762790020 learned_addr learned my addr 172.21.15.29:0/762790020 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4385365700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4380161950 0x7f438006a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50672/0 (socket says 172.21.15.29:50672) 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4385b66700 1 -- 172.21.15.29:0/762790020 >> v1:172.21.15.173:6789/0 conn(0x7f438015cd80 legacy=0x7f438015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4385b66700 1 -- 172.21.15.29:0/762790020 >> v1:172.21.15.29:6789/0 conn(0x7f4380161950 legacy=0x7f438006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4384b64700 1 -- 172.21.15.29:0/762790020 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345885083 0 0) 0x7f43801614c0 con 0x7f4380161950 2023-10-06T05:25:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4385b66700 1 -- 172.21.15.29:0/762790020 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438006af20 con 0x7f43800af5c0 2023-10-06T05:25:51.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4385b66700 1 --2- 172.21.15.29:0/762790020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43800af5c0 0x7f43800af990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4378009f20 tx=0x7f4378009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dccd50dce62c8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4384b64700 1 -- 172.21.15.29:0/762790020 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437800e070 con 0x7f43800af5c0 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4384b64700 1 -- 172.21.15.29:0/762790020 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437800ba40 con 0x7f43800af5c0 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4384b64700 1 -- 172.21.15.29:0/762790020 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780092e0 con 0x7f43800af5c0 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 -- 172.21.15.29:0/762790020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43800af5c0 msgr2=0x7f43800af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 --2- 172.21.15.29:0/762790020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43800af5c0 0x7f43800af990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4378009f20 tx=0x7f4378009840 comp rx=0 tx=0).stop 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 -- 172.21.15.29:0/762790020 shutdown_connections 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 --2- 172.21.15.29:0/762790020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43800af5c0 0x7f43800af990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 -- 172.21.15.29:0/762790020 >> 172.21.15.29:0/762790020 conn(0x7f4380067b70 msgr2=0x7f438006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 -- 172.21.15.29:0/762790020 shutdown_connections 2023-10-06T05:25:51.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.285+0000 7f4387dca700 1 -- 172.21.15.29:0/762790020 wait complete. 2023-10-06T05:25:51.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4387dca700 1 Processor -- start 2023-10-06T05:25:51.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4387dca700 1 -- start start 2023-10-06T05:25:51.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4387dca700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43800af5c0 0x7f43800a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4387dca700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438015cd80 0x7f43800ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4387dca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4380161950 0x7f43800adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4387dca700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4380159110 con 0x7f4380161950 2023-10-06T05:25:51.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4387dca700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800a7f30 con 0x7f438015cd80 2023-10-06T05:25:51.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4387dca700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800a7320 con 0x7f43800af5c0 2023-10-06T05:25:51.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4386367700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4380161950 0x7f43800adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4386367700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4380161950 0x7f43800adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51708/0 (socket says 172.21.15.29:51708) 2023-10-06T05:25:51.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4386367700 1 -- 172.21.15.29:0/3307164733 learned_addr learned my addr 172.21.15.29:0/3307164733 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:51.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4385365700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438015cd80 0x7f43800ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4385b66700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43800af5c0 0x7f43800a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4386367700 1 -- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43800af5c0 msgr2=0x7f43800a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4386367700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43800af5c0 0x7f43800a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4386367700 1 -- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438015cd80 msgr2=0x7f43800ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4386367700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438015cd80 0x7f43800ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4386367700 1 -- 172.21.15.29:0/3307164733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4378009ae0 con 0x7f4380161950 2023-10-06T05:25:51.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4385b66700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43800af5c0 0x7f43800a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:51.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.289+0000 7f4385365700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438015cd80 0x7f43800ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:51.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.293+0000 7f4386367700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4380161950 0x7f43800adba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f437c00c5e0 tx=0x7f437c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:51.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.293+0000 7f4375ffb700 1 -- 172.21.15.29:0/3307164733 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c011590 con 0x7f4380161950 2023-10-06T05:25:51.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.293+0000 7f4375ffb700 1 -- 172.21.15.29:0/3307164733 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c011710 con 0x7f4380161950 2023-10-06T05:25:51.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.293+0000 7f4375ffb700 1 -- 172.21.15.29:0/3307164733 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c011ad0 con 0x7f4380161950 2023-10-06T05:25:51.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.293+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43800a7600 con 0x7f4380161950 2023-10-06T05:25:51.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.293+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43800a7bc0 con 0x7f4380161950 2023-10-06T05:25:51.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.293+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43800a80c0 con 0x7f4380161950 2023-10-06T05:25:51.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.293+0000 7f4375ffb700 1 -- 172.21.15.29:0/3307164733 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f437c01c460 con 0x7f4380161950 2023-10-06T05:25:51.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.293+0000 7f4375ffb700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4364060550 0x7f4364062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.297+0000 7f4375ffb700 1 -- 172.21.15.29:0/3307164733 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f437c07c4c0 con 0x7f4380161950 2023-10-06T05:25:51.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.297+0000 7f4385b66700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4364060550 0x7f4364062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.297+0000 7f4385b66700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4364060550 0x7f4364062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4378009ab0 tx=0x7f4378017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:51.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.301+0000 7f4375ffb700 1 -- 172.21.15.29:0/3307164733 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f437c04c950 con 0x7f4380161950 2023-10-06T05:25:51.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.465+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f438004be00 con 0x7f4380161950 2023-10-06T05:25:51.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4375ffb700 1 -- 172.21.15.29:0/3307164733 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f437c04ff70 con 0x7f4380161950 2023-10-06T05:25:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:51.474 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4364060550 msgr2=0x7f4364062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4364060550 0x7f4364062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4378009ab0 tx=0x7f4378017000 comp rx=0 tx=0).stop 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4380161950 msgr2=0x7f43800adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4380161950 0x7f43800adba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f437c00c5e0 tx=0x7f437c007f60 comp rx=0 tx=0).stop 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 shutdown_connections 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4380161950 0x7f43800adba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4364060550 0x7f4364062a00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f438015cd80 0x7f43800ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 --2- 172.21.15.29:0/3307164733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f43800af5c0 0x7f43800a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 >> 172.21.15.29:0/3307164733 conn(0x7f4380067b70 msgr2=0x7f4380159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 shutdown_connections 2023-10-06T05:25:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.469+0000 7f4387dca700 1 -- 172.21.15.29:0/3307164733 wait complete. 2023-10-06T05:25:51.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:25:38.347316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:25:38.976583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:25:51.489 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:25:51.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a38e53700 1 Processor -- start 2023-10-06T05:25:51.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a38e53700 1 -- start start 2023-10-06T05:25:51.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a38e53700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6a341590f0 0x7f6a341594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a38e53700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a3415a2c0 0x7f6a3415cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a38e53700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a340b3fc0 con 0x7f6a3415d2b0 2023-10-06T05:25:51.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a38e53700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3415d8c0 con 0x7f6a3415a2c0 2023-10-06T05:25:51.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a38e53700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3415dba0 con 0x7f6a341590f0 2023-10-06T05:25:51.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a31d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a3415a2c0 0x7f6a3415cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a32d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6a3415d2b0 0x7f6a340b1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50680/0 (socket says 172.21.15.29:50680) 2023-10-06T05:25:51.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.597+0000 7f6a32d9d700 1 -- 172.21.15.29:0/2994895016 learned_addr learned my addr 172.21.15.29:0/2994895016 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:51.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a3259c700 1 --2- 172.21.15.29:0/2994895016 >> v2:172.21.15.173:3300/0 conn(0x7f6a341590f0 0x7f6a341594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a3159a700 1 -- 172.21.15.29:0/2994895016 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555427312 0 0) 0x7f6a340b3fc0 con 0x7f6a3415d2b0 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a3159a700 1 -- 172.21.15.29:0/2994895016 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a1c003570 con 0x7f6a3415d2b0 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a31d9b700 1 -- 172.21.15.29:0/2994895016 >> v2:172.21.15.173:3300/0 conn(0x7f6a341590f0 msgr2=0x7f6a341594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a31d9b700 1 --2- 172.21.15.29:0/2994895016 >> v2:172.21.15.173:3300/0 conn(0x7f6a341590f0 0x7f6a341594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a31d9b700 1 -- 172.21.15.29:0/2994895016 >> v1:172.21.15.29:6789/0 conn(0x7f6a3415d2b0 legacy=0x7f6a340b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a31d9b700 1 -- 172.21.15.29:0/2994895016 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34159ac0 con 0x7f6a3415a2c0 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a3259c700 1 --2- 172.21.15.29:0/2994895016 >> v2:172.21.15.173:3300/0 conn(0x7f6a341590f0 0x7f6a341594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a31d9b700 1 --2- 172.21.15.29:0/2994895016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415a2c0 0x7f6a3415cd70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a3406eb10 tx=0x7f6a240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ca9e3a638d7ec5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a3159a700 1 -- 172.21.15.29:0/2994895016 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24011630 con 0x7f6a3415a2c0 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a3159a700 1 -- 172.21.15.29:0/2994895016 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a240117b0 con 0x7f6a3415a2c0 2023-10-06T05:25:51.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a3159a700 1 -- 172.21.15.29:0/2994895016 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24011b70 con 0x7f6a3415a2c0 2023-10-06T05:25:51.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a38e53700 1 -- 172.21.15.29:0/2994895016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415a2c0 msgr2=0x7f6a3415cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a38e53700 1 --2- 172.21.15.29:0/2994895016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415a2c0 0x7f6a3415cd70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a3406eb10 tx=0x7f6a240091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a38e53700 1 -- 172.21.15.29:0/2994895016 shutdown_connections 2023-10-06T05:25:51.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a38e53700 1 --2- 172.21.15.29:0/2994895016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415a2c0 0x7f6a3415cd70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a38e53700 1 --2- 172.21.15.29:0/2994895016 >> v2:172.21.15.173:3300/0 conn(0x7f6a341590f0 0x7f6a341594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a38e53700 1 -- 172.21.15.29:0/2994895016 >> 172.21.15.29:0/2994895016 conn(0x7f6a340670a0 msgr2=0x7f6a340674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:51.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a38e53700 1 -- 172.21.15.29:0/2994895016 shutdown_connections 2023-10-06T05:25:51.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.601+0000 7f6a38e53700 1 -- 172.21.15.29:0/2994895016 wait complete. 2023-10-06T05:25:51.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 Processor -- start 2023-10-06T05:25:51.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 -- start start 2023-10-06T05:25:51.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a341590f0 0x7f6a340cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a3415a2c0 0x7f6a34146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d2b0 0x7f6a340cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340cf070 con 0x7f6a3415d2b0 2023-10-06T05:25:51.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340cf500 con 0x7f6a341590f0 2023-10-06T05:25:51.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340ce460 con 0x7f6a3415a2c0 2023-10-06T05:25:51.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a32d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d2b0 0x7f6a340cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a32d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d2b0 0x7f6a340cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51730/0 (socket says 172.21.15.29:51730) 2023-10-06T05:25:51.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a32d9d700 1 -- 172.21.15.29:0/367003580 learned_addr learned my addr 172.21.15.29:0/367003580 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:51.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a31d9b700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a3415a2c0 0x7f6a34146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a3259c700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a341590f0 0x7f6a340cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a32d9d700 1 -- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a3415a2c0 msgr2=0x7f6a34146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a32d9d700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a3415a2c0 0x7f6a34146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a32d9d700 1 -- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a341590f0 msgr2=0x7f6a340cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a32d9d700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a341590f0 0x7f6a340cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a32d9d700 1 -- 172.21.15.29:0/367003580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28009420 con 0x7f6a3415d2b0 2023-10-06T05:25:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a31d9b700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a3415a2c0 0x7f6a34146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a32d9d700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d2b0 0x7f6a340cdbe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c001460 tx=0x7f6a2c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a227fc700 1 -- 172.21.15.29:0/367003580 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00a870 con 0x7f6a3415d2b0 2023-10-06T05:25:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a227fc700 1 -- 172.21.15.29:0/367003580 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00a9d0 con 0x7f6a3415d2b0 2023-10-06T05:25:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a24009420 con 0x7f6a3415d2b0 2023-10-06T05:25:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a227fc700 1 -- 172.21.15.29:0/367003580 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00ad50 con 0x7f6a3415d2b0 2023-10-06T05:25:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.605+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a340cea20 con 0x7f6a3415d2b0 2023-10-06T05:25:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.609+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a340cf1e0 con 0x7f6a3415d2b0 2023-10-06T05:25:51.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.609+0000 7f6a227fc700 1 -- 172.21.15.29:0/367003580 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6a2c007300 con 0x7f6a3415d2b0 2023-10-06T05:25:51.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.609+0000 7f6a227fc700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a14060550 0x7f6a14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.609+0000 7f6a227fc700 1 -- 172.21.15.29:0/367003580 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a2c07cc40 con 0x7f6a3415d2b0 2023-10-06T05:25:51.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.609+0000 7f6a3259c700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a14060550 0x7f6a14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.613+0000 7f6a3259c700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a14060550 0x7f6a14062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009f40 tx=0x7f6a280091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:51.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.621+0000 7f6a227fc700 1 -- 172.21.15.29:0/367003580 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6a2c04d150 con 0x7f6a3415d2b0 2023-10-06T05:25:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.773+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a34071120 con 0x7f6a3415d2b0 2023-10-06T05:25:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.773+0000 7f6a227fc700 1 -- 172.21.15.29:0/367003580 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a2c050770 con 0x7f6a3415d2b0 2023-10-06T05:25:51.780 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a14060550 msgr2=0x7f6a14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a14060550 0x7f6a14062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009f40 tx=0x7f6a280091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d2b0 msgr2=0x7f6a340cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d2b0 0x7f6a340cdbe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c001460 tx=0x7f6a2c001a40 comp rx=0 tx=0).stop 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 shutdown_connections 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3415d2b0 0x7f6a340cdbe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a3415a2c0 0x7f6a34146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a14060550 0x7f6a14062a00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 --2- 172.21.15.29:0/367003580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a341590f0 0x7f6a340cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 >> 172.21.15.29:0/367003580 conn(0x7f6a340670a0 msgr2=0x7f6a3415b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 shutdown_connections 2023-10-06T05:25:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.777+0000 7f6a38e53700 1 -- 172.21.15.29:0/367003580 wait complete. 2023-10-06T05:25:51.795 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:25:51.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.901+0000 7fb630865700 1 Processor -- start 2023-10-06T05:25:51.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.901+0000 7fb630865700 1 -- start start 2023-10-06T05:25:51.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13ecb0 0x7fb62c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb62c06dde0 0x7fb62c0c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c0c8930 con 0x7fb62c13f080 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0688a0 con 0x7fb62c06dde0 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0c7d20 con 0x7fb62c13ecb0 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb62c06dde0 0x7fb62c0c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb62c06dde0 0x7fb62c0c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51734/0 (socket says 172.21.15.29:51734) 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62bfff700 1 -- 172.21.15.29:0/4219397202 learned_addr learned my addr 172.21.15.29:0/4219397202 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62b7fe700 1 --2- 172.21.15.29:0/4219397202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13ecb0 0x7fb62c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62bfff700 1 -- 172.21.15.29:0/4219397202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13ecb0 msgr2=0x7fb62c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62bfff700 1 --2- 172.21.15.29:0/4219397202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13ecb0 0x7fb62c159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62bfff700 1 -- 172.21.15.29:0/4219397202 >> v1:172.21.15.29:6789/0 conn(0x7fb62c13f080 legacy=0x7fb62c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62bfff700 1 -- 172.21.15.29:0/4219397202 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0c8000 con 0x7fb62c06dde0 2023-10-06T05:25:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62a7fc700 1 -- 172.21.15.29:0/4219397202 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262037038 0 0) 0x7fb62c0c8930 con 0x7fb62c13f080 2023-10-06T05:25:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62b7fe700 1 --2- 172.21.15.29:0/4219397202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13ecb0 0x7fb62c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62bfff700 1 --2- 172.21.15.29:0/4219397202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c06dde0 0x7fb62c0c9f50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb62400bc40 tx=0x7fb62400b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477c4f4a46831950 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:51.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62a7fc700 1 -- 172.21.15.29:0/4219397202 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400da90 con 0x7fb62c06dde0 2023-10-06T05:25:51.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62a7fc700 1 -- 172.21.15.29:0/4219397202 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62400dbf0 con 0x7fb62c06dde0 2023-10-06T05:25:51.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb62a7fc700 1 -- 172.21.15.29:0/4219397202 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624017410 con 0x7fb62c06dde0 2023-10-06T05:25:51.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 -- 172.21.15.29:0/4219397202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c06dde0 msgr2=0x7fb62c0c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 --2- 172.21.15.29:0/4219397202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c06dde0 0x7fb62c0c9f50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb62400bc40 tx=0x7fb62400b4e0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 -- 172.21.15.29:0/4219397202 shutdown_connections 2023-10-06T05:25:51.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 --2- 172.21.15.29:0/4219397202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c06dde0 0x7fb62c0c9f50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 --2- 172.21.15.29:0/4219397202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13ecb0 0x7fb62c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 -- 172.21.15.29:0/4219397202 >> 172.21.15.29:0/4219397202 conn(0x7fb62c0c9830 msgr2=0x7fb62c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:51.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 -- 172.21.15.29:0/4219397202 shutdown_connections 2023-10-06T05:25:51.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.905+0000 7fb630865700 1 -- 172.21.15.29:0/4219397202 wait complete. 2023-10-06T05:25:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 Processor -- start 2023-10-06T05:25:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 -- start start 2023-10-06T05:25:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb62c06dde0 0x7fb62c13ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c13ecb0 0x7fb62c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13f080 0x7fb62c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c158b50 con 0x7fb62c13ecb0 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c169070 con 0x7fb62c06dde0 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0c4520 con 0x7fb62c13f080 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c13ecb0 0x7fb62c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c13ecb0 0x7fb62c157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51746/0 (socket says 172.21.15.29:51746) 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62affd700 1 -- 172.21.15.29:0/2713582699 learned_addr learned my addr 172.21.15.29:0/2713582699 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62bfff700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13f080 0x7fb62c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62b7fe700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb62c06dde0 0x7fb62c13ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62affd700 1 -- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13f080 msgr2=0x7fb62c158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62affd700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13f080 0x7fb62c158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62affd700 1 -- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb62c06dde0 msgr2=0x7fb62c13ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62affd700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb62c06dde0 0x7fb62c13ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62affd700 1 -- 172.21.15.29:0/2713582699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c009a20 con 0x7fb62c13ecb0 2023-10-06T05:25:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb62affd700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c13ecb0 0x7fb62c157ff0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c4b0 tx=0x7fb61400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb6237fe700 1 -- 172.21.15.29:0/2713582699 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614011590 con 0x7fb62c13ecb0 2023-10-06T05:25:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb6237fe700 1 -- 172.21.15.29:0/2713582699 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb614011710 con 0x7fb62c13ecb0 2023-10-06T05:25:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62400b780 con 0x7fb62c13ecb0 2023-10-06T05:25:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb6237fe700 1 -- 172.21.15.29:0/2713582699 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614011ad0 con 0x7fb62c13ecb0 2023-10-06T05:25:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.909+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c0c4b60 con 0x7fb62c13ecb0 2023-10-06T05:25:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.913+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c04be00 con 0x7fb62c13ecb0 2023-10-06T05:25:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.913+0000 7fb6237fe700 1 -- 172.21.15.29:0/2713582699 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb61401b3b0 con 0x7fb62c13ecb0 2023-10-06T05:25:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.913+0000 7fb6237fe700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb60c060550 0x7fb60c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:51.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.913+0000 7fb6237fe700 1 -- 172.21.15.29:0/2713582699 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb61407c120 con 0x7fb62c13ecb0 2023-10-06T05:25:51.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.913+0000 7fb62b7fe700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb60c060550 0x7fb60c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:51.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.917+0000 7fb62b7fe700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb60c060550 0x7fb60c062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009fd0 tx=0x7fb61c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:51.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:51.921+0000 7fb6237fe700 1 -- 172.21.15.29:0/2713582699 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb61404c630 con 0x7fb62c13ecb0 2023-10-06T05:25:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.081+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb62c0683c0 con 0x7fb62c13ecb0 2023-10-06T05:25:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.081+0000 7fb6237fe700 1 -- 172.21.15.29:0/2713582699 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6140170a0 con 0x7fb62c13ecb0 2023-10-06T05:25:52.086 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:25:52.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.081+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb60c060550 msgr2=0x7fb60c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.081+0000 7fb630865700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb60c060550 0x7fb60c062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009fd0 tx=0x7fb61c00b040 comp rx=0 tx=0).stop 2023-10-06T05:25:52.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.081+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c13ecb0 msgr2=0x7fb62c157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.081+0000 7fb630865700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c13ecb0 0x7fb62c157ff0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c4b0 tx=0x7fb61400c7c0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.081+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 shutdown_connections 2023-10-06T05:25:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.081+0000 7fb630865700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb62c13f080 0x7fb62c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.085+0000 7fb630865700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb62c13ecb0 0x7fb62c157ff0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.085+0000 7fb630865700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb60c060550 0x7fb60c062a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.085+0000 7fb630865700 1 --2- 172.21.15.29:0/2713582699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb62c06dde0 0x7fb62c13ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.085+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 >> 172.21.15.29:0/2713582699 conn(0x7fb62c0c9830 msgr2=0x7fb62c06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.085+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 shutdown_connections 2023-10-06T05:25:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.085+0000 7fb630865700 1 -- 172.21.15.29:0/2713582699 wait complete. 2023-10-06T05:25:52.100 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:25:52.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64588f700 1 Processor -- start 2023-10-06T05:25:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64588f700 1 -- start start 2023-10-06T05:25:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64588f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc64015d730 0x7fc64006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64588f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc64006cc00 0x7fc64006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64588f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64006d040 con 0x7fc640158f10 2023-10-06T05:25:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64588f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64006a600 con 0x7fc64006cc00 2023-10-06T05:25:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64588f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6400cacd0 con 0x7fc64015d730 2023-10-06T05:25:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64508e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc64006cc00 0x7fc64006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc63ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc64015d730 0x7fc64006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc63ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc64015d730 0x7fc64006c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:46098/0 (socket says 172.21.15.29:46098) 2023-10-06T05:25:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc63ffff700 1 -- 172.21.15.29:0/4019341934 learned_addr learned my addr 172.21.15.29:0/4019341934 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64488d700 1 --1- 172.21.15.29:0/4019341934 >> v1:172.21.15.173:6789/0 conn(0x7fc640158f10 0x7fc6400ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:38580/0 (socket says 172.21.15.29:38580) 2023-10-06T05:25:52.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64508e700 1 -- 172.21.15.29:0/4019341934 >> v2:172.21.15.173:3300/0 conn(0x7fc64015d730 msgr2=0x7fc64006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64508e700 1 --2- 172.21.15.29:0/4019341934 >> v2:172.21.15.173:3300/0 conn(0x7fc64015d730 0x7fc64006c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64508e700 1 -- 172.21.15.29:0/4019341934 >> v1:172.21.15.173:6789/0 conn(0x7fc640158f10 legacy=0x7fc6400ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.209+0000 7fc64508e700 1 -- 172.21.15.29:0/4019341934 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6400cafb0 con 0x7fc64006cc00 2023-10-06T05:25:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64508e700 1 --2- 172.21.15.29:0/4019341934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 0x7fc64006aa50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc6400c3600 tx=0x7fc638009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec32e131cff572df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc63f7fe700 1 -- 172.21.15.29:0/4019341934 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63800e070 con 0x7fc64006cc00 2023-10-06T05:25:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc63f7fe700 1 -- 172.21.15.29:0/4019341934 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63800bb60 con 0x7fc64006cc00 2023-10-06T05:25:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc63f7fe700 1 -- 172.21.15.29:0/4019341934 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638012430 con 0x7fc64006cc00 2023-10-06T05:25:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 -- 172.21.15.29:0/4019341934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 msgr2=0x7fc64006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 --2- 172.21.15.29:0/4019341934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 0x7fc64006aa50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc6400c3600 tx=0x7fc638009780 comp rx=0 tx=0).stop 2023-10-06T05:25:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 -- 172.21.15.29:0/4019341934 shutdown_connections 2023-10-06T05:25:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 --2- 172.21.15.29:0/4019341934 >> v2:172.21.15.173:3300/0 conn(0x7fc64015d730 0x7fc64006c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 --2- 172.21.15.29:0/4019341934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 0x7fc64006aa50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 -- 172.21.15.29:0/4019341934 >> 172.21.15.29:0/4019341934 conn(0x7fc640062b60 msgr2=0x7fc640062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 -- 172.21.15.29:0/4019341934 shutdown_connections 2023-10-06T05:25:52.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 -- 172.21.15.29:0/4019341934 wait complete. 2023-10-06T05:25:52.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 Processor -- start 2023-10-06T05:25:52.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.213+0000 7fc64588f700 1 -- start start 2023-10-06T05:25:52.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64588f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 0x7fc640159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64588f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc640158f10 0x7fc640159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64588f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc64015d730 0x7fc64015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64588f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400c6aa0 con 0x7fc64006cc00 2023-10-06T05:25:52.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64588f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400b39d0 con 0x7fc64015d730 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64588f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc640157920 con 0x7fc640158f10 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64488d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 0x7fc640159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64488d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 0x7fc640159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51752/0 (socket says 172.21.15.29:51752) 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64488d700 1 -- 172.21.15.29:0/3164539360 learned_addr learned my addr 172.21.15.29:0/3164539360 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc63ffff700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc640158f10 0x7fc640159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64508e700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc64015d730 0x7fc64015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64488d700 1 -- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc640158f10 msgr2=0x7fc640159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64488d700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc640158f10 0x7fc640159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64488d700 1 -- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc64015d730 msgr2=0x7fc64015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64488d700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc64015d730 0x7fc64015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64488d700 1 -- 172.21.15.29:0/3164539360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc638009a20 con 0x7fc64006cc00 2023-10-06T05:25:52.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc63ffff700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc640158f10 0x7fc640159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:52.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64488d700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 0x7fc640159350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc63000c7c0 tx=0x7fc630007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:52.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc63cff9700 1 -- 172.21.15.29:0/3164539360 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630005a70 con 0x7fc64006cc00 2023-10-06T05:25:52.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc63cff9700 1 -- 172.21.15.29:0/3164539360 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630005bd0 con 0x7fc64006cc00 2023-10-06T05:25:52.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6400c67c0 con 0x7fc64006cc00 2023-10-06T05:25:52.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc63cff9700 1 -- 172.21.15.29:0/3164539360 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6300070d0 con 0x7fc64006cc00 2023-10-06T05:25:52.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6400b3ea0 con 0x7fc64006cc00 2023-10-06T05:25:52.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64004be00 con 0x7fc64006cc00 2023-10-06T05:25:52.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.217+0000 7fc63cff9700 1 -- 172.21.15.29:0/3164539360 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc630007480 con 0x7fc64006cc00 2023-10-06T05:25:52.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.221+0000 7fc63cff9700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc62c060550 0x7fc62c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.221+0000 7fc63cff9700 1 -- 172.21.15.29:0/3164539360 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc63007beb0 con 0x7fc64006cc00 2023-10-06T05:25:52.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.221+0000 7fc63ffff700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc62c060550 0x7fc62c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.221+0000 7fc63ffff700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc62c060550 0x7fc62c062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc634006d40 tx=0x7fc634008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:52.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.225+0000 7fc63cff9700 1 -- 172.21.15.29:0/3164539360 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc63004c340 con 0x7fc64006cc00 2023-10-06T05:25:52.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.388+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6400af630 con 0x7fc64006cc00 2023-10-06T05:25:52.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.388+0000 7fc63cff9700 1 -- 172.21.15.29:0/3164539360 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc630017020 con 0x7fc64006cc00 2023-10-06T05:25:52.396 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:25:52.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc62c060550 msgr2=0x7fc62c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc62c060550 0x7fc62c062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc634006d40 tx=0x7fc634008040 comp rx=0 tx=0).stop 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 msgr2=0x7fc640159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 0x7fc640159350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc63000c7c0 tx=0x7fc630007f00 comp rx=0 tx=0).stop 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 shutdown_connections 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc62c060550 0x7fc62c062a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc64015d730 0x7fc64015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc640158f10 0x7fc640159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 --2- 172.21.15.29:0/3164539360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc64006cc00 0x7fc640159350 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 >> 172.21.15.29:0/3164539360 conn(0x7fc640062b60 msgr2=0x7fc6400cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 shutdown_connections 2023-10-06T05:25:52.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.392+0000 7fc64588f700 1 -- 172.21.15.29:0/3164539360 wait complete. 2023-10-06T05:25:52.410 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:25:52.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.516+0000 7fa7169c5700 1 Processor -- start 2023-10-06T05:25:52.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.516+0000 7fa7169c5700 1 -- start start 2023-10-06T05:25:52.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa710159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa71015d890 0x7fa71006b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71006b380 con 0x7fa7100ce910 2023-10-06T05:25:52.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71006a770 con 0x7fa71015d890 2023-10-06T05:25:52.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71006aa50 con 0x7fa710158c30 2023-10-06T05:25:52.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70f7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa71015d890 0x7fa71006b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa710159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa710159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:53194/0 (socket says 172.21.15.29:53194) 2023-10-06T05:25:52.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70ffff700 1 -- 172.21.15.29:0/2270362423 learned_addr learned my addr 172.21.15.29:0/2270362423 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:52.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70f7fe700 1 -- 172.21.15.29:0/2270362423 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 msgr2=0x7fa710159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:52.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70f7fe700 1 --2- 172.21.15.29:0/2270362423 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa710159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70f7fe700 1 -- 172.21.15.29:0/2270362423 >> v1:172.21.15.173:6789/0 conn(0x7fa7100ce910 legacy=0x7fa7100cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70f7fe700 1 -- 172.21.15.29:0/2270362423 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71006ad30 con 0x7fa71015d890 2023-10-06T05:25:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70ffff700 1 --2- 172.21.15.29:0/2270362423 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa710159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70f7fe700 1 --2- 172.21.15.29:0/2270362423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71015d890 0x7fa71006b810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa7000098e0 tx=0x7fa7000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d7500da03427ef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70effd700 1 -- 172.21.15.29:0/2270362423 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70000b640 con 0x7fa71015d890 2023-10-06T05:25:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70effd700 1 -- 172.21.15.29:0/2270362423 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70000b7a0 con 0x7fa71015d890 2023-10-06T05:25:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa70effd700 1 -- 172.21.15.29:0/2270362423 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70000bb40 con 0x7fa71015d890 2023-10-06T05:25:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 -- 172.21.15.29:0/2270362423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71015d890 msgr2=0x7fa71006b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 --2- 172.21.15.29:0/2270362423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71015d890 0x7fa71006b810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa7000098e0 tx=0x7fa7000091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 -- 172.21.15.29:0/2270362423 shutdown_connections 2023-10-06T05:25:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 --2- 172.21.15.29:0/2270362423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa71015d890 0x7fa71006b810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 --2- 172.21.15.29:0/2270362423 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa710159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 -- 172.21.15.29:0/2270362423 >> 172.21.15.29:0/2270362423 conn(0x7fa7100670a0 msgr2=0x7fa7100674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:52.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 -- 172.21.15.29:0/2270362423 shutdown_connections 2023-10-06T05:25:52.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.520+0000 7fa7169c5700 1 -- 172.21.15.29:0/2270362423 wait complete. 2023-10-06T05:25:52.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa7169c5700 1 Processor -- start 2023-10-06T05:25:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa7169c5700 1 -- start start 2023-10-06T05:25:52.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa7169c5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7100ce910 0x7fa710154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa7169c5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa7100b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa7169c5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71015d890 0x7fa7100cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa7169c5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa710169810 con 0x7fa71015d890 2023-10-06T05:25:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa7169c5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100b5a10 con 0x7fa7100ce910 2023-10-06T05:25:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa7169c5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa710169a90 con 0x7fa710158c30 2023-10-06T05:25:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa714f62700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71015d890 0x7fa7100cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa714f62700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71015d890 0x7fa7100cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51758/0 (socket says 172.21.15.29:51758) 2023-10-06T05:25:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa714f62700 1 -- 172.21.15.29:0/1854556898 learned_addr learned my addr 172.21.15.29:0/1854556898 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa70f7fe700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa7100b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa70ffff700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7100ce910 0x7fa710154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa714f62700 1 -- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 msgr2=0x7fa7100b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa714f62700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa7100b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa714f62700 1 -- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7100ce910 msgr2=0x7fa710154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa714f62700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7100ce910 0x7fa710154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.524+0000 7fa714f62700 1 -- 172.21.15.29:0/1854556898 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f80094f0 con 0x7fa71015d890 2023-10-06T05:25:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.528+0000 7fa714f62700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71015d890 0x7fa7100cb1f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa70800c8e0 tx=0x7fa708001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.528+0000 7fa707fff700 1 -- 172.21.15.29:0/1854556898 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708012630 con 0x7fa71015d890 2023-10-06T05:25:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.528+0000 7fa707fff700 1 -- 172.21.15.29:0/1854556898 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa708012790 con 0x7fa71015d890 2023-10-06T05:25:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.528+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa700009420 con 0x7fa71015d890 2023-10-06T05:25:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.528+0000 7fa707fff700 1 -- 172.21.15.29:0/1854556898 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708012b50 con 0x7fa71015d890 2023-10-06T05:25:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.528+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71016a050 con 0x7fa71015d890 2023-10-06T05:25:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.528+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71016a240 con 0x7fa71015d890 2023-10-06T05:25:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.528+0000 7fa707fff700 1 -- 172.21.15.29:0/1854556898 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa70801a3a0 con 0x7fa71015d890 2023-10-06T05:25:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.528+0000 7fa707fff700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa6f0060550 0x7fa6f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.532+0000 7fa707fff700 1 -- 172.21.15.29:0/1854556898 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa70807cbc0 con 0x7fa71015d890 2023-10-06T05:25:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.532+0000 7fa70ffff700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa6f0060550 0x7fa6f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.532+0000 7fa70ffff700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa6f0060550 0x7fa6f0062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8006d20 tx=0x7fa6f8009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:52.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.540+0000 7fa707fff700 1 -- 172.21.15.29:0/1854556898 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa70804d050 con 0x7fa71015d890 2023-10-06T05:25:52.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa710071120 con 0x7fa71015d890 2023-10-06T05:25:52.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa707fff700 1 -- 172.21.15.29:0/1854556898 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa708050670 con 0x7fa71015d890 2023-10-06T05:25:52.701 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:25:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa6f0060550 msgr2=0x7fa6f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa6f0060550 0x7fa6f0062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8006d20 tx=0x7fa6f8009250 comp rx=0 tx=0).stop 2023-10-06T05:25:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71015d890 msgr2=0x7fa7100cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71015d890 0x7fa7100cb1f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa70800c8e0 tx=0x7fa708001710 comp rx=0 tx=0).stop 2023-10-06T05:25:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 shutdown_connections 2023-10-06T05:25:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa71015d890 0x7fa7100cb1f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa710158c30 0x7fa7100b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa6f0060550 0x7fa6f0062a00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 --2- 172.21.15.29:0/1854556898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7100ce910 0x7fa710154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 >> 172.21.15.29:0/1854556898 conn(0x7fa7100670a0 msgr2=0x7fa710155810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 shutdown_connections 2023-10-06T05:25:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.696+0000 7fa7169c5700 1 -- 172.21.15.29:0/1854556898 wait complete. 2023-10-06T05:25:52.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:25:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.824+0000 7f0f84539700 1 Processor -- start 2023-10-06T05:25:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.824+0000 7f0f84539700 1 -- start start 2023-10-06T05:25:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c06d900 0x7f0f7c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0f7c0ae630 0x7f0f7c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f7c150db0 0x7f0f7c151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c15b1b0 con 0x7f0f7c150db0 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c151750 con 0x7f0f7c0ae630 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0aebf0 con 0x7f0f7c06d900 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f822d5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c06d900 0x7f0f7c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f81ad4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0f7c0ae630 0x7f0f7c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f822d5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c06d900 0x7f0f7c06dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:53210/0 (socket says 172.21.15.29:53210) 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f822d5700 1 -- 172.21.15.29:0/1175351404 learned_addr learned my addr 172.21.15.29:0/1175351404 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f82ad6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f7c150db0 0x7f0f7c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f82ad6700 1 -- 172.21.15.29:0/1175351404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c06d900 msgr2=0x7f0f7c06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:52.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f82ad6700 1 --2- 172.21.15.29:0/1175351404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c06d900 0x7f0f7c06dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f82ad6700 1 -- 172.21.15.29:0/1175351404 >> v2:172.21.15.173:3300/0 conn(0x7f0f7c0ae630 msgr2=0x7f0f7c157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:52.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f82ad6700 1 --2- 172.21.15.29:0/1175351404 >> v2:172.21.15.173:3300/0 conn(0x7f0f7c0ae630 0x7f0f7c157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f82ad6700 1 -- 172.21.15.29:0/1175351404 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c15a880 con 0x7f0f7c150db0 2023-10-06T05:25:52.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f82ad6700 1 --2- 172.21.15.29:0/1175351404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 0x7f0f7c151210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c06e290 tx=0x7f0f74009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40338c1aef99579c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:52.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f812d3700 1 -- 172.21.15.29:0/1175351404 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400e070 con 0x7f0f7c150db0 2023-10-06T05:25:52.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f812d3700 1 -- 172.21.15.29:0/1175351404 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7400bab0 con 0x7f0f7c150db0 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f812d3700 1 -- 172.21.15.29:0/1175351404 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400be70 con 0x7f0f7c150db0 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 -- 172.21.15.29:0/1175351404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 msgr2=0x7f0f7c151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 --2- 172.21.15.29:0/1175351404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 0x7f0f7c151210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c06e290 tx=0x7f0f74009780 comp rx=0 tx=0).stop 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 -- 172.21.15.29:0/1175351404 shutdown_connections 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 --2- 172.21.15.29:0/1175351404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 0x7f0f7c151210 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 --2- 172.21.15.29:0/1175351404 >> v2:172.21.15.173:3300/0 conn(0x7f0f7c0ae630 0x7f0f7c157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 --2- 172.21.15.29:0/1175351404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c06d900 0x7f0f7c06dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 -- 172.21.15.29:0/1175351404 >> 172.21.15.29:0/1175351404 conn(0x7f0f7c06b770 msgr2=0x7f0f7c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 -- 172.21.15.29:0/1175351404 shutdown_connections 2023-10-06T05:25:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.828+0000 7f0f84539700 1 -- 172.21.15.29:0/1175351404 wait complete. 2023-10-06T05:25:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f84539700 1 Processor -- start 2023-10-06T05:25:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f84539700 1 -- start start 2023-10-06T05:25:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f84539700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c06d900 0x7f0f7c154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f84539700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c0ae630 0x7f0f7c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f84539700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 0x7f0f7c13dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f84539700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0cc000 con 0x7f0f7c150db0 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f84539700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c14c710 con 0x7f0f7c06d900 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f84539700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c14c9f0 con 0x7f0f7c0ae630 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f82ad6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 0x7f0f7c13dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f822d5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c06d900 0x7f0f7c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f81ad4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c0ae630 0x7f0f7c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f82ad6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 0x7f0f7c13dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51774/0 (socket says 172.21.15.29:51774) 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f822d5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c06d900 0x7f0f7c154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:46132/0 (socket says 172.21.15.29:46132) 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f82ad6700 1 -- 172.21.15.29:0/2071950599 learned_addr learned my addr 172.21.15.29:0/2071950599 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f82ad6700 1 -- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c0ae630 msgr2=0x7f0f7c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f82ad6700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c0ae630 0x7f0f7c0cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f82ad6700 1 -- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c06d900 msgr2=0x7f0f7c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:52.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f82ad6700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c06d900 0x7f0f7c154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:52.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f82ad6700 1 -- 172.21.15.29:0/2071950599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74009a20 con 0x7f0f7c150db0 2023-10-06T05:25:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.832+0000 7f0f82ad6700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 0x7f0f7c13dc80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f740097c0 tx=0x7f0f74019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f727fc700 1 -- 172.21.15.29:0/2071950599 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74012db0 con 0x7f0f7c150db0 2023-10-06T05:25:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f727fc700 1 -- 172.21.15.29:0/2071950599 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f74027470 con 0x7f0f7c150db0 2023-10-06T05:25:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c14ccd0 con 0x7f0f7c150db0 2023-10-06T05:25:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f727fc700 1 -- 172.21.15.29:0/2071950599 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74027830 con 0x7f0f7c150db0 2023-10-06T05:25:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c14d290 con 0x7f0f7c150db0 2023-10-06T05:25:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c14d480 con 0x7f0f7c150db0 2023-10-06T05:25:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f727fc700 1 -- 172.21.15.29:0/2071950599 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0f74024070 con 0x7f0f7c150db0 2023-10-06T05:25:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f727fc700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f60060550 0x7f0f60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f727fc700 1 -- 172.21.15.29:0/2071950599 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0f7407ef80 con 0x7f0f7c150db0 2023-10-06T05:25:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f822d5700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f60060550 0x7f0f60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:52.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.836+0000 7f0f822d5700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f60060550 0x7f0f60062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f78006d40 tx=0x7f0f78009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:52.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:52.844+0000 7f0f727fc700 1 -- 172.21.15.29:0/2071950599 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0f740aebe0 con 0x7f0f7c150db0 2023-10-06T05:25:53.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.040+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f7c0c92c0 con 0x7f0f7c150db0 2023-10-06T05:25:53.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.040+0000 7f0f727fc700 1 -- 172.21.15.29:0/2071950599 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f0f7404f410 con 0x7f0f7c150db0 2023-10-06T05:25:53.046 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:53.046 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/320155266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":320155266},{"type":"v1","addr":"172.21.15.29:6833","nonce":320155266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3562424943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3562424943},{"type":"v1","addr":"172.21.15.173:6836","nonce":3562424943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2321165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2321165769},{"type":"v1","addr":"172.21.15.173:6837","nonce":2321165769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:25:39.986226+0000","modified":"2023-10-06T05:25:43.642085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3557282345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3557282345},{"type":"v1","addr":"172.21.15.29:6835","nonce":3557282345}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T05:25:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f60060550 msgr2=0x7f0f60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f60060550 0x7f0f60062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f78006d40 tx=0x7f0f78009250 comp rx=0 tx=0).stop 2023-10-06T05:25:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 msgr2=0x7f0f7c13dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 0x7f0f7c13dc80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f740097c0 tx=0x7f0f74019000 comp rx=0 tx=0).stop 2023-10-06T05:25:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 shutdown_connections 2023-10-06T05:25:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f7c150db0 0x7f0f7c13dc80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f7c0ae630 0x7f0f7c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f60060550 0x7f0f60062a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 --2- 172.21.15.29:0/2071950599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f7c06d900 0x7f0f7c154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 >> 172.21.15.29:0/2071950599 conn(0x7f0f7c06b770 msgr2=0x7f0f7c14fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 shutdown_connections 2023-10-06T05:25:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.044+0000 7f0f84539700 1 -- 172.21.15.29:0/2071950599 wait complete. 2023-10-06T05:25:53.050 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-06T05:25:53.065 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:25:53.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.164+0000 7f24e63fb700 1 Processor -- start 2023-10-06T05:25:53.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.164+0000 7f24e63fb700 1 -- start start 2023-10-06T05:25:53.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.164+0000 7f24e63fb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e0158c00 0x7f24e006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.164+0000 7f24e63fb700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e006b250 con 0x7f24e00ceb90 2023-10-06T05:25:53.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.164+0000 7f24e63fb700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e006a640 con 0x7f24e00ce740 2023-10-06T05:25:53.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.164+0000 7f24e63fb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e006a920 con 0x7f24e0158c00 2023-10-06T05:25:53.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e5bfa700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f24e00ceb90 0x7f24e015a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50700/0 (socket says 172.21.15.29:50700) 2023-10-06T05:25:53.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e5bfa700 1 -- 172.21.15.29:0/1651715258 learned_addr learned my addr 172.21.15.29:0/1651715258 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:53.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e53f9700 1 --2- 172.21.15.29:0/1651715258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e0158c00 0x7f24e006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24d3fff700 1 -- 172.21.15.29:0/1651715258 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765698950 0 0) 0x7f24e006b250 con 0x7f24e00ceb90 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24d3fff700 1 -- 172.21.15.29:0/1651715258 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24cc003570 con 0x7f24e00ceb90 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e53f9700 1 -- 172.21.15.29:0/1651715258 >> v1:172.21.15.173:6789/0 conn(0x7f24e00ce740 legacy=0x7f24e00cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24d3fff700 1 -- 172.21.15.29:0/1651715258 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107114090 0 0) 0x7f24e006a640 con 0x7f24e00ce740 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e53f9700 1 -- 172.21.15.29:0/1651715258 >> v1:172.21.15.29:6789/0 conn(0x7f24e00ceb90 legacy=0x7f24e015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e53f9700 1 -- 172.21.15.29:0/1651715258 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e006ac00 con 0x7f24e0158c00 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e53f9700 1 --2- 172.21.15.29:0/1651715258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e0158c00 0x7f24e006b6e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009910 tx=0x7f24d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c120ac638babd44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24d3fff700 1 -- 172.21.15.29:0/1651715258 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400b680 con 0x7f24e0158c00 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24d3fff700 1 -- 172.21.15.29:0/1651715258 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d400b7e0 con 0x7f24e0158c00 2023-10-06T05:25:53.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24d3fff700 1 -- 172.21.15.29:0/1651715258 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400bba0 con 0x7f24e0158c00 2023-10-06T05:25:53.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e63fb700 1 -- 172.21.15.29:0/1651715258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e0158c00 msgr2=0x7f24e006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e63fb700 1 --2- 172.21.15.29:0/1651715258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e0158c00 0x7f24e006b6e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009910 tx=0x7f24d40091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e63fb700 1 -- 172.21.15.29:0/1651715258 shutdown_connections 2023-10-06T05:25:53.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e63fb700 1 --2- 172.21.15.29:0/1651715258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e0158c00 0x7f24e006b6e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e63fb700 1 -- 172.21.15.29:0/1651715258 >> 172.21.15.29:0/1651715258 conn(0x7f24e00670a0 msgr2=0x7f24e0067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:53.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e63fb700 1 -- 172.21.15.29:0/1651715258 shutdown_connections 2023-10-06T05:25:53.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.168+0000 7f24e63fb700 1 -- 172.21.15.29:0/1651715258 wait complete. 2023-10-06T05:25:53.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 Processor -- start 2023-10-06T05:25:53.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 -- start start 2023-10-06T05:25:53.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24e00ce740 0x7f24e0143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e00ceb90 0x7f24e00cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e0158c00 0x7f24e00cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e0169020 con 0x7f24e0158c00 2023-10-06T05:25:53.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e016d5a0 con 0x7f24e00ce740 2023-10-06T05:25:53.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e0169b40 con 0x7f24e00ceb90 2023-10-06T05:25:53.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e5bfa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e0158c00 0x7f24e00cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e4bf8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e00ceb90 0x7f24e00cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e4bf8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e00ceb90 0x7f24e00cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:53228/0 (socket says 172.21.15.29:53228) 2023-10-06T05:25:53.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e53f9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24e00ce740 0x7f24e0143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e4bf8700 1 -- 172.21.15.29:0/2398885098 learned_addr learned my addr 172.21.15.29:0/2398885098 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:53.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e4bf8700 1 -- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24e00ce740 msgr2=0x7f24e0143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e4bf8700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24e00ce740 0x7f24e0143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e4bf8700 1 -- 172.21.15.29:0/2398885098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e0158c00 msgr2=0x7f24e00cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e4bf8700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e0158c00 0x7f24e00cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e4bf8700 1 -- 172.21.15.29:0/2398885098 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4009420 con 0x7f24e00ceb90 2023-10-06T05:25:53.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e4bf8700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e00ceb90 0x7f24e00cbe50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00c7e0 tx=0x7f24dc007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:53.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24d17fa700 1 -- 172.21.15.29:0/2398885098 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc0105c0 con 0x7f24e00ceb90 2023-10-06T05:25:53.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24d17fa700 1 -- 172.21.15.29:0/2398885098 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24dc010740 con 0x7f24e00ceb90 2023-10-06T05:25:53.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e0169fd0 con 0x7f24e00ceb90 2023-10-06T05:25:53.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24d17fa700 1 -- 172.21.15.29:0/2398885098 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc010b00 con 0x7f24e00ceb90 2023-10-06T05:25:53.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.172+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e01694f0 con 0x7f24e00ceb90 2023-10-06T05:25:53.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.176+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e0169cf0 con 0x7f24e00ceb90 2023-10-06T05:25:53.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.176+0000 7f24d17fa700 1 -- 172.21.15.29:0/2398885098 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f24dc01b3b0 con 0x7f24e00ceb90 2023-10-06T05:25:53.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.176+0000 7f24d17fa700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f24c40605d0 0x7f24c4062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.176+0000 7f24d17fa700 1 -- 172.21.15.29:0/2398885098 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f24dc07bf30 con 0x7f24e00ceb90 2023-10-06T05:25:53.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.176+0000 7f24e53f9700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f24c40605d0 0x7f24c4062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.176+0000 7f24e53f9700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f24c40605d0 0x7f24c4062a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24d40093f0 tx=0x7f24d4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:53.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.184+0000 7f24d17fa700 1 -- 172.21.15.29:0/2398885098 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f24e0169cf0 con 0x7f24e00ceb90 2023-10-06T05:25:53.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.348+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24e0169c80 con 0x7f24e00ceb90 2023-10-06T05:25:53.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24d17fa700 1 -- 172.21.15.29:0/2398885098 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f24dc017020 con 0x7f24e00ceb90 2023-10-06T05:25:53.357 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:53.357 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:25:53.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f24c40605d0 msgr2=0x7f24c4062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f24c40605d0 0x7f24c4062a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24d40093f0 tx=0x7f24d4017000 comp rx=0 tx=0).stop 2023-10-06T05:25:53.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e00ceb90 msgr2=0x7f24e00cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e00ceb90 0x7f24e00cbe50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00c7e0 tx=0x7f24dc007df0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 shutdown_connections 2023-10-06T05:25:53.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e0158c00 0x7f24e00cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24e00ceb90 0x7f24e00cbe50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f24c40605d0 0x7f24c4062a80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 --2- 172.21.15.29:0/2398885098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24e00ce740 0x7f24e0143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 >> 172.21.15.29:0/2398885098 conn(0x7f24e00670a0 msgr2=0x7f24e015a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:53.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 shutdown_connections 2023-10-06T05:25:53.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.352+0000 7f24e63fb700 1 -- 172.21.15.29:0/2398885098 wait complete. 2023-10-06T05:25:53.372 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:25:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.468+0000 7f97e505a700 1 Processor -- start 2023-10-06T05:25:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.468+0000 7f97e505a700 1 -- start start 2023-10-06T05:25:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97e505a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e01605e0 0x7f97e00c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97e505a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e00c2980 con 0x7f97e00ca3c0 2023-10-06T05:25:53.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97e505a700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e00c6bb0 con 0x7f97e006b320 2023-10-06T05:25:53.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97e505a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00c6e90 con 0x7f97e01605e0 2023-10-06T05:25:53.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97e4859700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f97e00ca3c0 0x7f97e00c7c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50716/0 (socket says 172.21.15.29:50716) 2023-10-06T05:25:53.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97e4859700 1 -- 172.21.15.29:0/295506279 learned_addr learned my addr 172.21.15.29:0/295506279 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:53.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97dffff700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e01605e0 0x7f97e00c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871493850 0 0) 0x7f97e00c2980 con 0x7f97e00ca3c0 2023-10-06T05:25:53.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c8003570 con 0x7f97e00ca3c0 2023-10-06T05:25:53.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3340831365 0 0) 0x7f97c8003570 con 0x7f97e00ca3c0 2023-10-06T05:25:53.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e01605e0 msgr2=0x7f97e00c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:53.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e01605e0 0x7f97e00c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 >> v1:172.21.15.173:6789/0 conn(0x7f97e006b320 legacy=0x7f97e00c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e00c7170 con 0x7f97e00ca3c0 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f97d80017f0 con 0x7f97e00ca3c0 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 >> v1:172.21.15.29:6789/0 conn(0x7f97e00ca3c0 legacy=0x7f97e00c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c8003a90 0x7f97c8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c8004810 0x7f97c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c80051c0 0x7f97c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00c6e90 con 0x7f97c8004810 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c800c130 con 0x7f97c80051c0 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c800c2c0 con 0x7f97c8003a90 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97dffff700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e01605e0 0x7f97e00c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97df7fe700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c8004810 0x7f97c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97e4859700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c80051c0 0x7f97c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97dffff700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c8003a90 0x7f97c8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97df7fe700 1 -- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c8003a90 msgr2=0x7f97c8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97df7fe700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97c8003a90 0x7f97c8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97df7fe700 1 -- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c80051c0 msgr2=0x7f97c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97df7fe700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c80051c0 0x7f97c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97df7fe700 1 -- 172.21.15.29:0/295506279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c8003570 con 0x7f97c8004810 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97df7fe700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c8004810 0x7f97c8004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f97d0001a90 tx=0x7f97d0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5148d73ec534cf30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000c550 con 0x7f97c8004810 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d000c6d0 con 0x7f97c8004810 2023-10-06T05:25:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97deffd700 1 -- 172.21.15.29:0/295506279 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000ca90 con 0x7f97c8004810 2023-10-06T05:25:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97e505a700 1 -- 172.21.15.29:0/295506279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c8004810 msgr2=0x7f97c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.472+0000 7f97e505a700 1 --2- 172.21.15.29:0/295506279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97c8004810 0x7f97c8004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f97d0001a90 tx=0x7f97d0007d30 comp rx=0 tx=0).stop 2023-10-06T05:25:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e4859700 1 -- 172.21.15.29:0/295506279 reap_dead start 2023-10-06T05:25:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- 172.21.15.29:0/295506279 shutdown_connections 2023-10-06T05:25:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- 172.21.15.29:0/295506279 >> 172.21.15.29:0/295506279 conn(0x7f97e00670a0 msgr2=0x7f97e00674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- 172.21.15.29:0/295506279 shutdown_connections 2023-10-06T05:25:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- 172.21.15.29:0/295506279 wait complete. 2023-10-06T05:25:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 Processor -- start 2023-10-06T05:25:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- start start 2023-10-06T05:25:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c8004810 0x7f97e00c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97e0162320 0x7f97e00c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e00af3d0 0x7f97e014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00c30f0 con 0x7f97e0162320 2023-10-06T05:25:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00c4a10 con 0x7f97c8004810 2023-10-06T05:25:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e0161e90 con 0x7f97e00af3d0 2023-10-06T05:25:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97df7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97e0162320 0x7f97e00c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97df7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97e0162320 0x7f97e00c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51800/0 (socket says 172.21.15.29:51800) 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97df7fe700 1 -- 172.21.15.29:0/3528830470 learned_addr learned my addr 172.21.15.29:0/3528830470 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e4859700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e00af3d0 0x7f97e014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97dffff700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c8004810 0x7f97e00c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97df7fe700 1 -- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e00af3d0 msgr2=0x7f97e014d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97df7fe700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e00af3d0 0x7f97e014d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97df7fe700 1 -- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c8004810 msgr2=0x7f97e00c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97df7fe700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c8004810 0x7f97e00c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97df7fe700 1 -- 172.21.15.29:0/3528830470 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e0161560 con 0x7f97e0162320 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97df7fe700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97e0162320 0x7f97e00c44d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f97d0012a20 tx=0x7f97d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97c7fff700 1 -- 172.21.15.29:0/3528830470 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0001390 con 0x7f97e0162320 2023-10-06T05:25:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97c7fff700 1 -- 172.21.15.29:0/3528830470 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d0012e10 con 0x7f97e0162320 2023-10-06T05:25:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e0161840 con 0x7f97e0162320 2023-10-06T05:25:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97c7fff700 1 -- 172.21.15.29:0/3528830470 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0006a50 con 0x7f97e0162320 2023-10-06T05:25:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.476+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e00af850 con 0x7f97e0162320 2023-10-06T05:25:53.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.480+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e0162020 con 0x7f97e0162320 2023-10-06T05:25:53.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.480+0000 7f97c7fff700 1 -- 172.21.15.29:0/3528830470 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f97d0019030 con 0x7f97e0162320 2023-10-06T05:25:53.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.480+0000 7f97c7fff700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060550 0x7f97cc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:53.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.480+0000 7f97c7fff700 1 -- 172.21.15.29:0/3528830470 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f97d007ddd0 con 0x7f97e0162320 2023-10-06T05:25:53.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.480+0000 7f97dffff700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060550 0x7f97cc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:53.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.480+0000 7f97dffff700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060550 0x7f97cc062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97d4006fd0 tx=0x7f97d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:53.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.488+0000 7f97c7fff700 1 -- 172.21.15.29:0/3528830470 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f97d004e260 con 0x7f97e0162320 2023-10-06T05:25:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.680+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97e00afb00 con 0x7f97e0162320 2023-10-06T05:25:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.680+0000 7f97c7fff700 1 -- 172.21.15.29:0/3528830470 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f97d0051880 con 0x7f97e0162320 2023-10-06T05:25:53.687 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:25:53.688 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/320155266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":320155266},{"type":"v1","addr":"172.21.15.29:6833","nonce":320155266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3562424943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3562424943},{"type":"v1","addr":"172.21.15.173:6836","nonce":3562424943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2321165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2321165769},{"type":"v1","addr":"172.21.15.173:6837","nonce":2321165769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:25:39.986226+0000","modified":"2023-10-06T05:25:43.642085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3557282345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3557282345},{"type":"v1","addr":"172.21.15.29:6835","nonce":3557282345}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T05:25:53.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060550 msgr2=0x7f97cc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060550 0x7f97cc062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97d4006fd0 tx=0x7f97d4008040 comp rx=0 tx=0).stop 2023-10-06T05:25:53.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97e0162320 msgr2=0x7f97e00c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:53.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97e0162320 0x7f97e00c44d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f97d0012a20 tx=0x7f97d0015000 comp rx=0 tx=0).stop 2023-10-06T05:25:53.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 shutdown_connections 2023-10-06T05:25:53.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97e00af3d0 0x7f97e014d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97e0162320 0x7f97e00c44d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060550 0x7f97cc062a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 --2- 172.21.15.29:0/3528830470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97c8004810 0x7f97e00c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 >> 172.21.15.29:0/3528830470 conn(0x7f97e00670a0 msgr2=0x7f97e015bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 shutdown_connections 2023-10-06T05:25:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:53.684+0000 7f97e505a700 1 -- 172.21.15.29:0/3528830470 wait complete. 2023-10-06T05:25:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-06T05:25:54.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:25:39.986226+0000', 'modified': '2023-10-06T05:25:43.642085+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4315}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4315': {'gid': 4315, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/3557282345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 3557282345}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 3557282345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:25:54.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T05:25:54.104 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T05:25:54.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f40365fe700 1 Processor -- start 2023-10-06T05:25:54.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f40365fe700 1 -- start start 2023-10-06T05:25:54.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f40365fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4030159170 0x7f40300ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f40365fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403006ab80 con 0x7f403006c8f0 2023-10-06T05:25:54.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f40365fe700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40300cb4e0 con 0x7f403006ccc0 2023-10-06T05:25:54.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f40365fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40300cb7c0 con 0x7f4030159170 2023-10-06T05:25:54.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f4034b9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4030159170 0x7f40300ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f4034b9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4030159170 0x7f40300ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51808/0 (socket says 172.21.15.29:51808) 2023-10-06T05:25:54.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f4034b9b700 1 -- 172.21.15.29:0/361868071 learned_addr learned my addr 172.21.15.29:0/361868071 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:54.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f402ffff700 1 --1- 172.21.15.29:0/361868071 >> v1:172.21.15.29:6789/0 conn(0x7f403006c8f0 0x7f40300afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50730/0 (socket says 172.21.15.29:50730) 2023-10-06T05:25:54.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f4034b9b700 1 -- 172.21.15.29:0/361868071 >> v1:172.21.15.173:6789/0 conn(0x7f403006ccc0 legacy=0x7f4030158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f4034b9b700 1 -- 172.21.15.29:0/361868071 >> v1:172.21.15.29:6789/0 conn(0x7f403006c8f0 legacy=0x7f40300afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f4034b9b700 1 -- 172.21.15.29:0/361868071 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403006a810 con 0x7f4030159170 2023-10-06T05:25:54.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f4034b9b700 1 --2- 172.21.15.29:0/361868071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 0x7f40300ca770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4028009f20 tx=0x7f4028009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb9dec120b9d3b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f402effd700 1 -- 172.21.15.29:0/361868071 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402800e070 con 0x7f4030159170 2023-10-06T05:25:54.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f402effd700 1 -- 172.21.15.29:0/361868071 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402800ba40 con 0x7f4030159170 2023-10-06T05:25:54.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f402effd700 1 -- 172.21.15.29:0/361868071 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280092e0 con 0x7f4030159170 2023-10-06T05:25:54.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f40365fe700 1 -- 172.21.15.29:0/361868071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 msgr2=0x7f40300ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.224+0000 7f40365fe700 1 --2- 172.21.15.29:0/361868071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 0x7f40300ca770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4028009f20 tx=0x7f4028009840 comp rx=0 tx=0).stop 2023-10-06T05:25:54.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 -- 172.21.15.29:0/361868071 shutdown_connections 2023-10-06T05:25:54.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 --2- 172.21.15.29:0/361868071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 0x7f40300ca770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 -- 172.21.15.29:0/361868071 >> 172.21.15.29:0/361868071 conn(0x7f4030068510 msgr2=0x7f4030068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:54.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 -- 172.21.15.29:0/361868071 shutdown_connections 2023-10-06T05:25:54.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 -- 172.21.15.29:0/361868071 wait complete. 2023-10-06T05:25:54.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 Processor -- start 2023-10-06T05:25:54.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 -- start start 2023-10-06T05:25:54.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f403006c8f0 0x7f40300c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403006ccc0 0x7f40300b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 0x7f4030152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40300b5860 con 0x7f4030159170 2023-10-06T05:25:54.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40300b4c50 con 0x7f403006ccc0 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f40365fe700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40300b4f30 con 0x7f403006c8f0 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f4034b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 0x7f4030152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f4034b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 0x7f4030152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51822/0 (socket says 172.21.15.29:51822) 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f4034b9b700 1 -- 172.21.15.29:0/3480740208 learned_addr learned my addr 172.21.15.29:0/3480740208 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f402ffff700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f403006c8f0 0x7f40300c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.228+0000 7f402f7fe700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403006ccc0 0x7f40300b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4034b9b700 1 -- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f403006c8f0 msgr2=0x7f40300c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4034b9b700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f403006c8f0 0x7f40300c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4034b9b700 1 -- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403006ccc0 msgr2=0x7f40300b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4034b9b700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403006ccc0 0x7f40300b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4034b9b700 1 -- 172.21.15.29:0/3480740208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4028009ae0 con 0x7f4030159170 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f402f7fe700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403006ccc0 0x7f40300b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:54.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4034b9b700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 0x7f4030152dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40300cfd30 tx=0x7f4028017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4017fff700 1 -- 172.21.15.29:0/3480740208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280092e0 con 0x7f4030159170 2023-10-06T05:25:54.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4017fff700 1 -- 172.21.15.29:0/3480740208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4028012db0 con 0x7f4030159170 2023-10-06T05:25:54.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4017fff700 1 -- 172.21.15.29:0/3480740208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402801e660 con 0x7f4030159170 2023-10-06T05:25:54.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f40365fe700 1 -- 172.21.15.29:0/3480740208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40300b5210 con 0x7f4030159170 2023-10-06T05:25:54.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f40365fe700 1 -- 172.21.15.29:0/3480740208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40300c9120 con 0x7f4030159170 2023-10-06T05:25:54.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.232+0000 7f4017fff700 1 -- 172.21.15.29:0/3480740208 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f402801ea10 con 0x7f4030159170 2023-10-06T05:25:54.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f4017fff700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f401c060550 0x7f401c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f4017fff700 1 -- 172.21.15.29:0/3480740208 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f402807e5d0 con 0x7f4030159170 2023-10-06T05:25:54.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402ffff700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f401c060550 0x7f401c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f40388a7740 1 Processor -- start 2023-10-06T05:25:54.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f40388a7740 1 -- start start 2023-10-06T05:25:54.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402ffff700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f401c060550 0x7f401c062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40200029f0 tx=0x7f4020009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f40388a7740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663ae0 0x28e0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f40388a7740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f40388a7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26ae790 0x28e10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f40388a7740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x280ef30 con 0x2663710 2023-10-06T05:25:54.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f40388a7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x280aed0 con 0x26ae790 2023-10-06T05:25:54.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f40388a7740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x27d10b0 con 0x2663ae0 2023-10-06T05:25:54.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51828/0 (socket says 172.21.15.29:51828) 2023-10-06T05:25:54.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402f7fe700 1 -- 172.21.15.29:0/3472659874 learned_addr learned my addr 172.21.15.29:0/3472659874 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:54.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f4034b9b700 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26ae790 0x28e10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402ffff700 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663ae0 0x28e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402f7fe700 1 -- 172.21.15.29:0/3472659874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663ae0 msgr2=0x28e0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402f7fe700 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663ae0 0x28e0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402f7fe700 1 -- 172.21.15.29:0/3472659874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26ae790 msgr2=0x28e10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402f7fe700 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26ae790 0x28e10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f402f7fe700 1 -- 172.21.15.29:0/3472659874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26af9e0 con 0x2663710 2023-10-06T05:25:54.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.236+0000 7f4034b9b700 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26ae790 0x28e10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:54.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f402f7fe700 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e0b70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4024002750 tx=0x7f4024009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c8214976e3e951 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40157fa700 1 -- 172.21.15.29:0/3472659874 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024006820 con 0x2663710 2023-10-06T05:25:54.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40157fa700 1 -- 172.21.15.29:0/3472659874 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024006980 con 0x2663710 2023-10-06T05:25:54.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40157fa700 1 -- 172.21.15.29:0/3472659874 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024006d40 con 0x2663710 2023-10-06T05:25:54.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 -- 172.21.15.29:0/3472659874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 msgr2=0x28e0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e0b70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4024002750 tx=0x7f4024009040 comp rx=0 tx=0).stop 2023-10-06T05:25:54.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 -- 172.21.15.29:0/3472659874 shutdown_connections 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26ae790 0x28e10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e0b70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 --2- 172.21.15.29:0/3472659874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663ae0 0x28e0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 -- 172.21.15.29:0/3472659874 >> 172.21.15.29:0/3472659874 conn(0x2663eb0 msgr2=0x289d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 -- 172.21.15.29:0/3472659874 shutdown_connections 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 -- 172.21.15.29:0/3472659874 wait complete. 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 -- start start 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.240+0000 7f40388a7740 1 Processor -- start 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x28e5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 0x289ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x27d0d50 con 0x2663710 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x27a9970 con 0x2663ae0 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x263a060 con 0x26ae790 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 10 client.0 _ll_register_callbacks cb 0x27adb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51836/0 (socket says 172.21.15.29:51836) 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402ffff700 1 -- 172.21.15.29:0/3555964379 learned_addr learned my addr 172.21.15.29:0/3555964379 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402f7fe700 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x28e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f4034b9b700 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 0x289ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402ffff700 1 -- 172.21.15.29:0/3555964379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 msgr2=0x289ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402ffff700 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 0x289ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402ffff700 1 -- 172.21.15.29:0/3555964379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 msgr2=0x28e5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402ffff700 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x28e5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402ffff700 1 -- 172.21.15.29:0/3555964379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402400f040 con 0x2663710 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402f7fe700 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x28e5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402ffff700 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e4c40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f40200137a0 tx=0x7f4020014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee9d853b94e033e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f400e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f400e7fc700 1 -- 172.21.15.29:0/3555964379 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000f650 con 0x2663710 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f400e7fc700 1 -- 172.21.15.29:0/3555964379 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f402001b070 con 0x2663710 2023-10-06T05:25:54.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 -- 172.21.15.29:0/3555964379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27a9cc0 con 0x2663710 2023-10-06T05:25:54.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f400e7fc700 1 -- 172.21.15.29:0/3555964379 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4020022e70 con 0x2663710 2023-10-06T05:25:54.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 10 client.4707 fetch_fsmap learned FSMap version 7 2023-10-06T05:25:54.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 -- 172.21.15.29:0/3555964379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x27d9370 con 0x2663710 2023-10-06T05:25:54.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f400e7fc700 1 -- 172.21.15.29:0/3555964379 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27a9cc0 con 0x2663710 2023-10-06T05:25:54.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f400e7fc700 1 -- 172.21.15.29:0/3555964379 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f402002c3b0 con 0x2663710 2023-10-06T05:25:54.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 10 client.4707 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T05:25:54.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 10 client.4707 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:25:54.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 20 client.4707 populate_metadata read hostname 'smithi029' 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] conn(0x289c2d0 0x28efde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 4 client.4707 mds_command: new command op to 4315 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f40388a7740 1 -- 172.21.15.29:0/3555964379 --> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27ad3e0 con 0x289c2d0 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402f7fe700 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] conn(0x289c2d0 0x28efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f400e7fc700 10 client.4707 ms_handle_connect on v2:172.21.15.29:6834/3557282345 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.244+0000 7f402f7fe700 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] conn(0x289c2d0 0x28efde0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d9aec8215cfe7b7 server_cookie=46d03356827569bd in_seq=0 out_seq=0 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f400e7fc700 1 -- 172.21.15.29:0/3555964379 <== mds.0 v2:172.21.15.29:6834/3557282345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x27ad3e0 con 0x289c2d0 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f400e7fc700 10 client.4707 handle_command_reply: tid=0 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 client.4707 shutdown 2023-10-06T05:25:54.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 -- 172.21.15.29:0/3555964379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 msgr2=0x28e4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e4c40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f40200137a0 tx=0x7f4020014000 comp rx=0 tx=0).stop 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 -- 172.21.15.29:0/3555964379 shutdown_connections 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 0x289ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] conn(0x289c2d0 0x28efde0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x28e5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f400e7fc700 0 client.4707 ms_handle_reset on v2:172.21.15.29:6834/3557282345 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 --2- 172.21.15.29:0/3555964379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28e4c40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 -- 172.21.15.29:0/3555964379 >> 172.21.15.29:0/3555964379 conn(0x2663eb0 msgr2=0x28c41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 -- 172.21.15.29:0/3555964379 shutdown_connections 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 1 -- 172.21.15.29:0/3555964379 wait complete. 2023-10-06T05:25:54.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.248+0000 7f40388a7740 20 client.4707 trim_cache size 0 max 16384 2023-10-06T05:25:54.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.268+0000 7f40388a7740 1 Processor -- start 2023-10-06T05:25:54.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.268+0000 7f40388a7740 1 -- start start 2023-10-06T05:25:54.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663710 0x28956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x2895bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26ae790 0x28bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2811290 con 0x26ae790 2023-10-06T05:25:54.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x27b9e00 con 0x2663ae0 2023-10-06T05:25:54.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2807150 con 0x2663710 2023-10-06T05:25:54.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4034b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26ae790 0x28bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4034b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26ae790 0x28bfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51840/0 (socket says 172.21.15.29:51840) 2023-10-06T05:25:54.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4034b9b700 1 -- 172.21.15.29:0/4287875676 learned_addr learned my addr 172.21.15.29:0/4287875676 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:54.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f402f7fe700 1 --2- 172.21.15.29:0/4287875676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x2895bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f402ffff700 1 --2- 172.21.15.29:0/4287875676 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663710 0x28956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4034b9b700 1 -- 172.21.15.29:0/4287875676 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663710 msgr2=0x28956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4034b9b700 1 --2- 172.21.15.29:0/4287875676 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663710 0x28956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4034b9b700 1 -- 172.21.15.29:0/4287875676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 msgr2=0x2895bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4034b9b700 1 --2- 172.21.15.29:0/4287875676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x2895bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4034b9b700 1 -- 172.21.15.29:0/4287875676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030153670 con 0x26ae790 2023-10-06T05:25:54.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4034b9b700 1 --2- 172.21.15.29:0/4287875676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26ae790 0x28bfe90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f402800b6c0 tx=0x7f402807c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c47d5d2af2f8920 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4015ffb700 1 -- 172.21.15.29:0/4287875676 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402800e040 con 0x26ae790 2023-10-06T05:25:54.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4015ffb700 1 -- 172.21.15.29:0/4287875676 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4028052e60 con 0x26ae790 2023-10-06T05:25:54.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f4015ffb700 1 -- 172.21.15.29:0/4287875676 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280559b0 con 0x26ae790 2023-10-06T05:25:54.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 -- 172.21.15.29:0/4287875676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26ae790 msgr2=0x28bfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 --2- 172.21.15.29:0/4287875676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26ae790 0x28bfe90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f402800b6c0 tx=0x7f402807c8f0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 -- 172.21.15.29:0/4287875676 shutdown_connections 2023-10-06T05:25:54.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 --2- 172.21.15.29:0/4287875676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26ae790 0x28bfe90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 --2- 172.21.15.29:0/4287875676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x2895bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 --2- 172.21.15.29:0/4287875676 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2663710 0x28956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 -- 172.21.15.29:0/4287875676 >> 172.21.15.29:0/4287875676 conn(0x2663eb0 msgr2=0x28e3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:54.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 -- 172.21.15.29:0/4287875676 shutdown_connections 2023-10-06T05:25:54.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.272+0000 7f40388a7740 1 -- 172.21.15.29:0/4287875676 wait complete. 2023-10-06T05:25:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 1 -- start start 2023-10-06T05:25:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 1 Processor -- start 2023-10-06T05:25:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x28eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 0x28ef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x280a6e0 con 0x2663710 2023-10-06T05:25:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2811400 con 0x2663ae0 2023-10-06T05:25:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x26843a0 con 0x26ae790 2023-10-06T05:25:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 10 client.0 _ll_register_callbacks cb 0x27d6110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:25:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f402ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f402ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51846/0 (socket says 172.21.15.29:51846) 2023-10-06T05:25:54.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f402ffff700 1 -- 172.21.15.29:0/1350685690 learned_addr learned my addr 172.21.15.29:0/1350685690 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:54.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f4034b9b700 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 0x28ef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f402f7fe700 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x28eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f4034b9b700 1 -- 172.21.15.29:0/1350685690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 msgr2=0x28eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f4034b9b700 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x28eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f4034b9b700 1 -- 172.21.15.29:0/1350685690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 msgr2=0x28c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f4034b9b700 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28c14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f4034b9b700 1 -- 172.21.15.29:0/1350685690 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40300c9120 con 0x26ae790 2023-10-06T05:25:54.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f402ffff700 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:25:54.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f4034b9b700 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 0x28ef2e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f402807ca40 tx=0x7f4028067000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=446086caa8e1e2c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f400e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.173:3301/0 2023-10-06T05:25:54.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f400e7fc700 1 -- 172.21.15.29:0/1350685690 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028070070 con 0x26ae790 2023-10-06T05:25:54.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f40388a7740 1 -- 172.21.15.29:0/1350685690 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4024006980 con 0x26ae790 2023-10-06T05:25:54.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.276+0000 7f400e7fc700 1 -- 172.21.15.29:0/1350685690 <== mon.2 v2:172.21.15.173:3301/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f40280559b0 con 0x26ae790 2023-10-06T05:25:54.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f400e7fc700 1 -- 172.21.15.29:0/1350685690 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f402800e040 con 0x26ae790 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 10 client.4535 fetch_fsmap learned FSMap version 7 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 -- 172.21.15.29:0/1350685690 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x27bfd80 con 0x26ae790 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f400e7fc700 1 -- 172.21.15.29:0/1350685690 <== mon.2 v2:172.21.15.173:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024006980 con 0x26ae790 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f400e7fc700 1 -- 172.21.15.29:0/1350685690 <== mon.2 v2:172.21.15.173:3301/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4028051c10 con 0x26ae790 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 10 client.4535 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 10 client.4535 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 20 client.4535 populate_metadata read hostname 'smithi029' 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] conn(0x28ef820 0x2939c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 4 client.4535 mds_command: new command op to 4315 tid=0[{"prefix": "status"}] 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 -- 172.21.15.29:0/1350685690 --> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] -- command(tid 0: {"prefix": "status"}) v1 -- 0x27df410 con 0x28ef820 2023-10-06T05:25:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f402ffff700 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] conn(0x28ef820 0x2939c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f400e7fc700 10 client.4535 ms_handle_connect on v2:172.21.15.29:6834/3557282345 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f402ffff700 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] conn(0x28ef820 0x2939c60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eccb9d4124577cd1 server_cookie=42c03fce2c3a269d in_seq=0 out_seq=0 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f400e7fc700 1 -- 172.21.15.29:0/1350685690 <== mds.0 v2:172.21.15.29:6834/3557282345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x27df410 con 0x28ef820 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f400e7fc700 10 client.4535 handle_command_reply: tid=0 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 client.4535 shutdown 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 -- 172.21.15.29:0/1350685690 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 msgr2=0x28ef2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 0x28ef2e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f402807ca40 tx=0x7f4028067000 comp rx=0 tx=0).stop 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 -- 172.21.15.29:0/1350685690 shutdown_connections 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26ae790 0x28ef2e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.29:6834/3557282345,v1:172.21.15.29:6835/3557282345] conn(0x28ef820 0x2939c60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2663ae0 0x28eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f400e7fc700 0 client.4535 ms_handle_reset on v2:172.21.15.29:6834/3557282345 2023-10-06T05:25:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 --2- 172.21.15.29:0/1350685690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2663710 0x28c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 -- 172.21.15.29:0/1350685690 >> 172.21.15.29:0/1350685690 conn(0x2663eb0 msgr2=0x289c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 -- 172.21.15.29:0/1350685690 shutdown_connections 2023-10-06T05:25:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 1 -- 172.21.15.29:0/1350685690 wait complete. 2023-10-06T05:25:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.280+0000 7f40388a7740 20 client.4535 trim_cache size 0 max 16384 2023-10-06T05:25:54.292 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:25:54.292 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "bd99696d-d9bf-47c8-93f5-f978334ae590", 2023-10-06T05:25:54.292 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-06T05:25:54.292 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4315, 2023-10-06T05:25:54.292 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-06T05:25:54.292 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-06T05:25:54.292 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-06T05:25:54.293 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 13.638538051999999, 2023-10-06T05:25:54.293 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 7, 2023-10-06T05:25:54.293 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 24, 2023-10-06T05:25:54.293 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2023-10-06T05:25:54.293 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 18.678791403000002 2023-10-06T05:25:54.293 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:25:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 -- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f401c060550 msgr2=0x7f401c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f401c060550 0x7f401c062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40200029f0 tx=0x7f4020009040 comp rx=0 tx=0).stop 2023-10-06T05:25:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 -- 172.21.15.29:0/3480740208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 msgr2=0x7f4030152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 0x7f4030152dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40300cfd30 tx=0x7f4028017000 comp rx=0 tx=0).stop 2023-10-06T05:25:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 -- 172.21.15.29:0/3480740208 shutdown_connections 2023-10-06T05:25:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4030159170 0x7f4030152dd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f401c060550 0x7f401c062a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f403006ccc0 0x7f40300b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 --2- 172.21.15.29:0/3480740208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f403006c8f0 0x7f40300c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 -- 172.21.15.29:0/3480740208 >> 172.21.15.29:0/3480740208 conn(0x7f4030068510 msgr2=0x7f40301543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:54.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 -- 172.21.15.29:0/3480740208 shutdown_connections 2023-10-06T05:25:54.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.284+0000 7f40365fe700 1 -- 172.21.15.29:0/3480740208 wait complete. 2023-10-06T05:25:54.306 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T05:25:54.329 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T05:25:54.329 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T05:25:54.330 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-06T05:25:54.330 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-06T05:25:54.330 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-06T05:25:54.330 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-06T05:25:54.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.330 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:25:54.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.338 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-06T05:25:54.400 INFO:teuthology.orchestra.run.smithi029.stderr:Cannot find device "ceph-brx" 2023-10-06T05:25:54.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:25:54.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.401 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-10-06T05:25:54.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.409 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2023-10-06T05:25:54.430 INFO:teuthology.orchestra.run.smithi173.stderr:Cannot find device "ceph-brx" 2023-10-06T05:25:54.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:25:54.432 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T05:25:54.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:25:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.536+0000 7f72b985b700 1 Processor -- start 2023-10-06T05:25:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.536+0000 7f72b985b700 1 -- start start 2023-10-06T05:25:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72b40ace80 0x7f72b415d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b4159500 0x7f72b4159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72b406d6d0 0x7f72b406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b415d9e0 con 0x7f72b406d6d0 2023-10-06T05:25:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b406e090 con 0x7f72b40ace80 2023-10-06T05:25:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b415d010 con 0x7f72b4159500 2023-10-06T05:25:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72b406d6d0 0x7f72b406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72b406d6d0 0x7f72b406db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42104/0 (socket says 172.21.15.29:42104) 2023-10-06T05:25:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b37fe700 1 -- 172.21.15.29:0/256364709 learned_addr learned my addr 172.21.15.29:0/256364709 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b2ffd700 1 --2- 172.21.15.29:0/256364709 >> v2:172.21.15.173:3300/0 conn(0x7f72b40ace80 0x7f72b415d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b27fc700 1 --2- 172.21.15.29:0/256364709 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b4159500 0x7f72b4159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b37fe700 1 -- 172.21.15.29:0/256364709 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b4159500 msgr2=0x7f72b4159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b37fe700 1 --2- 172.21.15.29:0/256364709 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b4159500 0x7f72b4159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b37fe700 1 -- 172.21.15.29:0/256364709 >> v2:172.21.15.173:3300/0 conn(0x7f72b40ace80 msgr2=0x7f72b415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b37fe700 1 --2- 172.21.15.29:0/256364709 >> v2:172.21.15.173:3300/0 conn(0x7f72b40ace80 0x7f72b415d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b37fe700 1 -- 172.21.15.29:0/256364709 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b40ad250 con 0x7f72b406d6d0 2023-10-06T05:25:54.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b2ffd700 1 --2- 172.21.15.29:0/256364709 >> v2:172.21.15.173:3300/0 conn(0x7f72b40ace80 0x7f72b415d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:54.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b37fe700 1 --2- 172.21.15.29:0/256364709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b406d6d0 0x7f72b406db50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72b406e230 tx=0x7f72ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cae662ca8b4897 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b1ffb700 1 -- 172.21.15.29:0/256364709 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00e070 con 0x7f72b406d6d0 2023-10-06T05:25:54.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b1ffb700 1 -- 172.21.15.29:0/256364709 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac00ba20 con 0x7f72b406d6d0 2023-10-06T05:25:54.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b1ffb700 1 -- 172.21.15.29:0/256364709 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0092e0 con 0x7f72b406d6d0 2023-10-06T05:25:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 -- 172.21.15.29:0/256364709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b406d6d0 msgr2=0x7f72b406db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 --2- 172.21.15.29:0/256364709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b406d6d0 0x7f72b406db50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72b406e230 tx=0x7f72ac009840 comp rx=0 tx=0).stop 2023-10-06T05:25:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 -- 172.21.15.29:0/256364709 shutdown_connections 2023-10-06T05:25:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 --2- 172.21.15.29:0/256364709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b406d6d0 0x7f72b406db50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 --2- 172.21.15.29:0/256364709 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b4159500 0x7f72b4159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.540+0000 7f72b985b700 1 --2- 172.21.15.29:0/256364709 >> v2:172.21.15.173:3300/0 conn(0x7f72b40ace80 0x7f72b415d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.544+0000 7f72b985b700 1 -- 172.21.15.29:0/256364709 >> 172.21.15.29:0/256364709 conn(0x7f72b406b7b0 msgr2=0x7f72b40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.544+0000 7f72b985b700 1 -- 172.21.15.29:0/256364709 shutdown_connections 2023-10-06T05:25:54.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.544+0000 7f72b985b700 1 -- 172.21.15.29:0/256364709 wait complete. 2023-10-06T05:25:54.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.544+0000 7f72b985b700 1 Processor -- start 2023-10-06T05:25:54.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.544+0000 7f72b985b700 1 -- start start 2023-10-06T05:25:54.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b985b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b406d6d0 0x7f72b413c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b985b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b40ace80 0x7f72b40b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b985b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b4159500 0x7f72b413d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b985b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40b19f0 con 0x7f72b4159500 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b985b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40b0de0 con 0x7f72b406d6d0 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b985b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40b10c0 con 0x7f72b40ace80 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b406d6d0 0x7f72b413c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b4159500 0x7f72b413d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b27fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b40ace80 0x7f72b40b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b406d6d0 0x7f72b413c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:35942/0 (socket says 172.21.15.29:35942) 2023-10-06T05:25:54.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b2ffd700 1 -- 172.21.15.29:0/4267753775 learned_addr learned my addr 172.21.15.29:0/4267753775 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:54.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b37fe700 1 -- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b40ace80 msgr2=0x7f72b40b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b37fe700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b40ace80 0x7f72b40b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b37fe700 1 -- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b406d6d0 msgr2=0x7f72b413c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b37fe700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b406d6d0 0x7f72b413c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b37fe700 1 -- 172.21.15.29:0/4267753775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac009ae0 con 0x7f72b4159500 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b37fe700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b4159500 0x7f72b413d020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f72ac015000 tx=0x7f72ac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72aaffd700 1 -- 172.21.15.29:0/4267753775 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0032f0 con 0x7f72b4159500 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72aaffd700 1 -- 172.21.15.29:0/4267753775 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac008db0 con 0x7f72b4159500 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b40b13a0 con 0x7f72b4159500 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72aaffd700 1 -- 172.21.15.29:0/4267753775 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac026690 con 0x7f72b4159500 2023-10-06T05:25:54.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.548+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b40b1e80 con 0x7f72b4159500 2023-10-06T05:25:54.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.552+0000 7f72aaffd700 1 -- 172.21.15.29:0/4267753775 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f72ac003040 con 0x7f72b4159500 2023-10-06T05:25:54.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.552+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b40b2070 con 0x7f72b4159500 2023-10-06T05:25:54.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.552+0000 7f72aaffd700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7298060550 0x7f7298062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:54.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.552+0000 7f72aaffd700 1 -- 172.21.15.29:0/4267753775 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f72ac07e9b0 con 0x7f72b4159500 2023-10-06T05:25:54.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.552+0000 7f72b2ffd700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7298060550 0x7f7298062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:54.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.552+0000 7f72b2ffd700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7298060550 0x7f7298062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f72a4006dc0 tx=0x7f72a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:54.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.560+0000 7f72aaffd700 1 -- 172.21.15.29:0/4267753775 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f72ac04ee90 con 0x7f72b4159500 2023-10-06T05:25:54.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.756+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72b404be00 con 0x7f72b4159500 2023-10-06T05:25:54.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.756+0000 7f72aaffd700 1 -- 172.21.15.29:0/4267753775 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f72ac021070 con 0x7f72b4159500 2023-10-06T05:25:54.763 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:25:54.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7298060550 msgr2=0x7f7298062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7298060550 0x7f7298062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f72a4006dc0 tx=0x7f72a4008040 comp rx=0 tx=0).stop 2023-10-06T05:25:54.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b4159500 msgr2=0x7f72b413d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:54.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b4159500 0x7f72b413d020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f72ac015000 tx=0x7f72ac018000 comp rx=0 tx=0).stop 2023-10-06T05:25:54.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 shutdown_connections 2023-10-06T05:25:54.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b4159500 0x7f72b413d020 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72b40ace80 0x7f72b40b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7298060550 0x7f7298062a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 --2- 172.21.15.29:0/4267753775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b406d6d0 0x7f72b413c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:54.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 >> 172.21.15.29:0/4267753775 conn(0x7f72b406b7b0 msgr2=0x7f72b40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:54.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 shutdown_connections 2023-10-06T05:25:54.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:54.760+0000 7f72b985b700 1 -- 172.21.15.29:0/4267753775 wait complete. 2023-10-06T05:25:54.782 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:25:54.783 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:25:54.783 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:25:54.783 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T05:25:54.783 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T05:25:54.783 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:25:54.783 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:25:54.783 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:25:54.783 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:25:54.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.784 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:25:54.790 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:25:54.790 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:25:54.790 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:25:54.790 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:54.790 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:25:54.790 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:54.790 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:25:54.791 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:54.791 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:25:54.791 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:54.791 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:25:54.791 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:54.791 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:25:54.791 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42573sec preferred_lft 42573sec 2023-10-06T05:25:54.791 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:25:54.791 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:54.792 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:25:54.792 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:54.792 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:25:54.792 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:54.792 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:25:54.792 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:54.792 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T05:25:54.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.793 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:25:54.793 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:25:54.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2023-10-06T05:25:54.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2023-10-06T05:25:54.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2023-10-06T05:25:54.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T05:25:54.793 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:25:54.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.877 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:25:54.886 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:25:54.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.888 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:25:54.911 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:25:54.911 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:25:54.912 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:25:54.912 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:25:54.912 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:25:54.912 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:25:54.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.912 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:25:54.912 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:25:54.913 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:25:54.913 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:25:54.913 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:25:54.913 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:25:54.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:54.997 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:25:55.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:55.003 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2023-10-06T05:25:55.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:55.010 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:25:55.010 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:25:55.010 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:25:55.010 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T05:25:55.010 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:25:55.038 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T05:25:55.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:55.038 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:25:55.038 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:25:55.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T05:25:55.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T05:25:55.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T05:25:55.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T05:25:55.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T05:25:55.039 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:25:55.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:55.107 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:25:55.107 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:25:55.107 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-06T05:25:55.107 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T05:25:55.107 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:25:55.134 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T05:25:55.134 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:25:55.135 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T05:25:55.140 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:25:55.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:25:55.140 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:25:55.147 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:25:55.160 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:25:55.160 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:25:55.220 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:25:55.220 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:25:55.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:25:55.221 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:25:55.228 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:25:55.228 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T05:25:55.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:25:55.246 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:25:55.246 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:25:55.298 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:25:55.299 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:25:55.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:25:55.300 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:25:55.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2023-10-06T05:25:55.308+0000 7fd0c5abe380 -1 init, newargv = 0x5654a9193930 newargc=15 2023-10-06T05:25:55.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[40381]: starting ceph client 2023-10-06T05:25:55.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[40381]: starting fuse 2023-10-06T05:25:56.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:25:56.425 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:25:56.425 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:25:56.484 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:25:56.485 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:25:56.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:25:56.486 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:25:56.490 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:25:56.491 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:25:56.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:25:56.491 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:25:56.491 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:25:56.491 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:25:56.491 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:25:56.491 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:25:56.491 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:25:56.491 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T05:25:56.491 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:25:56.492 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:25:56.493 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:25:56.493 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:25:56.493 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2023-10-06T05:25:56.493 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:25:56.575 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.40381.asok 2023-10-06T05:25:56.761 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40381.asok 2023-10-06T05:25:56.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:25:56.761 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40381.asok status 2023-10-06T05:25:56.857 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:25:56.857 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:25:56.857 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:25:56.857 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:25:56.857 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2023-10-06T05:25:56.857 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:25:56.857 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T05:25:56.857 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "40381", 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4725, 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4725 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:25:56.858 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1506780120 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1506780120 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4725 192.168.0.1:0/1506780120", 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/1506780120", 2023-10-06T05:25:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:25:56.860 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 7, 2023-10-06T05:25:56.860 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 24, 2023-10-06T05:25:56.860 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:25:56.860 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:25:56.860 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:25:56.860 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:25:56.866 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:25:56.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0eaa2bb700 1 Processor -- start 2023-10-06T05:25:56.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0eaa2bb700 1 -- start start 2023-10-06T05:25:56.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0eaa2bb700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0ea41552c0 0x7f0ea4155690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:56.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0eaa2bb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ea406af30 0x7f0ea40b0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0eaa2bb700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea41568b0 con 0x7f0ea406cdd0 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0eaa2bb700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea40b07b0 con 0x7f0ea406af30 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0eaa2bb700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea4155ca0 con 0x7f0ea41552c0 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ea406af30 0x7f0ea40b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ea406af30 0x7f0ea40b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42122/0 (socket says 172.21.15.29:42122) 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea37fe700 1 -- 172.21.15.29:0/2085709469 learned_addr learned my addr 172.21.15.29:0/2085709469 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/2085709469 >> v2:172.21.15.173:3300/0 conn(0x7f0ea41552c0 0x7f0ea4155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea37fe700 1 -- 172.21.15.29:0/2085709469 >> v2:172.21.15.173:3300/0 conn(0x7f0ea41552c0 msgr2=0x7f0ea4155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea37fe700 1 --2- 172.21.15.29:0/2085709469 >> v2:172.21.15.173:3300/0 conn(0x7f0ea41552c0 0x7f0ea4155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea37fe700 1 -- 172.21.15.29:0/2085709469 >> v1:172.21.15.173:6789/0 conn(0x7f0ea406cdd0 legacy=0x7f0ea406e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:56.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea37fe700 1 -- 172.21.15.29:0/2085709469 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4155f80 con 0x7f0ea406af30 2023-10-06T05:25:56.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/2085709469 >> v2:172.21.15.173:3300/0 conn(0x7f0ea41552c0 0x7f0ea4155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:25:56.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea37fe700 1 --2- 172.21.15.29:0/2085709469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea406af30 0x7f0ea40b0270 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4068030 tx=0x7f0e8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5acea53ffe77fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:56.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.964+0000 7f0ea2ffd700 1 -- 172.21.15.29:0/2085709469 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00b860 con 0x7f0ea406af30 2023-10-06T05:25:56.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0ea2ffd700 1 -- 172.21.15.29:0/2085709469 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c00b9c0 con 0x7f0ea406af30 2023-10-06T05:25:56.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0ea2ffd700 1 -- 172.21.15.29:0/2085709469 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00bd60 con 0x7f0ea406af30 2023-10-06T05:25:56.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/2085709469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea406af30 msgr2=0x7f0ea40b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:56.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 --2- 172.21.15.29:0/2085709469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea406af30 0x7f0ea40b0270 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4068030 tx=0x7f0e8c009250 comp rx=0 tx=0).stop 2023-10-06T05:25:56.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/2085709469 shutdown_connections 2023-10-06T05:25:56.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 --2- 172.21.15.29:0/2085709469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea406af30 0x7f0ea40b0270 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:56.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 --2- 172.21.15.29:0/2085709469 >> v2:172.21.15.173:3300/0 conn(0x7f0ea41552c0 0x7f0ea4155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:56.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/2085709469 >> 172.21.15.29:0/2085709469 conn(0x7f0ea4067b70 msgr2=0x7f0ea406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:56.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/2085709469 shutdown_connections 2023-10-06T05:25:56.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/2085709469 wait complete. 2023-10-06T05:25:56.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 Processor -- start 2023-10-06T05:25:56.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 -- start start 2023-10-06T05:25:56.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea406af30 0x7f0ea40a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea406cdd0 0x7f0ea40ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ea41552c0 0x7f0ea40a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40a6720 con 0x7f0ea406cdd0 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40a5e80 con 0x7f0ea406af30 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.968+0000 7f0eaa2bb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40a6160 con 0x7f0ea41552c0 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea406cdd0 0x7f0ea40ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea406af30 0x7f0ea40a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea406af30 0x7f0ea40a4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:35956/0 (socket says 172.21.15.29:35956) 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea3fff700 1 -- 172.21.15.29:0/4284008332 learned_addr learned my addr 172.21.15.29:0/4284008332 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea8858700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ea41552c0 0x7f0ea40a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:56.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea3fff700 1 -- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ea41552c0 msgr2=0x7f0ea40a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:56.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ea41552c0 0x7f0ea40a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:56.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea3fff700 1 -- 172.21.15.29:0/4284008332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea406cdd0 msgr2=0x7f0ea40ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:56.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea406cdd0 0x7f0ea40ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:56.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea3fff700 1 -- 172.21.15.29:0/4284008332 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c0094f0 con 0x7f0ea406af30 2023-10-06T05:25:56.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0ea3fff700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea406af30 0x7f0ea40a4ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400e8d0 tx=0x7f0e94008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:56.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0e9bfff700 1 -- 172.21.15.29:0/4284008332 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94013410 con 0x7f0ea406af30 2023-10-06T05:25:56.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0e9bfff700 1 -- 172.21.15.29:0/4284008332 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94013570 con 0x7f0ea406af30 2023-10-06T05:25:56.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea40a6440 con 0x7f0ea406af30 2023-10-06T05:25:56.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0e9bfff700 1 -- 172.21.15.29:0/4284008332 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94013910 con 0x7f0ea406af30 2023-10-06T05:25:56.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea40a5410 con 0x7f0ea406af30 2023-10-06T05:25:56.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.972+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea40cb480 con 0x7f0ea406af30 2023-10-06T05:25:56.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.976+0000 7f0e9bfff700 1 -- 172.21.15.29:0/4284008332 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0e94013d00 con 0x7f0ea406af30 2023-10-06T05:25:56.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.976+0000 7f0e9bfff700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e84060550 0x7f0e84062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:56.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.976+0000 7f0e9bfff700 1 -- 172.21.15.29:0/4284008332 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e9407c6c0 con 0x7f0ea406af30 2023-10-06T05:25:56.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.976+0000 7f0ea37fe700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e84060550 0x7f0e84062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:56.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.976+0000 7f0ea37fe700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e84060550 0x7f0e84062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4155bd0 tx=0x7f0e8c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:56.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:56.984+0000 7f0e9bfff700 1 -- 172.21.15.29:0/4284008332 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ea40cb480 con 0x7f0ea406af30 2023-10-06T05:25:57.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.184+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ea40cb480 con 0x7f0ea406af30 2023-10-06T05:25:57.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.188+0000 7f0e9bfff700 1 -- 172.21.15.29:0/4284008332 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0ea40cb480 con 0x7f0ea406af30 2023-10-06T05:25:57.192 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:25:57.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e84060550 msgr2=0x7f0e84062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e84060550 0x7f0e84062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4155bd0 tx=0x7f0e8c017000 comp rx=0 tx=0).stop 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea406af30 msgr2=0x7f0ea40a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea406af30 0x7f0ea40a4ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400e8d0 tx=0x7f0e94008040 comp rx=0 tx=0).stop 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 shutdown_connections 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ea41552c0 0x7f0ea40a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ea406cdd0 0x7f0ea40ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e84060550 0x7f0e84062a00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 --2- 172.21.15.29:0/4284008332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea406af30 0x7f0ea40a4ed0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 >> 172.21.15.29:0/4284008332 conn(0x7f0ea4067b70 msgr2=0x7f0ea40ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:57.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 shutdown_connections 2023-10-06T05:25:57.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:57.192+0000 7f0eaa2bb700 1 -- 172.21.15.29:0/4284008332 wait complete. 2023-10-06T05:25:57.212 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:25:57.212 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:25:57.212 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:25:57.212 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T05:25:57.212 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T05:25:57.212 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:25:57.212 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:25:57.212 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:25:57.212 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T05:25:57.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.213 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:25:57.220 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:25:57.220 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:25:57.221 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42570sec preferred_lft 42570sec 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.222 INFO:teuthology.orchestra.run.smithi029.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::38dc:3fff:fed0:feb0/64 scope link 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c88:ceff:fe77:b613/64 scope link 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.224 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:25:57.236 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:25:57.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.238 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:25:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:25:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:25:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:25:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:25:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:25:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:25:57.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.248 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:25:57.248 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:25:57.248 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:25:57.248 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:25:57.248 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:25:57.248 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:25:57.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.287 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:25:57.334 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:25:57.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.335 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2023-10-06T05:25:57.342 INFO:teuthology.orchestra.run.smithi029.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T05:25:57.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.343 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:25:57.343 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:25:57.343 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:25:57.343 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T05:25:57.343 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:25:57.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.374 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T05:25:57.437 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:25:57.437 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:25:57.437 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:25:57.437 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.437 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:25:57.437 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.437 INFO:teuthology.orchestra.run.smithi029.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:25:57.437 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether ee:08:85:62:22:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T05:25:57.438 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T05:25:57.438 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.438 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec08:85ff:fe62:2212/64 scope link 2023-10-06T05:25:57.438 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T05:25:57.451 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:25:57.451 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:25:57.451 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:25:57.451 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.451 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:25:57.451 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.451 INFO:teuthology.orchestra.run.smithi029.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:25:57.452 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether ee:08:85:62:22:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T05:25:57.452 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T05:25:57.452 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.452 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec08:85ff:fe62:2212/64 scope link 2023-10-06T05:25:57.452 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:57.453 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T05:25:57.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.453 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:25:57.453 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:25:57.453 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T05:25:57.454 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T05:25:57.454 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T05:25:57.454 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T05:25:57.454 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T05:25:57.454 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:25:57.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:57.506 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:25:57.506 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:25:57.506 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.1 up 2023-10-06T05:25:57.506 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T05:25:57.507 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:25:57.532 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-06T05:25:57.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:25:57.533 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T05:25:57.587 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T05:25:57.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:25:57.587 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T05:25:57.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:25:57.610 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:25:57.610 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:25:57.667 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:25:57.668 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:25:57.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:25:57.669 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:25:57.676 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:25:57.676 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-10-06T05:25:57.676 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-06T05:25:57.679 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:25:57.697 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:25:57.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:25:57.709 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:25:57.710 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:25:57.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:25:57.711 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:25:57.716 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:25:57.758 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi029.stderr:2023-10-06T05:25:57.752+0000 7f58a8050380 -1 init, newargv = 0x55f8f3967c10 newargc=15 2023-10-06T05:25:57.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi029.stderr:ceph-fuse[40525]: starting ceph client 2023-10-06T05:25:57.768 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi029.stderr:ceph-fuse[40525]: starting fuse 2023-10-06T05:25:58.818 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:25:58.837 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:25:58.837 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:25:58.899 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:25:58.900 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:25:58.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:25:58.901 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:25:58.908 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:25:58.908 INFO:teuthology.orchestra.run.smithi029.stdout:53 2023-10-06T05:25:58.909 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:25:58.909 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:25:58.910 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:25:58.911 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:25:58.911 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:25:58.911 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:25:58.911 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:25:58.911 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:25:58.911 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.2")) 2023-10-06T05:25:58.911 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:25:58.994 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.2.40525.asok 2023-10-06T05:25:59.176 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.40525.asok 2023-10-06T05:25:59.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:25:59.176 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.40525.asok status 2023-10-06T05:25:59.316 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "2", 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "40525", 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:25:59.317 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4553, 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4553 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:25:59.318 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1868675587 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1868675587 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4553 172.21.15.29:0/1868675587", 2023-10-06T05:25:59.319 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "172.21.15.29:0/1868675587", 2023-10-06T05:25:59.320 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:25:59.320 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 7, 2023-10-06T05:25:59.320 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 24, 2023-10-06T05:25:59.320 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:25:59.320 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:25:59.320 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:25:59.320 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:25:59.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:25:59.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.428+0000 7f7fc885a700 1 Processor -- start 2023-10-06T05:25:59.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.428+0000 7f7fc885a700 1 -- start start 2023-10-06T05:25:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40cff90 0x7f7fc40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7fc40aeb00 0x7f7fc415d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc40cb150 con 0x7f7fc415bf20 2023-10-06T05:25:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc40cb5e0 con 0x7f7fc40aeb00 2023-10-06T05:25:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc415d9d0 con 0x7f7fc40cff90 2023-10-06T05:25:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc3fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7fc415bf20 0x7f7fc40cc750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54496/0 (socket says 172.21.15.29:54496) 2023-10-06T05:25:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc3fff700 1 -- 172.21.15.29:0/2657543670 learned_addr learned my addr 172.21.15.29:0/2657543670 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:25:59.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc2ffd700 1 --2- 172.21.15.29:0/2657543670 >> v2:172.21.15.29:3300/0 conn(0x7f7fc40aeb00 0x7f7fc415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:59.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc37fe700 1 --2- 172.21.15.29:0/2657543670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40cff90 0x7f7fc40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:59.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc27fc700 1 -- 172.21.15.29:0/2657543670 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446075839 0 0) 0x7f7fc40cb150 con 0x7f7fc415bf20 2023-10-06T05:25:59.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc27fc700 1 -- 172.21.15.29:0/2657543670 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb0003570 con 0x7f7fc415bf20 2023-10-06T05:25:59.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc2ffd700 1 -- 172.21.15.29:0/2657543670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40cff90 msgr2=0x7f7fc40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:25:59.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc27fc700 1 -- 172.21.15.29:0/2657543670 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 239647981 0 0) 0x7f7fb0003570 con 0x7f7fc415bf20 2023-10-06T05:25:59.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc2ffd700 1 --2- 172.21.15.29:0/2657543670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40cff90 0x7f7fc40d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc2ffd700 1 -- 172.21.15.29:0/2657543670 >> v1:172.21.15.29:6789/0 conn(0x7f7fc415bf20 legacy=0x7f7fc40cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc2ffd700 1 -- 172.21.15.29:0/2657543670 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40ca540 con 0x7f7fc40aeb00 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc2ffd700 1 --2- 172.21.15.29:0/2657543670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40aeb00 0x7f7fc415d490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0098e0 tx=0x7f7fac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f276960645107c39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc27fc700 1 -- 172.21.15.29:0/2657543670 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0017f0 con 0x7f7fc40aeb00 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc27fc700 1 -- 172.21.15.29:0/2657543670 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac011420 con 0x7f7fc40aeb00 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc27fc700 1 -- 172.21.15.29:0/2657543670 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac0117c0 con 0x7f7fc40aeb00 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 -- 172.21.15.29:0/2657543670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40aeb00 msgr2=0x7f7fc415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 --2- 172.21.15.29:0/2657543670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40aeb00 0x7f7fc415d490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0098e0 tx=0x7f7fac0091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 -- 172.21.15.29:0/2657543670 shutdown_connections 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 --2- 172.21.15.29:0/2657543670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40aeb00 0x7f7fc415d490 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 --2- 172.21.15.29:0/2657543670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40cff90 0x7f7fc40d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 -- 172.21.15.29:0/2657543670 >> 172.21.15.29:0/2657543670 conn(0x7f7fc40670a0 msgr2=0x7f7fc40674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 -- 172.21.15.29:0/2657543670 shutdown_connections 2023-10-06T05:25:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.432+0000 7f7fc885a700 1 -- 172.21.15.29:0/2657543670 wait complete. 2023-10-06T05:25:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 Processor -- start 2023-10-06T05:25:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 -- start start 2023-10-06T05:25:59.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40aeb00 0x7f7fc41564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:59.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40cff90 0x7f7fc41578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:59.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fc415bf20 0x7f7fc40c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:59.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4169f00 con 0x7f7fc40cff90 2023-10-06T05:25:59.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4156a00 con 0x7f7fc415bf20 2023-10-06T05:25:59.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41582d0 con 0x7f7fc40aeb00 2023-10-06T05:25:59.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40cff90 0x7f7fc41578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:59.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40cff90 0x7f7fc41578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42156/0 (socket says 172.21.15.29:42156) 2023-10-06T05:25:59.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc2ffd700 1 -- 172.21.15.29:0/1468108359 learned_addr learned my addr 172.21.15.29:0/1468108359 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:25:59.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc3fff700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fc415bf20 0x7f7fc40c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:59.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc37fe700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40aeb00 0x7f7fc41564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:59.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc2ffd700 1 -- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40aeb00 msgr2=0x7f7fc41564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:59.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc2ffd700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40aeb00 0x7f7fc41564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc2ffd700 1 -- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fc415bf20 msgr2=0x7f7fc40c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:59.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc2ffd700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fc415bf20 0x7f7fc40c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc2ffd700 1 -- 172.21.15.29:0/1468108359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac009420 con 0x7f7fc40cff90 2023-10-06T05:25:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc2ffd700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40cff90 0x7f7fc41578f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0030c0 tx=0x7f7fac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fbb7fe700 1 -- 172.21.15.29:0/1468108359 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac01cb30 con 0x7f7fc40cff90 2023-10-06T05:25:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fbb7fe700 1 -- 172.21.15.29:0/1468108359 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac01cc90 con 0x7f7fc40cff90 2023-10-06T05:25:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc41698b0 con 0x7f7fc40cff90 2023-10-06T05:25:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fbb7fe700 1 -- 172.21.15.29:0/1468108359 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac025680 con 0x7f7fc40cff90 2023-10-06T05:25:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.436+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc4169590 con 0x7f7fc40cff90 2023-10-06T05:25:59.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.440+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc416a0b0 con 0x7f7fc40cff90 2023-10-06T05:25:59.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.440+0000 7f7fbb7fe700 1 -- 172.21.15.29:0/1468108359 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7fac0193f0 con 0x7f7fc40cff90 2023-10-06T05:25:59.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.440+0000 7f7fbb7fe700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fa4060550 0x7f7fa4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:25:59.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.440+0000 7f7fbb7fe700 1 -- 172.21.15.29:0/1468108359 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7fac07da20 con 0x7f7fc40cff90 2023-10-06T05:25:59.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.444+0000 7f7fc37fe700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fa4060550 0x7f7fa4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:25:59.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.444+0000 7f7fc37fe700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fa4060550 0x7f7fa4062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009d10 tx=0x7f7fb40091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:25:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.452+0000 7f7fbb7fe700 1 -- 172.21.15.29:0/1468108359 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7fc416a0b0 con 0x7f7fc40cff90 2023-10-06T05:25:59.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.648+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7fc404be00 con 0x7f7fc40cff90 2023-10-06T05:25:59.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.648+0000 7f7fbb7fe700 1 -- 172.21.15.29:0/1468108359 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7fac04df30 con 0x7f7fc40cff90 2023-10-06T05:25:59.655 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:25:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fa4060550 msgr2=0x7f7fa4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fa4060550 0x7f7fa4062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009d10 tx=0x7f7fb40091a0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40cff90 msgr2=0x7f7fc41578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:25:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40cff90 0x7f7fc41578f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0030c0 tx=0x7f7fac016000 comp rx=0 tx=0).stop 2023-10-06T05:25:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 shutdown_connections 2023-10-06T05:25:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fa4060550 0x7f7fa4062a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fc415bf20 0x7f7fc40c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fc40cff90 0x7f7fc41578f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 --2- 172.21.15.29:0/1468108359 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fc40aeb00 0x7f7fc41564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:25:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 >> 172.21.15.29:0/1468108359 conn(0x7f7fc40670a0 msgr2=0x7f7fc4156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:25:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 shutdown_connections 2023-10-06T05:25:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:25:59.652+0000 7f7fc885a700 1 -- 172.21.15.29:0/1468108359 wait complete. 2023-10-06T05:25:59.669 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:25:59.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:25:59.669 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-10-06T05:25:59.669 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T05:25:59.669 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T05:25:59.669 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:25:59.669 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:25:59.669 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:25:59.669 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T05:25:59.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:59.670 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:25:59.678 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42550sec preferred_lft 42550sec 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:2a:88:0d:66 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:25:59.679 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:25:59.680 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T05:25:59.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:59.680 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-10-06T05:25:59.680 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-10-06T05:25:59.680 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add name ceph-brx type bridge 2023-10-06T05:25:59.680 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr flush dev ceph-brx 2023-10-06T05:25:59.680 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set ceph-brx up 2023-10-06T05:25:59.680 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T05:25:59.680 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-10-06T05:25:59.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:59.767 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:25:59.777 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-10-06T05:25:59.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:59.778 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-10-06T05:25:59.803 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-10-06T05:25:59.803 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:25:59.803 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-06T05:25:59.803 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T05:25:59.803 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:25:59.803 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-06T05:25:59.803 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-06T05:25:59.803 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:25:59.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:59.804 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-10-06T05:25:59.804 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-10-06T05:25:59.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T05:25:59.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T05:25:59.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T05:25:59.804 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-10-06T05:25:59.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:59.884 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-10-06T05:25:59.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:59.891 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2023-10-06T05:25:59.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:59.899 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-10-06T05:25:59.899 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-10-06T05:25:59.899 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T05:25:59.900 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T05:25:59.900 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-10-06T05:25:59.970 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T05:25:59.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:25:59.970 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-10-06T05:25:59.971 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-10-06T05:25:59.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T05:25:59.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T05:25:59.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T05:25:59.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T05:25:59.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T05:25:59.971 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-10-06T05:26:00.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:00.051 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-10-06T05:26:00.051 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-10-06T05:26:00.051 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2023-10-06T05:26:00.051 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T05:26:00.051 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-10-06T05:26:00.074 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-06T05:26:00.074 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:26:00.074 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T05:26:00.079 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T05:26:00.079 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:26:00.079 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T05:26:00.083 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-10-06T05:26:00.094 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:26:00.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:26:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:26:00.151 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:26:00.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:00.152 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-10-06T05:26:00.156 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:26:00.156 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-06T05:26:00.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-10-06T05:26:00.174 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:26:00.174 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:26:00.229 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:26:00.229 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:26:00.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:00.230 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-10-06T05:26:00.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:2023-10-06T05:26:00.225+0000 7f4d366bc380 -1 init, newargv = 0x55c90945abd0 newargc=15 2023-10-06T05:26:00.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[39437]: starting ceph client 2023-10-06T05:26:00.240 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[39437]: starting fuse 2023-10-06T05:26:01.336 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-10-06T05:26:01.354 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:26:01.354 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:26:01.369 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:26:01.370 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:26:01.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:01.371 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-10-06T05:26:01.422 INFO:teuthology.orchestra.run.smithi173.stdout:52 2023-10-06T05:26:01.422 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> 2023-10-06T05:26:01.423 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> 2023-10-06T05:26:01.424 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.1")) 2023-10-06T05:26:01.425 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-10-06T05:26:01.508 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.1.39437.asok 2023-10-06T05:26:01.695 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.39437.asok 2023-10-06T05:26:01.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:01.695 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.39437.asok status 2023-10-06T05:26:01.788 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-10-06T05:26:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-10-06T05:26:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "1", 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "39437", 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-10-06T05:26:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4565, 2023-10-06T05:26:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-10-06T05:26:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-10-06T05:26:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-10-06T05:26:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 4565 2023-10-06T05:26:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-06T05:26:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-10-06T05:26:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-10-06T05:26:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1553401216 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1553401216 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.4565 192.168.0.1:0/1553401216", 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/1553401216", 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-10-06T05:26:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 7, 2023-10-06T05:26:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 24, 2023-10-06T05:26:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:26:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-10-06T05:26:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2023-10-06T05:26:01.792 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-10-06T05:26:01.797 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:26:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64cfef0700 1 Processor -- start 2023-10-06T05:26:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64cfef0700 1 -- start start 2023-10-06T05:26:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64cfef0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 0x7f64c80af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64cfef0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64c815cd80 0x7f64c815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64cfef0700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c81614c0 con 0x7f64c8161950 2023-10-06T05:26:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64cfef0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c8160f40 con 0x7f64c815cd80 2023-10-06T05:26:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64cfef0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c806d420 con 0x7f64c80af5c0 2023-10-06T05:26:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ce48d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64c815cd80 0x7f64c815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ce48d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64c815cd80 0x7f64c815d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42158/0 (socket says 172.21.15.29:42158) 2023-10-06T05:26:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ce48d700 1 -- 172.21.15.29:0/2396787396 learned_addr learned my addr 172.21.15.29:0/2396787396 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64cdc8c700 1 --2- 172.21.15.29:0/2396787396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 0x7f64c80af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ccc8a700 1 -- 172.21.15.29:0/2396787396 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912536469 0 0) 0x7f64c81614c0 con 0x7f64c8161950 2023-10-06T05:26:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ccc8a700 1 -- 172.21.15.29:0/2396787396 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b0003570 con 0x7f64c8161950 2023-10-06T05:26:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ce48d700 1 -- 172.21.15.29:0/2396787396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 msgr2=0x7f64c80af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ce48d700 1 --2- 172.21.15.29:0/2396787396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 0x7f64c80af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ce48d700 1 -- 172.21.15.29:0/2396787396 >> v1:172.21.15.173:6789/0 conn(0x7f64c8161950 legacy=0x7f64c806a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ce48d700 1 -- 172.21.15.29:0/2396787396 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c806af20 con 0x7f64c815cd80 2023-10-06T05:26:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64cdc8c700 1 --2- 172.21.15.29:0/2396787396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 0x7f64c80af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ce48d700 1 --2- 172.21.15.29:0/2396787396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 0x7f64c815d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f64b80099b0 tx=0x7f64b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5eaaaa82b43edb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ccc8a700 1 -- 172.21.15.29:0/2396787396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800b680 con 0x7f64c815cd80 2023-10-06T05:26:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ccc8a700 1 -- 172.21.15.29:0/2396787396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b800b7e0 con 0x7f64c815cd80 2023-10-06T05:26:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.908+0000 7f64ccc8a700 1 -- 172.21.15.29:0/2396787396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800bb80 con 0x7f64c815cd80 2023-10-06T05:26:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 -- 172.21.15.29:0/2396787396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 msgr2=0x7f64c815d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 --2- 172.21.15.29:0/2396787396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 0x7f64c815d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f64b80099b0 tx=0x7f64b8009250 comp rx=0 tx=0).stop 2023-10-06T05:26:01.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 -- 172.21.15.29:0/2396787396 shutdown_connections 2023-10-06T05:26:01.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 --2- 172.21.15.29:0/2396787396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 0x7f64c815d1a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:01.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 --2- 172.21.15.29:0/2396787396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 0x7f64c80af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:01.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 -- 172.21.15.29:0/2396787396 >> 172.21.15.29:0/2396787396 conn(0x7f64c8067b70 msgr2=0x7f64c806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:01.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 -- 172.21.15.29:0/2396787396 shutdown_connections 2023-10-06T05:26:01.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 -- 172.21.15.29:0/2396787396 wait complete. 2023-10-06T05:26:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 Processor -- start 2023-10-06T05:26:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 -- start start 2023-10-06T05:26:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 0x7f64c81476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 0x7f64c8170910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8161950 0x7f64c8170e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80c97a0 con 0x7f64c815cd80 2023-10-06T05:26:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80a4f20 con 0x7f64c8161950 2023-10-06T05:26:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.912+0000 7f64cfef0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80a45f0 con 0x7f64c80af5c0 2023-10-06T05:26:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cd48b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 0x7f64c8170910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64ce48d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8161950 0x7f64c8170e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cd48b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 0x7f64c8170910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42160/0 (socket says 172.21.15.29:42160) 2023-10-06T05:26:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cdc8c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 0x7f64c81476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cd48b700 1 -- 172.21.15.29:0/592525426 learned_addr learned my addr 172.21.15.29:0/592525426 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cd48b700 1 -- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 msgr2=0x7f64c81476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cd48b700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 0x7f64c81476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cd48b700 1 -- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8161950 msgr2=0x7f64c8170e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cd48b700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8161950 0x7f64c8170e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:01.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cd48b700 1 -- 172.21.15.29:0/592525426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc009420 con 0x7f64c815cd80 2023-10-06T05:26:01.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cd48b700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 0x7f64c8170910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c930 tx=0x7f64c0002780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:01.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64c5ffb700 1 -- 172.21.15.29:0/592525426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0012630 con 0x7f64c815cd80 2023-10-06T05:26:01.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64c5ffb700 1 -- 172.21.15.29:0/592525426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c0012790 con 0x7f64c815cd80 2023-10-06T05:26:01.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b80094f0 con 0x7f64c815cd80 2023-10-06T05:26:01.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64c5ffb700 1 -- 172.21.15.29:0/592525426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0012b50 con 0x7f64c815cd80 2023-10-06T05:26:01.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c80a4bb0 con 0x7f64c815cd80 2023-10-06T05:26:01.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.916+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c80a50b0 con 0x7f64c815cd80 2023-10-06T05:26:01.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.920+0000 7f64c5ffb700 1 -- 172.21.15.29:0/592525426 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f64c001b400 con 0x7f64c815cd80 2023-10-06T05:26:01.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.920+0000 7f64c5ffb700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f64b4060550 0x7f64b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:01.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.920+0000 7f64c5ffb700 1 -- 172.21.15.29:0/592525426 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f64c007cc00 con 0x7f64c815cd80 2023-10-06T05:26:01.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.920+0000 7f64cdc8c700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f64b4060550 0x7f64b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:01.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.920+0000 7f64cdc8c700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f64b4060550 0x7f64b4062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009f40 tx=0x7f64bc0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:01.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:01.928+0000 7f64c5ffb700 1 -- 172.21.15.29:0/592525426 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f64c0083080 con 0x7f64c815cd80 2023-10-06T05:26:02.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.124+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64c804be00 con 0x7f64c815cd80 2023-10-06T05:26:02.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64c5ffb700 1 -- 172.21.15.29:0/592525426 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64c0016070 con 0x7f64c815cd80 2023-10-06T05:26:02.132 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f64b4060550 msgr2=0x7f64b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f64b4060550 0x7f64b4062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009f40 tx=0x7f64bc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 msgr2=0x7f64c8170910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 0x7f64c8170910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c930 tx=0x7f64c0002780 comp rx=0 tx=0).stop 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 shutdown_connections 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f64b4060550 0x7f64b4062a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8161950 0x7f64c8170e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64c815cd80 0x7f64c8170910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 --2- 172.21.15.29:0/592525426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64c80af5c0 0x7f64c81476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 >> 172.21.15.29:0/592525426 conn(0x7f64c8067b70 msgr2=0x7f64c815e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 shutdown_connections 2023-10-06T05:26:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:02.128+0000 7f64cfef0700 1 -- 172.21.15.29:0/592525426 wait complete. 2023-10-06T05:26:02.146 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:26:02.146 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:26:02.147 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-10-06T05:26:02.147 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T05:26:02.147 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T05:26:02.147 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:26:02.147 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:26:02.147 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:26:02.147 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T05:26:02.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.147 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-10-06T05:26:02.156 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:26:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:26:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:26:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-10-06T05:26:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.156 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:26:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:02.156 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42548sec preferred_lft 42548sec 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:26:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:2a:88:0d:66 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether ae:f6:93:21:94:c6 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::e88c:9cff:feaa:8888/64 scope link 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:26:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether ae:f6:93:21:94:c6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T05:26:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::acf6:93ff:fe21:94c6/64 scope link 2023-10-06T05:26:02.159 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.159 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:26:02.212 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-10-06T05:26:02.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.214 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-10-06T05:26:02.223 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-10-06T05:26:02.224 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:26:02.224 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-06T05:26:02.224 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T05:26:02.224 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:26:02.224 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-06T05:26:02.224 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-06T05:26:02.224 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:26:02.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.224 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-10-06T05:26:02.225 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-10-06T05:26:02.225 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T05:26:02.225 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T05:26:02.225 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T05:26:02.225 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-10-06T05:26:02.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.264 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-10-06T05:26:02.312 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T05:26:02.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.312 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2023-10-06T05:26:02.319 INFO:teuthology.orchestra.run.smithi173.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T05:26:02.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.319 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-10-06T05:26:02.319 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-10-06T05:26:02.319 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T05:26:02.319 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T05:26:02.319 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-10-06T05:26:02.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.351 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T05:26:02.362 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:26:02.362 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:26:02.362 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:26:02.362 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.362 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-10-06T05:26:02.362 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.362 INFO:teuthology.orchestra.run.smithi173.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:26:02.362 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:54:22:da:49:29 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T05:26:02.362 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T05:26:02.363 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.363 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c54:22ff:feda:4929/64 scope link 2023-10-06T05:26:02.363 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.364 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T05:26:02.378 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:54:22:da:49:29 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c54:22ff:feda:4929/64 scope link 2023-10-06T05:26:02.379 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:02.380 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T05:26:02.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.381 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-10-06T05:26:02.381 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-10-06T05:26:02.381 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T05:26:02.381 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T05:26:02.381 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T05:26:02.381 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T05:26:02.381 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T05:26:02.381 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-10-06T05:26:02.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:02.434 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-10-06T05:26:02.435 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-10-06T05:26:02.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.1 up 2023-10-06T05:26:02.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T05:26:02.435 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-10-06T05:26:02.460 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-06T05:26:02.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:26:02.460 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T05:26:02.466 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T05:26:02.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:26:02.467 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T05:26:02.472 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-10-06T05:26:02.485 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:26:02.485 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:26:02.497 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:26:02.498 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:26:02.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:02.498 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-10-06T05:26:02.547 INFO:teuthology.orchestra.run.smithi173.stdout:52 2023-10-06T05:26:02.548 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-10-06T05:26:02.548 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-06T05:26:02.550 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-10-06T05:26:02.568 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:26:02.568 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:26:02.581 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:26:02.582 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:26:02.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:02.582 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-10-06T05:26:02.587 INFO:teuthology.orchestra.run.smithi173.stdout:52 2023-10-06T05:26:02.633 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:2023-10-06T05:26:02.629+0000 7f4d28b7a380 -1 init, newargv = 0x563ad7bdbc90 newargc=15 2023-10-06T05:26:02.634 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:ceph-fuse[39554]: starting ceph client 2023-10-06T05:26:02.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:ceph-fuse[39554]: starting fuse 2023-10-06T05:26:03.689 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-10-06T05:26:03.707 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:26:03.707 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:26:03.722 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:26:03.723 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:26:03.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:03.724 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-10-06T05:26:03.731 INFO:teuthology.orchestra.run.smithi173.stdout:52 2023-10-06T05:26:03.731 INFO:teuthology.orchestra.run.smithi173.stdout:53 2023-10-06T05:26:03.731 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-10-06T05:26:03.731 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-06T05:26:03.732 DEBUG:teuthology.orchestra.run.smithi173:> 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-10-06T05:26:03.733 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:26:03.734 DEBUG:teuthology.orchestra.run.smithi173:> 2023-10-06T05:26:03.734 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.3")) 2023-10-06T05:26:03.734 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-10-06T05:26:03.816 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.3.39554.asok 2023-10-06T05:26:04.001 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.39554.asok 2023-10-06T05:26:04.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:04.001 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.39554.asok status 2023-10-06T05:26:04.143 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "3", 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "39554", 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-10-06T05:26:04.144 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4574, 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 4574 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.2:0", 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1262181101 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-06T05:26:04.145 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.2:0", 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1262181101 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.4574 192.168.0.2:0/1262181101", 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.2:0/1262181101", 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 7, 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 24, 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-10-06T05:26:04.146 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2023-10-06T05:26:04.147 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-10-06T05:26:04.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:04.153 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:26:04.153 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:04.162 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:26:04.162 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:04.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:04.162 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:04.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:04.222 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:26:04.222 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-06T05:26:04.228 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:26:04.228 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-06T05:26:04.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:04.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T05:26:04.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:04.251 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-10-06T05:26:04.251 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-06T05:26:04.259 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-10-06T05:26:04.259 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-06T05:26:04.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:04.259 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T05:26:04.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:04.274 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-10-06T05:26:04.274 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-06T05:26:04.279 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-10-06T05:26:04.279 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-06T05:26:04.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:04.280 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T05:26:04.293 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T05:26:04.311 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:04.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca48966700 1 Processor -- start 2023-10-06T05:26:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca48966700 1 -- start start 2023-10-06T05:26:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca48966700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca440b0de0 0x7fca440b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca48966700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 0x7fca4406ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca48966700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4406a970 con 0x7fca4406e9f0 2023-10-06T05:26:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca48966700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4406f6e0 con 0x7fca440b0de0 2023-10-06T05:26:04.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca48966700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4406ee70 con 0x7fca440cc460 2023-10-06T05:26:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca41d9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fca4406e9f0 0x7fca440ca070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60074/0 (socket says 172.21.15.29:60074) 2023-10-06T05:26:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca41d9b700 1 -- 172.21.15.29:0/4102084837 learned_addr learned my addr 172.21.15.29:0/4102084837 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca4259c700 1 --2- 172.21.15.29:0/4102084837 >> v2:172.21.15.173:3300/0 conn(0x7fca440b0de0 0x7fca440b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca42d9d700 1 --2- 172.21.15.29:0/4102084837 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 0x7fca4406ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca4159a700 1 -- 172.21.15.29:0/4102084837 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100619344 0 0) 0x7fca4406a970 con 0x7fca4406e9f0 2023-10-06T05:26:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca4159a700 1 -- 172.21.15.29:0/4102084837 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca2c003570 con 0x7fca4406e9f0 2023-10-06T05:26:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca42d9d700 1 -- 172.21.15.29:0/4102084837 >> v2:172.21.15.173:3300/0 conn(0x7fca440b0de0 msgr2=0x7fca440b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca42d9d700 1 --2- 172.21.15.29:0/4102084837 >> v2:172.21.15.173:3300/0 conn(0x7fca440b0de0 0x7fca440b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca42d9d700 1 -- 172.21.15.29:0/4102084837 >> v1:172.21.15.29:6789/0 conn(0x7fca4406e9f0 legacy=0x7fca440ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.420+0000 7fca42d9d700 1 -- 172.21.15.29:0/4102084837 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4406f120 con 0x7fca440cc460 2023-10-06T05:26:04.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca42d9d700 1 --2- 172.21.15.29:0/4102084837 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 0x7fca4406ae00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca340098e0 tx=0x7fca340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d653b86acb9db2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca4159a700 1 -- 172.21.15.29:0/4102084837 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34011630 con 0x7fca440cc460 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca4159a700 1 -- 172.21.15.29:0/4102084837 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca34011790 con 0x7fca440cc460 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca4159a700 1 -- 172.21.15.29:0/4102084837 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34011b30 con 0x7fca440cc460 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 -- 172.21.15.29:0/4102084837 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 msgr2=0x7fca4406ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 --2- 172.21.15.29:0/4102084837 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 0x7fca4406ae00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca340098e0 tx=0x7fca340091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 -- 172.21.15.29:0/4102084837 shutdown_connections 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 --2- 172.21.15.29:0/4102084837 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 0x7fca4406ae00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 --2- 172.21.15.29:0/4102084837 >> v2:172.21.15.173:3300/0 conn(0x7fca440b0de0 0x7fca440b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 -- 172.21.15.29:0/4102084837 >> 172.21.15.29:0/4102084837 conn(0x7fca44067b70 msgr2=0x7fca4406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 -- 172.21.15.29:0/4102084837 shutdown_connections 2023-10-06T05:26:04.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 -- 172.21.15.29:0/4102084837 wait complete. 2023-10-06T05:26:04.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 Processor -- start 2023-10-06T05:26:04.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.424+0000 7fca48966700 1 -- start start 2023-10-06T05:26:04.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca48966700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca4406e9f0 0x7fca440a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca48966700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca440b0de0 0x7fca44144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca48966700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 0x7fca44155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca48966700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4415fb10 con 0x7fca4406e9f0 2023-10-06T05:26:04.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca48966700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44169210 con 0x7fca440b0de0 2023-10-06T05:26:04.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca48966700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440a5410 con 0x7fca440cc460 2023-10-06T05:26:04.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca4259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca4406e9f0 0x7fca440a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca4259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca4406e9f0 0x7fca440a4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34922/0 (socket says 172.21.15.29:34922) 2023-10-06T05:26:04.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca4259c700 1 -- 172.21.15.29:0/808940208 learned_addr learned my addr 172.21.15.29:0/808940208 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:04.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca42d9d700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 0x7fca44155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca41d9b700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca440b0de0 0x7fca44144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca4259c700 1 -- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 msgr2=0x7fca44155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca4259c700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 0x7fca44155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca4259c700 1 -- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca440b0de0 msgr2=0x7fca44144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca4259c700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca440b0de0 0x7fca44144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca4259c700 1 -- 172.21.15.29:0/808940208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca34009420 con 0x7fca4406e9f0 2023-10-06T05:26:04.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca4259c700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca4406e9f0 0x7fca440a4ed0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009f20 tx=0x7fca3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca327fc700 1 -- 172.21.15.29:0/808940208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00cbd0 con 0x7fca4406e9f0 2023-10-06T05:26:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca327fc700 1 -- 172.21.15.29:0/808940208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c00f040 con 0x7fca4406e9f0 2023-10-06T05:26:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca44144ab0 con 0x7fca4406e9f0 2023-10-06T05:26:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca327fc700 1 -- 172.21.15.29:0/808940208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c014480 con 0x7fca4406e9f0 2023-10-06T05:26:04.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4415f550 con 0x7fca4406e9f0 2023-10-06T05:26:04.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.428+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca44168fe0 con 0x7fca4406e9f0 2023-10-06T05:26:04.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.432+0000 7fca327fc700 1 -- 172.21.15.29:0/808940208 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fca3c0147f0 con 0x7fca4406e9f0 2023-10-06T05:26:04.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.432+0000 7fca327fc700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca24060550 0x7fca24062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.432+0000 7fca327fc700 1 -- 172.21.15.29:0/808940208 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca3c07d280 con 0x7fca4406e9f0 2023-10-06T05:26:04.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.432+0000 7fca41d9b700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca24060550 0x7fca24062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.432+0000 7fca41d9b700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca24060550 0x7fca24062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fca44155c30 tx=0x7fca38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:04.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.436+0000 7fca327fc700 1 -- 172.21.15.29:0/808940208 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca44168fe0 con 0x7fca4406e9f0 2023-10-06T05:26:04.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.600+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca44168fe0 con 0x7fca4406e9f0 2023-10-06T05:26:04.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca327fc700 1 -- 172.21.15.29:0/808940208 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fca44168fe0 con 0x7fca4406e9f0 2023-10-06T05:26:04.609 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:04.609 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:04.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca24060550 msgr2=0x7fca24062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca24060550 0x7fca24062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fca44155c30 tx=0x7fca38009040 comp rx=0 tx=0).stop 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca4406e9f0 msgr2=0x7fca440a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca4406e9f0 0x7fca440a4ed0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009f20 tx=0x7fca3c00b040 comp rx=0 tx=0).stop 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 shutdown_connections 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca440cc460 0x7fca44155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca24060550 0x7fca24062a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca440b0de0 0x7fca44144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 --2- 172.21.15.29:0/808940208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca4406e9f0 0x7fca440a4ed0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 >> 172.21.15.29:0/808940208 conn(0x7fca44067b70 msgr2=0x7fca440aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 shutdown_connections 2023-10-06T05:26:04.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.604+0000 7fca48966700 1 -- 172.21.15.29:0/808940208 wait complete. 2023-10-06T05:26:04.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:25:38.347316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:25:38.976583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:26:04.623 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:26:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61ea49f700 1 Processor -- start 2023-10-06T05:26:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61ea49f700 1 -- start start 2023-10-06T05:26:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61ea49f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e41559d0 0x7f61e40c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61ea49f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e41596e0 con 0x7f61e4155da0 2023-10-06T05:26:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61ea49f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e415a520 con 0x7f61e40cb590 2023-10-06T05:26:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61ea49f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40ae800 con 0x7f61e41559d0 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61e8c9c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f61e4155da0 0x7f61e40cae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60084/0 (socket says 172.21.15.29:60084) 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61e8c9c700 1 -- 172.21.15.29:0/3012214958 learned_addr learned my addr 172.21.15.29:0/3012214958 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61e949d700 1 --2- 172.21.15.29:0/3012214958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e41559d0 0x7f61e40c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61d7fff700 1 -- 172.21.15.29:0/3012214958 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130513805 0 0) 0x7f61e41596e0 con 0x7f61e4155da0 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61d7fff700 1 -- 172.21.15.29:0/3012214958 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d0003570 con 0x7f61e4155da0 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61d7fff700 1 -- 172.21.15.29:0/3012214958 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705279866 0 0) 0x7f61e415a520 con 0x7f61e40cb590 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61d7fff700 1 -- 172.21.15.29:0/3012214958 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e41596e0 con 0x7f61e40cb590 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61d7fff700 1 -- 172.21.15.29:0/3012214958 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 755923373 0 0) 0x7f61d0003570 con 0x7f61e4155da0 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61e949d700 1 -- 172.21.15.29:0/3012214958 >> v1:172.21.15.173:6789/0 conn(0x7f61e40cb590 legacy=0x7f61e406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61e949d700 1 -- 172.21.15.29:0/3012214958 >> v1:172.21.15.29:6789/0 conn(0x7f61e4155da0 legacy=0x7f61e40cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61e949d700 1 -- 172.21.15.29:0/3012214958 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4159910 con 0x7f61e41559d0 2023-10-06T05:26:04.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61e949d700 1 --2- 172.21.15.29:0/3012214958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e41559d0 0x7f61e40c8470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009910 tx=0x7f61e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7afa04b5fcb044ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61d7fff700 1 -- 172.21.15.29:0/3012214958 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8001470 con 0x7f61e41559d0 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.736+0000 7f61d7fff700 1 -- 172.21.15.29:0/3012214958 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0011420 con 0x7f61e41559d0 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61d7fff700 1 -- 172.21.15.29:0/3012214958 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e00117a0 con 0x7f61e41559d0 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 -- 172.21.15.29:0/3012214958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e41559d0 msgr2=0x7f61e40c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 --2- 172.21.15.29:0/3012214958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e41559d0 0x7f61e40c8470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009910 tx=0x7f61e00091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 -- 172.21.15.29:0/3012214958 shutdown_connections 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 --2- 172.21.15.29:0/3012214958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e41559d0 0x7f61e40c8470 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 -- 172.21.15.29:0/3012214958 >> 172.21.15.29:0/3012214958 conn(0x7f61e406c6c0 msgr2=0x7f61e406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 -- 172.21.15.29:0/3012214958 shutdown_connections 2023-10-06T05:26:04.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 -- 172.21.15.29:0/3012214958 wait complete. 2023-10-06T05:26:04.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 Processor -- start 2023-10-06T05:26:04.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 -- start start 2023-10-06T05:26:04.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e40cb590 0x7f61e40c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e41559d0 0x7f61e40afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e4155da0 0x7f61e40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e414fc20 con 0x7f61e41559d0 2023-10-06T05:26:04.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40c92f0 con 0x7f61e4155da0 2023-10-06T05:26:04.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61ea49f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40c54a0 con 0x7f61e40cb590 2023-10-06T05:26:04.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e8c9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e41559d0 0x7f61e40afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e8c9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e41559d0 0x7f61e40afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34930/0 (socket says 172.21.15.29:34930) 2023-10-06T05:26:04.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e8c9c700 1 -- 172.21.15.29:0/1130024471 learned_addr learned my addr 172.21.15.29:0/1130024471 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:04.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e949d700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e40cb590 0x7f61e40c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e9c9e700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e4155da0 0x7f61e40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e8c9c700 1 -- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e40cb590 msgr2=0x7f61e40c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e8c9c700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e40cb590 0x7f61e40c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e8c9c700 1 -- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e4155da0 msgr2=0x7f61e40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e8c9c700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e4155da0 0x7f61e40b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e8c9c700 1 -- 172.21.15.29:0/1130024471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0009420 con 0x7f61e41559d0 2023-10-06T05:26:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e9c9e700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e4155da0 0x7f61e40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.740+0000 7f61e8c9c700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e41559d0 0x7f61e40afff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c7e0 tx=0x7f61d8001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.744+0000 7f61d57fa700 1 -- 172.21.15.29:0/1130024471 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8007360 con 0x7f61e41559d0 2023-10-06T05:26:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.744+0000 7f61d57fa700 1 -- 172.21.15.29:0/1130024471 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d80074e0 con 0x7f61e41559d0 2023-10-06T05:26:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.744+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e40c5780 con 0x7f61e41559d0 2023-10-06T05:26:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.744+0000 7f61d57fa700 1 -- 172.21.15.29:0/1130024471 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8004830 con 0x7f61e41559d0 2023-10-06T05:26:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.744+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e40c39b0 con 0x7f61e41559d0 2023-10-06T05:26:04.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.744+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e40c94f0 con 0x7f61e41559d0 2023-10-06T05:26:04.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.744+0000 7f61d57fa700 1 -- 172.21.15.29:0/1130024471 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f61d8004ba0 con 0x7f61e41559d0 2023-10-06T05:26:04.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.744+0000 7f61d57fa700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61c8060550 0x7f61c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:04.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.744+0000 7f61d57fa700 1 -- 172.21.15.29:0/1130024471 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f61d807bfe0 con 0x7f61e41559d0 2023-10-06T05:26:04.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.748+0000 7f61e949d700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61c8060550 0x7f61c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:04.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.748+0000 7f61e949d700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61c8060550 0x7f61c8062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009860 tx=0x7f61e0016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.752+0000 7f61d57fa700 1 -- 172.21.15.29:0/1130024471 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f61e40c94f0 con 0x7f61e41559d0 2023-10-06T05:26:04.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.916+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61e40c94b0 con 0x7f61e41559d0 2023-10-06T05:26:04.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.916+0000 7f61d57fa700 1 -- 172.21.15.29:0/1130024471 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61d80180a0 con 0x7f61e41559d0 2023-10-06T05:26:04.923 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:26:04.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61c8060550 msgr2=0x7f61c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61c8060550 0x7f61c8062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009860 tx=0x7f61e0016000 comp rx=0 tx=0).stop 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e41559d0 msgr2=0x7f61e40afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e41559d0 0x7f61e40afff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c7e0 tx=0x7f61d8001a30 comp rx=0 tx=0).stop 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 shutdown_connections 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61c8060550 0x7f61c8062a00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61e4155da0 0x7f61e40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e41559d0 0x7f61e40afff0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 --2- 172.21.15.29:0/1130024471 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f61e40cb590 0x7f61e40c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 >> 172.21.15.29:0/1130024471 conn(0x7f61e406c6c0 msgr2=0x7f61e4150180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 shutdown_connections 2023-10-06T05:26:04.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:04.920+0000 7f61ea49f700 1 -- 172.21.15.29:0/1130024471 wait complete. 2023-10-06T05:26:04.937 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:26:05.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b911e0700 1 Processor -- start 2023-10-06T05:26:05.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b911e0700 1 -- start start 2023-10-06T05:26:05.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b911e0700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2b8c06b1a0 0x7f2b8c06b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b911e0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c0cb430 0x7f2b8c0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b911e0700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c06e040 con 0x7f2b8c15d490 2023-10-06T05:26:05.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b911e0700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c0ca8e0 con 0x7f2b8c06b1a0 2023-10-06T05:26:05.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b911e0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c15d000 con 0x7f2b8c0cb430 2023-10-06T05:26:05.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8259c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c0cb430 0x7f2b8c0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8ad9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2b8c06b1a0 0x7f2b8c06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8b59e700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f2b8c15d490 0x7f2b8c0c73f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:40322/0 (socket says 172.21.15.29:40322) 2023-10-06T05:26:05.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8b59e700 1 -- 172.21.15.29:0/48696737 learned_addr learned my addr 172.21.15.29:0/48696737 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:05.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8a59c700 1 -- 172.21.15.29:0/48696737 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595489328 0 0) 0x7f2b8c06e040 con 0x7f2b8c15d490 2023-10-06T05:26:05.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8a59c700 1 -- 172.21.15.29:0/48696737 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b78003570 con 0x7f2b8c15d490 2023-10-06T05:26:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8ad9d700 1 -- 172.21.15.29:0/48696737 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c0cb430 msgr2=0x7f2b8c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8ad9d700 1 --2- 172.21.15.29:0/48696737 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c0cb430 0x7f2b8c0ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8ad9d700 1 -- 172.21.15.29:0/48696737 >> v1:172.21.15.173:6789/0 conn(0x7f2b8c15d490 legacy=0x7f2b8c0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8ad9d700 1 -- 172.21.15.29:0/48696737 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c06da80 con 0x7f2b8c06b1a0 2023-10-06T05:26:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.044+0000 7f2b8259c700 1 --2- 172.21.15.29:0/48696737 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c0cb430 0x7f2b8c0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b8ad9d700 1 --2- 172.21.15.29:0/48696737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 0x7f2b8c06b570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009910 tx=0x7f2b7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=183c6f0d6e4c5cea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b8a59c700 1 -- 172.21.15.29:0/48696737 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011630 con 0x7f2b8c06b1a0 2023-10-06T05:26:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b8a59c700 1 -- 172.21.15.29:0/48696737 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c011790 con 0x7f2b8c06b1a0 2023-10-06T05:26:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b8a59c700 1 -- 172.21.15.29:0/48696737 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011b10 con 0x7f2b8c06b1a0 2023-10-06T05:26:05.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 -- 172.21.15.29:0/48696737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 msgr2=0x7f2b8c06b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 --2- 172.21.15.29:0/48696737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 0x7f2b8c06b570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009910 tx=0x7f2b7c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 -- 172.21.15.29:0/48696737 shutdown_connections 2023-10-06T05:26:05.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 --2- 172.21.15.29:0/48696737 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c0cb430 0x7f2b8c0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 --2- 172.21.15.29:0/48696737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 0x7f2b8c06b570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 -- 172.21.15.29:0/48696737 >> 172.21.15.29:0/48696737 conn(0x7f2b8c0cd0e0 msgr2=0x7f2b8c0c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:05.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 -- 172.21.15.29:0/48696737 shutdown_connections 2023-10-06T05:26:05.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 -- 172.21.15.29:0/48696737 wait complete. 2023-10-06T05:26:05.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 Processor -- start 2023-10-06T05:26:05.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.048+0000 7f2b911e0700 1 -- start start 2023-10-06T05:26:05.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b911e0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 0x7f2b8c14b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b911e0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c0cb430 0x7f2b8c15b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b911e0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c15d490 0x7f2b8c15b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b911e0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c15a5a0 con 0x7f2b8c0cb430 2023-10-06T05:26:05.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b911e0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c159990 con 0x7f2b8c06b1a0 2023-10-06T05:26:05.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b911e0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c159c70 con 0x7f2b8c15d490 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c0cb430 0x7f2b8c15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c0cb430 0x7f2b8c15b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34942/0 (socket says 172.21.15.29:34942) 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8259c700 1 -- 172.21.15.29:0/3682514828 learned_addr learned my addr 172.21.15.29:0/3682514828 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8ad9d700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 0x7f2b8c14b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8b59e700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c15d490 0x7f2b8c15b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8259c700 1 -- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c15d490 msgr2=0x7f2b8c15b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8259c700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c15d490 0x7f2b8c15b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8259c700 1 -- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 msgr2=0x7f2b8c14b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8259c700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 0x7f2b8c14b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8259c700 1 -- 172.21.15.29:0/3682514828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74009420 con 0x7f2b8c0cb430 2023-10-06T05:26:05.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8ad9d700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 0x7f2b8c14b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:05.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b8259c700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c0cb430 0x7f2b8c15b140 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400ec80 tx=0x7f2b740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:05.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b837fe700 1 -- 172.21.15.29:0/3682514828 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400c9d0 con 0x7f2b8c0cb430 2023-10-06T05:26:05.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b837fe700 1 -- 172.21.15.29:0/3682514828 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400cb30 con 0x7f2b8c0cb430 2023-10-06T05:26:05.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c009420 con 0x7f2b8c0cb430 2023-10-06T05:26:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b837fe700 1 -- 172.21.15.29:0/3682514828 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400ceb0 con 0x7f2b8c0cb430 2023-10-06T05:26:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.052+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c15a230 con 0x7f2b8c0cb430 2023-10-06T05:26:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.056+0000 7f2b837fe700 1 -- 172.21.15.29:0/3682514828 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2b74013680 con 0x7f2b8c0cb430 2023-10-06T05:26:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.056+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c15a710 con 0x7f2b8c0cb430 2023-10-06T05:26:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.056+0000 7f2b837fe700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2b6c060550 0x7f2b6c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.056+0000 7f2b837fe700 1 -- 172.21.15.29:0/3682514828 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2b7407cd20 con 0x7f2b8c0cb430 2023-10-06T05:26:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.056+0000 7f2b8ad9d700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2b6c060550 0x7f2b6c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.056+0000 7f2b8ad9d700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2b6c060550 0x7f2b6c062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0093a0 tx=0x7f2b7c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:05.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.064+0000 7f2b837fe700 1 -- 172.21.15.29:0/3682514828 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2b7404d1b0 con 0x7f2b8c0cb430 2023-10-06T05:26:05.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.224+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2b8c071120 con 0x7f2b8c0cb430 2023-10-06T05:26:05.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b837fe700 1 -- 172.21.15.29:0/3682514828 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2b740507d0 con 0x7f2b8c0cb430 2023-10-06T05:26:05.232 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2b6c060550 msgr2=0x7f2b6c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2b6c060550 0x7f2b6c062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0093a0 tx=0x7f2b7c017000 comp rx=0 tx=0).stop 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c0cb430 msgr2=0x7f2b8c15b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c0cb430 0x7f2b8c15b140 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400ec80 tx=0x7f2b740091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 shutdown_connections 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b8c15d490 0x7f2b8c15b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8c0cb430 0x7f2b8c15b140 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2b6c060550 0x7f2b6c062a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 --2- 172.21.15.29:0/3682514828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b8c06b1a0 0x7f2b8c14b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 >> 172.21.15.29:0/3682514828 conn(0x7f2b8c0cd0e0 msgr2=0x7f2b8c0c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:05.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 shutdown_connections 2023-10-06T05:26:05.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.228+0000 7f2b911e0700 1 -- 172.21.15.29:0/3682514828 wait complete. 2023-10-06T05:26:05.246 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:26:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.352+0000 7fe58234c700 1 Processor -- start 2023-10-06T05:26:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.352+0000 7fe58234c700 1 -- start start 2023-10-06T05:26:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe58234c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c158c30 0x7fe57c159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe58234c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c06b380 con 0x7fe57c06b810 2023-10-06T05:26:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe58234c700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c06bc70 con 0x7fe57c15d890 2023-10-06T05:26:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe58234c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c06a770 con 0x7fe57c158c30 2023-10-06T05:26:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe5808e9700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe57c06b810 0x7fe57c0cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60096/0 (socket says 172.21.15.29:60096) 2023-10-06T05:26:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe5808e9700 1 -- 172.21.15.29:0/1236606694 learned_addr learned my addr 172.21.15.29:0/1236606694 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57bfff700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c158c30 0x7fe57c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697965236 0 0) 0x7fe57c06b380 con 0x7fe57c06b810 2023-10-06T05:26:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe568003570 con 0x7fe57c06b810 2023-10-06T05:26:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566490302 0 0) 0x7fe57c06bc70 con 0x7fe57c15d890 2023-10-06T05:26:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe57c06b380 con 0x7fe57c15d890 2023-10-06T05:26:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3518892269 0 0) 0x7fe568003570 con 0x7fe57c06b810 2023-10-06T05:26:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c158c30 msgr2=0x7fe57c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c158c30 0x7fe57c159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 >> v1:172.21.15.173:6789/0 conn(0x7fe57c15d890 legacy=0x7fe57c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c06aa50 con 0x7fe57c06b810 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fe5740017f0 con 0x7fe57c06b810 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 >> v1:172.21.15.29:6789/0 conn(0x7fe57c06b810 legacy=0x7fe57c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c158c30 0x7fe568003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe568004180 0x7fe568004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe568004d50 0x7fe5680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c06a770 con 0x7fe568004d50 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56800bba0 con 0x7fe568004180 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56800bd60 con 0x7fe57c158c30 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe5808e9700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe568004d50 0x7fe5680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57bfff700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c158c30 0x7fe568003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe57b7fe700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe568004180 0x7fe568004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe5808e9700 1 -- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c158c30 msgr2=0x7fe568003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe5808e9700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c158c30 0x7fe568003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe5808e9700 1 -- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe568004180 msgr2=0x7fe568004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe5808e9700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe568004180 0x7fe568004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe5808e9700 1 -- 172.21.15.29:0/1236606694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568003570 con 0x7fe568004d50 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.356+0000 7fe5808e9700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe568004d50 0x7fe5680051c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe57400a8c0 tx=0x7fe57c159540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147f8944b01c53a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740070f0 con 0x7fe568004d50 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574007270 con 0x7fe568004d50 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe57affd700 1 -- 172.21.15.29:0/1236606694 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574007630 con 0x7fe568004d50 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe58234c700 1 -- 172.21.15.29:0/1236606694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe568004d50 msgr2=0x7fe5680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe58234c700 1 --2- 172.21.15.29:0/1236606694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe568004d50 0x7fe5680051c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe57400a8c0 tx=0x7fe57c159540 comp rx=0 tx=0).stop 2023-10-06T05:26:05.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe5808e9700 1 -- 172.21.15.29:0/1236606694 reap_dead start 2023-10-06T05:26:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe58234c700 1 -- 172.21.15.29:0/1236606694 shutdown_connections 2023-10-06T05:26:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe58234c700 1 -- 172.21.15.29:0/1236606694 >> 172.21.15.29:0/1236606694 conn(0x7fe57c0670a0 msgr2=0x7fe57c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe58234c700 1 -- 172.21.15.29:0/1236606694 shutdown_connections 2023-10-06T05:26:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe58234c700 1 -- 172.21.15.29:0/1236606694 wait complete. 2023-10-06T05:26:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe58234c700 1 Processor -- start 2023-10-06T05:26:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.360+0000 7fe58234c700 1 -- start start 2023-10-06T05:26:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe58234c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe57c1551c0 0x7fe57c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe58234c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe57c0c8b60 0x7fe57c0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe58234c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c0c75e0 0x7fe57c0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe58234c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0c9510 con 0x7fe57c0c8b60 2023-10-06T05:26:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe58234c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0c7150 con 0x7fe57c1551c0 2023-10-06T05:26:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe58234c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c169f40 con 0x7fe57c0c75e0 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe57c0c8b60 0x7fe57c0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe57c0c8b60 0x7fe57c0c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34956/0 (socket says 172.21.15.29:34956) 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57b7fe700 1 -- 172.21.15.29:0/1718208812 learned_addr learned my addr 172.21.15.29:0/1718208812 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57bfff700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe57c1551c0 0x7fe57c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe5808e9700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c0c75e0 0x7fe57c0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57b7fe700 1 -- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c0c75e0 msgr2=0x7fe57c0c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57b7fe700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c0c75e0 0x7fe57c0c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57b7fe700 1 -- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe57c1551c0 msgr2=0x7fe57c0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57b7fe700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe57c1551c0 0x7fe57c0b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57b7fe700 1 -- 172.21.15.29:0/1718208812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c0b11d0 con 0x7fe57c0c8b60 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe57b7fe700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe57c0c8b60 0x7fe57c0c8fd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe564007860 tx=0x7fe564007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:05.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe573fff700 1 -- 172.21.15.29:0/1718208812 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564014680 con 0x7fe57c0c8b60 2023-10-06T05:26:05.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe573fff700 1 -- 172.21.15.29:0/1718208812 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5640147e0 con 0x7fe57c0c8b60 2023-10-06T05:26:05.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe573fff700 1 -- 172.21.15.29:0/1718208812 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564014ba0 con 0x7fe57c0c8b60 2023-10-06T05:26:05.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c0b14b0 con 0x7fe57c0c8b60 2023-10-06T05:26:05.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c0aee20 con 0x7fe57c0c8b60 2023-10-06T05:26:05.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57c0c7300 con 0x7fe57c0c8b60 2023-10-06T05:26:05.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.364+0000 7fe573fff700 1 -- 172.21.15.29:0/1718208812 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe56401d400 con 0x7fe57c0c8b60 2023-10-06T05:26:05.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.368+0000 7fe573fff700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe55c060580 0x7fe55c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.368+0000 7fe573fff700 1 -- 172.21.15.29:0/1718208812 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe56407ce30 con 0x7fe57c0c8b60 2023-10-06T05:26:05.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.368+0000 7fe57bfff700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe55c060580 0x7fe55c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.368+0000 7fe57bfff700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe55c060580 0x7fe55c062a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe56c006f00 tx=0x7fe56c0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:05.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.376+0000 7fe573fff700 1 -- 172.21.15.29:0/1718208812 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe57c0c7300 con 0x7fe57c0c8b60 2023-10-06T05:26:05.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.536+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe57c0c72c0 con 0x7fe57c0c8b60 2023-10-06T05:26:05.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe573fff700 1 -- 172.21.15.29:0/1718208812 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe56404d2c0 con 0x7fe57c0c8b60 2023-10-06T05:26:05.544 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:26:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe55c060580 msgr2=0x7fe55c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe55c060580 0x7fe55c062a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe56c006f00 tx=0x7fe56c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe57c0c8b60 msgr2=0x7fe57c0c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe57c0c8b60 0x7fe57c0c8fd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe564007860 tx=0x7fe564007d10 comp rx=0 tx=0).stop 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 shutdown_connections 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe57c0c75e0 0x7fe57c0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe57c0c8b60 0x7fe57c0c8fd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe55c060580 0x7fe55c062a30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 --2- 172.21.15.29:0/1718208812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe57c1551c0 0x7fe57c0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 >> 172.21.15.29:0/1718208812 conn(0x7fe57c0670a0 msgr2=0x7fe57c0cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 shutdown_connections 2023-10-06T05:26:05.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.540+0000 7fe58234c700 1 -- 172.21.15.29:0/1718208812 wait complete. 2023-10-06T05:26:05.558 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:26:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f2aa0700 1 Processor -- start 2023-10-06T05:26:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f2aa0700 1 -- start start 2023-10-06T05:26:05.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f2aa0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec156d70 0x7fb2ec0b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f2aa0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2ec0afbb0 0x7fb2ec0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f2aa0700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec0c8e70 con 0x7fb2ec0cdcb0 2023-10-06T05:26:05.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f2aa0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec0ce220 con 0x7fb2ec0afbb0 2023-10-06T05:26:05.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f2aa0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0ce500 con 0x7fb2ec156d70 2023-10-06T05:26:05.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f103d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2ec0afbb0 0x7fb2ec0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f103d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2ec0afbb0 0x7fb2ec0b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34962/0 (socket says 172.21.15.29:34962) 2023-10-06T05:26:05.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f103d700 1 -- 172.21.15.29:0/1925955826 learned_addr learned my addr 172.21.15.29:0/1925955826 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f083c700 1 --2- 172.21.15.29:0/1925955826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec156d70 0x7fb2ec0b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f103d700 1 -- 172.21.15.29:0/1925955826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec156d70 msgr2=0x7fb2ec0b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f103d700 1 --2- 172.21.15.29:0/1925955826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec156d70 0x7fb2ec0b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f103d700 1 -- 172.21.15.29:0/1925955826 >> v1:172.21.15.173:6789/0 conn(0x7fb2ec0cdcb0 legacy=0x7fb2ec0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f103d700 1 -- 172.21.15.29:0/1925955826 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0c8b00 con 0x7fb2ec0afbb0 2023-10-06T05:26:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2f103d700 1 --2- 172.21.15.29:0/1925955826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec0afbb0 0x7fb2ec0b0030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009f20 tx=0x7fb2e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d04dd38609c3b40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2eb7fe700 1 -- 172.21.15.29:0/1925955826 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400e070 con 0x7fb2ec0afbb0 2023-10-06T05:26:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.664+0000 7fb2eb7fe700 1 -- 172.21.15.29:0/1925955826 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e400ba80 con 0x7fb2ec0afbb0 2023-10-06T05:26:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2eb7fe700 1 -- 172.21.15.29:0/1925955826 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40092e0 con 0x7fb2ec0afbb0 2023-10-06T05:26:05.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/1925955826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec0afbb0 msgr2=0x7fb2ec0b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 --2- 172.21.15.29:0/1925955826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec0afbb0 0x7fb2ec0b0030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009f20 tx=0x7fb2e4009840 comp rx=0 tx=0).stop 2023-10-06T05:26:05.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/1925955826 shutdown_connections 2023-10-06T05:26:05.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 --2- 172.21.15.29:0/1925955826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec0afbb0 0x7fb2ec0b0030 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 --2- 172.21.15.29:0/1925955826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec156d70 0x7fb2ec0b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/1925955826 >> 172.21.15.29:0/1925955826 conn(0x7fb2ec0692b0 msgr2=0x7fb2ec069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:05.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/1925955826 shutdown_connections 2023-10-06T05:26:05.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/1925955826 wait complete. 2023-10-06T05:26:05.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 Processor -- start 2023-10-06T05:26:05.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.668+0000 7fb2f2aa0700 1 -- start start 2023-10-06T05:26:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f2aa0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2ec0afbb0 0x7fb2ec1561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f2aa0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec0cdcb0 0x7fb2ec0c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f2aa0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec156d70 0x7fb2ec0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f2aa0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0c6380 con 0x7fb2ec156d70 2023-10-06T05:26:05.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f2aa0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec167050 con 0x7fb2ec0afbb0 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f2aa0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0c5ae0 con 0x7fb2ec0cdcb0 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f103d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec156d70 0x7fb2ec0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f103d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec156d70 0x7fb2ec0b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34972/0 (socket says 172.21.15.29:34972) 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f103d700 1 -- 172.21.15.29:0/4041732015 learned_addr learned my addr 172.21.15.29:0/4041732015 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f083c700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2ec0afbb0 0x7fb2ec1561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2ebfff700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec0cdcb0 0x7fb2ec0c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f103d700 1 -- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec0cdcb0 msgr2=0x7fb2ec0c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f103d700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec0cdcb0 0x7fb2ec0c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f103d700 1 -- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2ec0afbb0 msgr2=0x7fb2ec1561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f103d700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2ec0afbb0 0x7fb2ec1561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f103d700 1 -- 172.21.15.29:0/4041732015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4009ae0 con 0x7fb2ec156d70 2023-10-06T05:26:05.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f083c700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2ec0afbb0 0x7fb2ec1561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:05.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f103d700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec156d70 0x7fb2ec0b1210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009430 tx=0x7fb2e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:05.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2e8ff9700 1 -- 172.21.15.29:0/4041732015 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40032f0 con 0x7fb2ec156d70 2023-10-06T05:26:05.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2e8ff9700 1 -- 172.21.15.29:0/4041732015 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e4008e70 con 0x7fb2ec156d70 2023-10-06T05:26:05.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec0c5dc0 con 0x7fb2ec156d70 2023-10-06T05:26:05.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2e8ff9700 1 -- 172.21.15.29:0/4041732015 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4026670 con 0x7fb2ec156d70 2023-10-06T05:26:05.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec156720 con 0x7fb2ec156d70 2023-10-06T05:26:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.672+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec166e20 con 0x7fb2ec156d70 2023-10-06T05:26:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.676+0000 7fb2e8ff9700 1 -- 172.21.15.29:0/4041732015 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb2e4003040 con 0x7fb2ec156d70 2023-10-06T05:26:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.676+0000 7fb2e8ff9700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb2d8060580 0x7fb2d8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.676+0000 7fb2e8ff9700 1 -- 172.21.15.29:0/4041732015 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2e407e9f0 con 0x7fb2ec156d70 2023-10-06T05:26:05.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.676+0000 7fb2f083c700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb2d8060580 0x7fb2d8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:05.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.676+0000 7fb2f083c700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb2d8060580 0x7fb2d8062a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc006fd0 tx=0x7fb2dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.680+0000 7fb2e8ff9700 1 -- 172.21.15.29:0/4041732015 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb2ec166e20 con 0x7fb2ec156d70 2023-10-06T05:26:05.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.836+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2ec166e20 con 0x7fb2ec156d70 2023-10-06T05:26:05.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.836+0000 7fb2e8ff9700 1 -- 172.21.15.29:0/4041732015 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2ec166e20 con 0x7fb2ec156d70 2023-10-06T05:26:05.844 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:26:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb2d8060580 msgr2=0x7fb2d8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb2d8060580 0x7fb2d8062a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc006fd0 tx=0x7fb2dc008040 comp rx=0 tx=0).stop 2023-10-06T05:26:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec156d70 msgr2=0x7fb2ec0b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec156d70 0x7fb2ec0b1210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009430 tx=0x7fb2e4018000 comp rx=0 tx=0).stop 2023-10-06T05:26:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 shutdown_connections 2023-10-06T05:26:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2ec156d70 0x7fb2ec0b1210 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2ec0cdcb0 0x7fb2ec0c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb2d8060580 0x7fb2d8062a30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 --2- 172.21.15.29:0/4041732015 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2ec0afbb0 0x7fb2ec1561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:05.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 >> 172.21.15.29:0/4041732015 conn(0x7fb2ec0692b0 msgr2=0x7fb2ec0c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:05.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 shutdown_connections 2023-10-06T05:26:05.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.840+0000 7fb2f2aa0700 1 -- 172.21.15.29:0/4041732015 wait complete. 2023-10-06T05:26:05.858 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:05.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b7b59e700 1 Processor -- start 2023-10-06T05:26:06.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b7b59e700 1 -- start start 2023-10-06T05:26:06.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b7b59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4b7c06dde0 0x7f4b7c067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b7b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 0x7f4b7c067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b7b59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c068770 con 0x7f4b7c158ca0 2023-10-06T05:26:06.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b7b59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c068530 con 0x7f4b7c06dde0 2023-10-06T05:26:06.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b7b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0c68b0 con 0x7f4b7c159070 2023-10-06T05:26:06.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b79d9b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4b7c06dde0 0x7f4b7c067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b7ad9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 0x7f4b7c067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b79d9b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4b7c06dde0 0x7f4b7c067ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:49118/0 (socket says 172.21.15.29:49118) 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.960+0000 7f4b79d9b700 1 -- 172.21.15.29:0/3889029707 learned_addr learned my addr 172.21.15.29:0/3889029707 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b79d9b700 1 -- 172.21.15.29:0/3889029707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 msgr2=0x7f4b7c067ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b79d9b700 1 --2- 172.21.15.29:0/3889029707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 0x7f4b7c067ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b79d9b700 1 -- 172.21.15.29:0/3889029707 >> v1:172.21.15.173:6789/0 conn(0x7f4b7c158ca0 legacy=0x7f4b7c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b79d9b700 1 -- 172.21.15.29:0/3889029707 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0c7430 con 0x7f4b7c06dde0 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b79d9b700 1 --2- 172.21.15.29:0/3889029707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b7c06dde0 0x7f4b7c067ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009f20 tx=0x7f4b74009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0a87aea079cac29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7959a700 1 -- 172.21.15.29:0/3889029707 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7400e070 con 0x7f4b7c06dde0 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7959a700 1 -- 172.21.15.29:0/3889029707 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7400b9d0 con 0x7f4b7c06dde0 2023-10-06T05:26:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7959a700 1 -- 172.21.15.29:0/3889029707 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b740092e0 con 0x7f4b7c06dde0 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3889029707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b7c06dde0 msgr2=0x7f4b7c067ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7b59e700 1 --2- 172.21.15.29:0/3889029707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b7c06dde0 0x7f4b7c067ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009f20 tx=0x7f4b74009840 comp rx=0 tx=0).stop 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3889029707 shutdown_connections 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7b59e700 1 --2- 172.21.15.29:0/3889029707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 0x7f4b7c067ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7b59e700 1 --2- 172.21.15.29:0/3889029707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b7c06dde0 0x7f4b7c067ab0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3889029707 >> 172.21.15.29:0/3889029707 conn(0x7f4b7c06abc0 msgr2=0x7f4b7c06af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3889029707 shutdown_connections 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.964+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3889029707 wait complete. 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 Processor -- start 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 -- start start 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b7c06dde0 0x7f4b7c0c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c158ca0 0x7f4b7c0c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 0x7f4b7c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0b1230 con 0x7f4b7c158ca0 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0c2f30 con 0x7f4b7c06dde0 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0c23b0 con 0x7f4b7c159070 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b79d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c158ca0 0x7f4b7c0c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b7c06dde0 0x7f4b7c0c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7ad9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 0x7f4b7c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b79d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c158ca0 0x7f4b7c0c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34982/0 (socket says 172.21.15.29:34982) 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b79d9b700 1 -- 172.21.15.29:0/3638063897 learned_addr learned my addr 172.21.15.29:0/3638063897 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b79d9b700 1 -- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 msgr2=0x7f4b7c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b79d9b700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 0x7f4b7c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b79d9b700 1 -- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b7c06dde0 msgr2=0x7f4b7c0c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b79d9b700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b7c06dde0 0x7f4b7c0c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b79d9b700 1 -- 172.21.15.29:0/3638063897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74009ae0 con 0x7f4b7c158ca0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b79d9b700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c158ca0 0x7f4b7c0c1b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400b610 tx=0x7f4b74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b727fc700 1 -- 172.21.15.29:0/3638063897 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b740088f0 con 0x7f4b7c158ca0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b727fc700 1 -- 172.21.15.29:0/3638063897 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b74008a50 con 0x7f4b7c158ca0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c0c2690 con 0x7f4b7c158ca0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b727fc700 1 -- 172.21.15.29:0/3638063897 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74008e10 con 0x7f4b7c158ca0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.968+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c0c20c0 con 0x7f4b7c158ca0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.972+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c0c3710 con 0x7f4b7c158ca0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.972+0000 7f4b727fc700 1 -- 172.21.15.29:0/3638063897 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4b74003040 con 0x7f4b7c158ca0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.972+0000 7f4b727fc700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4b5c060580 0x7f4b5c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.972+0000 7f4b727fc700 1 -- 172.21.15.29:0/3638063897 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4b7407e280 con 0x7f4b7c158ca0 2023-10-06T05:26:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.972+0000 7f4b7a59c700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4b5c060580 0x7f4b5c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.976+0000 7f4b7a59c700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4b5c060580 0x7f4b5c062a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b64003a80 tx=0x7f4b64007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:05.984+0000 7f4b727fc700 1 -- 172.21.15.29:0/3638063897 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4b7c0c3710 con 0x7f4b7c158ca0 2023-10-06T05:26:06.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.144+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b7c0c3710 con 0x7f4b7c158ca0 2023-10-06T05:26:06.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.144+0000 7f4b727fc700 1 -- 172.21.15.29:0/3638063897 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f4b7c0c3710 con 0x7f4b7c158ca0 2023-10-06T05:26:06.151 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:06.151 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:06.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4b5c060580 msgr2=0x7f4b5c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4b5c060580 0x7f4b5c062a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b64003a80 tx=0x7f4b64007ec0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c158ca0 msgr2=0x7f4b7c0c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c158ca0 0x7f4b7c0c1b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400b610 tx=0x7f4b74018000 comp rx=0 tx=0).stop 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 shutdown_connections 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b7c159070 0x7f4b7c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c158ca0 0x7f4b7c0c1b80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4b5c060580 0x7f4b5c062a30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 --2- 172.21.15.29:0/3638063897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b7c06dde0 0x7f4b7c0c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 >> 172.21.15.29:0/3638063897 conn(0x7f4b7c06abc0 msgr2=0x7f4b7c0ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 shutdown_connections 2023-10-06T05:26:06.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.148+0000 7f4b7b59e700 1 -- 172.21.15.29:0/3638063897 wait complete. 2023-10-06T05:26:06.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:25:38.347316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:25:38.976583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:26:06.166 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:26:06.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13e670700 1 Processor -- start 2023-10-06T05:26:06.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13e670700 1 -- start start 2023-10-06T05:26:06.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13e670700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc138158f10 0x7fc1380ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13e670700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 0x7fc13806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13e670700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc13806cc00 0x7fc1380cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13e670700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13806a600 con 0x7fc13806cc00 2023-10-06T05:26:06.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13e670700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13806d080 con 0x7fc138158f10 2023-10-06T05:26:06.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13e670700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380cacd0 con 0x7fc13815d730 2023-10-06T05:26:06.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13de6f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc13806cc00 0x7fc1380cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13de6f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc13806cc00 0x7fc1380cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34992/0 (socket says 172.21.15.29:34992) 2023-10-06T05:26:06.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13d66e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc138158f10 0x7fc1380ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13de6f700 1 -- 172.21.15.29:0/3472321742 learned_addr learned my addr 172.21.15.29:0/3472321742 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:06.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13ce6d700 1 --2- 172.21.15.29:0/3472321742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 0x7fc13806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13d66e700 1 -- 172.21.15.29:0/3472321742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 msgr2=0x7fc13806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13d66e700 1 --2- 172.21.15.29:0/3472321742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 0x7fc13806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13d66e700 1 -- 172.21.15.29:0/3472321742 >> v2:172.21.15.29:3300/0 conn(0x7fc13806cc00 msgr2=0x7fc1380cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13d66e700 1 --2- 172.21.15.29:0/3472321742 >> v2:172.21.15.29:3300/0 conn(0x7fc13806cc00 0x7fc1380cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13d66e700 1 -- 172.21.15.29:0/3472321742 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1380cafb0 con 0x7fc138158f10 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc13d66e700 1 --2- 172.21.15.29:0/3472321742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc138158f10 0x7fc1380ca4a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc1380d0f30 tx=0x7fc130009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f8dfde787fae826 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc12bfff700 1 -- 172.21.15.29:0/3472321742 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000e070 con 0x7fc138158f10 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc12bfff700 1 -- 172.21.15.29:0/3472321742 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13000bab0 con 0x7fc138158f10 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.276+0000 7fc12bfff700 1 -- 172.21.15.29:0/3472321742 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000be70 con 0x7fc138158f10 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 -- 172.21.15.29:0/3472321742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc138158f10 msgr2=0x7fc1380ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 --2- 172.21.15.29:0/3472321742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc138158f10 0x7fc1380ca4a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc1380d0f30 tx=0x7fc130009780 comp rx=0 tx=0).stop 2023-10-06T05:26:06.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 -- 172.21.15.29:0/3472321742 shutdown_connections 2023-10-06T05:26:06.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 --2- 172.21.15.29:0/3472321742 >> v2:172.21.15.29:3300/0 conn(0x7fc13806cc00 0x7fc1380cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 --2- 172.21.15.29:0/3472321742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 0x7fc13806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 --2- 172.21.15.29:0/3472321742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc138158f10 0x7fc1380ca4a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 -- 172.21.15.29:0/3472321742 >> 172.21.15.29:0/3472321742 conn(0x7fc138062b60 msgr2=0x7fc138062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:06.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 -- 172.21.15.29:0/3472321742 shutdown_connections 2023-10-06T05:26:06.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 -- 172.21.15.29:0/3472321742 wait complete. 2023-10-06T05:26:06.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 Processor -- start 2023-10-06T05:26:06.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 -- start start 2023-10-06T05:26:06.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc13806cc00 0x7fc1380b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc138158f10 0x7fc138169500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 0x7fc138169a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380b3be0 con 0x7fc138158f10 2023-10-06T05:26:06.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380b3ec0 con 0x7fc13806cc00 2023-10-06T05:26:06.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.280+0000 7fc13e670700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380b41a0 con 0x7fc13815d730 2023-10-06T05:26:06.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13ce6d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc138158f10 0x7fc138169500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13d66e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc13806cc00 0x7fc1380b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13ce6d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc138158f10 0x7fc138169500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35000/0 (socket says 172.21.15.29:35000) 2023-10-06T05:26:06.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13ce6d700 1 -- 172.21.15.29:0/729053060 learned_addr learned my addr 172.21.15.29:0/729053060 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:06.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13de6f700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 0x7fc138169a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13ce6d700 1 -- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 msgr2=0x7fc138169a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13ce6d700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 0x7fc138169a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13ce6d700 1 -- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc13806cc00 msgr2=0x7fc1380b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13ce6d700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc13806cc00 0x7fc1380b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13ce6d700 1 -- 172.21.15.29:0/729053060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc130009a20 con 0x7fc138158f10 2023-10-06T05:26:06.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13d66e700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc13806cc00 0x7fc1380b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:06.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13ce6d700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc138158f10 0x7fc138169500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc13400e930 tx=0x7fc1340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc1297fa700 1 -- 172.21.15.29:0/729053060 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc134013680 con 0x7fc138158f10 2023-10-06T05:26:06.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc1297fa700 1 -- 172.21.15.29:0/729053060 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1340137e0 con 0x7fc138158f10 2023-10-06T05:26:06.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1380b4480 con 0x7fc138158f10 2023-10-06T05:26:06.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc1297fa700 1 -- 172.21.15.29:0/729053060 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc134013b80 con 0x7fc138158f10 2023-10-06T05:26:06.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1380b5260 con 0x7fc138158f10 2023-10-06T05:26:06.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.284+0000 7fc1297fa700 1 -- 172.21.15.29:0/729053060 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc13400c3e0 con 0x7fc138158f10 2023-10-06T05:26:06.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.288+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13804be00 con 0x7fc138158f10 2023-10-06T05:26:06.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.288+0000 7fc1297fa700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc11c060550 0x7fc11c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.288+0000 7fc1297fa700 1 -- 172.21.15.29:0/729053060 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc13407c9c0 con 0x7fc138158f10 2023-10-06T05:26:06.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.288+0000 7fc13d66e700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc11c060550 0x7fc11c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.288+0000 7fc13d66e700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc11c060550 0x7fc11c062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1300099f0 tx=0x7fc130019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.296+0000 7fc1297fa700 1 -- 172.21.15.29:0/729053060 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc13404ce50 con 0x7fc138158f10 2023-10-06T05:26:06.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1380cdd60 con 0x7fc138158f10 2023-10-06T05:26:06.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc1297fa700 1 -- 172.21.15.29:0/729053060 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1340170a0 con 0x7fc138158f10 2023-10-06T05:26:06.465 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:26:06.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc11c060550 msgr2=0x7fc11c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc11c060550 0x7fc11c062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1300099f0 tx=0x7fc130019000 comp rx=0 tx=0).stop 2023-10-06T05:26:06.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc138158f10 msgr2=0x7fc138169500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc138158f10 0x7fc138169500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc13400e930 tx=0x7fc1340091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 shutdown_connections 2023-10-06T05:26:06.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc13815d730 0x7fc138169a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc138158f10 0x7fc138169500 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc11c060550 0x7fc11c062a00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 --2- 172.21.15.29:0/729053060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc13806cc00 0x7fc1380b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 >> 172.21.15.29:0/729053060 conn(0x7fc138062b60 msgr2=0x7fc1380ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:06.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.460+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 shutdown_connections 2023-10-06T05:26:06.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.464+0000 7fc13e670700 1 -- 172.21.15.29:0/729053060 wait complete. 2023-10-06T05:26:06.480 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:26:06.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff59d0b6700 1 Processor -- start 2023-10-06T05:26:06.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff59d0b6700 1 -- start start 2023-10-06T05:26:06.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff59d0b6700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff5980c8b80 0x7ff5980cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff59d0b6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff598155da0 0x7ff5980cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff59d0b6700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5981596e0 con 0x7ff5981559d0 2023-10-06T05:26:06.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff59d0b6700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59815a520 con 0x7ff5980c8b80 2023-10-06T05:26:06.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff59d0b6700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980ae800 con 0x7ff598155da0 2023-10-06T05:26:06.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff597fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff5981559d0 0x7ff5980c8470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60104/0 (socket says 172.21.15.29:60104) 2023-10-06T05:26:06.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff597fff700 1 -- 172.21.15.29:0/752112026 learned_addr learned my addr 172.21.15.29:0/752112026 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:06.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff5977fe700 1 --2- 172.21.15.29:0/752112026 >> v2:172.21.15.173:3300/0 conn(0x7ff5980c8b80 0x7ff5980cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff59c8b5700 1 --2- 172.21.15.29:0/752112026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff598155da0 0x7ff5980cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff596ffd700 1 -- 172.21.15.29:0/752112026 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74468242 0 0) 0x7ff5981596e0 con 0x7ff5981559d0 2023-10-06T05:26:06.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff596ffd700 1 -- 172.21.15.29:0/752112026 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff584003570 con 0x7ff5981559d0 2023-10-06T05:26:06.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff5977fe700 1 -- 172.21.15.29:0/752112026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff598155da0 msgr2=0x7ff5980cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:06.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff5977fe700 1 --2- 172.21.15.29:0/752112026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff598155da0 0x7ff5980cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff5977fe700 1 -- 172.21.15.29:0/752112026 >> v1:172.21.15.29:6789/0 conn(0x7ff5981559d0 legacy=0x7ff5980c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff5977fe700 1 -- 172.21.15.29:0/752112026 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff598159910 con 0x7ff5980c8b80 2023-10-06T05:26:06.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.588+0000 7ff59c8b5700 1 --2- 172.21.15.29:0/752112026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff598155da0 0x7ff5980cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:06.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff5977fe700 1 --2- 172.21.15.29:0/752112026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5980c8b80 0x7ff5980cae80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff5800098e0 tx=0x7ff5800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7deeb8740f66b899 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff596ffd700 1 -- 172.21.15.29:0/752112026 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011630 con 0x7ff5980c8b80 2023-10-06T05:26:06.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff596ffd700 1 -- 172.21.15.29:0/752112026 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580011790 con 0x7ff5980c8b80 2023-10-06T05:26:06.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff596ffd700 1 -- 172.21.15.29:0/752112026 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011b10 con 0x7ff5980c8b80 2023-10-06T05:26:06.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff59d0b6700 1 -- 172.21.15.29:0/752112026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5980c8b80 msgr2=0x7ff5980cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff59d0b6700 1 --2- 172.21.15.29:0/752112026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5980c8b80 0x7ff5980cae80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff5800098e0 tx=0x7ff5800091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff59d0b6700 1 -- 172.21.15.29:0/752112026 shutdown_connections 2023-10-06T05:26:06.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff59d0b6700 1 --2- 172.21.15.29:0/752112026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff598155da0 0x7ff5980cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff59d0b6700 1 --2- 172.21.15.29:0/752112026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5980c8b80 0x7ff5980cae80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff59d0b6700 1 -- 172.21.15.29:0/752112026 >> 172.21.15.29:0/752112026 conn(0x7ff59806c6c0 msgr2=0x7ff59806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:06.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff59d0b6700 1 -- 172.21.15.29:0/752112026 shutdown_connections 2023-10-06T05:26:06.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.592+0000 7ff59d0b6700 1 -- 172.21.15.29:0/752112026 wait complete. 2023-10-06T05:26:06.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59d0b6700 1 Processor -- start 2023-10-06T05:26:06.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59d0b6700 1 -- start start 2023-10-06T05:26:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59d0b6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5980c8b80 0x7ff59814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59d0b6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5981559d0 0x7ff598166aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59d0b6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff598155da0 0x7ff5980c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59d0b6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980c5b30 con 0x7ff598155da0 2023-10-06T05:26:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59d0b6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980c55d0 con 0x7ff5981559d0 2023-10-06T05:26:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59d0b6700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980c5850 con 0x7ff5980c8b80 2023-10-06T05:26:06.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59c8b5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff598155da0 0x7ff5980c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59c8b5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff598155da0 0x7ff5980c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35004/0 (socket says 172.21.15.29:35004) 2023-10-06T05:26:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59c8b5700 1 -- 172.21.15.29:0/2097842176 learned_addr learned my addr 172.21.15.29:0/2097842176 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff597fff700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5980c8b80 0x7ff59814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff5977fe700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5981559d0 0x7ff598166aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59c8b5700 1 -- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5980c8b80 msgr2=0x7ff59814f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59c8b5700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5980c8b80 0x7ff59814f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59c8b5700 1 -- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5981559d0 msgr2=0x7ff598166aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59c8b5700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5981559d0 0x7ff598166aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.596+0000 7ff59c8b5700 1 -- 172.21.15.29:0/2097842176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009a20 con 0x7ff598155da0 2023-10-06T05:26:06.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff59c8b5700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff598155da0 0x7ff5980c5090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff590009ef0 tx=0x7ff59000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff58ffff700 1 -- 172.21.15.29:0/2097842176 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000cb70 con 0x7ff598155da0 2023-10-06T05:26:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff58ffff700 1 -- 172.21.15.29:0/2097842176 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59000f040 con 0x7ff598155da0 2023-10-06T05:26:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff580009420 con 0x7ff598155da0 2023-10-06T05:26:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff58ffff700 1 -- 172.21.15.29:0/2097842176 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590014480 con 0x7ff598155da0 2023-10-06T05:26:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5981698f0 con 0x7ff598155da0 2023-10-06T05:26:06.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59804be00 con 0x7ff598155da0 2023-10-06T05:26:06.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff58ffff700 1 -- 172.21.15.29:0/2097842176 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff590003020 con 0x7ff598155da0 2023-10-06T05:26:06.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff58ffff700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff578060550 0x7ff578062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.600+0000 7ff58ffff700 1 -- 172.21.15.29:0/2097842176 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff59007d110 con 0x7ff598155da0 2023-10-06T05:26:06.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.604+0000 7ff597fff700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff578060550 0x7ff578062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.604+0000 7ff597fff700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff578060550 0x7ff578062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff5980c9750 tx=0x7ff588009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.612+0000 7ff58ffff700 1 -- 172.21.15.29:0/2097842176 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff59004d5a0 con 0x7ff598155da0 2023-10-06T05:26:06.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.772+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff598159bf0 con 0x7ff598155da0 2023-10-06T05:26:06.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.772+0000 7ff58ffff700 1 -- 172.21.15.29:0/2097842176 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff590050bc0 con 0x7ff598155da0 2023-10-06T05:26:06.777 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:26:06.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.772+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff578060550 msgr2=0x7ff578062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.772+0000 7ff59d0b6700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff578060550 0x7ff578062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff5980c9750 tx=0x7ff588009040 comp rx=0 tx=0).stop 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.772+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff598155da0 msgr2=0x7ff5980c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.772+0000 7ff59d0b6700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff598155da0 0x7ff5980c5090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff590009ef0 tx=0x7ff59000b040 comp rx=0 tx=0).stop 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.772+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 shutdown_connections 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.772+0000 7ff59d0b6700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff598155da0 0x7ff5980c5090 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.772+0000 7ff59d0b6700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff578060550 0x7ff578062a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.776+0000 7ff59d0b6700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5981559d0 0x7ff598166aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.776+0000 7ff59d0b6700 1 --2- 172.21.15.29:0/2097842176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5980c8b80 0x7ff59814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.776+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 >> 172.21.15.29:0/2097842176 conn(0x7ff59806c6c0 msgr2=0x7ff5980c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.776+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 shutdown_connections 2023-10-06T05:26:06.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.776+0000 7ff59d0b6700 1 -- 172.21.15.29:0/2097842176 wait complete. 2023-10-06T05:26:06.792 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:26:06.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c500e2700 1 Processor -- start 2023-10-06T05:26:06.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c500e2700 1 -- start start 2023-10-06T05:26:06.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c500e2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c4815d890 0x7f8c48159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c500e2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4806b810 0x7f8c480cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c500e2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4806b380 con 0x7f8c48158c30 2023-10-06T05:26:06.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c500e2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4806bc50 con 0x7f8c4815d890 2023-10-06T05:26:06.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c500e2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4806a770 con 0x7f8c4806b810 2023-10-06T05:26:06.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c4d67d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c4815d890 0x7f8c48159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c4de7e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8c48158c30 0x7f8c480ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60106/0 (socket says 172.21.15.29:60106) 2023-10-06T05:26:06.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c4d67d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c4815d890 0x7f8c48159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35012/0 (socket says 172.21.15.29:35012) 2023-10-06T05:26:06.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c4de7e700 1 -- 172.21.15.29:0/1130825538 learned_addr learned my addr 172.21.15.29:0/1130825538 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:06.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.900+0000 7f8c4e67f700 1 --2- 172.21.15.29:0/1130825538 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4806b810 0x7f8c480cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c4d67d700 1 -- 172.21.15.29:0/1130825538 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4806b810 msgr2=0x7f8c480cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:06.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c4d67d700 1 --2- 172.21.15.29:0/1130825538 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4806b810 0x7f8c480cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c4d67d700 1 -- 172.21.15.29:0/1130825538 >> v1:172.21.15.29:6789/0 conn(0x7f8c48158c30 legacy=0x7f8c480ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c4d67d700 1 -- 172.21.15.29:0/1130825538 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4806aa50 con 0x7f8c4815d890 2023-10-06T05:26:06.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c4d67d700 1 --2- 172.21.15.29:0/1130825538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c4815d890 0x7f8c48159000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8c440098e0 tx=0x7f8c440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716284fc30892164 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c4ce7c700 1 -- 172.21.15.29:0/1130825538 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44009e80 con 0x7f8c4815d890 2023-10-06T05:26:06.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c4ce7c700 1 -- 172.21.15.29:0/1130825538 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4400b860 con 0x7f8c4815d890 2023-10-06T05:26:06.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c4ce7c700 1 -- 172.21.15.29:0/1130825538 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4400bbe0 con 0x7f8c4815d890 2023-10-06T05:26:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c500e2700 1 -- 172.21.15.29:0/1130825538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c4815d890 msgr2=0x7f8c48159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c500e2700 1 --2- 172.21.15.29:0/1130825538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c4815d890 0x7f8c48159000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8c440098e0 tx=0x7f8c440091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c500e2700 1 -- 172.21.15.29:0/1130825538 shutdown_connections 2023-10-06T05:26:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c500e2700 1 --2- 172.21.15.29:0/1130825538 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4806b810 0x7f8c480cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c500e2700 1 --2- 172.21.15.29:0/1130825538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c4815d890 0x7f8c48159000 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c500e2700 1 -- 172.21.15.29:0/1130825538 >> 172.21.15.29:0/1130825538 conn(0x7f8c480670a0 msgr2=0x7f8c480674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c500e2700 1 -- 172.21.15.29:0/1130825538 shutdown_connections 2023-10-06T05:26:06.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.904+0000 7f8c500e2700 1 -- 172.21.15.29:0/1130825538 wait complete. 2023-10-06T05:26:06.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c500e2700 1 Processor -- start 2023-10-06T05:26:06.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c500e2700 1 -- start start 2023-10-06T05:26:06.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c500e2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c4806b810 0x7f8c4815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c500e2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c48158c30 0x7f8c48159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c500e2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4815d890 0x7f8c48154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c500e2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4815c3d0 con 0x7f8c48158c30 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c500e2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c48159fd0 con 0x7f8c4806b810 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c500e2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480c8250 con 0x7f8c4815d890 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c4d67d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c48158c30 0x7f8c48159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c4d67d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c48158c30 0x7f8c48159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35028/0 (socket says 172.21.15.29:35028) 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c4d67d700 1 -- 172.21.15.29:0/3645620942 learned_addr learned my addr 172.21.15.29:0/3645620942 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c4de7e700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c4806b810 0x7f8c4815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c4e67f700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4815d890 0x7f8c48154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c4d67d700 1 -- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4815d890 msgr2=0x7f8c48154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.908+0000 7f8c4d67d700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4815d890 0x7f8c48154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c4d67d700 1 -- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c4806b810 msgr2=0x7f8c4815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c4d67d700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c4806b810 0x7f8c4815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:06.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c4d67d700 1 -- 172.21.15.29:0/3645620942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c44009420 con 0x7f8c48158c30 2023-10-06T05:26:06.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c4e67f700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4815d890 0x7f8c48154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:26:06.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c4d67d700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c48158c30 0x7f8c48159a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c4806e090 tx=0x7f8c44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c3dffb700 1 -- 172.21.15.29:0/3645620942 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4400bbe0 con 0x7f8c48158c30 2023-10-06T05:26:06.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c3dffb700 1 -- 172.21.15.29:0/3645620942 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c44011420 con 0x7f8c48158c30 2023-10-06T05:26:06.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c48154c40 con 0x7f8c48158c30 2023-10-06T05:26:06.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c3dffb700 1 -- 172.21.15.29:0/3645620942 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c440117e0 con 0x7f8c48158c30 2023-10-06T05:26:06.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4815c8d0 con 0x7f8c48158c30 2023-10-06T05:26:06.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c480c8400 con 0x7f8c48158c30 2023-10-06T05:26:06.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.912+0000 7f8c3dffb700 1 -- 172.21.15.29:0/3645620942 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8c44011b90 con 0x7f8c48158c30 2023-10-06T05:26:06.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.916+0000 7f8c3dffb700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c2c060550 0x7f8c2c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:06.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.916+0000 7f8c3dffb700 1 -- 172.21.15.29:0/3645620942 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c4407e1f0 con 0x7f8c48158c30 2023-10-06T05:26:06.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.916+0000 7f8c4de7e700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c2c060550 0x7f8c2c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:06.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.916+0000 7f8c4de7e700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c2c060550 0x7f8c2c062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8c38007130 tx=0x7f8c38007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:06.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:06.920+0000 7f8c3dffb700 1 -- 172.21.15.29:0/3645620942 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8c480c8400 con 0x7f8c48158c30 2023-10-06T05:26:07.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.080+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c480c83c0 con 0x7f8c48158c30 2023-10-06T05:26:07.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.084+0000 7f8c3dffb700 1 -- 172.21.15.29:0/3645620942 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c4404e5e0 con 0x7f8c48158c30 2023-10-06T05:26:07.088 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:26:07.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c2c060550 msgr2=0x7f8c2c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c2c060550 0x7f8c2c062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8c38007130 tx=0x7f8c38007eb0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c48158c30 msgr2=0x7f8c48159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c48158c30 0x7f8c48159a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c4806e090 tx=0x7f8c44017000 comp rx=0 tx=0).stop 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 shutdown_connections 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8c4815d890 0x7f8c48154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c48158c30 0x7f8c48159a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8c2c060550 0x7f8c2c062a00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 --2- 172.21.15.29:0/3645620942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8c4806b810 0x7f8c4815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 >> 172.21.15.29:0/3645620942 conn(0x7f8c480670a0 msgr2=0x7f8c480cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 shutdown_connections 2023-10-06T05:26:07.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.088+0000 7f8c500e2700 1 -- 172.21.15.29:0/3645620942 wait complete. 2023-10-06T05:26:07.107 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:26:07.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95dba4700 1 Processor -- start 2023-10-06T05:26:07.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95dba4700 1 -- start start 2023-10-06T05:26:07.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95dba4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 0x7fd9580c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95dba4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd9580c72f0 0x7fd9580676f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95dba4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95806bf90 con 0x7fd958158e30 2023-10-06T05:26:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95dba4700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95806b6f0 con 0x7fd9580c72f0 2023-10-06T05:26:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95dba4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95806b9d0 con 0x7fd958159200 2023-10-06T05:26:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95cba2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd958158e30 0x7fd958068260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60116/0 (socket says 172.21.15.29:60116) 2023-10-06T05:26:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95cba2700 1 -- 172.21.15.29:0/765880479 learned_addr learned my addr 172.21.15.29:0/765880479 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd95d3a3700 1 --2- 172.21.15.29:0/765880479 >> v2:172.21.15.173:3300/0 conn(0x7fd9580c72f0 0x7fd9580676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd957fff700 1 --2- 172.21.15.29:0/765880479 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 0x7fd9580c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd9577fe700 1 -- 172.21.15.29:0/765880479 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621901254 0 0) 0x7fd95806bf90 con 0x7fd958158e30 2023-10-06T05:26:07.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.216+0000 7fd9577fe700 1 -- 172.21.15.29:0/765880479 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd940003570 con 0x7fd958158e30 2023-10-06T05:26:07.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd957fff700 1 -- 172.21.15.29:0/765880479 >> v2:172.21.15.173:3300/0 conn(0x7fd9580c72f0 msgr2=0x7fd9580676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd957fff700 1 --2- 172.21.15.29:0/765880479 >> v2:172.21.15.173:3300/0 conn(0x7fd9580c72f0 0x7fd9580676f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd957fff700 1 -- 172.21.15.29:0/765880479 >> v1:172.21.15.29:6789/0 conn(0x7fd958158e30 legacy=0x7fd958068260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd957fff700 1 -- 172.21.15.29:0/765880479 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95806bcb0 con 0x7fd958159200 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd9577fe700 1 -- 172.21.15.29:0/765880479 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 799778166 0 0) 0x7fd940003570 con 0x7fd958158e30 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd957fff700 1 --2- 172.21.15.29:0/765880479 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 0x7fd9580c6db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0098e0 tx=0x7fd94c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b904463cab304f9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd9577fe700 1 -- 172.21.15.29:0/765880479 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c011630 con 0x7fd958159200 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd9577fe700 1 -- 172.21.15.29:0/765880479 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c011790 con 0x7fd958159200 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd9577fe700 1 -- 172.21.15.29:0/765880479 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c011b30 con 0x7fd958159200 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 -- 172.21.15.29:0/765880479 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 msgr2=0x7fd9580c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 --2- 172.21.15.29:0/765880479 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 0x7fd9580c6db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0098e0 tx=0x7fd94c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 -- 172.21.15.29:0/765880479 shutdown_connections 2023-10-06T05:26:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 --2- 172.21.15.29:0/765880479 >> v2:172.21.15.173:3300/0 conn(0x7fd9580c72f0 0x7fd9580676f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 --2- 172.21.15.29:0/765880479 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 0x7fd9580c6db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 -- 172.21.15.29:0/765880479 >> 172.21.15.29:0/765880479 conn(0x7fd9580c9830 msgr2=0x7fd95806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 -- 172.21.15.29:0/765880479 shutdown_connections 2023-10-06T05:26:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 -- 172.21.15.29:0/765880479 wait complete. 2023-10-06T05:26:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 Processor -- start 2023-10-06T05:26:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 -- start start 2023-10-06T05:26:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9580c72f0 0x7fd95816c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd958158e30 0x7fd95815eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 0x7fd95815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580b0210 con 0x7fd958158e30 2023-10-06T05:26:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95816c720 con 0x7fd9580c72f0 2023-10-06T05:26:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95dba4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580af600 con 0x7fd958159200 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd957fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd958158e30 0x7fd95815eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd957fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd958158e30 0x7fd95815eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35032/0 (socket says 172.21.15.29:35032) 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd957fff700 1 -- 172.21.15.29:0/1211286977 learned_addr learned my addr 172.21.15.29:0/1211286977 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95d3a3700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 0x7fd95815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.220+0000 7fd95cba2700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9580c72f0 0x7fd95816c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd957fff700 1 -- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 msgr2=0x7fd95815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd957fff700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 0x7fd95815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd957fff700 1 -- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9580c72f0 msgr2=0x7fd95816c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd957fff700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9580c72f0 0x7fd95816c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd957fff700 1 -- 172.21.15.29:0/1211286977 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c009420 con 0x7fd958158e30 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd957fff700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd958158e30 0x7fd95815eb70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd95806bb10 tx=0x7fd94c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:07.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd954ff9700 1 -- 172.21.15.29:0/1211286977 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c01f070 con 0x7fd958158e30 2023-10-06T05:26:07.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd954ff9700 1 -- 172.21.15.29:0/1211286977 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c000bc0 con 0x7fd958158e30 2023-10-06T05:26:07.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9580af8e0 con 0x7fd958158e30 2023-10-06T05:26:07.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd954ff9700 1 -- 172.21.15.29:0/1211286977 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c025420 con 0x7fd958158e30 2023-10-06T05:26:07.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9580afea0 con 0x7fd958158e30 2023-10-06T05:26:07.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd958155320 con 0x7fd958158e30 2023-10-06T05:26:07.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd954ff9700 1 -- 172.21.15.29:0/1211286977 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd94c023070 con 0x7fd958158e30 2023-10-06T05:26:07.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.224+0000 7fd954ff9700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd944060550 0x7fd944062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.228+0000 7fd954ff9700 1 -- 172.21.15.29:0/1211286977 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd94c07dc40 con 0x7fd958158e30 2023-10-06T05:26:07.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.228+0000 7fd95cba2700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd944060550 0x7fd944062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.228+0000 7fd95cba2700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd944060550 0x7fd944062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd948005f50 tx=0x7fd948007c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:07.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.236+0000 7fd954ff9700 1 -- 172.21.15.29:0/1211286977 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd958155320 con 0x7fd958158e30 2023-10-06T05:26:07.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd958155320 con 0x7fd958158e30 2023-10-06T05:26:07.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd954ff9700 1 -- 172.21.15.29:0/1211286977 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd958155320 con 0x7fd958158e30 2023-10-06T05:26:07.402 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:26:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd944060550 msgr2=0x7fd944062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd944060550 0x7fd944062a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd948005f50 tx=0x7fd948007c60 comp rx=0 tx=0).stop 2023-10-06T05:26:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd958158e30 msgr2=0x7fd95815eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd958158e30 0x7fd95815eb70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd95806bb10 tx=0x7fd94c017000 comp rx=0 tx=0).stop 2023-10-06T05:26:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 shutdown_connections 2023-10-06T05:26:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd958159200 0x7fd95815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd958158e30 0x7fd95815eb70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd944060550 0x7fd944062a00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 --2- 172.21.15.29:0/1211286977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9580c72f0 0x7fd95816c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.396+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 >> 172.21.15.29:0/1211286977 conn(0x7fd9580c9830 msgr2=0x7fd95806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:07.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.400+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 shutdown_connections 2023-10-06T05:26:07.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.400+0000 7fd95dba4700 1 -- 172.21.15.29:0/1211286977 wait complete. 2023-10-06T05:26:07.416 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:07.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 Processor -- start 2023-10-06T05:26:07.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 -- start start 2023-10-06T05:26:07.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f692c158ee0 0x7f692c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f692c06a500 0x7f692c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c0c5a10 con 0x7f692c1592b0 2023-10-06T05:26:07.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c0cbb90 con 0x7f692c06a500 2023-10-06T05:26:07.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c06a990 con 0x7f692c158ee0 2023-10-06T05:26:07.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692a7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f692c06a500 0x7f692c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f692c1592b0 0x7f692c0cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60118/0 (socket says 172.21.15.29:60118) 2023-10-06T05:26:07.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692a7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f692c06a500 0x7f692c06c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35042/0 (socket says 172.21.15.29:35042) 2023-10-06T05:26:07.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692a7fc700 1 -- 172.21.15.29:0/2342459236 learned_addr learned my addr 172.21.15.29:0/2342459236 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692affd700 1 --2- 172.21.15.29:0/2342459236 >> v2:172.21.15.173:3300/0 conn(0x7f692c158ee0 0x7f692c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692a7fc700 1 -- 172.21.15.29:0/2342459236 >> v2:172.21.15.173:3300/0 conn(0x7f692c158ee0 msgr2=0x7f692c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692a7fc700 1 --2- 172.21.15.29:0/2342459236 >> v2:172.21.15.173:3300/0 conn(0x7f692c158ee0 0x7f692c15d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692a7fc700 1 -- 172.21.15.29:0/2342459236 >> v1:172.21.15.29:6789/0 conn(0x7f692c1592b0 legacy=0x7f692c0cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692a7fc700 1 -- 172.21.15.29:0/2342459236 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c06ac70 con 0x7f692c06a500 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692affd700 1 --2- 172.21.15.29:0/2342459236 >> v2:172.21.15.173:3300/0 conn(0x7f692c158ee0 0x7f692c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f692a7fc700 1 --2- 172.21.15.29:0/2342459236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c06a500 0x7f692c06c6c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f692c069fd0 tx=0x7f6924009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1e2ccfa5a7c4ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f6929ffb700 1 -- 172.21.15.29:0/2342459236 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692400e070 con 0x7f692c06a500 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f6929ffb700 1 -- 172.21.15.29:0/2342459236 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692400ba50 con 0x7f692c06a500 2023-10-06T05:26:07.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f6929ffb700 1 -- 172.21.15.29:0/2342459236 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240092e0 con 0x7f692c06a500 2023-10-06T05:26:07.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 -- 172.21.15.29:0/2342459236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c06a500 msgr2=0x7f692c06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 --2- 172.21.15.29:0/2342459236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c06a500 0x7f692c06c6c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f692c069fd0 tx=0x7f6924009840 comp rx=0 tx=0).stop 2023-10-06T05:26:07.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 -- 172.21.15.29:0/2342459236 shutdown_connections 2023-10-06T05:26:07.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 --2- 172.21.15.29:0/2342459236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c06a500 0x7f692c06c6c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 --2- 172.21.15.29:0/2342459236 >> v2:172.21.15.173:3300/0 conn(0x7f692c158ee0 0x7f692c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 -- 172.21.15.29:0/2342459236 >> 172.21.15.29:0/2342459236 conn(0x7f692c062b60 msgr2=0x7f692c062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:07.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 -- 172.21.15.29:0/2342459236 shutdown_connections 2023-10-06T05:26:07.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.524+0000 7f69319c2700 1 -- 172.21.15.29:0/2342459236 wait complete. 2023-10-06T05:26:07.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 Processor -- start 2023-10-06T05:26:07.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 -- start start 2023-10-06T05:26:07.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f692c06a500 0x7f692c15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c158ee0 0x7f692c145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c1592b0 0x7f692c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c159a20 con 0x7f692c1592b0 2023-10-06T05:26:07.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1533f0 con 0x7f692c158ee0 2023-10-06T05:26:07.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c0c83b0 con 0x7f692c06a500 2023-10-06T05:26:07.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c1592b0 0x7f692c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c1592b0 0x7f692c0cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35046/0 (socket says 172.21.15.29:35046) 2023-10-06T05:26:07.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692b7fe700 1 -- 172.21.15.29:0/2508340072 learned_addr learned my addr 172.21.15.29:0/2508340072 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:07.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692a7fc700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c158ee0 0x7f692c145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692affd700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f692c06a500 0x7f692c15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692b7fe700 1 -- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f692c06a500 msgr2=0x7f692c15bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692b7fe700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f692c06a500 0x7f692c15bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692b7fe700 1 -- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c158ee0 msgr2=0x7f692c145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692b7fe700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c158ee0 0x7f692c145870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692b7fe700 1 -- 172.21.15.29:0/2508340072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6924009ae0 con 0x7f692c1592b0 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f692b7fe700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c1592b0 0x7f692c0cf690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c590 tx=0x7f691c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f6922ffd700 1 -- 172.21.15.29:0/2508340072 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c005a70 con 0x7f692c1592b0 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f6922ffd700 1 -- 172.21.15.29:0/2508340072 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c005bf0 con 0x7f692c1592b0 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c0c8690 con 0x7f692c1592b0 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f6922ffd700 1 -- 172.21.15.29:0/2508340072 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0070d0 con 0x7f692c1592b0 2023-10-06T05:26:07.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.528+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c1596b0 con 0x7f692c1592b0 2023-10-06T05:26:07.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.532+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c159b90 con 0x7f692c1592b0 2023-10-06T05:26:07.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.532+0000 7f6922ffd700 1 -- 172.21.15.29:0/2508340072 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f691c0074c0 con 0x7f692c1592b0 2023-10-06T05:26:07.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.532+0000 7f6922ffd700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f690c060580 0x7f690c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.532+0000 7f6922ffd700 1 -- 172.21.15.29:0/2508340072 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f691c07bda0 con 0x7f692c1592b0 2023-10-06T05:26:07.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.532+0000 7f692affd700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f690c060580 0x7f690c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.536+0000 7f692affd700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f690c060580 0x7f690c062a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f691400adc0 tx=0x7f6914006f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:07.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.540+0000 7f6922ffd700 1 -- 172.21.15.29:0/2508340072 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f691c04c230 con 0x7f692c1592b0 2023-10-06T05:26:07.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.700+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f692c04be00 con 0x7f692c1592b0 2023-10-06T05:26:07.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.704+0000 7f6922ffd700 1 -- 172.21.15.29:0/2508340072 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f691c017090 con 0x7f692c1592b0 2023-10-06T05:26:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:07.710 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.704+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f690c060580 msgr2=0x7f690c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.704+0000 7f69319c2700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f690c060580 0x7f690c062a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f691400adc0 tx=0x7f6914006f90 comp rx=0 tx=0).stop 2023-10-06T05:26:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.704+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c1592b0 msgr2=0x7f692c0cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.704+0000 7f69319c2700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c1592b0 0x7f692c0cf690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c590 tx=0x7f691c007ef0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.708+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 shutdown_connections 2023-10-06T05:26:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.708+0000 7f69319c2700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f692c1592b0 0x7f692c0cf690 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.708+0000 7f69319c2700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f690c060580 0x7f690c062a30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.708+0000 7f69319c2700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f692c158ee0 0x7f692c145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.708+0000 7f69319c2700 1 --2- 172.21.15.29:0/2508340072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f692c06a500 0x7f692c15bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.708+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 >> 172.21.15.29:0/2508340072 conn(0x7f692c062b60 msgr2=0x7f692c1553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:07.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.708+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 shutdown_connections 2023-10-06T05:26:07.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.708+0000 7f69319c2700 1 -- 172.21.15.29:0/2508340072 wait complete. 2023-10-06T05:26:07.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:25:38.347316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:25:38.976583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:26:07.724 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:26:07.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.836+0000 7fa333f59700 1 Processor -- start 2023-10-06T05:26:07.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.836+0000 7fa333f59700 1 -- start start 2023-10-06T05:26:07.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.836+0000 7fa333f59700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa32c158c30 0x7fa32c159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.836+0000 7fa333f59700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa32c06b810 0x7fa32c0cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.836+0000 7fa333f59700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c06b380 con 0x7fa32c15d890 2023-10-06T05:26:07.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.836+0000 7fa333f59700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c06bc50 con 0x7fa32c158c30 2023-10-06T05:26:07.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.836+0000 7fa333f59700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c06a770 con 0x7fa32c06b810 2023-10-06T05:26:07.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.836+0000 7fa331cf5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa32c158c30 0x7fa32c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa3324f6700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa32c06b810 0x7fa32c0cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa331cf5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa32c158c30 0x7fa32c159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35054/0 (socket says 172.21.15.29:35054) 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa3314f4700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa32c15d890 0x7fa32c0ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:40338/0 (socket says 172.21.15.29:40338) 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa3324f6700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa32c06b810 0x7fa32c0cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:49212/0 (socket says 172.21.15.29:49212) 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa331cf5700 1 -- 172.21.15.29:0/1001504736 learned_addr learned my addr 172.21.15.29:0/1001504736 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa331cf5700 1 -- 172.21.15.29:0/1001504736 >> v2:172.21.15.173:3300/0 conn(0x7fa32c06b810 msgr2=0x7fa32c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa331cf5700 1 --2- 172.21.15.29:0/1001504736 >> v2:172.21.15.173:3300/0 conn(0x7fa32c06b810 0x7fa32c0cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa331cf5700 1 -- 172.21.15.29:0/1001504736 >> v1:172.21.15.173:6789/0 conn(0x7fa32c15d890 legacy=0x7fa32c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa331cf5700 1 -- 172.21.15.29:0/1001504736 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c06aa50 con 0x7fa32c158c30 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa331cf5700 1 --2- 172.21.15.29:0/1001504736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c158c30 0x7fa32c159000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0b6040 tx=0x7fa328009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae448dc374966ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa330cf3700 1 -- 172.21.15.29:0/1001504736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328009e70 con 0x7fa32c158c30 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa330cf3700 1 -- 172.21.15.29:0/1001504736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32800b860 con 0x7fa32c158c30 2023-10-06T05:26:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa330cf3700 1 -- 172.21.15.29:0/1001504736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32800bc00 con 0x7fa32c158c30 2023-10-06T05:26:07.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa333f59700 1 -- 172.21.15.29:0/1001504736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c158c30 msgr2=0x7fa32c159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa333f59700 1 --2- 172.21.15.29:0/1001504736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c158c30 0x7fa32c159000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0b6040 tx=0x7fa328009250 comp rx=0 tx=0).stop 2023-10-06T05:26:07.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa333f59700 1 -- 172.21.15.29:0/1001504736 shutdown_connections 2023-10-06T05:26:07.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa333f59700 1 --2- 172.21.15.29:0/1001504736 >> v2:172.21.15.173:3300/0 conn(0x7fa32c06b810 0x7fa32c0cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa333f59700 1 --2- 172.21.15.29:0/1001504736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c158c30 0x7fa32c159000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa333f59700 1 -- 172.21.15.29:0/1001504736 >> 172.21.15.29:0/1001504736 conn(0x7fa32c0670a0 msgr2=0x7fa32c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:07.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa333f59700 1 -- 172.21.15.29:0/1001504736 shutdown_connections 2023-10-06T05:26:07.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.840+0000 7fa333f59700 1 -- 172.21.15.29:0/1001504736 wait complete. 2023-10-06T05:26:07.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 Processor -- start 2023-10-06T05:26:07.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 -- start start 2023-10-06T05:26:07.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa32c06b810 0x7fa32c1439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa32c158c30 0x7fa32c0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c15d890 0x7fa32c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0b3030 con 0x7fa32c15d890 2023-10-06T05:26:07.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c8de0 con 0x7fa32c158c30 2023-10-06T05:26:07.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c9e20 con 0x7fa32c06b810 2023-10-06T05:26:07.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3324f6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c15d890 0x7fa32c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3324f6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c15d890 0x7fa32c0cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35066/0 (socket says 172.21.15.29:35066) 2023-10-06T05:26:07.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3324f6700 1 -- 172.21.15.29:0/2606875616 learned_addr learned my addr 172.21.15.29:0/2606875616 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:07.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3314f4700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa32c158c30 0x7fa32c0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa331cf5700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa32c06b810 0x7fa32c1439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3324f6700 1 -- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa32c06b810 msgr2=0x7fa32c1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3324f6700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa32c06b810 0x7fa32c1439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3324f6700 1 -- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa32c158c30 msgr2=0x7fa32c0cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:07.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3324f6700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa32c158c30 0x7fa32c0cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:07.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3324f6700 1 -- 172.21.15.29:0/2606875616 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3280094f0 con 0x7fa32c15d890 2023-10-06T05:26:07.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa331cf5700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa32c06b810 0x7fa32c1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:07.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa3324f6700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c15d890 0x7fa32c0cc9e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa324009e90 tx=0x7fa32400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:07.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa31dffb700 1 -- 172.21.15.29:0/2606875616 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400cc20 con 0x7fa32c15d890 2023-10-06T05:26:07.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa31dffb700 1 -- 172.21.15.29:0/2606875616 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32400f040 con 0x7fa32c15d890 2023-10-06T05:26:07.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c143ef0 con 0x7fa32c15d890 2023-10-06T05:26:07.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa31dffb700 1 -- 172.21.15.29:0/2606875616 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324014480 con 0x7fa32c15d890 2023-10-06T05:26:07.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.844+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c0c9340 con 0x7fa32c15d890 2023-10-06T05:26:07.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.848+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c071120 con 0x7fa32c15d890 2023-10-06T05:26:07.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.848+0000 7fa31dffb700 1 -- 172.21.15.29:0/2606875616 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa324014830 con 0x7fa32c15d890 2023-10-06T05:26:07.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.848+0000 7fa31dffb700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa310060550 0x7fa310062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:07.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.848+0000 7fa31dffb700 1 -- 172.21.15.29:0/2606875616 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa32407d6e0 con 0x7fa32c15d890 2023-10-06T05:26:07.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.848+0000 7fa331cf5700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa310060550 0x7fa310062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:07.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.852+0000 7fa331cf5700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa310060550 0x7fa310062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0b6040 tx=0x7fa328017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:07.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:07.856+0000 7fa31dffb700 1 -- 172.21.15.29:0/2606875616 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa324051560 con 0x7fa32c15d890 2023-10-06T05:26:08.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.024+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa32c06ad30 con 0x7fa32c15d890 2023-10-06T05:26:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.024+0000 7fa31dffb700 1 -- 172.21.15.29:0/2606875616 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3240510f0 con 0x7fa32c15d890 2023-10-06T05:26:08.030 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:26:08.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.024+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa310060550 msgr2=0x7fa310062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.024+0000 7fa333f59700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa310060550 0x7fa310062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0b6040 tx=0x7fa328017000 comp rx=0 tx=0).stop 2023-10-06T05:26:08.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.024+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c15d890 msgr2=0x7fa32c0cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.024+0000 7fa333f59700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c15d890 0x7fa32c0cc9e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa324009e90 tx=0x7fa32400b040 comp rx=0 tx=0).stop 2023-10-06T05:26:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.028+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 shutdown_connections 2023-10-06T05:26:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.028+0000 7fa333f59700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa32c15d890 0x7fa32c0cc9e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.028+0000 7fa333f59700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa310060550 0x7fa310062a00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.028+0000 7fa333f59700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa32c158c30 0x7fa32c0cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.028+0000 7fa333f59700 1 --2- 172.21.15.29:0/2606875616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa32c06b810 0x7fa32c1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.028+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 >> 172.21.15.29:0/2606875616 conn(0x7fa32c0670a0 msgr2=0x7fa32c0cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:08.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.028+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 shutdown_connections 2023-10-06T05:26:08.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.028+0000 7fa333f59700 1 -- 172.21.15.29:0/2606875616 wait complete. 2023-10-06T05:26:08.044 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:26:08.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6299f75700 1 Processor -- start 2023-10-06T05:26:08.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6299f75700 1 -- start start 2023-10-06T05:26:08.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6299f75700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 0x7f629415b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6299f75700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62940c8af0 0x7f62940ab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6299f75700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629406b540 con 0x7f629406a370 2023-10-06T05:26:08.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6299f75700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629415b650 con 0x7f62940c8af0 2023-10-06T05:26:08.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6299f75700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629406a930 con 0x7f6294156870 2023-10-06T05:26:08.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6293fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f629406a370 0x7f62940c83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60126/0 (socket says 172.21.15.29:60126) 2023-10-06T05:26:08.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6293fff700 1 -- 172.21.15.29:0/4092179816 learned_addr learned my addr 172.21.15.29:0/4092179816 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:08.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6298f73700 1 --2- 172.21.15.29:0/4092179816 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 0x7f629415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.152+0000 7f6299774700 1 --2- 172.21.15.29:0/4092179816 >> v2:172.21.15.173:3300/0 conn(0x7f62940c8af0 0x7f62940ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f62937fe700 1 -- 172.21.15.29:0/4092179816 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147213784 0 0) 0x7f629406b540 con 0x7f629406a370 2023-10-06T05:26:08.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f62937fe700 1 -- 172.21.15.29:0/4092179816 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6280003570 con 0x7f629406a370 2023-10-06T05:26:08.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299774700 1 -- 172.21.15.29:0/4092179816 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 msgr2=0x7f629415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:08.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299774700 1 --2- 172.21.15.29:0/4092179816 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 0x7f629415b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299774700 1 -- 172.21.15.29:0/4092179816 >> v1:172.21.15.29:6789/0 conn(0x7f629406a370 legacy=0x7f62940c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299774700 1 -- 172.21.15.29:0/4092179816 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629406ac10 con 0x7f62940c8af0 2023-10-06T05:26:08.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299774700 1 --2- 172.21.15.29:0/4092179816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 0x7f62940ab700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f628c009910 tx=0x7f628c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e12cdbe50decc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:08.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f62937fe700 1 -- 172.21.15.29:0/4092179816 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c011630 con 0x7f62940c8af0 2023-10-06T05:26:08.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f62937fe700 1 -- 172.21.15.29:0/4092179816 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c011790 con 0x7f62940c8af0 2023-10-06T05:26:08.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f62937fe700 1 -- 172.21.15.29:0/4092179816 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c011b30 con 0x7f62940c8af0 2023-10-06T05:26:08.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299f75700 1 -- 172.21.15.29:0/4092179816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 msgr2=0x7f62940ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299f75700 1 --2- 172.21.15.29:0/4092179816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 0x7f62940ab700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f628c009910 tx=0x7f628c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299f75700 1 -- 172.21.15.29:0/4092179816 shutdown_connections 2023-10-06T05:26:08.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299f75700 1 --2- 172.21.15.29:0/4092179816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 0x7f62940ab700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299f75700 1 --2- 172.21.15.29:0/4092179816 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 0x7f629415b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299f75700 1 -- 172.21.15.29:0/4092179816 >> 172.21.15.29:0/4092179816 conn(0x7f629406c6c0 msgr2=0x7f629406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:08.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299f75700 1 -- 172.21.15.29:0/4092179816 shutdown_connections 2023-10-06T05:26:08.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.156+0000 7f6299f75700 1 -- 172.21.15.29:0/4092179816 wait complete. 2023-10-06T05:26:08.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 Processor -- start 2023-10-06T05:26:08.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 -- start start 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f629406a370 0x7f6294141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 0x7f62941537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 0x7f6294154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940c33c0 con 0x7f629406a370 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940c2ab0 con 0x7f62940c8af0 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62941542b0 con 0x7f6294156870 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6298f73700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f629406a370 0x7f6294141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6298f73700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f629406a370 0x7f6294141600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35068/0 (socket says 172.21.15.29:35068) 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6298f73700 1 -- 172.21.15.29:0/604361868 learned_addr learned my addr 172.21.15.29:0/604361868 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299774700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 0x7f6294154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6293fff700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 0x7f62941537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6298f73700 1 -- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 msgr2=0x7f6294154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6298f73700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 0x7f6294154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6298f73700 1 -- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 msgr2=0x7f62941537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6298f73700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 0x7f62941537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6298f73700 1 -- 172.21.15.29:0/604361868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c009420 con 0x7f629406a370 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6293fff700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 0x7f62941537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6298f73700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f629406a370 0x7f6294141600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6284009e50 tx=0x7f628400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6290ff9700 1 -- 172.21.15.29:0/604361868 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400cc20 con 0x7f629406a370 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6290ff9700 1 -- 172.21.15.29:0/604361868 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628400f040 con 0x7f629406a370 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62940c2d70 con 0x7f629406a370 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6290ff9700 1 -- 172.21.15.29:0/604361868 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6284014480 con 0x7f629406a370 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.160+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6294152ac0 con 0x7f629406a370 2023-10-06T05:26:08.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.164+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629404be00 con 0x7f629406a370 2023-10-06T05:26:08.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.164+0000 7f6290ff9700 1 -- 172.21.15.29:0/604361868 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f62840147f0 con 0x7f629406a370 2023-10-06T05:26:08.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.164+0000 7f6290ff9700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6274060550 0x7f6274062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.164+0000 7f6290ff9700 1 -- 172.21.15.29:0/604361868 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f628407d610 con 0x7f629406a370 2023-10-06T05:26:08.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.164+0000 7f6293fff700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6274060550 0x7f6274062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.164+0000 7f6293fff700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6274060550 0x7f6274062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f627c007fd0 tx=0x7f627c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:08.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.172+0000 7f6290ff9700 1 -- 172.21.15.29:0/604361868 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f628404daa0 con 0x7f629406a370 2023-10-06T05:26:08.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f629406aef0 con 0x7f629406a370 2023-10-06T05:26:08.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6290ff9700 1 -- 172.21.15.29:0/604361868 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f62840510c0 con 0x7f629406a370 2023-10-06T05:26:08.342 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:26:08.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6274060550 msgr2=0x7f6274062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6274060550 0x7f6274062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f627c007fd0 tx=0x7f627c009040 comp rx=0 tx=0).stop 2023-10-06T05:26:08.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f629406a370 msgr2=0x7f6294141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f629406a370 0x7f6294141600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6284009e50 tx=0x7f628400b040 comp rx=0 tx=0).stop 2023-10-06T05:26:08.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 shutdown_connections 2023-10-06T05:26:08.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6294156870 0x7f6294154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6274060550 0x7f6274062a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62940c8af0 0x7f62941537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 --2- 172.21.15.29:0/604361868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f629406a370 0x7f6294141600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 >> 172.21.15.29:0/604361868 conn(0x7f629406c6c0 msgr2=0x7f62940cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:08.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 shutdown_connections 2023-10-06T05:26:08.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.336+0000 7f6299f75700 1 -- 172.21.15.29:0/604361868 wait complete. 2023-10-06T05:26:08.356 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:26:08.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.464+0000 7f25a3e2e700 1 Processor -- start 2023-10-06T05:26:08.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.464+0000 7f25a3e2e700 1 -- start start 2023-10-06T05:26:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 0x7f259c0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f259c157260 0x7f259c0ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c0cd000 con 0x7f259c06cdd0 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c0cd9d0 con 0x7f259c157260 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0cc3f0 con 0x7f259c156e90 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a23cb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f259c157260 0x7f259c0ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a23cb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f259c157260 0x7f259c0ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35072/0 (socket says 172.21.15.29:35072) 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a23cb700 1 -- 172.21.15.29:0/4271274375 learned_addr learned my addr 172.21.15.29:0/4271274375 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a1bca700 1 --2- 172.21.15.29:0/4271274375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 0x7f259c0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a23cb700 1 -- 172.21.15.29:0/4271274375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 msgr2=0x7f259c0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a23cb700 1 --2- 172.21.15.29:0/4271274375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 0x7f259c0cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a23cb700 1 -- 172.21.15.29:0/4271274375 >> v1:172.21.15.173:6789/0 conn(0x7f259c06cdd0 legacy=0x7f259c0cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a23cb700 1 -- 172.21.15.29:0/4271274375 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0cc6d0 con 0x7f259c157260 2023-10-06T05:26:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a1bca700 1 --2- 172.21.15.29:0/4271274375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 0x7f259c0cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:08.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a23cb700 1 --2- 172.21.15.29:0/4271274375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 0x7f259c0ca830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2594009f20 tx=0x7f2594009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e47d65ea3770596 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a0bc8700 1 -- 172.21.15.29:0/4271274375 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259400e070 con 0x7f259c157260 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a0bc8700 1 -- 172.21.15.29:0/4271274375 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259400ba80 con 0x7f259c157260 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a0bc8700 1 -- 172.21.15.29:0/4271274375 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940092e0 con 0x7f259c157260 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 -- 172.21.15.29:0/4271274375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 msgr2=0x7f259c0ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 --2- 172.21.15.29:0/4271274375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 0x7f259c0ca830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2594009f20 tx=0x7f2594009840 comp rx=0 tx=0).stop 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 -- 172.21.15.29:0/4271274375 shutdown_connections 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 --2- 172.21.15.29:0/4271274375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 0x7f259c0ca830 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 --2- 172.21.15.29:0/4271274375 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 0x7f259c0cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 -- 172.21.15.29:0/4271274375 >> 172.21.15.29:0/4271274375 conn(0x7f259c069d30 msgr2=0x7f259c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 -- 172.21.15.29:0/4271274375 shutdown_connections 2023-10-06T05:26:08.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.468+0000 7f25a3e2e700 1 -- 172.21.15.29:0/4271274375 wait complete. 2023-10-06T05:26:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a3e2e700 1 Processor -- start 2023-10-06T05:26:08.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a3e2e700 1 -- start start 2023-10-06T05:26:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a3e2e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f259c06cdd0 0x7f259c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a3e2e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 0x7f259c068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a3e2e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 0x7f259c0b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a3e2e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c154d60 con 0x7f259c157260 2023-10-06T05:26:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a3e2e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c067de0 con 0x7f259c06cdd0 2023-10-06T05:26:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a3e2e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0671d0 con 0x7f259c156e90 2023-10-06T05:26:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a23cb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 0x7f259c0b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a23cb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 0x7f259c0b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35078/0 (socket says 172.21.15.29:35078) 2023-10-06T05:26:08.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a23cb700 1 -- 172.21.15.29:0/2658585426 learned_addr learned my addr 172.21.15.29:0/2658585426 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:08.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.472+0000 7f25a13c9700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 0x7f259c068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a1bca700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f259c06cdd0 0x7f259c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a23cb700 1 -- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 msgr2=0x7f259c068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a23cb700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 0x7f259c068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a23cb700 1 -- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f259c06cdd0 msgr2=0x7f259c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a23cb700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f259c06cdd0 0x7f259c0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a23cb700 1 -- 172.21.15.29:0/2658585426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2594009ae0 con 0x7f259c157260 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a23cb700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 0x7f259c0b0d70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f259c06dc90 tx=0x7f2594018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f2591ffb700 1 -- 172.21.15.29:0/2658585426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940032f0 con 0x7f259c157260 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c0674b0 con 0x7f259c157260 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f2591ffb700 1 -- 172.21.15.29:0/2658585426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2594008d20 con 0x7f259c157260 2023-10-06T05:26:08.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f2591ffb700 1 -- 172.21.15.29:0/2658585426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594008e90 con 0x7f259c157260 2023-10-06T05:26:08.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c067a70 con 0x7f259c157260 2023-10-06T05:26:08.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f2591ffb700 1 -- 172.21.15.29:0/2658585426 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2594003040 con 0x7f259c157260 2023-10-06T05:26:08.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.476+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c071120 con 0x7f259c157260 2023-10-06T05:26:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.480+0000 7f2591ffb700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2580060550 0x7f2580062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.480+0000 7f2591ffb700 1 -- 172.21.15.29:0/2658585426 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f259407deb0 con 0x7f259c157260 2023-10-06T05:26:08.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.480+0000 7f25a1bca700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2580060550 0x7f2580062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.480+0000 7f25a1bca700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2580060550 0x7f2580062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f259c0b2b90 tx=0x7f2598008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:08.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.484+0000 7f2591ffb700 1 -- 172.21.15.29:0/2658585426 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f259404e340 con 0x7f259c157260 2023-10-06T05:26:08.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.644+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f259c067f20 con 0x7f259c157260 2023-10-06T05:26:08.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f2591ffb700 1 -- 172.21.15.29:0/2658585426 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2594051960 con 0x7f259c157260 2023-10-06T05:26:08.653 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:26:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2580060550 msgr2=0x7f2580062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2580060550 0x7f2580062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f259c0b2b90 tx=0x7f2598008040 comp rx=0 tx=0).stop 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 msgr2=0x7f259c0b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 0x7f259c0b0d70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f259c06dc90 tx=0x7f2594018000 comp rx=0 tx=0).stop 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 shutdown_connections 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f259c157260 0x7f259c0b0d70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f259c156e90 0x7f259c068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2580060550 0x7f2580062a00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 --2- 172.21.15.29:0/2658585426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f259c06cdd0 0x7f259c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 >> 172.21.15.29:0/2658585426 conn(0x7f259c069d30 msgr2=0x7f259c0cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 shutdown_connections 2023-10-06T05:26:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.648+0000 7f25a3e2e700 1 -- 172.21.15.29:0/2658585426 wait complete. 2023-10-06T05:26:08.667 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:26:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.768+0000 7f0e8d44d700 1 Processor -- start 2023-10-06T05:26:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.768+0000 7f0e8d44d700 1 -- start start 2023-10-06T05:26:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e8d44d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e88155050 0x7f0e880aac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e8d44d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0e8806b440 0x7f0e880670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e8d44d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8806afb0 con 0x7f0e881599d0 2023-10-06T05:26:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e8d44d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8806a410 con 0x7f0e88155050 2023-10-06T05:26:08.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e8d44d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8806a680 con 0x7f0e8806b440 2023-10-06T05:26:08.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e87fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e88155050 0x7f0e880aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e8cc4c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0e881599d0 0x7f0e880c6ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60142/0 (socket says 172.21.15.29:60142) 2023-10-06T05:26:08.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e8cc4c700 1 -- 172.21.15.29:0/3296619472 learned_addr learned my addr 172.21.15.29:0/3296619472 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:08.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e7ffff700 1 --2- 172.21.15.29:0/3296619472 >> v2:172.21.15.173:3300/0 conn(0x7f0e8806b440 0x7f0e880670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e87fff700 1 -- 172.21.15.29:0/3296619472 >> v2:172.21.15.173:3300/0 conn(0x7f0e8806b440 msgr2=0x7f0e880670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e87fff700 1 --2- 172.21.15.29:0/3296619472 >> v2:172.21.15.173:3300/0 conn(0x7f0e8806b440 0x7f0e880670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e877fe700 1 -- 172.21.15.29:0/3296619472 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351569612 0 0) 0x7f0e8806afb0 con 0x7f0e881599d0 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e87fff700 1 -- 172.21.15.29:0/3296619472 >> v1:172.21.15.29:6789/0 conn(0x7f0e881599d0 legacy=0x7f0e880c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e87fff700 1 -- 172.21.15.29:0/3296619472 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8806a960 con 0x7f0e88155050 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e87fff700 1 --2- 172.21.15.29:0/3296619472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 0x7f0e880aac00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0e8806a300 tx=0x7f0e780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e857277642668a91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e877fe700 1 -- 172.21.15.29:0/3296619472 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78011630 con 0x7f0e88155050 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e877fe700 1 -- 172.21.15.29:0/3296619472 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e78011790 con 0x7f0e88155050 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.772+0000 7f0e877fe700 1 -- 172.21.15.29:0/3296619472 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78011b30 con 0x7f0e88155050 2023-10-06T05:26:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 -- 172.21.15.29:0/3296619472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 msgr2=0x7f0e880aac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 --2- 172.21.15.29:0/3296619472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 0x7f0e880aac00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0e8806a300 tx=0x7f0e780091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 -- 172.21.15.29:0/3296619472 shutdown_connections 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 --2- 172.21.15.29:0/3296619472 >> v2:172.21.15.173:3300/0 conn(0x7f0e8806b440 0x7f0e880670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 --2- 172.21.15.29:0/3296619472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 0x7f0e880aac00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 -- 172.21.15.29:0/3296619472 >> 172.21.15.29:0/3296619472 conn(0x7f0e8806c6c0 msgr2=0x7f0e8806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 -- 172.21.15.29:0/3296619472 shutdown_connections 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 -- 172.21.15.29:0/3296619472 wait complete. 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 Processor -- start 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 -- start start 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e8806b440 0x7f0e88164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 0x7f0e880c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e881599d0 0x7f0e880ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88148dc0 con 0x7f0e88155050 2023-10-06T05:26:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880b06d0 con 0x7f0e881599d0 2023-10-06T05:26:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8d44d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880af820 con 0x7f0e8806b440 2023-10-06T05:26:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e7ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 0x7f0e880c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e7ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 0x7f0e880c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35096/0 (socket says 172.21.15.29:35096) 2023-10-06T05:26:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e7ffff700 1 -- 172.21.15.29:0/2159816783 learned_addr learned my addr 172.21.15.29:0/2159816783 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e8cc4c700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e881599d0 0x7f0e880ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.776+0000 7f0e87fff700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e8806b440 0x7f0e88164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e7ffff700 1 -- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e8806b440 msgr2=0x7f0e88164950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e7ffff700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e8806b440 0x7f0e88164950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e7ffff700 1 -- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e881599d0 msgr2=0x7f0e880ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e7ffff700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e881599d0 0x7f0e880ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e7ffff700 1 -- 172.21.15.29:0/2159816783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e78009420 con 0x7f0e88155050 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e87fff700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e8806b440 0x7f0e88164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e8cc4c700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e881599d0 0x7f0e880ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e7ffff700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 0x7f0e880c53a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000e950 tx=0x7f0e700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e84ff9700 1 -- 172.21.15.29:0/2159816783 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70013680 con 0x7f0e88155050 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e84ff9700 1 -- 172.21.15.29:0/2159816783 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700137e0 con 0x7f0e88155050 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e880c58e0 con 0x7f0e88155050 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e84ff9700 1 -- 172.21.15.29:0/2159816783 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70013ba0 con 0x7f0e88155050 2023-10-06T05:26:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e880afda0 con 0x7f0e88155050 2023-10-06T05:26:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.780+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e880b0840 con 0x7f0e88155050 2023-10-06T05:26:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.784+0000 7f0e84ff9700 1 -- 172.21.15.29:0/2159816783 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0e700123d0 con 0x7f0e88155050 2023-10-06T05:26:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.784+0000 7f0e84ff9700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e68060580 0x7f0e68062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.784+0000 7f0e84ff9700 1 -- 172.21.15.29:0/2159816783 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e7007ca40 con 0x7f0e88155050 2023-10-06T05:26:08.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.784+0000 7f0e87fff700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e68060580 0x7f0e68062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:08.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.784+0000 7f0e87fff700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e68060580 0x7f0e68062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e780093f0 tx=0x7f0e78017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:08.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.792+0000 7f0e84ff9700 1 -- 172.21.15.29:0/2159816783 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0e7007ee60 con 0x7f0e88155050 2023-10-06T05:26:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.952+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e88154570 con 0x7f0e88155050 2023-10-06T05:26:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.952+0000 7f0e84ff9700 1 -- 172.21.15.29:0/2159816783 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e7004ced0 con 0x7f0e88155050 2023-10-06T05:26:08.959 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:26:08.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e68060580 msgr2=0x7f0e68062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e68060580 0x7f0e68062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e780093f0 tx=0x7f0e78017000 comp rx=0 tx=0).stop 2023-10-06T05:26:08.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 msgr2=0x7f0e880c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:08.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 0x7f0e880c53a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000e950 tx=0x7f0e700091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 shutdown_connections 2023-10-06T05:26:08.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0e68060580 0x7f0e68062a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e881599d0 0x7f0e880ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e88155050 0x7f0e880c53a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 --2- 172.21.15.29:0/2159816783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e8806b440 0x7f0e88164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 >> 172.21.15.29:0/2159816783 conn(0x7f0e8806c6c0 msgr2=0x7f0e880c8450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 shutdown_connections 2023-10-06T05:26:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:08.956+0000 7f0e8d44d700 1 -- 172.21.15.29:0/2159816783 wait complete. 2023-10-06T05:26:08.974 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:09.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f300ba2a700 1 Processor -- start 2023-10-06T05:26:09.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f300ba2a700 1 -- start start 2023-10-06T05:26:09.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f300ba2a700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3004158ee0 0x7f300415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f300ba2a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040c5a10 con 0x7f300406a500 2023-10-06T05:26:09.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f300ba2a700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300406a990 con 0x7f300406cdd0 2023-10-06T05:26:09.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f300ba2a700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300406ac70 con 0x7f3004158ee0 2023-10-06T05:26:09.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f3008fc5700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f300406a500 0x7f300406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60158/0 (socket says 172.21.15.29:60158) 2023-10-06T05:26:09.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f3008fc5700 1 -- 172.21.15.29:0/1527003400 learned_addr learned my addr 172.21.15.29:0/1527003400 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:09.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f30097c6700 1 --2- 172.21.15.29:0/1527003400 >> v2:172.21.15.173:3300/0 conn(0x7f3004158ee0 0x7f300415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f2ffbfff700 1 -- 172.21.15.29:0/1527003400 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560464608 0 0) 0x7f300406a990 con 0x7f300406cdd0 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f2ffbfff700 1 -- 172.21.15.29:0/1527003400 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff0003570 con 0x7f300406cdd0 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f2ffbfff700 1 -- 172.21.15.29:0/1527003400 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338236921 0 0) 0x7f30040c5a10 con 0x7f300406a500 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f2ffbfff700 1 -- 172.21.15.29:0/1527003400 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f300406a990 con 0x7f300406a500 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f30097c6700 1 -- 172.21.15.29:0/1527003400 >> v1:172.21.15.173:6789/0 conn(0x7f300406cdd0 legacy=0x7f30040cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f30097c6700 1 -- 172.21.15.29:0/1527003400 >> v1:172.21.15.29:6789/0 conn(0x7f300406a500 legacy=0x7f300406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f30097c6700 1 -- 172.21.15.29:0/1527003400 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300406af50 con 0x7f3004158ee0 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f30097c6700 1 --2- 172.21.15.29:0/1527003400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3004158ee0 0x7f300415d630 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30000098e0 tx=0x7f30000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a165309f71ccb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f2ffbfff700 1 -- 172.21.15.29:0/1527003400 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000011630 con 0x7f3004158ee0 2023-10-06T05:26:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f2ffbfff700 1 -- 172.21.15.29:0/1527003400 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3000011790 con 0x7f3004158ee0 2023-10-06T05:26:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.072+0000 7f2ffbfff700 1 -- 172.21.15.29:0/1527003400 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000011b30 con 0x7f3004158ee0 2023-10-06T05:26:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 -- 172.21.15.29:0/1527003400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3004158ee0 msgr2=0x7f300415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 --2- 172.21.15.29:0/1527003400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3004158ee0 0x7f300415d630 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30000098e0 tx=0x7f30000091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 -- 172.21.15.29:0/1527003400 shutdown_connections 2023-10-06T05:26:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 --2- 172.21.15.29:0/1527003400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3004158ee0 0x7f300415d630 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 -- 172.21.15.29:0/1527003400 >> 172.21.15.29:0/1527003400 conn(0x7f3004062b60 msgr2=0x7f3004062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 -- 172.21.15.29:0/1527003400 shutdown_connections 2023-10-06T05:26:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 -- 172.21.15.29:0/1527003400 wait complete. 2023-10-06T05:26:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 Processor -- start 2023-10-06T05:26:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 -- start start 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f300406a500 0x7f300415b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.076+0000 7f300ba2a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f300406cdd0 0x7f300415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f300ba2a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3004158ee0 0x7f300415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f300ba2a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004169770 con 0x7f300406cdd0 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f300ba2a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040c6fc0 con 0x7f3004158ee0 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f300ba2a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30040c72a0 con 0x7f300406a500 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3008fc5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f300406cdd0 0x7f300415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3008fc5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f300406cdd0 0x7f300415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35100/0 (socket says 172.21.15.29:35100) 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3008fc5700 1 -- 172.21.15.29:0/3829167868 learned_addr learned my addr 172.21.15.29:0/3829167868 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f30097c6700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f300406a500 0x7f300415b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3009fc7700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3004158ee0 0x7f300415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3008fc5700 1 -- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f300406a500 msgr2=0x7f300415b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3008fc5700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f300406a500 0x7f300415b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3008fc5700 1 -- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3004158ee0 msgr2=0x7f300415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3008fc5700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3004158ee0 0x7f300415ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3008fc5700 1 -- 172.21.15.29:0/3829167868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000009420 con 0x7f300406cdd0 2023-10-06T05:26:09.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f3008fc5700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f300406cdd0 0x7f300415e520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4001ed0 tx=0x7f2ff4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:09.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f2ff97fa700 1 -- 172.21.15.29:0/3829167868 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4005c00 con 0x7f300406cdd0 2023-10-06T05:26:09.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f2ff97fa700 1 -- 172.21.15.29:0/3829167868 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff4005d60 con 0x7f300406cdd0 2023-10-06T05:26:09.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30040c7580 con 0x7f300406cdd0 2023-10-06T05:26:09.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f2ff97fa700 1 -- 172.21.15.29:0/3829167868 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40072e0 con 0x7f300406cdd0 2023-10-06T05:26:09.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30040c7b40 con 0x7f300406cdd0 2023-10-06T05:26:09.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.080+0000 7f2ff97fa700 1 -- 172.21.15.29:0/3829167868 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2ff401b3b0 con 0x7f300406cdd0 2023-10-06T05:26:09.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.084+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30041698b0 con 0x7f300406cdd0 2023-10-06T05:26:09.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.084+0000 7f2ff97fa700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2fe8060550 0x7f2fe8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.084+0000 7f2ff97fa700 1 -- 172.21.15.29:0/3829167868 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ff407bbe0 con 0x7f300406cdd0 2023-10-06T05:26:09.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.084+0000 7f30097c6700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2fe8060550 0x7f2fe8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.084+0000 7f30097c6700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2fe8060550 0x7f2fe8062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f30000093f0 tx=0x7f3000017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:09.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.096+0000 7f2ff97fa700 1 -- 172.21.15.29:0/3829167868 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2ff4049be0 con 0x7f300406cdd0 2023-10-06T05:26:09.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.252+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f300404be00 con 0x7f300406cdd0 2023-10-06T05:26:09.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.252+0000 7f2ff97fa700 1 -- 172.21.15.29:0/3829167868 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f2ff4017090 con 0x7f300406cdd0 2023-10-06T05:26:09.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:09.260 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:09.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2fe8060550 msgr2=0x7f2fe8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2fe8060550 0x7f2fe8062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f30000093f0 tx=0x7f3000017000 comp rx=0 tx=0).stop 2023-10-06T05:26:09.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f300406cdd0 msgr2=0x7f300415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f300406cdd0 0x7f300415e520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4001ed0 tx=0x7f2ff4007db0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 shutdown_connections 2023-10-06T05:26:09.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2fe8060550 0x7f2fe8062a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3004158ee0 0x7f300415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f300406cdd0 0x7f300415e520 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 --2- 172.21.15.29:0/3829167868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f300406a500 0x7f300415b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 >> 172.21.15.29:0/3829167868 conn(0x7f3004062b60 msgr2=0x7f30040b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:09.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 shutdown_connections 2023-10-06T05:26:09.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.256+0000 7f300ba2a700 1 -- 172.21.15.29:0/3829167868 wait complete. 2023-10-06T05:26:09.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:25:38.347316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:25:38.976583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:26:09.274 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:26:09.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2373fff700 1 Processor -- start 2023-10-06T05:26:09.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2373fff700 1 -- start start 2023-10-06T05:26:09.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2373fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23740c9a50 0x7f23740af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2373fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f23740ac600 0x7f23740aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2373fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23740c7360 con 0x7f23740c9680 2023-10-06T05:26:09.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2373fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23740acf60 con 0x7f23740c9a50 2023-10-06T05:26:09.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2373fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237415d310 con 0x7f23740ac600 2023-10-06T05:26:09.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2372ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f23740c9680 0x7f237415cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60160/0 (socket says 172.21.15.29:60160) 2023-10-06T05:26:09.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f23727fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23740c9a50 0x7f23740af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2372ffd700 1 -- 172.21.15.29:0/556324814 learned_addr learned my addr 172.21.15.29:0/556324814 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:09.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f23737fe700 1 --2- 172.21.15.29:0/556324814 >> v2:172.21.15.173:3300/0 conn(0x7f23740ac600 0x7f23740aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f23727fc700 1 -- 172.21.15.29:0/556324814 >> v2:172.21.15.173:3300/0 conn(0x7f23740ac600 msgr2=0x7f23740aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:09.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f23727fc700 1 --2- 172.21.15.29:0/556324814 >> v2:172.21.15.173:3300/0 conn(0x7f23740ac600 0x7f23740aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f23727fc700 1 -- 172.21.15.29:0/556324814 >> v1:172.21.15.29:6789/0 conn(0x7f23740c9680 legacy=0x7f237415cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f23727fc700 1 -- 172.21.15.29:0/556324814 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237415d5f0 con 0x7f23740c9a50 2023-10-06T05:26:09.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f23727fc700 1 --2- 172.21.15.29:0/556324814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740c9a50 0x7f23740af070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f23740aec20 tx=0x7f23680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318edc1e6deff273 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:09.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2371ffb700 1 -- 172.21.15.29:0/556324814 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2368011630 con 0x7f23740c9a50 2023-10-06T05:26:09.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2371ffb700 1 -- 172.21.15.29:0/556324814 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2368011790 con 0x7f23740c9a50 2023-10-06T05:26:09.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.384+0000 7f2371ffb700 1 -- 172.21.15.29:0/556324814 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2368011b30 con 0x7f23740c9a50 2023-10-06T05:26:09.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.388+0000 7f2373fff700 1 -- 172.21.15.29:0/556324814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740c9a50 msgr2=0x7f23740af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.388+0000 7f2373fff700 1 --2- 172.21.15.29:0/556324814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740c9a50 0x7f23740af070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f23740aec20 tx=0x7f23680091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.388+0000 7f2373fff700 1 -- 172.21.15.29:0/556324814 shutdown_connections 2023-10-06T05:26:09.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.388+0000 7f2373fff700 1 --2- 172.21.15.29:0/556324814 >> v2:172.21.15.173:3300/0 conn(0x7f23740ac600 0x7f23740aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.388+0000 7f2373fff700 1 --2- 172.21.15.29:0/556324814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740c9a50 0x7f23740af070 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.388+0000 7f2373fff700 1 -- 172.21.15.29:0/556324814 >> 172.21.15.29:0/556324814 conn(0x7f237406d7d0 msgr2=0x7f237406dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:09.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.388+0000 7f2373fff700 1 -- 172.21.15.29:0/556324814 shutdown_connections 2023-10-06T05:26:09.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.388+0000 7f2373fff700 1 -- 172.21.15.29:0/556324814 wait complete. 2023-10-06T05:26:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 Processor -- start 2023-10-06T05:26:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 -- start start 2023-10-06T05:26:09.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740ac600 0x7f237415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23740c9680 0x7f23740cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23740c9a50 0x7f23740c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23740cb2c0 con 0x7f23740ac600 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237415add0 con 0x7f23740c9a50 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23740ca6b0 con 0x7f23740c9680 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2372ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740ac600 0x7f237415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2372ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740ac600 0x7f237415a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35114/0 (socket says 172.21.15.29:35114) 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2372ffd700 1 -- 172.21.15.29:0/3804285993 learned_addr learned my addr 172.21.15.29:0/3804285993 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f23737fe700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23740c9a50 0x7f23740c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f23727fc700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23740c9680 0x7f23740cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2372ffd700 1 -- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23740c9680 msgr2=0x7f23740cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2372ffd700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23740c9680 0x7f23740cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2372ffd700 1 -- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23740c9a50 msgr2=0x7f23740c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2372ffd700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23740c9a50 0x7f23740c2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2372ffd700 1 -- 172.21.15.29:0/3804285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2368009420 con 0x7f23740ac600 2023-10-06T05:26:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2372ffd700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740ac600 0x7f237415a890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f236400cd30 tx=0x7f2364001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f235affd700 1 -- 172.21.15.29:0/3804285993 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364004bb0 con 0x7f23740ac600 2023-10-06T05:26:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f235affd700 1 -- 172.21.15.29:0/3804285993 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2364004d30 con 0x7f23740ac600 2023-10-06T05:26:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23740ca990 con 0x7f23740ac600 2023-10-06T05:26:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f235affd700 1 -- 172.21.15.29:0/3804285993 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364004ea0 con 0x7f23740ac600 2023-10-06T05:26:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.392+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23740caf50 con 0x7f23740ac600 2023-10-06T05:26:09.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.396+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237406a8c0 con 0x7f23740ac600 2023-10-06T05:26:09.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.396+0000 7f235affd700 1 -- 172.21.15.29:0/3804285993 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2364007300 con 0x7f23740ac600 2023-10-06T05:26:09.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.396+0000 7f235affd700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2360060580 0x7f2360062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.396+0000 7f235affd700 1 -- 172.21.15.29:0/3804285993 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f236407c420 con 0x7f23740ac600 2023-10-06T05:26:09.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.396+0000 7f23727fc700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2360060580 0x7f2360062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.396+0000 7f23727fc700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2360060580 0x7f2360062a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23680093f0 tx=0x7f2368017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:09.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.404+0000 7f235affd700 1 -- 172.21.15.29:0/3804285993 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f236404c8b0 con 0x7f23740ac600 2023-10-06T05:26:09.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.560+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f237415d8d0 con 0x7f23740ac600 2023-10-06T05:26:09.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f235affd700 1 -- 172.21.15.29:0/3804285993 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23640180a0 con 0x7f23740ac600 2023-10-06T05:26:09.569 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:26:09.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2360060580 msgr2=0x7f2360062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2360060580 0x7f2360062a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23680093f0 tx=0x7f2368017000 comp rx=0 tx=0).stop 2023-10-06T05:26:09.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740ac600 msgr2=0x7f237415a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740ac600 0x7f237415a890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f236400cd30 tx=0x7f2364001ad0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 shutdown_connections 2023-10-06T05:26:09.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2360060580 0x7f2360062a30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23740c9a50 0x7f23740c2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23740c9680 0x7f23740cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 --2- 172.21.15.29:0/3804285993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23740ac600 0x7f237415a890 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 >> 172.21.15.29:0/3804285993 conn(0x7f237406d7d0 msgr2=0x7f23740c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:09.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 shutdown_connections 2023-10-06T05:26:09.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.564+0000 7f2373fff700 1 -- 172.21.15.29:0/3804285993 wait complete. 2023-10-06T05:26:09.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:26:09.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a759e700 1 Processor -- start 2023-10-06T05:26:09.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a759e700 1 -- start start 2023-10-06T05:26:09.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 0x7f50a80c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f50a806ceb0 0x7f50a80c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a80c9500 con 0x7f50a80c3490 2023-10-06T05:26:09.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a80cb880 con 0x7f50a806ceb0 2023-10-06T05:26:09.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80ca080 con 0x7f50a815c450 2023-10-06T05:26:09.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a5d9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f50a80c3490 0x7f50a806c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60168/0 (socket says 172.21.15.29:60168) 2023-10-06T05:26:09.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a5d9b700 1 -- 172.21.15.29:0/1848398948 learned_addr learned my addr 172.21.15.29:0/1848398948 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:09.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a659c700 1 --2- 172.21.15.29:0/1848398948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 0x7f50a80c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a6d9d700 1 --2- 172.21.15.29:0/1848398948 >> v2:172.21.15.173:3300/0 conn(0x7f50a806ceb0 0x7f50a80c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a559a700 1 -- 172.21.15.29:0/1848398948 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319899250 0 0) 0x7f50a80c9500 con 0x7f50a80c3490 2023-10-06T05:26:09.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a559a700 1 -- 172.21.15.29:0/1848398948 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5090003570 con 0x7f50a80c3490 2023-10-06T05:26:09.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a659c700 1 -- 172.21.15.29:0/1848398948 >> v2:172.21.15.173:3300/0 conn(0x7f50a806ceb0 msgr2=0x7f50a80c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:09.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a659c700 1 --2- 172.21.15.29:0/1848398948 >> v2:172.21.15.173:3300/0 conn(0x7f50a806ceb0 0x7f50a80c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a659c700 1 -- 172.21.15.29:0/1848398948 >> v1:172.21.15.29:6789/0 conn(0x7f50a80c3490 legacy=0x7f50a806c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a659c700 1 -- 172.21.15.29:0/1848398948 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80c38e0 con 0x7f50a815c450 2023-10-06T05:26:09.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.692+0000 7f50a6d9d700 1 --2- 172.21.15.29:0/1848398948 >> v2:172.21.15.173:3300/0 conn(0x7f50a806ceb0 0x7f50a80c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:09.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a659c700 1 --2- 172.21.15.29:0/1848398948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 0x7f50a80c2f50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50980098d0 tx=0x7f5098009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffbe91197159d656 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:09.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a559a700 1 -- 172.21.15.29:0/1848398948 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098005c10 con 0x7f50a815c450 2023-10-06T05:26:09.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a559a700 1 -- 172.21.15.29:0/1848398948 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5098005d70 con 0x7f50a815c450 2023-10-06T05:26:09.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a559a700 1 -- 172.21.15.29:0/1848398948 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098006240 con 0x7f50a815c450 2023-10-06T05:26:09.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a759e700 1 -- 172.21.15.29:0/1848398948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 msgr2=0x7f50a80c2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a759e700 1 --2- 172.21.15.29:0/1848398948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 0x7f50a80c2f50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50980098d0 tx=0x7f5098009120 comp rx=0 tx=0).stop 2023-10-06T05:26:09.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a759e700 1 -- 172.21.15.29:0/1848398948 shutdown_connections 2023-10-06T05:26:09.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a759e700 1 --2- 172.21.15.29:0/1848398948 >> v2:172.21.15.173:3300/0 conn(0x7f50a806ceb0 0x7f50a80c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a759e700 1 --2- 172.21.15.29:0/1848398948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 0x7f50a80c2f50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a759e700 1 -- 172.21.15.29:0/1848398948 >> 172.21.15.29:0/1848398948 conn(0x7f50a806ba30 msgr2=0x7f50a8095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:09.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a759e700 1 -- 172.21.15.29:0/1848398948 shutdown_connections 2023-10-06T05:26:09.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.696+0000 7f50a759e700 1 -- 172.21.15.29:0/1848398948 wait complete. 2023-10-06T05:26:09.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 Processor -- start 2023-10-06T05:26:09.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 -- start start 2023-10-06T05:26:09.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50a806ceb0 0x7f50a814ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50a80c3490 0x7f50a80cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 0x7f50a80cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a814f0f0 con 0x7f50a806ceb0 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a815a820 con 0x7f50a80c3490 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8159c10 con 0x7f50a815c450 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50a806ceb0 0x7f50a814ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50a806ceb0 0x7f50a814ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35124/0 (socket says 172.21.15.29:35124) 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a659c700 1 -- 172.21.15.29:0/819661231 learned_addr learned my addr 172.21.15.29:0/819661231 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a5d9b700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50a80c3490 0x7f50a80cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a6d9d700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 0x7f50a80cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a659c700 1 -- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 msgr2=0x7f50a80cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a659c700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 0x7f50a80cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a659c700 1 -- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50a80c3490 msgr2=0x7f50a80cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a659c700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50a80c3490 0x7f50a80cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a659c700 1 -- 172.21.15.29:0/819661231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a0009a20 con 0x7f50a806ceb0 2023-10-06T05:26:09.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a659c700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50a806ceb0 0x7f50a814ebb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5098009ec0 tx=0x7f5098016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:09.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50967fc700 1 -- 172.21.15.29:0/819661231 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509801b690 con 0x7f50a806ceb0 2023-10-06T05:26:09.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50967fc700 1 -- 172.21.15.29:0/819661231 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509801b7f0 con 0x7f50a806ceb0 2023-10-06T05:26:09.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50967fc700 1 -- 172.21.15.29:0/819661231 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509801bbb0 con 0x7f50a806ceb0 2023-10-06T05:26:09.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50980093c0 con 0x7f50a806ceb0 2023-10-06T05:26:09.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.700+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a815a1d0 con 0x7f50a806ceb0 2023-10-06T05:26:09.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.704+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a804be00 con 0x7f50a806ceb0 2023-10-06T05:26:09.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.704+0000 7f50967fc700 1 -- 172.21.15.29:0/819661231 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f509802f440 con 0x7f50a806ceb0 2023-10-06T05:26:09.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.704+0000 7f50967fc700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5088060580 0x7f5088062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:09.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.704+0000 7f50967fc700 1 -- 172.21.15.29:0/819661231 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f509807e6b0 con 0x7f50a806ceb0 2023-10-06T05:26:09.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.704+0000 7f50a5d9b700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5088060580 0x7f5088062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:09.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.704+0000 7f50a5d9b700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5088060580 0x7f5088062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f50a80685f0 tx=0x7f509c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:09.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.712+0000 7f50967fc700 1 -- 172.21.15.29:0/819661231 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f509804ec00 con 0x7f50a806ceb0 2023-10-06T05:26:09.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f50a8068060 con 0x7f50a806ceb0 2023-10-06T05:26:09.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50967fc700 1 -- 172.21.15.29:0/819661231 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5098052220 con 0x7f50a806ceb0 2023-10-06T05:26:09.885 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:26:09.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5088060580 msgr2=0x7f5088062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5088060580 0x7f5088062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f50a80685f0 tx=0x7f509c009040 comp rx=0 tx=0).stop 2023-10-06T05:26:09.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50a806ceb0 msgr2=0x7f50a814ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:09.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50a806ceb0 0x7f50a814ebb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5098009ec0 tx=0x7f5098016000 comp rx=0 tx=0).stop 2023-10-06T05:26:09.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 shutdown_connections 2023-10-06T05:26:09.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50a815c450 0x7f50a80cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5088060580 0x7f5088062a30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50a80c3490 0x7f50a80cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 --2- 172.21.15.29:0/819661231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50a806ceb0 0x7f50a814ebb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:09.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 >> 172.21.15.29:0/819661231 conn(0x7f50a806ba30 msgr2=0x7f50a8068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:09.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 shutdown_connections 2023-10-06T05:26:09.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:09.880+0000 7f50a759e700 1 -- 172.21.15.29:0/819661231 wait complete. 2023-10-06T05:26:09.899 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:26:09.927 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:26:09.929 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:26:10.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.008+0000 7ff740954700 1 Processor -- start 2023-10-06T05:26:10.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.008+0000 7ff740954700 1 -- start start 2023-10-06T05:26:10.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff73c157040 0x7ff73c0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 0x7ff73c06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73c0c6b40 con 0x7ff73c156c70 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73c06e090 con 0x7ff73c157040 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c06bdd0 con 0x7ff73c06d6d0 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff73a59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff73c157040 0x7ff73c0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff73a59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff73c157040 0x7ff73c0c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35130/0 (socket says 172.21.15.29:35130) 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff73a59c700 1 -- 172.21.15.29:0/2237394625 learned_addr learned my addr 172.21.15.29:0/2237394625 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff73b59e700 1 --2- 172.21.15.29:0/2237394625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 0x7ff73c06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff73a59c700 1 -- 172.21.15.29:0/2237394625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 msgr2=0x7ff73c06db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff73a59c700 1 --2- 172.21.15.29:0/2237394625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 0x7ff73c06db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff73a59c700 1 -- 172.21.15.29:0/2237394625 >> v1:172.21.15.173:6789/0 conn(0x7ff73c156c70 legacy=0x7ff73c06b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff73a59c700 1 -- 172.21.15.29:0/2237394625 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c0c6d90 con 0x7ff73c157040 2023-10-06T05:26:10.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff73a59c700 1 --2- 172.21.15.29:0/2237394625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c157040 0x7ff73c0c7870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff7300099b0 tx=0x7ff730009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1adaaec5aad835f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:10.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff739d9b700 1 -- 172.21.15.29:0/2237394625 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730009ea0 con 0x7ff73c157040 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff739d9b700 1 -- 172.21.15.29:0/2237394625 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73000b860 con 0x7ff73c157040 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff739d9b700 1 -- 172.21.15.29:0/2237394625 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73000bc00 con 0x7ff73c157040 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 -- 172.21.15.29:0/2237394625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c157040 msgr2=0x7ff73c0c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 --2- 172.21.15.29:0/2237394625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c157040 0x7ff73c0c7870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff7300099b0 tx=0x7ff730009250 comp rx=0 tx=0).stop 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 -- 172.21.15.29:0/2237394625 shutdown_connections 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 --2- 172.21.15.29:0/2237394625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 0x7ff73c06db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 --2- 172.21.15.29:0/2237394625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c157040 0x7ff73c0c7870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 -- 172.21.15.29:0/2237394625 >> 172.21.15.29:0/2237394625 conn(0x7ff73c0c9830 msgr2=0x7ff73c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 -- 172.21.15.29:0/2237394625 shutdown_connections 2023-10-06T05:26:10.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.012+0000 7ff740954700 1 -- 172.21.15.29:0/2237394625 wait complete. 2023-10-06T05:26:10.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 Processor -- start 2023-10-06T05:26:10.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 -- start start 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 0x7ff73c154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c156c70 0x7ff73c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff73c157040 0x7ff73c0c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c154750 con 0x7ff73c156c70 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0ca040 con 0x7ff73c157040 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0ca320 con 0x7ff73c06d6d0 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c156c70 0x7ff73c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c156c70 0x7ff73c0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35138/0 (socket says 172.21.15.29:35138) 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73a59c700 1 -- 172.21.15.29:0/2553147607 learned_addr learned my addr 172.21.15.29:0/2553147607 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73b59e700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff73c157040 0x7ff73c0c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73ad9d700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 0x7ff73c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73a59c700 1 -- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 msgr2=0x7ff73c154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73a59c700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 0x7ff73c154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73a59c700 1 -- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff73c157040 msgr2=0x7ff73c0c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73a59c700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff73c157040 0x7ff73c0c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73a59c700 1 -- 172.21.15.29:0/2553147607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7300094f0 con 0x7ff73c156c70 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73b59e700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff73c157040 0x7ff73c0c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff73a59c700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c156c70 0x7ff73c0b1890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff73c06eda0 tx=0x7ff730017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff722ffd700 1 -- 172.21.15.29:0/2553147607 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73000bbe0 con 0x7ff73c156c70 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73c0ca600 con 0x7ff73c156c70 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff722ffd700 1 -- 172.21.15.29:0/2553147607 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73001a450 con 0x7ff73c156c70 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff722ffd700 1 -- 172.21.15.29:0/2553147607 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73001a810 con 0x7ff73c156c70 2023-10-06T05:26:10.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.016+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c0b1dd0 con 0x7ff73c156c70 2023-10-06T05:26:10.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.020+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c0caae0 con 0x7ff73c156c70 2023-10-06T05:26:10.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.020+0000 7ff722ffd700 1 -- 172.21.15.29:0/2553147607 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff73001ab80 con 0x7ff73c156c70 2023-10-06T05:26:10.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.020+0000 7ff722ffd700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff728060550 0x7ff728062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.020+0000 7ff722ffd700 1 -- 172.21.15.29:0/2553147607 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff73007e410 con 0x7ff73c156c70 2023-10-06T05:26:10.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.020+0000 7ff73ad9d700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff728060550 0x7ff728062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.020+0000 7ff73ad9d700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff728060550 0x7ff728062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0037c0 tx=0x7ff72c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:10.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.028+0000 7ff722ffd700 1 -- 172.21.15.29:0/2553147607 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff73004e800 con 0x7ff73c156c70 2023-10-06T05:26:10.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.192+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff73c04be00 con 0x7ff73c156c70 2023-10-06T05:26:10.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.192+0000 7ff722ffd700 1 -- 172.21.15.29:0/2553147607 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff730051e20 con 0x7ff73c156c70 2023-10-06T05:26:10.198 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff728060550 msgr2=0x7ff728062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff728060550 0x7ff728062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0037c0 tx=0x7ff72c009040 comp rx=0 tx=0).stop 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c156c70 msgr2=0x7ff73c0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c156c70 0x7ff73c0b1890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff73c06eda0 tx=0x7ff730017000 comp rx=0 tx=0).stop 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 shutdown_connections 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff728060550 0x7ff728062a00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff73c157040 0x7ff73c0c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff73c156c70 0x7ff73c0b1890 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 --2- 172.21.15.29:0/2553147607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff73c06d6d0 0x7ff73c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 >> 172.21.15.29:0/2553147607 conn(0x7ff73c0c9830 msgr2=0x7ff73c0c2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:10.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 shutdown_connections 2023-10-06T05:26:10.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.196+0000 7ff740954700 1 -- 172.21.15.29:0/2553147607 wait complete. 2023-10-06T05:26:10.217 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:26:10.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.328+0000 7fe7c7fff700 1 Processor -- start 2023-10-06T05:26:10.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.328+0000 7fe7c7fff700 1 -- start start 2023-10-06T05:26:10.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c80cada0 0x7fe7c8161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c80c4380 con 0x7fe7c8156b50 2023-10-06T05:26:10.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c80c4810 con 0x7fe7c8156f20 2023-10-06T05:26:10.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80c3770 con 0x7fe7c80cada0 2023-10-06T05:26:10.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c6ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe7c8156b50 0x7fe7c80c8ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60184/0 (socket says 172.21.15.29:60184) 2023-10-06T05:26:10.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c6ffd700 1 -- 172.21.15.29:0/2417441834 learned_addr learned my addr 172.21.15.29:0/2417441834 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:10.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c77fe700 1 --2- 172.21.15.29:0/2417441834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c80cada0 0x7fe7c8161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c67fc700 1 -- 172.21.15.29:0/2417441834 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422311730 0 0) 0x7fe7c80c4380 con 0x7fe7c8156b50 2023-10-06T05:26:10.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c67fc700 1 -- 172.21.15.29:0/2417441834 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a8003570 con 0x7fe7c8156b50 2023-10-06T05:26:10.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c67fc700 1 -- 172.21.15.29:0/2417441834 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161971586 0 0) 0x7fe7c80c4810 con 0x7fe7c8156f20 2023-10-06T05:26:10.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c67fc700 1 -- 172.21.15.29:0/2417441834 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c80c4380 con 0x7fe7c8156f20 2023-10-06T05:26:10.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c77fe700 1 -- 172.21.15.29:0/2417441834 >> v1:172.21.15.173:6789/0 conn(0x7fe7c8156f20 legacy=0x7fe7c80ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c77fe700 1 -- 172.21.15.29:0/2417441834 >> v1:172.21.15.29:6789/0 conn(0x7fe7c8156b50 legacy=0x7fe7c80c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c77fe700 1 -- 172.21.15.29:0/2417441834 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80c3a50 con 0x7fe7c80cada0 2023-10-06T05:26:10.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c77fe700 1 --2- 172.21.15.29:0/2417441834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c80cada0 0x7fe7c8161ca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009e90 tx=0x7fe7c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=635a57c67309a109 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:10.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c67fc700 1 -- 172.21.15.29:0/2417441834 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000e070 con 0x7fe7c80cada0 2023-10-06T05:26:10.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c67fc700 1 -- 172.21.15.29:0/2417441834 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c000bb80 con 0x7fe7c80cada0 2023-10-06T05:26:10.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c67fc700 1 -- 172.21.15.29:0/2417441834 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0012430 con 0x7fe7c80cada0 2023-10-06T05:26:10.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 -- 172.21.15.29:0/2417441834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c80cada0 msgr2=0x7fe7c8161ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 --2- 172.21.15.29:0/2417441834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c80cada0 0x7fe7c8161ca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009e90 tx=0x7fe7c0009780 comp rx=0 tx=0).stop 2023-10-06T05:26:10.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 -- 172.21.15.29:0/2417441834 shutdown_connections 2023-10-06T05:26:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 --2- 172.21.15.29:0/2417441834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c80cada0 0x7fe7c8161ca0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 -- 172.21.15.29:0/2417441834 >> 172.21.15.29:0/2417441834 conn(0x7fe7c8069d50 msgr2=0x7fe7c806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 -- 172.21.15.29:0/2417441834 shutdown_connections 2023-10-06T05:26:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.332+0000 7fe7c7fff700 1 -- 172.21.15.29:0/2417441834 wait complete. 2023-10-06T05:26:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c7fff700 1 Processor -- start 2023-10-06T05:26:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c7fff700 1 -- start start 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7c80cada0 0x7fe7c815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c8156b50 0x7fe7c816a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c8156f20 0x7fe7c816a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c815c3d0 con 0x7fe7c80cada0 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c7fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c813f2a0 con 0x7fe7c8156f20 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c7fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c813f580 con 0x7fe7c8156b50 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7c80cada0 0x7fe7c815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7c80cada0 0x7fe7c815be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35144/0 (socket says 172.21.15.29:35144) 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c6ffd700 1 -- 172.21.15.29:0/1145128913 learned_addr learned my addr 172.21.15.29:0/1145128913 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c77fe700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c8156f20 0x7fe7c816a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7bffff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c8156b50 0x7fe7c816a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c6ffd700 1 -- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c8156b50 msgr2=0x7fe7c816a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c6ffd700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c8156b50 0x7fe7c816a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c6ffd700 1 -- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c8156f20 msgr2=0x7fe7c816a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c6ffd700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c8156f20 0x7fe7c816a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7c6ffd700 1 -- 172.21.15.29:0/1145128913 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c0009a20 con 0x7fe7c80cada0 2023-10-06T05:26:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.336+0000 7fe7bffff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c8156b50 0x7fe7c816a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:10.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.340+0000 7fe7c6ffd700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7c80cada0 0x7fe7c815be90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c790 tx=0x7fe7b8007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:10.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.340+0000 7fe7beffd700 1 -- 172.21.15.29:0/1145128913 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8005b30 con 0x7fe7c80cada0 2023-10-06T05:26:10.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.340+0000 7fe7beffd700 1 -- 172.21.15.29:0/1145128913 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8005c90 con 0x7fe7c80cada0 2023-10-06T05:26:10.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.340+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c813f860 con 0x7fe7c80cada0 2023-10-06T05:26:10.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.340+0000 7fe7beffd700 1 -- 172.21.15.29:0/1145128913 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8007300 con 0x7fe7c80cada0 2023-10-06T05:26:10.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.340+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c813fe20 con 0x7fe7c80cada0 2023-10-06T05:26:10.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.340+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c8140040 con 0x7fe7c80cada0 2023-10-06T05:26:10.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.340+0000 7fe7beffd700 1 -- 172.21.15.29:0/1145128913 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe7b801b3b0 con 0x7fe7c80cada0 2023-10-06T05:26:10.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.344+0000 7fe7beffd700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe7ac060550 0x7fe7ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.344+0000 7fe7beffd700 1 -- 172.21.15.29:0/1145128913 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7b807bfb0 con 0x7fe7c80cada0 2023-10-06T05:26:10.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.344+0000 7fe7bffff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe7ac060550 0x7fe7ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.344+0000 7fe7bffff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe7ac060550 0x7fe7ac062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80c8dd0 tx=0x7fe7b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:10.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.348+0000 7fe7beffd700 1 -- 172.21.15.29:0/1145128913 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe7b804fe30 con 0x7fe7c80cada0 2023-10-06T05:26:10.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.508+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7c804be00 con 0x7fe7c80cada0 2023-10-06T05:26:10.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.508+0000 7fe7beffd700 1 -- 172.21.15.29:0/1145128913 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe7b8017020 con 0x7fe7c80cada0 2023-10-06T05:26:10.515 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:26:10.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe7ac060550 msgr2=0x7fe7ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe7ac060550 0x7fe7ac062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80c8dd0 tx=0x7fe7b0009040 comp rx=0 tx=0).stop 2023-10-06T05:26:10.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7c80cada0 msgr2=0x7fe7c815be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7c80cada0 0x7fe7c815be90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c790 tx=0x7fe7b8007ea0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 shutdown_connections 2023-10-06T05:26:10.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe7ac060550 0x7fe7ac062a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c8156f20 0x7fe7c816a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7c8156b50 0x7fe7c816a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 --2- 172.21.15.29:0/1145128913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7c80cada0 0x7fe7c815be90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 >> 172.21.15.29:0/1145128913 conn(0x7fe7c8069d50 msgr2=0x7fe7c8152530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:10.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 shutdown_connections 2023-10-06T05:26:10.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.512+0000 7fe7c7fff700 1 -- 172.21.15.29:0/1145128913 wait complete. 2023-10-06T05:26:10.537 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-10-06T05:26:10.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-10-06T05:26:10.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7dcf8700 1 Processor -- start 2023-10-06T05:26:10.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7dcf8700 1 -- start start 2023-10-06T05:26:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7dcf8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780cff90 0x7f0d780d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7dcf8700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0d7815bf20 0x7f0d7815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7dcf8700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d780cb150 con 0x7f0d780aeb00 2023-10-06T05:26:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7dcf8700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780cb5e0 con 0x7f0d7815bf20 2023-10-06T05:26:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7dcf8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7815c8e0 con 0x7f0d780cff90 2023-10-06T05:26:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d77fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0d780aeb00 0x7f0d7815d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60198/0 (socket says 172.21.15.29:60198) 2023-10-06T05:26:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d77fff700 1 -- 172.21.15.29:0/1813516514 learned_addr learned my addr 172.21.15.29:0/1813516514 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7d4f7700 1 --2- 172.21.15.29:0/1813516514 >> v2:172.21.15.173:3300/0 conn(0x7f0d7815bf20 0x7f0d7815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7ccf6700 1 --2- 172.21.15.29:0/1813516514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780cff90 0x7f0d780d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d777fe700 1 -- 172.21.15.29:0/1813516514 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229113769 0 0) 0x7f0d780cb150 con 0x7f0d780aeb00 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d777fe700 1 -- 172.21.15.29:0/1813516514 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d64003570 con 0x7f0d780aeb00 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7d4f7700 1 -- 172.21.15.29:0/1813516514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780cff90 msgr2=0x7f0d780d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7d4f7700 1 --2- 172.21.15.29:0/1813516514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780cff90 0x7f0d780d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7d4f7700 1 -- 172.21.15.29:0/1813516514 >> v1:172.21.15.29:6789/0 conn(0x7f0d780aeb00 legacy=0x7f0d7815d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7d4f7700 1 -- 172.21.15.29:0/1813516514 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780ca540 con 0x7f0d7815bf20 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.640+0000 7f0d7d4f7700 1 --2- 172.21.15.29:0/1813516514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7815bf20 0x7f0d7815c3a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009e90 tx=0x7f0d70009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bfc2233bc63f465 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d777fe700 1 -- 172.21.15.29:0/1813516514 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000e070 con 0x7f0d7815bf20 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d777fe700 1 -- 172.21.15.29:0/1813516514 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000bb40 con 0x7f0d7815bf20 2023-10-06T05:26:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d777fe700 1 -- 172.21.15.29:0/1813516514 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70012430 con 0x7f0d7815bf20 2023-10-06T05:26:10.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1813516514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7815bf20 msgr2=0x7f0d7815c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 --2- 172.21.15.29:0/1813516514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7815bf20 0x7f0d7815c3a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009e90 tx=0x7f0d70009780 comp rx=0 tx=0).stop 2023-10-06T05:26:10.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1813516514 shutdown_connections 2023-10-06T05:26:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 --2- 172.21.15.29:0/1813516514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7815bf20 0x7f0d7815c3a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 --2- 172.21.15.29:0/1813516514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780cff90 0x7f0d780d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1813516514 >> 172.21.15.29:0/1813516514 conn(0x7f0d780670a0 msgr2=0x7f0d780674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1813516514 shutdown_connections 2023-10-06T05:26:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1813516514 wait complete. 2023-10-06T05:26:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 Processor -- start 2023-10-06T05:26:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.644+0000 7f0d7dcf8700 1 -- start start 2023-10-06T05:26:10.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7dcf8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780aeb00 0x7f0d780c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7dcf8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d780cff90 0x7f0d781591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7dcf8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815bf20 0x7f0d780cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7dcf8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780b4100 con 0x7f0d7815bf20 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7dcf8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780c8670 con 0x7f0d780cff90 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7dcf8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780c7dd0 con 0x7f0d780aeb00 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7d4f7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815bf20 0x7f0d780cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7d4f7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815bf20 0x7f0d780cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35150/0 (socket says 172.21.15.29:35150) 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7d4f7700 1 -- 172.21.15.29:0/1240700597 learned_addr learned my addr 172.21.15.29:0/1240700597 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d77fff700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d780cff90 0x7f0d781591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7ccf6700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780aeb00 0x7f0d780c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7d4f7700 1 -- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780aeb00 msgr2=0x7f0d780c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7d4f7700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780aeb00 0x7f0d780c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7d4f7700 1 -- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d780cff90 msgr2=0x7f0d781591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7d4f7700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d780cff90 0x7f0d781591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7d4f7700 1 -- 172.21.15.29:0/1240700597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d70009a20 con 0x7f0d7815bf20 2023-10-06T05:26:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7d4f7700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815bf20 0x7f0d780cd940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d7806e4d0 tx=0x7f0d70019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d74ff9700 1 -- 172.21.15.29:0/1240700597 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70027470 con 0x7f0d7815bf20 2023-10-06T05:26:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d74ff9700 1 -- 172.21.15.29:0/1240700597 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700275d0 con 0x7f0d7815bf20 2023-10-06T05:26:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d780c80b0 con 0x7f0d7815bf20 2023-10-06T05:26:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d74ff9700 1 -- 172.21.15.29:0/1240700597 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70027990 con 0x7f0d7815bf20 2023-10-06T05:26:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d780c7ac0 con 0x7f0d7815bf20 2023-10-06T05:26:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.648+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d780b42b0 con 0x7f0d7815bf20 2023-10-06T05:26:10.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.652+0000 7f0d74ff9700 1 -- 172.21.15.29:0/1240700597 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0d70024070 con 0x7f0d7815bf20 2023-10-06T05:26:10.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.652+0000 7f0d74ff9700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d58060580 0x7f0d58062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:10.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.652+0000 7f0d74ff9700 1 -- 172.21.15.29:0/1240700597 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0d7007f0a0 con 0x7f0d7815bf20 2023-10-06T05:26:10.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.652+0000 7f0d7ccf6700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d58060580 0x7f0d58062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:10.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.652+0000 7f0d7ccf6700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d58060580 0x7f0d58062a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009db0 tx=0x7f0d600091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:10.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.660+0000 7f0d74ff9700 1 -- 172.21.15.29:0/1240700597 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0d780b42b0 con 0x7f0d7815bf20 2023-10-06T05:26:10.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:10.876+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f0d7804be00 con 0x7f0d7815bf20 2023-10-06T05:26:11.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.460+0000 7f0d74ff9700 1 -- 172.21.15.29:0/1240700597 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v51) v1 ==== 145+0+0 (secure 0 0 0) 0x7f0d7002c020 con 0x7f0d7815bf20 2023-10-06T05:26:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d58060580 msgr2=0x7f0d58062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:11.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d58060580 0x7f0d58062a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009db0 tx=0x7f0d600091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815bf20 msgr2=0x7f0d780cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815bf20 0x7f0d780cd940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d7806e4d0 tx=0x7f0d70019000 comp rx=0 tx=0).stop 2023-10-06T05:26:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 shutdown_connections 2023-10-06T05:26:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815bf20 0x7f0d780cd940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0d58060580 0x7f0d58062a30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d780cff90 0x7f0d781591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 --2- 172.21.15.29:0/1240700597 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d780aeb00 0x7f0d780c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 >> 172.21.15.29:0/1240700597 conn(0x7f0d780670a0 msgr2=0x7f0d7815cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 shutdown_connections 2023-10-06T05:26:11.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.468+0000 7f0d7dcf8700 1 -- 172.21.15.29:0/1240700597 wait complete. 2023-10-06T05:26:11.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T05:26:11.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.608+0000 7f6cce591700 1 Processor -- start 2023-10-06T05:26:11.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.608+0000 7f6cce591700 1 -- start start 2023-10-06T05:26:11.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cce591700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc813f080 0x7f6cc8159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:11.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cce591700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc80c8930 con 0x7f6cc813ecb0 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cce591700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc80688a0 con 0x7f6cc806dde0 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cce591700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80c7d20 con 0x7f6cc813f080 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6ccd58f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6cc813ecb0 0x7f6cc806d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60206/0 (socket says 172.21.15.29:60206) 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6ccd58f700 1 -- 172.21.15.29:0/2521434097 learned_addr learned my addr 172.21.15.29:0/2521434097 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cccd8e700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc813f080 0x7f6cc8159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283347616 0 0) 0x7f6cc80c8930 con 0x7f6cc813ecb0 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb4003570 con 0x7f6cc813ecb0 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1697107736 0 0) 0x7f6cb4003570 con 0x7f6cc813ecb0 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc813f080 msgr2=0x7f6cc8159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc813f080 0x7f6cc8159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 >> v1:172.21.15.173:6789/0 conn(0x7f6cc806dde0 legacy=0x7f6cc80c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:11.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80c8000 con 0x7f6cc813ecb0 2023-10-06T05:26:11.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f6cc4001470 con 0x7f6cc813ecb0 2023-10-06T05:26:11.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 >> v1:172.21.15.29:6789/0 conn(0x7f6cc813ecb0 legacy=0x7f6cc806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:11.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc813f080 0x7f6cb4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:11.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cb4003fd0 0x7f6cb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:11.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cb4004d50 0x7f6cb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:11.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80c7d20 con 0x7f6cb4004d50 2023-10-06T05:26:11.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb400cc50 con 0x7f6cb4003fd0 2023-10-06T05:26:11.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb400ce10 con 0x7f6cc813f080 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6ccd58f700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc813f080 0x7f6cb4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6cccd8e700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cb4003fd0 0x7f6cb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6ccdd90700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cb4004d50 0x7f6cb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6ccd58f700 1 -- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cb4003fd0 msgr2=0x7f6cb4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6ccd58f700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cb4003fd0 0x7f6cb4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6ccd58f700 1 -- 172.21.15.29:0/2521434097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cb4004d50 msgr2=0x7f6cb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6ccd58f700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cb4004d50 0x7f6cb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.612+0000 7f6ccd58f700 1 -- 172.21.15.29:0/2521434097 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4003570 con 0x7f6cc813f080 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6ccd58f700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc813f080 0x7f6cb4003a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400c390 tx=0x7f6cc80c88a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2fe4704fbdb6ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400cc60 con 0x7f6cc813f080 2023-10-06T05:26:11.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400cdc0 con 0x7f6cc813f080 2023-10-06T05:26:11.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6cbffff700 1 -- 172.21.15.29:0/2521434097 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4005b70 con 0x7f6cc813f080 2023-10-06T05:26:11.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6cce591700 1 -- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc813f080 msgr2=0x7f6cb4003a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:11.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6cce591700 1 --2- 172.21.15.29:0/2521434097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc813f080 0x7f6cb4003a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400c390 tx=0x7f6cc80c88a0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6ccdd90700 1 -- 172.21.15.29:0/2521434097 reap_dead start 2023-10-06T05:26:11.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6cce591700 1 -- 172.21.15.29:0/2521434097 shutdown_connections 2023-10-06T05:26:11.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6cce591700 1 -- 172.21.15.29:0/2521434097 >> 172.21.15.29:0/2521434097 conn(0x7f6cc80c9830 msgr2=0x7f6cc806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:11.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6cce591700 1 -- 172.21.15.29:0/2521434097 shutdown_connections 2023-10-06T05:26:11.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.616+0000 7f6cce591700 1 -- 172.21.15.29:0/2521434097 wait complete. 2023-10-06T05:26:11.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 Processor -- start 2023-10-06T05:26:11.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 -- start start 2023-10-06T05:26:11.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc813f080 0x7f6cc813cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:11.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cc81692e0 0x7f6cc8157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:11.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc81581a0 0x7f6cc8155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:11.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81586c0 con 0x7f6cc81692e0 2023-10-06T05:26:11.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc813d010 con 0x7f6cc813f080 2023-10-06T05:26:11.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80c3540 con 0x7f6cc81581a0 2023-10-06T05:26:11.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cccd8e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cc81692e0 0x7f6cc8157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:11.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cccd8e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cc81692e0 0x7f6cc8157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35166/0 (socket says 172.21.15.29:35166) 2023-10-06T05:26:11.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cccd8e700 1 -- 172.21.15.29:0/2078743581 learned_addr learned my addr 172.21.15.29:0/2078743581 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:11.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6ccd58f700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc813f080 0x7f6cc813cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6ccdd90700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc81581a0 0x7f6cc8155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cccd8e700 1 -- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc81581a0 msgr2=0x7f6cc8155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cccd8e700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc81581a0 0x7f6cc8155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cccd8e700 1 -- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc813f080 msgr2=0x7f6cc813cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cccd8e700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc813f080 0x7f6cc813cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cccd8e700 1 -- 172.21.15.29:0/2078743581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80c3820 con 0x7f6cc81692e0 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6ccdd90700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc81581a0 0x7f6cc8155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cccd8e700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cc81692e0 0x7f6cc8157c60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8011d20 tx=0x7f6cb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cbd7fa700 1 -- 172.21.15.29:0/2078743581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800fac0 con 0x7f6cc81692e0 2023-10-06T05:26:11.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cbd7fa700 1 -- 172.21.15.29:0/2078743581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb800fc20 con 0x7f6cc81692e0 2023-10-06T05:26:11.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc80c3b00 con 0x7f6cc81692e0 2023-10-06T05:26:11.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cbd7fa700 1 -- 172.21.15.29:0/2078743581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb801d480 con 0x7f6cc81692e0 2023-10-06T05:26:11.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.620+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc80c5df0 con 0x7f6cc81692e0 2023-10-06T05:26:11.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.624+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc804be00 con 0x7f6cc81692e0 2023-10-06T05:26:11.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.624+0000 7f6cbd7fa700 1 -- 172.21.15.29:0/2078743581 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6cb8014440 con 0x7f6cc81692e0 2023-10-06T05:26:11.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.624+0000 7f6cbd7fa700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6cac060550 0x7f6cac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:11.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.624+0000 7f6cbd7fa700 1 -- 172.21.15.29:0/2078743581 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6cb8018070 con 0x7f6cc81692e0 2023-10-06T05:26:11.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.624+0000 7f6ccd58f700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6cac060550 0x7f6cac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:11.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.628+0000 7f6ccd58f700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6cac060550 0x7f6cac062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4007d10 tx=0x7f6cc4015000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:11.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.632+0000 7f6cbd7fa700 1 -- 172.21.15.29:0/2078743581 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6cb804db80 con 0x7f6cc81692e0 2023-10-06T05:26:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.800+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6cc80c7a60 con 0x7f6cc81692e0 2023-10-06T05:26:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cbd7fa700 1 -- 172.21.15.29:0/2078743581 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6cb80511a0 con 0x7f6cc81692e0 2023-10-06T05:26:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6cac060550 msgr2=0x7f6cac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6cac060550 0x7f6cac062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4007d10 tx=0x7f6cc4015000 comp rx=0 tx=0).stop 2023-10-06T05:26:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cc81692e0 msgr2=0x7f6cc8157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cc81692e0 0x7f6cc8157c60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8011d20 tx=0x7f6cb80091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 shutdown_connections 2023-10-06T05:26:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cc81581a0 0x7f6cc8155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cc81692e0 0x7f6cc8157c60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6cac060550 0x7f6cac062a00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 --2- 172.21.15.29:0/2078743581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc813f080 0x7f6cc813cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:11.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.808+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 >> 172.21.15.29:0/2078743581 conn(0x7f6cc80c9830 msgr2=0x7f6cc806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:11.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.812+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 shutdown_connections 2023-10-06T05:26:11.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:11.812+0000 7f6cce591700 1 -- 172.21.15.29:0/2078743581 wait complete. 2023-10-06T05:26:11.829 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T05:26:11.829 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:26:11.849 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:26:11.870 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T05:26:11.870 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:26:11.870 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:26:11.870 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:11.900 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:26:11.900 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:26:11.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:11.901 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:26:11.963 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2023-10-06T05:26:11.964 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:26:11.964 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-06T05:26:11.991 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:26:11.992 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:26:11.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:11.992 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T05:26:12.050 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:26:12.050 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:26:12.050 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-06T05:26:12.068 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:26:12.068 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:26:12.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:12.068 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T05:26:12.075 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2023-10-06T05:26:12.075 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:26:12.076 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-06T05:26:12.092 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:26:12.092 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:26:12.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:12.093 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T05:26:12.144 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T05:26:12.144 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:12.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.252+0000 7fbe55336700 1 Processor -- start 2023-10-06T05:26:12.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.252+0000 7fbe55336700 1 -- start start 2023-10-06T05:26:12.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.252+0000 7fbe55336700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbe500cff90 0x7fbe500d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.252+0000 7fbe55336700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500cb150 con 0x7fbe5015bf20 2023-10-06T05:26:12.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.252+0000 7fbe55336700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500ca540 con 0x7fbe500aeb00 2023-10-06T05:26:12.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.252+0000 7fbe55336700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe500cb5e0 con 0x7fbe500cff90 2023-10-06T05:26:12.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe54b35700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbe5015bf20 0x7fbe5006a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60212/0 (socket says 172.21.15.29:60212) 2023-10-06T05:26:12.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbe500cff90 0x7fbe500d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe54b35700 1 -- 172.21.15.29:0/3888912525 learned_addr learned my addr 172.21.15.29:0/3888912525 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:12.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4effd700 1 -- 172.21.15.29:0/3888912525 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095204014 0 0) 0x7fbe500cb150 con 0x7fbe5015bf20 2023-10-06T05:26:12.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4effd700 1 -- 172.21.15.29:0/3888912525 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe38003570 con 0x7fbe5015bf20 2023-10-06T05:26:12.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4ffff700 1 -- 172.21.15.29:0/3888912525 >> v1:172.21.15.173:6789/0 conn(0x7fbe500aeb00 legacy=0x7fbe5015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4ffff700 1 -- 172.21.15.29:0/3888912525 >> v1:172.21.15.29:6789/0 conn(0x7fbe5015bf20 legacy=0x7fbe5006a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4ffff700 1 -- 172.21.15.29:0/3888912525 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500ca820 con 0x7fbe500cff90 2023-10-06T05:26:12.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4ffff700 1 --2- 172.21.15.29:0/3888912525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 0x7fbe500d0360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbe440098e0 tx=0x7fbe440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cafafec11e163a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:12.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4effd700 1 -- 172.21.15.29:0/3888912525 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400b640 con 0x7fbe500cff90 2023-10-06T05:26:12.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4effd700 1 -- 172.21.15.29:0/3888912525 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4400b7a0 con 0x7fbe500cff90 2023-10-06T05:26:12.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe4effd700 1 -- 172.21.15.29:0/3888912525 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400bb40 con 0x7fbe500cff90 2023-10-06T05:26:12.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe55336700 1 -- 172.21.15.29:0/3888912525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 msgr2=0x7fbe500d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe55336700 1 --2- 172.21.15.29:0/3888912525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 0x7fbe500d0360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbe440098e0 tx=0x7fbe440091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe55336700 1 -- 172.21.15.29:0/3888912525 shutdown_connections 2023-10-06T05:26:12.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe55336700 1 --2- 172.21.15.29:0/3888912525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 0x7fbe500d0360 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe55336700 1 -- 172.21.15.29:0/3888912525 >> 172.21.15.29:0/3888912525 conn(0x7fbe500670a0 msgr2=0x7fbe500674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:12.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe55336700 1 -- 172.21.15.29:0/3888912525 shutdown_connections 2023-10-06T05:26:12.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.256+0000 7fbe55336700 1 -- 172.21.15.29:0/3888912525 wait complete. 2023-10-06T05:26:12.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 Processor -- start 2023-10-06T05:26:12.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 -- start start 2023-10-06T05:26:12.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe500aeb00 0x7fbe500c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 0x7fbe500b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe5015bf20 0x7fbe50157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b35b0 con 0x7fbe500cff90 2023-10-06T05:26:12.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b56f0 con 0x7fbe500aeb00 2023-10-06T05:26:12.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b5940 con 0x7fbe5015bf20 2023-10-06T05:26:12.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 0x7fbe500b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 0x7fbe500b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35176/0 (socket says 172.21.15.29:35176) 2023-10-06T05:26:12.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4f7fe700 1 -- 172.21.15.29:0/325747403 learned_addr learned my addr 172.21.15.29:0/325747403 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:12.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4ffff700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe500aeb00 0x7fbe500c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe54b35700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe5015bf20 0x7fbe50157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4f7fe700 1 -- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe5015bf20 msgr2=0x7fbe50157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4f7fe700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe5015bf20 0x7fbe50157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4f7fe700 1 -- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe500aeb00 msgr2=0x7fbe500c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4f7fe700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe500aeb00 0x7fbe500c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4f7fe700 1 -- 172.21.15.29:0/325747403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44009420 con 0x7fbe500cff90 2023-10-06T05:26:12.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4ffff700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe500aeb00 0x7fbe500c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:12.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe54b35700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe5015bf20 0x7fbe50157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:26:12.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe4f7fe700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 0x7fbe500b51b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c5c0 tx=0x7fbe40007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:12.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe37fff700 1 -- 172.21.15.29:0/325747403 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40011590 con 0x7fbe500cff90 2023-10-06T05:26:12.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe37fff700 1 -- 172.21.15.29:0/325747403 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40011710 con 0x7fbe500cff90 2023-10-06T05:26:12.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe500b2c80 con 0x7fbe500cff90 2023-10-06T05:26:12.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe37fff700 1 -- 172.21.15.29:0/325747403 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40011ad0 con 0x7fbe500cff90 2023-10-06T05:26:12.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.260+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe500b3240 con 0x7fbe500cff90 2023-10-06T05:26:12.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.264+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5004be00 con 0x7fbe500cff90 2023-10-06T05:26:12.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.264+0000 7fbe37fff700 1 -- 172.21.15.29:0/325747403 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbe4001b3b0 con 0x7fbe500cff90 2023-10-06T05:26:12.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.264+0000 7fbe37fff700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe3c060550 0x7fbe3c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.264+0000 7fbe37fff700 1 -- 172.21.15.29:0/325747403 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbe4007bd90 con 0x7fbe500cff90 2023-10-06T05:26:12.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.264+0000 7fbe4ffff700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe3c060550 0x7fbe3c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.264+0000 7fbe4ffff700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe3c060550 0x7fbe3c062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe440093f0 tx=0x7fbe44017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:12.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.272+0000 7fbe37fff700 1 -- 172.21.15.29:0/325747403 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbe4004c220 con 0x7fbe500cff90 2023-10-06T05:26:12.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe500cab00 con 0x7fbe500cff90 2023-10-06T05:26:12.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe37fff700 1 -- 172.21.15.29:0/325747403 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fbe40017020 con 0x7fbe500cff90 2023-10-06T05:26:12.473 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:12.473 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/320155266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":320155266},{"type":"v1","addr":"172.21.15.29:6833","nonce":320155266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3562424943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3562424943},{"type":"v1","addr":"172.21.15.173:6836","nonce":3562424943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2321165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2321165769},{"type":"v1","addr":"172.21.15.173:6837","nonce":2321165769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:25:39.986226+0000","modified":"2023-10-06T05:25:43.642085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3557282345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3557282345},{"type":"v1","addr":"172.21.15.29:6835","nonce":3557282345}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe3c060550 msgr2=0x7fbe3c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe3c060550 0x7fbe3c062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe440093f0 tx=0x7fbe44017000 comp rx=0 tx=0).stop 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 msgr2=0x7fbe500b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 0x7fbe500b51b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c5c0 tx=0x7fbe40007f50 comp rx=0 tx=0).stop 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 shutdown_connections 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe5015bf20 0x7fbe50157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe500cff90 0x7fbe500b51b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe3c060550 0x7fbe3c062a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 --2- 172.21.15.29:0/325747403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe500aeb00 0x7fbe500c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 >> 172.21.15.29:0/325747403 conn(0x7fbe500670a0 msgr2=0x7fbe50158340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 shutdown_connections 2023-10-06T05:26:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.468+0000 7fbe55336700 1 -- 172.21.15.29:0/325747403 wait complete. 2023-10-06T05:26:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-06T05:26:12.488 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:12.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 Processor -- start 2023-10-06T05:26:12.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 -- start start 2023-10-06T05:26:12.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a70158ca0 0x7f2a7006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2a700681c0 0x7f2a7006dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a70068770 con 0x7f2a70159070 2023-10-06T05:26:12.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a700c68b0 con 0x7f2a70158ca0 2023-10-06T05:26:12.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a700c7430 con 0x7f2a700681c0 2023-10-06T05:26:12.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6effd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2a70159070 0x7f2a70067ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60224/0 (socket says 172.21.15.29:60224) 2023-10-06T05:26:12.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6effd700 1 -- 172.21.15.29:0/1129709694 learned_addr learned my addr 172.21.15.29:0/1129709694 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:12.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6f7fe700 1 --2- 172.21.15.29:0/1129709694 >> v2:172.21.15.29:3300/0 conn(0x7f2a70158ca0 0x7f2a7006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6ffff700 1 --2- 172.21.15.29:0/1129709694 >> v2:172.21.15.173:3300/0 conn(0x7f2a700681c0 0x7f2a7006dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6e7fc700 1 -- 172.21.15.29:0/1129709694 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928876827 0 0) 0x7f2a70068770 con 0x7f2a70159070 2023-10-06T05:26:12.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6e7fc700 1 -- 172.21.15.29:0/1129709694 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a58003570 con 0x7f2a70159070 2023-10-06T05:26:12.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6f7fe700 1 -- 172.21.15.29:0/1129709694 >> v2:172.21.15.173:3300/0 conn(0x7f2a700681c0 msgr2=0x7f2a7006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:12.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6f7fe700 1 --2- 172.21.15.29:0/1129709694 >> v2:172.21.15.173:3300/0 conn(0x7f2a700681c0 0x7f2a7006dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6f7fe700 1 -- 172.21.15.29:0/1129709694 >> v1:172.21.15.29:6789/0 conn(0x7f2a70159070 legacy=0x7f2a70067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6f7fe700 1 -- 172.21.15.29:0/1129709694 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a700ac140 con 0x7f2a70158ca0 2023-10-06T05:26:12.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6f7fe700 1 --2- 172.21.15.29:0/1129709694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a70158ca0 0x7f2a7006d6d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a7015db30 tx=0x7f2a60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b80cbc23b88734 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:12.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6e7fc700 1 -- 172.21.15.29:0/1129709694 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000e070 con 0x7f2a70158ca0 2023-10-06T05:26:12.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6e7fc700 1 -- 172.21.15.29:0/1129709694 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6000bab0 con 0x7f2a70158ca0 2023-10-06T05:26:12.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a6e7fc700 1 -- 172.21.15.29:0/1129709694 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000be70 con 0x7f2a70158ca0 2023-10-06T05:26:12.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 -- 172.21.15.29:0/1129709694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a70158ca0 msgr2=0x7f2a7006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 --2- 172.21.15.29:0/1129709694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a70158ca0 0x7f2a7006d6d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a7015db30 tx=0x7f2a60009780 comp rx=0 tx=0).stop 2023-10-06T05:26:12.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 -- 172.21.15.29:0/1129709694 shutdown_connections 2023-10-06T05:26:12.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 --2- 172.21.15.29:0/1129709694 >> v2:172.21.15.173:3300/0 conn(0x7f2a700681c0 0x7f2a7006dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 --2- 172.21.15.29:0/1129709694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a70158ca0 0x7f2a7006d6d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.588+0000 7f2a74c18700 1 -- 172.21.15.29:0/1129709694 >> 172.21.15.29:0/1129709694 conn(0x7f2a7006abc0 msgr2=0x7f2a7006af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:12.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.592+0000 7f2a74c18700 1 -- 172.21.15.29:0/1129709694 shutdown_connections 2023-10-06T05:26:12.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.592+0000 7f2a74c18700 1 -- 172.21.15.29:0/1129709694 wait complete. 2023-10-06T05:26:12.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.592+0000 7f2a74c18700 1 Processor -- start 2023-10-06T05:26:12.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.592+0000 7f2a74c18700 1 -- start start 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a74c18700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a700681c0 0x7f2a701550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a74c18700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a70158ca0 0x7f2a70168610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a74c18700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a70159070 0x7f2a700c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a74c18700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700af910 con 0x7f2a700681c0 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a74c18700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700afbf0 con 0x7f2a70158ca0 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a74c18700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70155920 con 0x7f2a70159070 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a700681c0 0x7f2a701550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a700681c0 0x7f2a701550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35188/0 (socket says 172.21.15.29:35188) 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6f7fe700 1 -- 172.21.15.29:0/2265394319 learned_addr learned my addr 172.21.15.29:0/2265394319 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:12.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6ffff700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a70159070 0x7f2a700c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6effd700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a70158ca0 0x7f2a70168610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6f7fe700 1 -- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a70159070 msgr2=0x7f2a700c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6f7fe700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a70159070 0x7f2a700c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6f7fe700 1 -- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a70158ca0 msgr2=0x7f2a70168610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6f7fe700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a70158ca0 0x7f2a70168610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6f7fe700 1 -- 172.21.15.29:0/2265394319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a60009a20 con 0x7f2a700681c0 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a6f7fe700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a700681c0 0x7f2a701550f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2a7006a550 tx=0x7f2a60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a577fe700 1 -- 172.21.15.29:0/2265394319 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60012bb0 con 0x7f2a700681c0 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a577fe700 1 -- 172.21.15.29:0/2265394319 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a60021070 con 0x7f2a700681c0 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a70155c00 con 0x7f2a700681c0 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a577fe700 1 -- 172.21.15.29:0/2265394319 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60026430 con 0x7f2a700681c0 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a70155630 con 0x7f2a700681c0 2023-10-06T05:26:12.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.596+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a700b2080 con 0x7f2a700681c0 2023-10-06T05:26:12.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.600+0000 7f2a577fe700 1 -- 172.21.15.29:0/2265394319 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2a60023030 con 0x7f2a700681c0 2023-10-06T05:26:12.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.600+0000 7f2a577fe700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a5c060550 0x7f2a5c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.600+0000 7f2a577fe700 1 -- 172.21.15.29:0/2265394319 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2a6007e830 con 0x7f2a700681c0 2023-10-06T05:26:12.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.600+0000 7f2a6effd700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a5c060550 0x7f2a5c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.600+0000 7f2a6effd700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a5c060550 0x7f2a5c062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a70156660 tx=0x7f2a64009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:12.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.604+0000 7f2a577fe700 1 -- 172.21.15.29:0/2265394319 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2a6004ecc0 con 0x7f2a700681c0 2023-10-06T05:26:12.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.772+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a7004be00 con 0x7f2a700681c0 2023-10-06T05:26:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a577fe700 1 -- 172.21.15.29:0/2265394319 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f2a600522e0 con 0x7f2a700681c0 2023-10-06T05:26:12.781 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:12.782 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a5c060550 msgr2=0x7f2a5c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a5c060550 0x7f2a5c062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a70156660 tx=0x7f2a64009040 comp rx=0 tx=0).stop 2023-10-06T05:26:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a700681c0 msgr2=0x7f2a701550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a700681c0 0x7f2a701550f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2a7006a550 tx=0x7f2a60019000 comp rx=0 tx=0).stop 2023-10-06T05:26:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 shutdown_connections 2023-10-06T05:26:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a70159070 0x7f2a700c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a5c060550 0x7f2a5c062a00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a70158ca0 0x7f2a70168610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 --2- 172.21.15.29:0/2265394319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a700681c0 0x7f2a701550f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 >> 172.21.15.29:0/2265394319 conn(0x7f2a7006abc0 msgr2=0x7f2a700ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 shutdown_connections 2023-10-06T05:26:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.776+0000 7f2a74c18700 1 -- 172.21.15.29:0/2265394319 wait complete. 2023-10-06T05:26:12.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:25:38.347316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:25:38.976583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:26:12.796 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:26:12.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f3727062700 1 Processor -- start 2023-10-06T05:26:12.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f3727062700 1 -- start start 2023-10-06T05:26:12.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f3727062700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3720158f10 0x7f37200ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f3727062700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37200cacd0 con 0x7f372006cdd0 2023-10-06T05:26:12.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f3727062700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37200cafb0 con 0x7f372015d730 2023-10-06T05:26:12.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f3727062700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372006a600 con 0x7f3720158f10 2023-10-06T05:26:12.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f3726861700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f372006cdd0 0x7f372006aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60236/0 (socket says 172.21.15.29:60236) 2023-10-06T05:26:12.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f3726861700 1 -- 172.21.15.29:0/3462648736 learned_addr learned my addr 172.21.15.29:0/3462648736 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:12.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f3726060700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3720158f10 0x7f37200ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542645217 0 0) 0x7f37200cacd0 con 0x7f372006cdd0 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f370c003570 con 0x7f372006cdd0 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478871743 0 0) 0x7f37200cafb0 con 0x7f372015d730 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37200cacd0 con 0x7f372015d730 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 457179259 0 0) 0x7f370c003570 con 0x7f372006cdd0 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3720158f10 msgr2=0x7f37200ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3720158f10 0x7f37200ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 >> v1:172.21.15.173:6789/0 conn(0x7f372015d730 legacy=0x7f372006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200cb290 con 0x7f372006cdd0 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.900+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f37180017f0 con 0x7f372006cdd0 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 >> v1:172.21.15.29:6789/0 conn(0x7f372006cdd0 legacy=0x7f372006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3720158f10 0x7f370c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f370c004180 0x7f370c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f370c004d50 0x7f370c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c00bb70 con 0x7f370c004180 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c00bce0 con 0x7f370c004d50 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c00bea0 con 0x7f3720158f10 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372585f700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f370c004180 0x7f370c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3726060700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3720158f10 0x7f370c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3726861700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f370c004d50 0x7f370c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372585f700 1 -- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3720158f10 msgr2=0x7f370c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372585f700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3720158f10 0x7f370c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372585f700 1 -- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f370c004d50 msgr2=0x7f370c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372585f700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f370c004d50 0x7f370c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372585f700 1 -- 172.21.15.29:0/3462648736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c003570 con 0x7f370c004180 2023-10-06T05:26:12.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372585f700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f370c004180 0x7f370c004810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3710001a10 tx=0x7f3710007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61d8b49a2d39754 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:12.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000c5d0 con 0x7f370c004180 2023-10-06T05:26:12.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371000c730 con 0x7f370c004180 2023-10-06T05:26:12.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f372505e700 1 -- 172.21.15.29:0/3462648736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000cad0 con 0x7f370c004180 2023-10-06T05:26:12.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3727062700 1 -- 172.21.15.29:0/3462648736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f370c004180 msgr2=0x7f370c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3727062700 1 --2- 172.21.15.29:0/3462648736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f370c004180 0x7f370c004810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3710001a10 tx=0x7f3710007d30 comp rx=0 tx=0).stop 2023-10-06T05:26:12.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3726861700 1 -- 172.21.15.29:0/3462648736 reap_dead start 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3727062700 1 -- 172.21.15.29:0/3462648736 shutdown_connections 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3727062700 1 -- 172.21.15.29:0/3462648736 >> 172.21.15.29:0/3462648736 conn(0x7f3720062b60 msgr2=0x7f3720062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3727062700 1 -- 172.21.15.29:0/3462648736 shutdown_connections 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3727062700 1 -- 172.21.15.29:0/3462648736 wait complete. 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.904+0000 7f3727062700 1 Processor -- start 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3727062700 1 -- start start 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3727062700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f370c004180 0x7f3720158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3727062700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37200c56f0 0x7f37200b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3727062700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37200c9180 0x7f37200c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3727062700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37200c9b30 con 0x7f37200c9180 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3727062700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3720158b40 con 0x7f370c004180 2023-10-06T05:26:12.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3727062700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37200b3200 con 0x7f37200c56f0 2023-10-06T05:26:12.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726861700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37200c9180 0x7f37200c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726060700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f370c004180 0x7f3720158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726861700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37200c9180 0x7f37200c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35200/0 (socket says 172.21.15.29:35200) 2023-10-06T05:26:12.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f372585f700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37200c56f0 0x7f37200b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726861700 1 -- 172.21.15.29:0/4177546677 learned_addr learned my addr 172.21.15.29:0/4177546677 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:12.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726861700 1 -- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37200c56f0 msgr2=0x7f37200b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726861700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37200c56f0 0x7f37200b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726861700 1 -- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f370c004180 msgr2=0x7f3720158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:12.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726861700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f370c004180 0x7f3720158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:12.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726861700 1 -- 172.21.15.29:0/4177546677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200c5bf0 con 0x7f37200c9180 2023-10-06T05:26:12.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3726861700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37200c9180 0x7f37200c95f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3718000f80 tx=0x7f3718002110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:12.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f37167fc700 1 -- 172.21.15.29:0/4177546677 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371800eb10 con 0x7f37200c9180 2023-10-06T05:26:12.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f37167fc700 1 -- 172.21.15.29:0/4177546677 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371800ec70 con 0x7f37200c9180 2023-10-06T05:26:12.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37200c5ed0 con 0x7f37200c9180 2023-10-06T05:26:12.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f37167fc700 1 -- 172.21.15.29:0/4177546677 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718013420 con 0x7f37200c9180 2023-10-06T05:26:12.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.908+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37200b5b20 con 0x7f37200c9180 2023-10-06T05:26:12.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.912+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37200b2cf0 con 0x7f37200c9180 2023-10-06T05:26:12.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.912+0000 7f37167fc700 1 -- 172.21.15.29:0/4177546677 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f37180137f0 con 0x7f37200c9180 2023-10-06T05:26:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.912+0000 7f37167fc700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060580 0x7f3704062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.912+0000 7f37167fc700 1 -- 172.21.15.29:0/4177546677 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f371807ccc0 con 0x7f37200c9180 2023-10-06T05:26:12.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.912+0000 7f3726060700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060580 0x7f3704062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:12.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.912+0000 7f3726060700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060580 0x7f3704062a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f371c006f00 tx=0x7f371c0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:12.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:12.924+0000 7f37167fc700 1 -- 172.21.15.29:0/4177546677 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f37200b2cf0 con 0x7f37200c9180 2023-10-06T05:26:13.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.084+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37200b2cf0 con 0x7f37200c9180 2023-10-06T05:26:13.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.084+0000 7f37167fc700 1 -- 172.21.15.29:0/4177546677 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37200b2cf0 con 0x7f37200c9180 2023-10-06T05:26:13.091 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:26:13.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.084+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060580 msgr2=0x7f3704062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.084+0000 7f3727062700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060580 0x7f3704062a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f371c006f00 tx=0x7f371c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.084+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37200c9180 msgr2=0x7f37200c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.084+0000 7f3727062700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37200c9180 0x7f37200c95f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3718000f80 tx=0x7f3718002110 comp rx=0 tx=0).stop 2023-10-06T05:26:13.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.088+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 shutdown_connections 2023-10-06T05:26:13.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.088+0000 7f3727062700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37200c9180 0x7f37200c95f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.088+0000 7f3727062700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37200c56f0 0x7f37200b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.088+0000 7f3727062700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060580 0x7f3704062a30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.088+0000 7f3727062700 1 --2- 172.21.15.29:0/4177546677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f370c004180 0x7f3720158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.088+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 >> 172.21.15.29:0/4177546677 conn(0x7f3720062b60 msgr2=0x7f3720062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:13.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.088+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 shutdown_connections 2023-10-06T05:26:13.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.088+0000 7f3727062700 1 -- 172.21.15.29:0/4177546677 wait complete. 2023-10-06T05:26:13.104 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:26:13.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.208+0000 7f81be272700 1 Processor -- start 2023-10-06T05:26:13.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.208+0000 7f81be272700 1 -- start start 2023-10-06T05:26:13.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.208+0000 7f81be272700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80694e0 0x7f81b80698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.208+0000 7f81be272700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b80ae820 con 0x7f81b80ce660 2023-10-06T05:26:13.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.208+0000 7f81be272700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b80cce50 con 0x7f81b80cd2e0 2023-10-06T05:26:13.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.208+0000 7f81be272700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b815b8d0 con 0x7f81b80694e0 2023-10-06T05:26:13.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81bda71700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f81b80ce660 0x7f81b815b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60248/0 (socket says 172.21.15.29:60248) 2023-10-06T05:26:13.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81bda71700 1 -- 172.21.15.29:0/1759262016 learned_addr learned my addr 172.21.15.29:0/1759262016 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:13.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81bd270700 1 --2- 172.21.15.29:0/1759262016 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80694e0 0x7f81b80698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81abfff700 1 -- 172.21.15.29:0/1759262016 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339998654 0 0) 0x7f81b0001490 con 0x7f81b80ce660 2023-10-06T05:26:13.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81abfff700 1 -- 172.21.15.29:0/1759262016 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a4003570 con 0x7f81b80ce660 2023-10-06T05:26:13.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81abfff700 1 -- 172.21.15.29:0/1759262016 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094771118 0 0) 0x7f81b80cce50 con 0x7f81b80cd2e0 2023-10-06T05:26:13.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81abfff700 1 -- 172.21.15.29:0/1759262016 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b0001490 con 0x7f81b80cd2e0 2023-10-06T05:26:13.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81bd270700 1 -- 172.21.15.29:0/1759262016 >> v1:172.21.15.173:6789/0 conn(0x7f81b80cd2e0 legacy=0x7f81b815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81bd270700 1 -- 172.21.15.29:0/1759262016 >> v1:172.21.15.29:6789/0 conn(0x7f81b80ce660 legacy=0x7f81b815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81bd270700 1 -- 172.21.15.29:0/1759262016 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80cc280 con 0x7f81b80694e0 2023-10-06T05:26:13.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81bd270700 1 --2- 172.21.15.29:0/1759262016 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80694e0 0x7f81b80698b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009910 tx=0x7f81b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d52af5829a106c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:13.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81abfff700 1 -- 172.21.15.29:0/1759262016 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4011630 con 0x7f81b80694e0 2023-10-06T05:26:13.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81abfff700 1 -- 172.21.15.29:0/1759262016 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b4011790 con 0x7f81b80694e0 2023-10-06T05:26:13.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81abfff700 1 -- 172.21.15.29:0/1759262016 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4011b30 con 0x7f81b80694e0 2023-10-06T05:26:13.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81be272700 1 -- 172.21.15.29:0/1759262016 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80694e0 msgr2=0x7f81b80698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81be272700 1 --2- 172.21.15.29:0/1759262016 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80694e0 0x7f81b80698b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009910 tx=0x7f81b40091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81be272700 1 -- 172.21.15.29:0/1759262016 shutdown_connections 2023-10-06T05:26:13.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81be272700 1 --2- 172.21.15.29:0/1759262016 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80694e0 0x7f81b80698b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81be272700 1 -- 172.21.15.29:0/1759262016 >> 172.21.15.29:0/1759262016 conn(0x7f81b806d150 msgr2=0x7f81b80cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:13.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81be272700 1 -- 172.21.15.29:0/1759262016 shutdown_connections 2023-10-06T05:26:13.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.212+0000 7f81be272700 1 -- 172.21.15.29:0/1759262016 wait complete. 2023-10-06T05:26:13.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81be272700 1 Processor -- start 2023-10-06T05:26:13.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81be272700 1 -- start start 2023-10-06T05:26:13.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81be272700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81b80694e0 0x7f81b81598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81be272700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80cd2e0 0x7f81b8158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81be272700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81b80ce660 0x7f81b8153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81be272700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8168090 con 0x7f81b80ce660 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81be272700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b81473e0 con 0x7f81b80694e0 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81be272700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8167510 con 0x7f81b80cd2e0 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bda71700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81b80ce660 0x7f81b8153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bda71700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81b80ce660 0x7f81b8153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35204/0 (socket says 172.21.15.29:35204) 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bda71700 1 -- 172.21.15.29:0/4110182900 learned_addr learned my addr 172.21.15.29:0/4110182900 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bca6f700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80cd2e0 0x7f81b8158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bd270700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81b80694e0 0x7f81b81598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bda71700 1 -- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80cd2e0 msgr2=0x7f81b8158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bda71700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80cd2e0 0x7f81b8158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bda71700 1 -- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81b80694e0 msgr2=0x7f81b81598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bda71700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81b80694e0 0x7f81b81598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bda71700 1 -- 172.21.15.29:0/4110182900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b4009420 con 0x7f81b80ce660 2023-10-06T05:26:13.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.216+0000 7f81bca6f700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80cd2e0 0x7f81b8158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:13.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81bda71700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81b80ce660 0x7f81b8153390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f81b000cd60 tx=0x7f81b0001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:13.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81a97fa700 1 -- 172.21.15.29:0/4110182900 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000ab70 con 0x7f81b80ce660 2023-10-06T05:26:13.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81a97fa700 1 -- 172.21.15.29:0/4110182900 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000acf0 con 0x7f81b80ce660 2023-10-06T05:26:13.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b8167850 con 0x7f81b80ce660 2023-10-06T05:26:13.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81a97fa700 1 -- 172.21.15.29:0/4110182900 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0007340 con 0x7f81b80ce660 2023-10-06T05:26:13.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b8159e30 con 0x7f81b80ce660 2023-10-06T05:26:13.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b806d6d0 con 0x7f81b80ce660 2023-10-06T05:26:13.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81a97fa700 1 -- 172.21.15.29:0/4110182900 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f81b00076f0 con 0x7f81b80ce660 2023-10-06T05:26:13.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81a97fa700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f819c060550 0x7f819c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.220+0000 7f81a97fa700 1 -- 172.21.15.29:0/4110182900 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f81b007cd10 con 0x7f81b80ce660 2023-10-06T05:26:13.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.224+0000 7f81bd270700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f819c060550 0x7f819c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.224+0000 7f81bd270700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f819c060550 0x7f819c062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009860 tx=0x7f81b4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:13.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.228+0000 7f81a97fa700 1 -- 172.21.15.29:0/4110182900 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f81b806d6d0 con 0x7f81b80ce660 2023-10-06T05:26:13.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f81b80ae820 con 0x7f81b80ce660 2023-10-06T05:26:13.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81a97fa700 1 -- 172.21.15.29:0/4110182900 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81b80ae820 con 0x7f81b80ce660 2023-10-06T05:26:13.397 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:26:13.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f819c060550 msgr2=0x7f819c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f819c060550 0x7f819c062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009860 tx=0x7f81b4017000 comp rx=0 tx=0).stop 2023-10-06T05:26:13.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81b80ce660 msgr2=0x7f81b8153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81b80ce660 0x7f81b8153390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f81b000cd60 tx=0x7f81b0001bd0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 shutdown_connections 2023-10-06T05:26:13.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81b80ce660 0x7f81b8153390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81b80cd2e0 0x7f81b8158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f819c060550 0x7f819c062a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 --2- 172.21.15.29:0/4110182900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81b80694e0 0x7f81b81598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 >> 172.21.15.29:0/4110182900 conn(0x7f81b806d150 msgr2=0x7f81b80c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:13.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 shutdown_connections 2023-10-06T05:26:13.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.392+0000 7f81be272700 1 -- 172.21.15.29:0/4110182900 wait complete. 2023-10-06T05:26:13.411 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:26:13.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8026ac4700 1 Processor -- start 2023-10-06T05:26:13.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8026ac4700 1 -- start start 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8026ac4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80201569e0 0x7f8020156db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8026ac4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f80200cc200 0x7f80200ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8026ac4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802006b200 con 0x7f80200c6ca0 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8026ac4700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802006a5f0 con 0x7f80200cc200 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8026ac4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802006a8d0 con 0x7f80201569e0 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f80200c6ca0 0x7f80200cbaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60260/0 (socket says 172.21.15.29:60260) 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801ffff700 1 -- 172.21.15.29:0/3186499617 learned_addr learned my addr 172.21.15.29:0/3186499617 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8025061700 1 --2- 172.21.15.29:0/3186499617 >> v2:172.21.15.173:3300/0 conn(0x7f80200cc200 0x7f80200ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8024860700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80201569e0 0x7f8020156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048141916 0 0) 0x7f802006b200 con 0x7f80200c6ca0 2023-10-06T05:26:13.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8008003570 con 0x7f80200c6ca0 2023-10-06T05:26:13.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303037730 0 0) 0x7f8008003570 con 0x7f80200c6ca0 2023-10-06T05:26:13.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80201569e0 msgr2=0x7f8020156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:13.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80201569e0 0x7f8020156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 >> v2:172.21.15.173:3300/0 conn(0x7f80200cc200 msgr2=0x7f80200ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 --2- 172.21.15.29:0/3186499617 >> v2:172.21.15.173:3300/0 conn(0x7f80200cc200 0x7f80200ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802006abb0 con 0x7f80200c6ca0 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f8014001470 con 0x7f80200c6ca0 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 >> v1:172.21.15.29:6789/0 conn(0x7f80200c6ca0 legacy=0x7f80200cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8008003a60 0x7f8008003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80201569e0 0x7f8008004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8008004d50 0x7f80080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802006a5f0 con 0x7f8008004d50 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802006a8d0 con 0x7f8008003a60 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800800ba60 con 0x7f80201569e0 2023-10-06T05:26:13.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8025061700 1 --2- 172.21.15.29:0/3186499617 >> v2:172.21.15.173:3300/0 conn(0x7f80200cc200 0x7f80200ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8024860700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8008003a60 0x7f8008003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f8025061700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8008004d50 0x7f80080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.516+0000 7f801ffff700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80201569e0 0x7f8008004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8025061700 1 -- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80201569e0 msgr2=0x7f8008004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8025061700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80201569e0 0x7f8008004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8025061700 1 -- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8008003a60 msgr2=0x7f8008003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8025061700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8008003a60 0x7f8008003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8025061700 1 -- 172.21.15.29:0/3186499617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008003570 con 0x7f8008004d50 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8025061700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8008004d50 0x7f80080051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80200cc600 tx=0x7f801800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a46db367ab99b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800ebe0 con 0x7f8008004d50 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801800f040 con 0x7f8008004d50 2023-10-06T05:26:13.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f801f7fe700 1 -- 172.21.15.29:0/3186499617 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018014480 con 0x7f8008004d50 2023-10-06T05:26:13.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8026ac4700 1 -- 172.21.15.29:0/3186499617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8008004d50 msgr2=0x7f80080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8026ac4700 1 --2- 172.21.15.29:0/3186499617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8008004d50 0x7f80080051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80200cc600 tx=0x7f801800b040 comp rx=0 tx=0).stop 2023-10-06T05:26:13.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8025061700 1 -- 172.21.15.29:0/3186499617 reap_dead start 2023-10-06T05:26:13.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8026ac4700 1 -- 172.21.15.29:0/3186499617 shutdown_connections 2023-10-06T05:26:13.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8026ac4700 1 -- 172.21.15.29:0/3186499617 >> 172.21.15.29:0/3186499617 conn(0x7f80200670a0 msgr2=0x7f80200674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:13.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8026ac4700 1 -- 172.21.15.29:0/3186499617 shutdown_connections 2023-10-06T05:26:13.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8026ac4700 1 -- 172.21.15.29:0/3186499617 wait complete. 2023-10-06T05:26:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8026ac4700 1 Processor -- start 2023-10-06T05:26:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.520+0000 7f8026ac4700 1 -- start start 2023-10-06T05:26:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8026ac4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f802014f6a0 0x7f80200c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8026ac4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f802014fa70 0x7f80200afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8026ac4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8020152d00 0x7f80200b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8026ac4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80200c4840 con 0x7f802014f6a0 2023-10-06T05:26:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8026ac4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020166c90 con 0x7f802014fa70 2023-10-06T05:26:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8026ac4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8020153200 con 0x7f8020152d00 2023-10-06T05:26:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8024860700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f802014f6a0 0x7f80200c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8024860700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f802014f6a0 0x7f80200c4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35222/0 (socket says 172.21.15.29:35222) 2023-10-06T05:26:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8024860700 1 -- 172.21.15.29:0/3196309780 learned_addr learned my addr 172.21.15.29:0/3196309780 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f801ffff700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f802014fa70 0x7f80200afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8025061700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8020152d00 0x7f80200b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8024860700 1 -- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8020152d00 msgr2=0x7f80200b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8024860700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8020152d00 0x7f80200b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8024860700 1 -- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f802014fa70 msgr2=0x7f80200afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8024860700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f802014fa70 0x7f80200afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8024860700 1 -- 172.21.15.29:0/3196309780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80201534e0 con 0x7f802014f6a0 2023-10-06T05:26:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8024860700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f802014f6a0 0x7f80200c4300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8010006ac0 tx=0x7f80100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f801cff9700 1 -- 172.21.15.29:0/3196309780 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000f940 con 0x7f802014f6a0 2023-10-06T05:26:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f801cff9700 1 -- 172.21.15.29:0/3196309780 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801000faa0 con 0x7f802014f6a0 2023-10-06T05:26:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80201537c0 con 0x7f802014f6a0 2023-10-06T05:26:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f801cff9700 1 -- 172.21.15.29:0/3196309780 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000fe20 con 0x7f802014f6a0 2023-10-06T05:26:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.524+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8020154550 con 0x7f802014f6a0 2023-10-06T05:26:13.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.528+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8020071120 con 0x7f802014f6a0 2023-10-06T05:26:13.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.528+0000 7f801cff9700 1 -- 172.21.15.29:0/3196309780 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8010014650 con 0x7f802014f6a0 2023-10-06T05:26:13.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.528+0000 7f801cff9700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f800c060580 0x7f800c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.528+0000 7f801cff9700 1 -- 172.21.15.29:0/3196309780 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8010018030 con 0x7f802014f6a0 2023-10-06T05:26:13.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.528+0000 7f801ffff700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f800c060580 0x7f800c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.528+0000 7f801ffff700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f800c060580 0x7f800c062a30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8014001120 tx=0x7f8014001e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:13.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.536+0000 7f801cff9700 1 -- 172.21.15.29:0/3196309780 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80100acbe0 con 0x7f802014f6a0 2023-10-06T05:26:13.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f802006ae90 con 0x7f802014f6a0 2023-10-06T05:26:13.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f801cff9700 1 -- 172.21.15.29:0/3196309780 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f801004d680 con 0x7f802014f6a0 2023-10-06T05:26:13.702 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:26:13.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f800c060580 msgr2=0x7f800c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f800c060580 0x7f800c062a30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8014001120 tx=0x7f8014001e90 comp rx=0 tx=0).stop 2023-10-06T05:26:13.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f802014f6a0 msgr2=0x7f80200c4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f802014f6a0 0x7f80200c4300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8010006ac0 tx=0x7f80100091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 shutdown_connections 2023-10-06T05:26:13.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8020152d00 0x7f80200b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f800c060580 0x7f800c062a30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f802014fa70 0x7f80200afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 --2- 172.21.15.29:0/3196309780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f802014f6a0 0x7f80200c4300 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 >> 172.21.15.29:0/3196309780 conn(0x7f80200670a0 msgr2=0x7f80200c2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:13.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 shutdown_connections 2023-10-06T05:26:13.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.696+0000 7f8026ac4700 1 -- 172.21.15.29:0/3196309780 wait complete. 2023-10-06T05:26:13.716 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:26:13.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.820+0000 7f8b5b59e700 1 Processor -- start 2023-10-06T05:26:13.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.820+0000 7f8b5b59e700 1 -- start start 2023-10-06T05:26:13.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.820+0000 7f8b5b59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8b5c0c9fe0 0x7f8b5c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.820+0000 7f8b5b59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5c0c6cc0 con 0x7f8b5c15d3a0 2023-10-06T05:26:13.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.820+0000 7f8b5b59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5c0c63d0 con 0x7f8b5c15cfd0 2023-10-06T05:26:13.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.820+0000 7f8b5b59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c0ca830 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b59d9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8b5c15d3a0 0x7f8b5c0c7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60270/0 (socket says 172.21.15.29:60270) 2023-10-06T05:26:13.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b59d9b700 1 -- 172.21.15.29:0/1112098753 learned_addr learned my addr 172.21.15.29:0/1112098753 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:13.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5ad9d700 1 --2- 172.21.15.29:0/1112098753 >> v2:172.21.15.173:3300/0 conn(0x7f8b5c0c9fe0 0x7f8b5c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5959a700 1 -- 172.21.15.29:0/1112098753 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232596926 0 0) 0x7f8b5c0c6cc0 con 0x7f8b5c15d3a0 2023-10-06T05:26:13.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5959a700 1 -- 172.21.15.29:0/1112098753 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b44003570 con 0x7f8b5c15d3a0 2023-10-06T05:26:13.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5ad9d700 1 -- 172.21.15.29:0/1112098753 >> v1:172.21.15.173:6789/0 conn(0x7f8b5c15cfd0 legacy=0x7f8b5c1616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5ad9d700 1 -- 172.21.15.29:0/1112098753 >> v1:172.21.15.29:6789/0 conn(0x7f8b5c15d3a0 legacy=0x7f8b5c0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5959a700 1 -- 172.21.15.29:0/1112098753 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 589193707 0 0) 0x7f8b44003570 con 0x7f8b5c15d3a0 2023-10-06T05:26:13.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5ad9d700 1 -- 172.21.15.29:0/1112098753 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c0ca550 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5ad9d700 1 --2- 172.21.15.29:0/1112098753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b5c0c9fe0 0x7f8b5c0c81b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009e60 tx=0x7f8b54009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d2fb23e38019c49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:13.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5959a700 1 -- 172.21.15.29:0/1112098753 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400e070 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5959a700 1 -- 172.21.15.29:0/1112098753 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5400b850 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5959a700 1 -- 172.21.15.29:0/1112098753 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c001470 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5b59e700 1 -- 172.21.15.29:0/1112098753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b5c0c9fe0 msgr2=0x7f8b5c0c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5b59e700 1 --2- 172.21.15.29:0/1112098753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b5c0c9fe0 0x7f8b5c0c81b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009e60 tx=0x7f8b54009780 comp rx=0 tx=0).stop 2023-10-06T05:26:13.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5b59e700 1 -- 172.21.15.29:0/1112098753 shutdown_connections 2023-10-06T05:26:13.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5b59e700 1 --2- 172.21.15.29:0/1112098753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b5c0c9fe0 0x7f8b5c0c81b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5b59e700 1 -- 172.21.15.29:0/1112098753 >> 172.21.15.29:0/1112098753 conn(0x7f8b5c06c6c0 msgr2=0x7f8b5c06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:13.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5b59e700 1 -- 172.21.15.29:0/1112098753 shutdown_connections 2023-10-06T05:26:13.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.824+0000 7f8b5b59e700 1 -- 172.21.15.29:0/1112098753 wait complete. 2023-10-06T05:26:13.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5b59e700 1 Processor -- start 2023-10-06T05:26:13.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5b59e700 1 -- start start 2023-10-06T05:26:13.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5c0c9fe0 0x7f8b5c15ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b5c15cfd0 0x7f8b5c0c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5b59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b5c15d3a0 0x7f8b5c0c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0c7860 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5b59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c16e830 con 0x7f8b5c15d3a0 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c159110 con 0x7f8b5c15cfd0 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5c0c9fe0 0x7f8b5c15ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5c0c9fe0 0x7f8b5c15ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35238/0 (socket says 172.21.15.29:35238) 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5a59c700 1 -- 172.21.15.29:0/2280732936 learned_addr learned my addr 172.21.15.29:0/2280732936 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5ad9d700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b5c15d3a0 0x7f8b5c0c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b59d9b700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b5c15cfd0 0x7f8b5c0c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5a59c700 1 -- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b5c15cfd0 msgr2=0x7f8b5c0c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5a59c700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b5c15cfd0 0x7f8b5c0c1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5a59c700 1 -- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b5c15d3a0 msgr2=0x7f8b5c0c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:13.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5a59c700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b5c15d3a0 0x7f8b5c0c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:13.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.828+0000 7f8b5a59c700 1 -- 172.21.15.29:0/2280732936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b54009a20 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.832+0000 7f8b5a59c700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5c0c9fe0 0x7f8b5c15ee40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c590 tx=0x7f8b5000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:13.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.832+0000 7f8b4a7fc700 1 -- 172.21.15.29:0/2280732936 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50011590 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.832+0000 7f8b4a7fc700 1 -- 172.21.15.29:0/2280732936 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b50011710 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.832+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c16dcb0 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.832+0000 7f8b4a7fc700 1 -- 172.21.15.29:0/2280732936 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50011ad0 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.832+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c16e2f0 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.832+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c15d8f0 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.832+0000 7f8b4a7fc700 1 -- 172.21.15.29:0/2280732936 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8b5001b3b0 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.832+0000 7f8b4a7fc700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8b3c060550 0x7f8b3c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:13.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.836+0000 7f8b4a7fc700 1 -- 172.21.15.29:0/2280732936 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8b5007bea0 con 0x7f8b5c0c9fe0 2023-10-06T05:26:13.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.836+0000 7f8b59d9b700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8b3c060550 0x7f8b3c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:13.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.836+0000 7f8b59d9b700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8b3c060550 0x7f8b3c062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c06ad90 tx=0x7f8b4c000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:13.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:13.844+0000 7f8b4a7fc700 1 -- 172.21.15.29:0/2280732936 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8b5c15d8f0 con 0x7f8b5c0c9fe0 2023-10-06T05:26:14.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.008+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b5c15d8f0 con 0x7f8b5c0c9fe0 2023-10-06T05:26:14.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b4a7fc700 1 -- 172.21.15.29:0/2280732936 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b5c15d8f0 con 0x7f8b5c0c9fe0 2023-10-06T05:26:14.017 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:26:14.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8b3c060550 msgr2=0x7f8b3c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8b3c060550 0x7f8b3c062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c06ad90 tx=0x7f8b4c000bc0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5c0c9fe0 msgr2=0x7f8b5c15ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5c0c9fe0 0x7f8b5c15ee40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c590 tx=0x7f8b5000c8a0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 shutdown_connections 2023-10-06T05:26:14.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8b3c060550 0x7f8b3c062a00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b5c15d3a0 0x7f8b5c0c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b5c15cfd0 0x7f8b5c0c1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 --2- 172.21.15.29:0/2280732936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5c0c9fe0 0x7f8b5c15ee40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 >> 172.21.15.29:0/2280732936 conn(0x7f8b5c06c6c0 msgr2=0x7f8b5c06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:14.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 shutdown_connections 2023-10-06T05:26:14.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.012+0000 7f8b5b59e700 1 -- 172.21.15.29:0/2280732936 wait complete. 2023-10-06T05:26:14.031 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:14.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f512100b700 1 Processor -- start 2023-10-06T05:26:14.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f512100b700 1 -- start start 2023-10-06T05:26:14.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f512100b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f511c1569f0 0x7f511c0ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f512100b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c06a5b0 con 0x7f511c156dc0 2023-10-06T05:26:14.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f512100b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c15b0a0 con 0x7f511c0c68b0 2023-10-06T05:26:14.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f512100b700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c15b380 con 0x7f511c1569f0 2023-10-06T05:26:14.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f511c156dc0 0x7f511c15a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60282/0 (socket says 172.21.15.29:60282) 2023-10-06T05:26:14.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511b7fe700 1 -- 172.21.15.29:0/91774592 learned_addr learned my addr 172.21.15.29:0/91774592 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:14.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511bfff700 1 --2- 172.21.15.29:0/91774592 >> v2:172.21.15.173:3300/0 conn(0x7f511c1569f0 0x7f511c0ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698626763 0 0) 0x7f511c06a5b0 con 0x7f511c156dc0 2023-10-06T05:26:14.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5108003570 con 0x7f511c156dc0 2023-10-06T05:26:14.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3539125792 0 0) 0x7f5108003570 con 0x7f511c156dc0 2023-10-06T05:26:14.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 >> v2:172.21.15.173:3300/0 conn(0x7f511c1569f0 msgr2=0x7f511c0ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:14.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 --2- 172.21.15.29:0/91774592 >> v2:172.21.15.173:3300/0 conn(0x7f511c1569f0 0x7f511c0ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 >> v1:172.21.15.173:6789/0 conn(0x7f511c0c68b0 legacy=0x7f511c06aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c15b660 con 0x7f511c156dc0 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f5104001470 con 0x7f511c156dc0 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 >> v1:172.21.15.29:6789/0 conn(0x7f511c156dc0 legacy=0x7f511c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108003a60 0x7f5108003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5108004810 0x7f5108004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51080051c0 0x7f510800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c15b380 con 0x7f5108004810 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510800c0d0 con 0x7f5108003a60 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510800c290 con 0x7f51080051c0 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511b7fe700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5108004810 0x7f5108004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f511bfff700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108003a60 0x7f5108003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.132+0000 7f512080a700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51080051c0 0x7f510800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f511b7fe700 1 -- 172.21.15.29:0/91774592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51080051c0 msgr2=0x7f510800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:14.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f511b7fe700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51080051c0 0x7f510800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f511b7fe700 1 -- 172.21.15.29:0/91774592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108003a60 msgr2=0x7f5108003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:14.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f511b7fe700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108003a60 0x7f5108003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f511b7fe700 1 -- 172.21.15.29:0/91774592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5108003570 con 0x7f5108004810 2023-10-06T05:26:14.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512080a700 1 -- 172.21.15.29:0/91774592 reap_dead start 2023-10-06T05:26:14.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f511b7fe700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5108004810 0x7f5108004c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f510400c3c0 tx=0x7f5104001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160e250c1d0c31be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:14.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400cc50 con 0x7f5108004810 2023-10-06T05:26:14.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510400cdb0 con 0x7f5108004810 2023-10-06T05:26:14.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f511affd700 1 -- 172.21.15.29:0/91774592 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104005b50 con 0x7f5108004810 2023-10-06T05:26:14.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512100b700 1 -- 172.21.15.29:0/91774592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5108004810 msgr2=0x7f5108004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512100b700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5108004810 0x7f5108004c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f510400c3c0 tx=0x7f5104001e50 comp rx=0 tx=0).stop 2023-10-06T05:26:14.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512100b700 1 -- 172.21.15.29:0/91774592 shutdown_connections 2023-10-06T05:26:14.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512100b700 1 --2- 172.21.15.29:0/91774592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5108004810 0x7f5108004c80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512100b700 1 -- 172.21.15.29:0/91774592 >> 172.21.15.29:0/91774592 conn(0x7f511c0670a0 msgr2=0x7f511c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:14.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512100b700 1 -- 172.21.15.29:0/91774592 shutdown_connections 2023-10-06T05:26:14.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512100b700 1 -- 172.21.15.29:0/91774592 wait complete. 2023-10-06T05:26:14.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512100b700 1 Processor -- start 2023-10-06T05:26:14.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.136+0000 7f512100b700 1 -- start start 2023-10-06T05:26:14.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512100b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108004810 0x7f511c167aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512100b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f511c159d80 0x7f511c0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512100b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0ad370 0x7f511c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512100b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c167fe0 con 0x7f511c0ad370 2023-10-06T05:26:14.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512100b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c155c50 con 0x7f5108004810 2023-10-06T05:26:14.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512100b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c1553f0 con 0x7f511c159d80 2023-10-06T05:26:14.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512080a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0ad370 0x7f511c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f511bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108004810 0x7f511c167aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512080a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0ad370 0x7f511c1536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35254/0 (socket says 172.21.15.29:35254) 2023-10-06T05:26:14.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f511bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108004810 0x7f511c167aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:49526/0 (socket says 172.21.15.29:49526) 2023-10-06T05:26:14.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512080a700 1 -- 172.21.15.29:0/814865059 learned_addr learned my addr 172.21.15.29:0/814865059 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:14.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f511b7fe700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f511c159d80 0x7f511c0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512080a700 1 -- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f511c159d80 msgr2=0x7f511c0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512080a700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f511c159d80 0x7f511c0ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512080a700 1 -- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108004810 msgr2=0x7f511c167aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512080a700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108004810 0x7f511c167aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512080a700 1 -- 172.21.15.29:0/814865059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c155690 con 0x7f511c0ad370 2023-10-06T05:26:14.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f511bfff700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108004810 0x7f511c167aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:14.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512080a700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0ad370 0x7f511c1536d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f511c0c8fc0 tx=0x7f5114001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:14.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f5113fff700 1 -- 172.21.15.29:0/814865059 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114006ba0 con 0x7f511c0ad370 2023-10-06T05:26:14.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f5113fff700 1 -- 172.21.15.29:0/814865059 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5114006d00 con 0x7f511c0ad370 2023-10-06T05:26:14.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c155970 con 0x7f511c0ad370 2023-10-06T05:26:14.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f5113fff700 1 -- 172.21.15.29:0/814865059 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511400c7e0 con 0x7f511c0ad370 2023-10-06T05:26:14.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.140+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c153250 con 0x7f511c0ad370 2023-10-06T05:26:14.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.144+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c04be00 con 0x7f511c0ad370 2023-10-06T05:26:14.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.144+0000 7f5113fff700 1 -- 172.21.15.29:0/814865059 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f511400cb50 con 0x7f511c0ad370 2023-10-06T05:26:14.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.144+0000 7f5113fff700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f50fc060550 0x7f50fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.144+0000 7f5113fff700 1 -- 172.21.15.29:0/814865059 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f511407c130 con 0x7f511c0ad370 2023-10-06T05:26:14.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.144+0000 7f511bfff700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f50fc060550 0x7f50fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.148+0000 7f511bfff700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f50fc060550 0x7f50fc062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f510c006f00 tx=0x7f510c0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:14.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.152+0000 7f5113fff700 1 -- 172.21.15.29:0/814865059 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5114050060 con 0x7f511c0ad370 2023-10-06T05:26:14.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.348+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f511c0c8ff0 con 0x7f511c0ad370 2023-10-06T05:26:14.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.348+0000 7f5113fff700 1 -- 172.21.15.29:0/814865059 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f511404fbf0 con 0x7f511c0ad370 2023-10-06T05:26:14.355 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:14.355 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/320155266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":320155266},{"type":"v1","addr":"172.21.15.29:6833","nonce":320155266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3562424943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3562424943},{"type":"v1","addr":"172.21.15.173:6836","nonce":3562424943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2321165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2321165769},{"type":"v1","addr":"172.21.15.173:6837","nonce":2321165769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:25:39.986226+0000","modified":"2023-10-06T05:25:43.642085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3557282345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3557282345},{"type":"v1","addr":"172.21.15.29:6835","nonce":3557282345}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T05:26:14.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f50fc060550 msgr2=0x7f50fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f50fc060550 0x7f50fc062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f510c006f00 tx=0x7f510c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0ad370 msgr2=0x7f511c1536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0ad370 0x7f511c1536d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f511c0c8fc0 tx=0x7f5114001640 comp rx=0 tx=0).stop 2023-10-06T05:26:14.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 shutdown_connections 2023-10-06T05:26:14.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f511c0ad370 0x7f511c1536d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f511c159d80 0x7f511c0ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f50fc060550 0x7f50fc062a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 --2- 172.21.15.29:0/814865059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5108004810 0x7f511c167aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 >> 172.21.15.29:0/814865059 conn(0x7f511c0670a0 msgr2=0x7f511c147170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:14.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 shutdown_connections 2023-10-06T05:26:14.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.352+0000 7f512100b700 1 -- 172.21.15.29:0/814865059 wait complete. 2023-10-06T05:26:14.359 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-06T05:26:14.370 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:14.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.472+0000 7fba9b59e700 1 Processor -- start 2023-10-06T05:26:14.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.472+0000 7fba9b59e700 1 -- start start 2023-10-06T05:26:14.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba9c06c8f0 0x7fba9c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c06ccc0 0x7fba9c0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9c06aef0 con 0x7fba9c0c94a0 2023-10-06T05:26:14.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9c06a2e0 con 0x7fba9c06c8f0 2023-10-06T05:26:14.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c06a5c0 con 0x7fba9c06ccc0 2023-10-06T05:26:14.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9a59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba9c06c8f0 0x7fba9c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9ad9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fba9c0c94a0 0x7fba9c0c9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58126/0 (socket says 172.21.15.29:58126) 2023-10-06T05:26:14.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9ad9d700 1 -- 172.21.15.29:0/3043031017 learned_addr learned my addr 172.21.15.29:0/3043031017 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:14.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba99d9b700 1 --2- 172.21.15.29:0/3043031017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c06ccc0 0x7fba9c0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9a59c700 1 -- 172.21.15.29:0/3043031017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c06ccc0 msgr2=0x7fba9c0c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:14.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9a59c700 1 --2- 172.21.15.29:0/3043031017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c06ccc0 0x7fba9c0c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9a59c700 1 -- 172.21.15.29:0/3043031017 >> v1:172.21.15.29:6789/0 conn(0x7fba9c0c94a0 legacy=0x7fba9c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9a59c700 1 -- 172.21.15.29:0/3043031017 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c06a8a0 con 0x7fba9c06c8f0 2023-10-06T05:26:14.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9a59c700 1 --2- 172.21.15.29:0/3043031017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06c8f0 0x7fba9c06b380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba900098e0 tx=0x7fba900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c499fe8a21c78c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:14.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9959a700 1 -- 172.21.15.29:0/3043031017 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000b640 con 0x7fba9c06c8f0 2023-10-06T05:26:14.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9959a700 1 -- 172.21.15.29:0/3043031017 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9000b7a0 con 0x7fba9c06c8f0 2023-10-06T05:26:14.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9959a700 1 -- 172.21.15.29:0/3043031017 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000bb40 con 0x7fba9c06c8f0 2023-10-06T05:26:14.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 -- 172.21.15.29:0/3043031017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06c8f0 msgr2=0x7fba9c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 --2- 172.21.15.29:0/3043031017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06c8f0 0x7fba9c06b380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba900098e0 tx=0x7fba900091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 -- 172.21.15.29:0/3043031017 shutdown_connections 2023-10-06T05:26:14.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 --2- 172.21.15.29:0/3043031017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c06ccc0 0x7fba9c0c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 --2- 172.21.15.29:0/3043031017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06c8f0 0x7fba9c06b380 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 -- 172.21.15.29:0/3043031017 >> 172.21.15.29:0/3043031017 conn(0x7fba9c0670a0 msgr2=0x7fba9c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:14.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 -- 172.21.15.29:0/3043031017 shutdown_connections 2023-10-06T05:26:14.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.476+0000 7fba9b59e700 1 -- 172.21.15.29:0/3043031017 wait complete. 2023-10-06T05:26:14.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.480+0000 7fba9b59e700 1 Processor -- start 2023-10-06T05:26:14.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.480+0000 7fba9b59e700 1 -- start start 2023-10-06T05:26:14.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9b59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9c06c8f0 0x7fba9c14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06ccc0 0x7fba9c152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c0c94a0 0x7fba9c152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c16a910 con 0x7fba9c06ccc0 2023-10-06T05:26:14.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9b59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c16a5e0 con 0x7fba9c06c8f0 2023-10-06T05:26:14.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c0b07e0 con 0x7fba9c0c94a0 2023-10-06T05:26:14.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba99d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06ccc0 0x7fba9c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba99d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06ccc0 0x7fba9c152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35634/0 (socket says 172.21.15.29:35634) 2023-10-06T05:26:14.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba99d9b700 1 -- 172.21.15.29:0/1536921413 learned_addr learned my addr 172.21.15.29:0/1536921413 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:14.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9a59c700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9c06c8f0 0x7fba9c14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9ad9d700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c0c94a0 0x7fba9c152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba99d9b700 1 -- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c0c94a0 msgr2=0x7fba9c152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba99d9b700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c0c94a0 0x7fba9c152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba99d9b700 1 -- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9c06c8f0 msgr2=0x7fba9c14b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba99d9b700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9c06c8f0 0x7fba9c14b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba99d9b700 1 -- 172.21.15.29:0/1536921413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009420 con 0x7fba9c06ccc0 2023-10-06T05:26:14.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba99d9b700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06ccc0 0x7fba9c152960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009ef0 tx=0x7fba8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:14.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba8a7fc700 1 -- 172.21.15.29:0/1536921413 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00cb70 con 0x7fba9c06ccc0 2023-10-06T05:26:14.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba8a7fc700 1 -- 172.21.15.29:0/1536921413 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c00f040 con 0x7fba9c06ccc0 2023-10-06T05:26:14.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba8a7fc700 1 -- 172.21.15.29:0/1536921413 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c014480 con 0x7fba9c06ccc0 2023-10-06T05:26:14.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c0b0ac0 con 0x7fba9c06ccc0 2023-10-06T05:26:14.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c0b0da0 con 0x7fba9c06ccc0 2023-10-06T05:26:14.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.484+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c04be00 con 0x7fba9c06ccc0 2023-10-06T05:26:14.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.488+0000 7fba8a7fc700 1 -- 172.21.15.29:0/1536921413 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fba8c0147f0 con 0x7fba9c06ccc0 2023-10-06T05:26:14.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.488+0000 7fba8a7fc700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba7c060550 0x7fba7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.488+0000 7fba8a7fc700 1 -- 172.21.15.29:0/1536921413 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fba8c07d570 con 0x7fba9c06ccc0 2023-10-06T05:26:14.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.488+0000 7fba9a59c700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba7c060550 0x7fba7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.488+0000 7fba9a59c700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba7c060550 0x7fba7c062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fba900093f0 tx=0x7fba90017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:14.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.492+0000 7fba8a7fc700 1 -- 172.21.15.29:0/1536921413 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fba8c04d960 con 0x7fba9c06ccc0 2023-10-06T05:26:14.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.656+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba9c06ab80 con 0x7fba9c06ccc0 2023-10-06T05:26:14.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba8a7fc700 1 -- 172.21.15.29:0/1536921413 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fba8c050f80 con 0x7fba9c06ccc0 2023-10-06T05:26:14.664 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:14.665 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:14.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba7c060550 msgr2=0x7fba7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba7c060550 0x7fba7c062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fba900093f0 tx=0x7fba90017000 comp rx=0 tx=0).stop 2023-10-06T05:26:14.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06ccc0 msgr2=0x7fba9c152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06ccc0 0x7fba9c152960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009ef0 tx=0x7fba8c00b040 comp rx=0 tx=0).stop 2023-10-06T05:26:14.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 shutdown_connections 2023-10-06T05:26:14.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9c0c94a0 0x7fba9c152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba9c06ccc0 0x7fba9c152960 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba7c060550 0x7fba7c062a00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 --2- 172.21.15.29:0/1536921413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba9c06c8f0 0x7fba9c14b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 >> 172.21.15.29:0/1536921413 conn(0x7fba9c0670a0 msgr2=0x7fba9c159780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:14.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 shutdown_connections 2023-10-06T05:26:14.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.660+0000 7fba9b59e700 1 -- 172.21.15.29:0/1536921413 wait complete. 2023-10-06T05:26:14.680 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T05:26:14.680 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:14.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4dce3c700 1 Processor -- start 2023-10-06T05:26:14.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4dce3c700 1 -- start start 2023-10-06T05:26:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4dce3c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4d81569f0 0x7fc4d80ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4dce3c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 0x7fc4d815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4dce3c700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d806a5b0 con 0x7fc4d80c68b0 2023-10-06T05:26:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4dce3c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d815b0a0 con 0x7fc4d81569f0 2023-10-06T05:26:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4dce3c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d815b380 con 0x7fc4d8156dc0 2023-10-06T05:26:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4d81569f0 0x7fc4d80ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4d81569f0 0x7fc4d80ab220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35638/0 (socket says 172.21.15.29:35638) 2023-10-06T05:26:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d77fe700 1 -- 172.21.15.29:0/166417490 learned_addr learned my addr 172.21.15.29:0/166417490 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4ceffd700 1 --2- 172.21.15.29:0/166417490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 0x7fc4d815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d77fe700 1 -- 172.21.15.29:0/166417490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 msgr2=0x7fc4d815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d77fe700 1 --2- 172.21.15.29:0/166417490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 0x7fc4d815a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d77fe700 1 -- 172.21.15.29:0/166417490 >> v1:172.21.15.173:6789/0 conn(0x7fc4d80c68b0 legacy=0x7fc4d806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d77fe700 1 -- 172.21.15.29:0/166417490 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d815b660 con 0x7fc4d81569f0 2023-10-06T05:26:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4ceffd700 1 --2- 172.21.15.29:0/166417490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 0x7fc4d815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d77fe700 1 --2- 172.21.15.29:0/166417490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d81569f0 0x7fc4d80ab220 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80099b0 tx=0x7fc4c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b269af15a7424e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:14.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d6ffd700 1 -- 172.21.15.29:0/166417490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800b860 con 0x7fc4d81569f0 2023-10-06T05:26:14.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d6ffd700 1 -- 172.21.15.29:0/166417490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c800b9c0 con 0x7fc4d81569f0 2023-10-06T05:26:14.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.784+0000 7fc4d6ffd700 1 -- 172.21.15.29:0/166417490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800bd60 con 0x7fc4d81569f0 2023-10-06T05:26:14.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 -- 172.21.15.29:0/166417490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d81569f0 msgr2=0x7fc4d80ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 --2- 172.21.15.29:0/166417490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d81569f0 0x7fc4d80ab220 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80099b0 tx=0x7fc4c8009250 comp rx=0 tx=0).stop 2023-10-06T05:26:14.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 -- 172.21.15.29:0/166417490 shutdown_connections 2023-10-06T05:26:14.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 --2- 172.21.15.29:0/166417490 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 0x7fc4d815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 --2- 172.21.15.29:0/166417490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d81569f0 0x7fc4d80ab220 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 -- 172.21.15.29:0/166417490 >> 172.21.15.29:0/166417490 conn(0x7fc4d80670a0 msgr2=0x7fc4d80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:14.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 -- 172.21.15.29:0/166417490 shutdown_connections 2023-10-06T05:26:14.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 -- 172.21.15.29:0/166417490 wait complete. 2023-10-06T05:26:14.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 Processor -- start 2023-10-06T05:26:14.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 -- start start 2023-10-06T05:26:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4d80c68b0 0x7fc4d8168980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d81569f0 0x7fc4d80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 0x7fc4d816c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d81679b0 con 0x7fc4d81569f0 2023-10-06T05:26:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d81684f0 con 0x7fc4d80c68b0 2023-10-06T05:26:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4dce3c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d8168ec0 con 0x7fc4d8156dc0 2023-10-06T05:26:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4ceffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d81569f0 0x7fc4d80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4d77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4d80c68b0 0x7fc4d8168980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4d77fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4d80c68b0 0x7fc4d8168980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:53202/0 (socket says 172.21.15.29:53202) 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.788+0000 7fc4d77fe700 1 -- 172.21.15.29:0/2030716321 learned_addr learned my addr 172.21.15.29:0/2030716321 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4d7fff700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 0x7fc4d816c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4d77fe700 1 -- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 msgr2=0x7fc4d816c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4d77fe700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 0x7fc4d816c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4d77fe700 1 -- 172.21.15.29:0/2030716321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d81569f0 msgr2=0x7fc4d80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4d77fe700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d81569f0 0x7fc4d80cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4d77fe700 1 -- 172.21.15.29:0/2030716321 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80094f0 con 0x7fc4d80c68b0 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4d77fe700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4d80c68b0 0x7fc4d8168980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009290 tx=0x7fc4c8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4cffff700 1 -- 172.21.15.29:0/2030716321 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8011e00 con 0x7fc4d80c68b0 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4cffff700 1 -- 172.21.15.29:0/2030716321 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c801f070 con 0x7fc4d80c68b0 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d8167bc0 con 0x7fc4d80c68b0 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4cffff700 1 -- 172.21.15.29:0/2030716321 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80266d0 con 0x7fc4d80c68b0 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d8168180 con 0x7fc4d80c68b0 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d804be00 con 0x7fc4d80c68b0 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.792+0000 7fc4cffff700 1 -- 172.21.15.29:0/2030716321 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc4c8026a40 con 0x7fc4d80c68b0 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.796+0000 7fc4cffff700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc4b8060580 0x7fc4b8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.796+0000 7fc4cffff700 1 -- 172.21.15.29:0/2030716321 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc4c8021070 con 0x7fc4d80c68b0 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.796+0000 7fc4ceffd700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc4b8060580 0x7fc4b8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.796+0000 7fc4ceffd700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc4b8060580 0x7fc4b8062a30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc4d806ba20 tx=0x7fc4c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:14.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.804+0000 7fc4cffff700 1 -- 172.21.15.29:0/2030716321 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc4c804ed70 con 0x7fc4d80c68b0 2023-10-06T05:26:15.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:14.996+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4d80c8ff0 con 0x7fc4d80c68b0 2023-10-06T05:26:15.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4cffff700 1 -- 172.21.15.29:0/2030716321 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fc4c8015090 con 0x7fc4d80c68b0 2023-10-06T05:26:15.005 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:15.005 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/320155266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":320155266},{"type":"v1","addr":"172.21.15.29:6833","nonce":320155266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3562424943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3562424943},{"type":"v1","addr":"172.21.15.173:6836","nonce":3562424943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2321165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2321165769},{"type":"v1","addr":"172.21.15.173:6837","nonce":2321165769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:25:39.986226+0000","modified":"2023-10-06T05:25:43.642085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3557282345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3557282345},{"type":"v1","addr":"172.21.15.29:6835","nonce":3557282345}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T05:26:15.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc4b8060580 msgr2=0x7fc4b8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc4b8060580 0x7fc4b8062a30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc4d806ba20 tx=0x7fc4c0008040 comp rx=0 tx=0).stop 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4d80c68b0 msgr2=0x7fc4d8168980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4d80c68b0 0x7fc4d8168980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009290 tx=0x7fc4c8017000 comp rx=0 tx=0).stop 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 shutdown_connections 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4d8156dc0 0x7fc4d816c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4d81569f0 0x7fc4d80cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc4b8060580 0x7fc4b8062a30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 --2- 172.21.15.29:0/2030716321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4d80c68b0 0x7fc4d8168980 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 >> 172.21.15.29:0/2030716321 conn(0x7fc4d80670a0 msgr2=0x7fc4d80c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:15.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 shutdown_connections 2023-10-06T05:26:15.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.000+0000 7fc4dce3c700 1 -- 172.21.15.29:0/2030716321 wait complete. 2023-10-06T05:26:15.009 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-06T05:26:15.021 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:15.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46c5202700 1 Processor -- start 2023-10-06T05:26:15.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46c5202700 1 -- start start 2023-10-06T05:26:15.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46c5202700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46c0158c00 0x7f46c006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46c5202700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c006b250 con 0x7f46c00ce740 2023-10-06T05:26:15.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46c5202700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c006a640 con 0x7f46c00cebc0 2023-10-06T05:26:15.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46c5202700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c006a920 con 0x7f46c0158c00 2023-10-06T05:26:15.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46bffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46c0158c00 0x7f46c006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46bf7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f46c00ce740 0x7f46c00cfb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58134/0 (socket says 172.21.15.29:58134) 2023-10-06T05:26:15.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46bf7fe700 1 -- 172.21.15.29:0/214153222 learned_addr learned my addr 172.21.15.29:0/214153222 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:15.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46beffd700 1 -- 172.21.15.29:0/214153222 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407262449 0 0) 0x7f46c006b250 con 0x7f46c00ce740 2023-10-06T05:26:15.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46bffff700 1 -- 172.21.15.29:0/214153222 >> v1:172.21.15.173:6789/0 conn(0x7f46c00cebc0 legacy=0x7f46c015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46bffff700 1 -- 172.21.15.29:0/214153222 >> v1:172.21.15.29:6789/0 conn(0x7f46c00ce740 legacy=0x7f46c00cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46bffff700 1 -- 172.21.15.29:0/214153222 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c006ac00 con 0x7f46c0158c00 2023-10-06T05:26:15.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46bffff700 1 --2- 172.21.15.29:0/214153222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 0x7f46c006b6e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009e60 tx=0x7f46b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac78261d5643373 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:15.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46beffd700 1 -- 172.21.15.29:0/214153222 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000e070 con 0x7f46c0158c00 2023-10-06T05:26:15.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46beffd700 1 -- 172.21.15.29:0/214153222 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b000bc30 con 0x7f46c0158c00 2023-10-06T05:26:15.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.120+0000 7f46beffd700 1 -- 172.21.15.29:0/214153222 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0012430 con 0x7f46c0158c00 2023-10-06T05:26:15.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.124+0000 7f46c5202700 1 -- 172.21.15.29:0/214153222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 msgr2=0x7f46c006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.124+0000 7f46c5202700 1 --2- 172.21.15.29:0/214153222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 0x7f46c006b6e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009e60 tx=0x7f46b0009780 comp rx=0 tx=0).stop 2023-10-06T05:26:15.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.124+0000 7f46c5202700 1 -- 172.21.15.29:0/214153222 shutdown_connections 2023-10-06T05:26:15.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.124+0000 7f46c5202700 1 --2- 172.21.15.29:0/214153222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 0x7f46c006b6e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.124+0000 7f46c5202700 1 -- 172.21.15.29:0/214153222 >> 172.21.15.29:0/214153222 conn(0x7f46c00670a0 msgr2=0x7f46c0067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:15.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.124+0000 7f46c5202700 1 -- 172.21.15.29:0/214153222 shutdown_connections 2023-10-06T05:26:15.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.124+0000 7f46c5202700 1 -- 172.21.15.29:0/214153222 wait complete. 2023-10-06T05:26:15.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.124+0000 7f46c5202700 1 Processor -- start 2023-10-06T05:26:15.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.124+0000 7f46c5202700 1 -- start start 2023-10-06T05:26:15.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c5202700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46c00ce740 0x7f46c00c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c5202700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cebc0 0x7f46c00c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c5202700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 0x7f46c0150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c5202700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0151880 con 0x7f46c0158c00 2023-10-06T05:26:15.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c5202700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00b3a60 con 0x7f46c00cebc0 2023-10-06T05:26:15.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c5202700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00b3d40 con 0x7f46c00ce740 2023-10-06T05:26:15.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c4a01700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 0x7f46c0150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c4a01700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 0x7f46c0150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35652/0 (socket says 172.21.15.29:35652) 2023-10-06T05:26:15.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c4a01700 1 -- 172.21.15.29:0/3334632271 learned_addr learned my addr 172.21.15.29:0/3334632271 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46bf7fe700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cebc0 0x7f46c00c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46bffff700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46c00ce740 0x7f46c00c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c4a01700 1 -- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46c00ce740 msgr2=0x7f46c00c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c4a01700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46c00ce740 0x7f46c00c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c4a01700 1 -- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cebc0 msgr2=0x7f46c00c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c4a01700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cebc0 0x7f46c00c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c4a01700 1 -- 172.21.15.29:0/3334632271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0009a20 con 0x7f46c0158c00 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46bf7fe700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cebc0 0x7f46c00c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c4a01700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 0x7f46c0150600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c590 tx=0x7f46b8007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46a7fff700 1 -- 172.21.15.29:0/3334632271 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8011590 con 0x7f46c0158c00 2023-10-06T05:26:15.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46a7fff700 1 -- 172.21.15.29:0/3334632271 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b80116f0 con 0x7f46c0158c00 2023-10-06T05:26:15.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c0151230 con 0x7f46c0158c00 2023-10-06T05:26:15.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46a7fff700 1 -- 172.21.15.29:0/3334632271 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8011ab0 con 0x7f46c0158c00 2023-10-06T05:26:15.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c00c99f0 con 0x7f46c0158c00 2023-10-06T05:26:15.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c00c9c10 con 0x7f46c0158c00 2023-10-06T05:26:15.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.128+0000 7f46a7fff700 1 -- 172.21.15.29:0/3334632271 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f46b801b3b0 con 0x7f46c0158c00 2023-10-06T05:26:15.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.132+0000 7f46a7fff700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f46ac060580 0x7f46ac062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.132+0000 7f46a7fff700 1 -- 172.21.15.29:0/3334632271 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46b807be80 con 0x7f46c0158c00 2023-10-06T05:26:15.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.132+0000 7f46bffff700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f46ac060580 0x7f46ac062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.132+0000 7f46bffff700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f46ac060580 0x7f46ac062a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009e60 tx=0x7f46b0019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:15.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.140+0000 7f46a7fff700 1 -- 172.21.15.29:0/3334632271 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f46b804c270 con 0x7f46c0158c00 2023-10-06T05:26:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.328+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46c004be00 con 0x7f46c0158c00 2023-10-06T05:26:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46a7fff700 1 -- 172.21.15.29:0/3334632271 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f46b8017020 con 0x7f46c0158c00 2023-10-06T05:26:15.338 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:15.338 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/320155266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":320155266},{"type":"v1","addr":"172.21.15.29:6833","nonce":320155266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3562424943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3562424943},{"type":"v1","addr":"172.21.15.173:6836","nonce":3562424943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2321165769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":2321165769},{"type":"v1","addr":"172.21.15.173:6837","nonce":2321165769}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:25:39.986226+0000","modified":"2023-10-06T05:25:43.642085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3557282345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3557282345},{"type":"v1","addr":"172.21.15.29:6835","nonce":3557282345}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T05:26:15.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f46ac060580 msgr2=0x7f46ac062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f46ac060580 0x7f46ac062a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009e60 tx=0x7f46b0019000 comp rx=0 tx=0).stop 2023-10-06T05:26:15.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 msgr2=0x7f46c0150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 0x7f46c0150600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c590 tx=0x7f46b8007ec0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 shutdown_connections 2023-10-06T05:26:15.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46c0158c00 0x7f46c0150600 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f46ac060580 0x7f46ac062a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c00cebc0 0x7f46c00c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 --2- 172.21.15.29:0/3334632271 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46c00ce740 0x7f46c00c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 >> 172.21.15.29:0/3334632271 conn(0x7f46c00670a0 msgr2=0x7f46c00c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:15.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 shutdown_connections 2023-10-06T05:26:15.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.332+0000 7f46c5202700 1 -- 172.21.15.29:0/3334632271 wait complete. 2023-10-06T05:26:15.341 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2023-10-06T05:26:15.351 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:15.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.452+0000 7f6f1092d700 1 Processor -- start 2023-10-06T05:26:15.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.452+0000 7f6f1092d700 1 -- start start 2023-10-06T05:26:15.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.452+0000 7f6f1092d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c158c00 0x7f6f0c06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.452+0000 7f6f1092d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c06b250 con 0x7f6f0c0ceb90 2023-10-06T05:26:15.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.452+0000 7f6f1092d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c06a640 con 0x7f6f0c0ce740 2023-10-06T05:26:15.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.452+0000 7f6f1092d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c06a920 con 0x7f6f0c158c00 2023-10-06T05:26:15.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.452+0000 7f6f0b59e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6f0c0ceb90 0x7f6f0c15a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58142/0 (socket says 172.21.15.29:58142) 2023-10-06T05:26:15.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.452+0000 7f6f0b59e700 1 -- 172.21.15.29:0/3488302458 learned_addr learned my addr 172.21.15.29:0/3488302458 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:15.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0ad9d700 1 --2- 172.21.15.29:0/3488302458 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c158c00 0x7f6f0c06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0a59c700 1 -- 172.21.15.29:0/3488302458 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254598110 0 0) 0x7f6f0c06b250 con 0x7f6f0c0ceb90 2023-10-06T05:26:15.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0a59c700 1 -- 172.21.15.29:0/3488302458 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef8003570 con 0x7f6f0c0ceb90 2023-10-06T05:26:15.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0a59c700 1 -- 172.21.15.29:0/3488302458 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778887717 0 0) 0x7f6f0c06a640 con 0x7f6f0c0ce740 2023-10-06T05:26:15.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0a59c700 1 -- 172.21.15.29:0/3488302458 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f0c06b250 con 0x7f6f0c0ce740 2023-10-06T05:26:15.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0ad9d700 1 -- 172.21.15.29:0/3488302458 >> v1:172.21.15.173:6789/0 conn(0x7f6f0c0ce740 legacy=0x7f6f0c0cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0ad9d700 1 -- 172.21.15.29:0/3488302458 >> v1:172.21.15.29:6789/0 conn(0x7f6f0c0ceb90 legacy=0x7f6f0c15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0ad9d700 1 -- 172.21.15.29:0/3488302458 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c06ac00 con 0x7f6f0c158c00 2023-10-06T05:26:15.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0ad9d700 1 --2- 172.21.15.29:0/3488302458 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c158c00 0x7f6f0c06b6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009910 tx=0x7f6efc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1575dc9103f04c94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:15.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0a59c700 1 -- 172.21.15.29:0/3488302458 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc011630 con 0x7f6f0c158c00 2023-10-06T05:26:15.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0a59c700 1 -- 172.21.15.29:0/3488302458 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc011790 con 0x7f6f0c158c00 2023-10-06T05:26:15.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f0a59c700 1 -- 172.21.15.29:0/3488302458 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc011b10 con 0x7f6f0c158c00 2023-10-06T05:26:15.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f1092d700 1 -- 172.21.15.29:0/3488302458 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c158c00 msgr2=0x7f6f0c06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f1092d700 1 --2- 172.21.15.29:0/3488302458 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c158c00 0x7f6f0c06b6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009910 tx=0x7f6efc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f1092d700 1 -- 172.21.15.29:0/3488302458 shutdown_connections 2023-10-06T05:26:15.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f1092d700 1 --2- 172.21.15.29:0/3488302458 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c158c00 0x7f6f0c06b6e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f1092d700 1 -- 172.21.15.29:0/3488302458 >> 172.21.15.29:0/3488302458 conn(0x7f6f0c0670a0 msgr2=0x7f6f0c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:15.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f1092d700 1 -- 172.21.15.29:0/3488302458 shutdown_connections 2023-10-06T05:26:15.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.456+0000 7f6f1092d700 1 -- 172.21.15.29:0/3488302458 wait complete. 2023-10-06T05:26:15.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 Processor -- start 2023-10-06T05:26:15.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 -- start start 2023-10-06T05:26:15.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f0c0ce740 0x7f6f0c1693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c0ceb90 0x7f6f0c15d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c158c00 0x7f6f0c15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c14b170 con 0x7f6f0c158c00 2023-10-06T05:26:15.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c15cc90 con 0x7f6f0c0ce740 2023-10-06T05:26:15.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c169920 con 0x7f6f0c0ceb90 2023-10-06T05:26:15.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c158c00 0x7f6f0c15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0ad9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f0c0ce740 0x7f6f0c1693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c158c00 0x7f6f0c15b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35658/0 (socket says 172.21.15.29:35658) 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f03fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c0ceb90 0x7f6f0c15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0ad9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f0c0ce740 0x7f6f0c1693e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:53218/0 (socket says 172.21.15.29:53218) 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0b59e700 1 -- 172.21.15.29:0/3438403099 learned_addr learned my addr 172.21.15.29:0/3438403099 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0b59e700 1 -- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c0ceb90 msgr2=0x7f6f0c15d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0b59e700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c0ceb90 0x7f6f0c15d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0b59e700 1 -- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f0c0ce740 msgr2=0x7f6f0c1693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0b59e700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f0c0ce740 0x7f6f0c1693e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0b59e700 1 -- 172.21.15.29:0/3438403099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc009420 con 0x7f6f0c158c00 2023-10-06T05:26:15.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f0b59e700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c158c00 0x7f6f0c15b180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f04001460 tx=0x7f6f04001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:15.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f02ffd700 1 -- 172.21.15.29:0/3438403099 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0400a8b0 con 0x7f6f0c158c00 2023-10-06T05:26:15.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f02ffd700 1 -- 172.21.15.29:0/3438403099 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0400aa10 con 0x7f6f0c158c00 2023-10-06T05:26:15.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0c150a90 con 0x7f6f0c158c00 2023-10-06T05:26:15.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f02ffd700 1 -- 172.21.15.29:0/3438403099 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0400add0 con 0x7f6f0c158c00 2023-10-06T05:26:15.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.460+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0c0b5a20 con 0x7f6f0c158c00 2023-10-06T05:26:15.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.464+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0c06b7f0 con 0x7f6f0c158c00 2023-10-06T05:26:15.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.464+0000 7f6f02ffd700 1 -- 172.21.15.29:0/3438403099 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6f04007300 con 0x7f6f0c158c00 2023-10-06T05:26:15.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.464+0000 7f6f02ffd700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6eec060550 0x7f6eec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.464+0000 7f6f02ffd700 1 -- 172.21.15.29:0/3438403099 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f0407d4f0 con 0x7f6f0c158c00 2023-10-06T05:26:15.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.464+0000 7f6f0ad9d700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6eec060550 0x7f6eec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.468+0000 7f6f0ad9d700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6eec060550 0x7f6eec062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0091e0 tx=0x7f6efc017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:15.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.472+0000 7f6f02ffd700 1 -- 172.21.15.29:0/3438403099 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6f0404dae0 con 0x7f6f0c158c00 2023-10-06T05:26:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.636+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f0c06b7f0 con 0x7f6f0c158c00 2023-10-06T05:26:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.636+0000 7f6f02ffd700 1 -- 172.21.15.29:0/3438403099 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f6f0c06b7f0 con 0x7f6f0c158c00 2023-10-06T05:26:15.644 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:25:41.643713+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:25:38.347316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T05:25:38.976583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6eec060550 msgr2=0x7f6eec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6eec060550 0x7f6eec062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0091e0 tx=0x7f6efc017000 comp rx=0 tx=0).stop 2023-10-06T05:26:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c158c00 msgr2=0x7f6f0c15b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c158c00 0x7f6f0c15b180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f04001460 tx=0x7f6f04001aa0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 shutdown_connections 2023-10-06T05:26:15.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c158c00 0x7f6f0c15b180 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f0c0ceb90 0x7f6f0c15d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6eec060550 0x7f6eec062a00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 --2- 172.21.15.29:0/3438403099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f0c0ce740 0x7f6f0c1693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 >> 172.21.15.29:0/3438403099 conn(0x7f6f0c0670a0 msgr2=0x7f6f0c158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:15.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 shutdown_connections 2023-10-06T05:26:15.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.640+0000 7f6f1092d700 1 -- 172.21.15.29:0/3438403099 wait complete. 2023-10-06T05:26:15.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T05:26:15.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.760+0000 7f3333fff700 1 Processor -- start 2023-10-06T05:26:15.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.760+0000 7f3333fff700 1 -- start start 2023-10-06T05:26:15.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f33341590b0 0x7f33340aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f33340ce7f0 0x7f33340af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33340c9420 con 0x7f33340c81b0 2023-10-06T05:26:15.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3334159480 con 0x7f33341590b0 2023-10-06T05:26:15.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33340c9700 con 0x7f33340ce7f0 2023-10-06T05:26:15.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3332ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f33341590b0 0x7f33340aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3332ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f33341590b0 0x7f33340aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35664/0 (socket says 172.21.15.29:35664) 2023-10-06T05:26:15.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3332ffd700 1 -- 172.21.15.29:0/2482940404 learned_addr learned my addr 172.21.15.29:0/2482940404 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:15.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f33327fc700 1 --2- 172.21.15.29:0/2482940404 >> v2:172.21.15.173:3300/0 conn(0x7f33340ce7f0 0x7f33340af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3332ffd700 1 -- 172.21.15.29:0/2482940404 >> v2:172.21.15.173:3300/0 conn(0x7f33340ce7f0 msgr2=0x7f33340af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:15.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3332ffd700 1 --2- 172.21.15.29:0/2482940404 >> v2:172.21.15.173:3300/0 conn(0x7f33340ce7f0 0x7f33340af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3332ffd700 1 -- 172.21.15.29:0/2482940404 >> v1:172.21.15.173:6789/0 conn(0x7f33340c81b0 legacy=0x7f333415cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3332ffd700 1 -- 172.21.15.29:0/2482940404 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340c99e0 con 0x7f33341590b0 2023-10-06T05:26:15.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3332ffd700 1 --2- 172.21.15.29:0/2482940404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33341590b0 0x7f33340aed70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f333406da00 tx=0x7f3324009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d780e8bf46300 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:15.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3331ffb700 1 -- 172.21.15.29:0/2482940404 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324009e70 con 0x7f33341590b0 2023-10-06T05:26:15.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3331ffb700 1 -- 172.21.15.29:0/2482940404 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400b860 con 0x7f33341590b0 2023-10-06T05:26:15.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3331ffb700 1 -- 172.21.15.29:0/2482940404 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400bc20 con 0x7f33341590b0 2023-10-06T05:26:15.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 -- 172.21.15.29:0/2482940404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33341590b0 msgr2=0x7f33340aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 --2- 172.21.15.29:0/2482940404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33341590b0 0x7f33340aed70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f333406da00 tx=0x7f3324009250 comp rx=0 tx=0).stop 2023-10-06T05:26:15.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 -- 172.21.15.29:0/2482940404 shutdown_connections 2023-10-06T05:26:15.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 --2- 172.21.15.29:0/2482940404 >> v2:172.21.15.173:3300/0 conn(0x7f33340ce7f0 0x7f33340af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 --2- 172.21.15.29:0/2482940404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33341590b0 0x7f33340aed70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 -- 172.21.15.29:0/2482940404 >> 172.21.15.29:0/2482940404 conn(0x7f333406d190 msgr2=0x7f33340cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:15.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 -- 172.21.15.29:0/2482940404 shutdown_connections 2023-10-06T05:26:15.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.764+0000 7f3333fff700 1 -- 172.21.15.29:0/2482940404 wait complete. 2023-10-06T05:26:15.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 Processor -- start 2023-10-06T05:26:15.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 -- start start 2023-10-06T05:26:15.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33340c81b0 0x7f3334169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33340ce7f0 0x7f33340c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33341590b0 0x7f3334157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333416a4a0 con 0x7f33340c81b0 2023-10-06T05:26:15.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340c25b0 con 0x7f33341590b0 2023-10-06T05:26:15.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33340c19a0 con 0x7f33340ce7f0 2023-10-06T05:26:15.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3332ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33340c81b0 0x7f3334169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3332ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33340c81b0 0x7f3334169f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35678/0 (socket says 172.21.15.29:35678) 2023-10-06T05:26:15.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3332ffd700 1 -- 172.21.15.29:0/1382608869 learned_addr learned my addr 172.21.15.29:0/1382608869 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:15.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f33337fe700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33341590b0 0x7f3334157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f33327fc700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33340ce7f0 0x7f33340c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3332ffd700 1 -- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33340ce7f0 msgr2=0x7f33340c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3332ffd700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33340ce7f0 0x7f33340c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3332ffd700 1 -- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33341590b0 msgr2=0x7f3334157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3332ffd700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33341590b0 0x7f3334157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3332ffd700 1 -- 172.21.15.29:0/1382608869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240094f0 con 0x7f33340c81b0 2023-10-06T05:26:15.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f33337fe700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33341590b0 0x7f3334157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:15.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3332ffd700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33340c81b0 0x7f3334169f60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f333406ed90 tx=0x7f3324017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:15.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f332affd700 1 -- 172.21.15.29:0/1382608869 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332401f070 con 0x7f33340c81b0 2023-10-06T05:26:15.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f332affd700 1 -- 172.21.15.29:0/1382608869 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324002f30 con 0x7f33340c81b0 2023-10-06T05:26:15.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f332affd700 1 -- 172.21.15.29:0/1382608869 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400b9d0 con 0x7f33340c81b0 2023-10-06T05:26:15.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33340c1c80 con 0x7f33340c81b0 2023-10-06T05:26:15.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.768+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33340c2240 con 0x7f33340c81b0 2023-10-06T05:26:15.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.772+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333404be00 con 0x7f33340c81b0 2023-10-06T05:26:15.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.772+0000 7f332affd700 1 -- 172.21.15.29:0/1382608869 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3324023070 con 0x7f33340c81b0 2023-10-06T05:26:15.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.772+0000 7f332affd700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3314060550 0x7f3314062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:15.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.772+0000 7f332affd700 1 -- 172.21.15.29:0/1382608869 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f332407db00 con 0x7f33340c81b0 2023-10-06T05:26:15.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.772+0000 7f33327fc700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3314060550 0x7f3314062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:15.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.776+0000 7f33327fc700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3314060550 0x7f3314062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33340c4670 tx=0x7f331c0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:15.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.780+0000 7f332affd700 1 -- 172.21.15.29:0/1382608869 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f332407fe60 con 0x7f33340c81b0 2023-10-06T05:26:15.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.976+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f33340ca3c0 con 0x7f33340c81b0 2023-10-06T05:26:15.984 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-06T05:26:15.980+0000 7fe44aab2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T05:26:15.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.988+0000 7f332affd700 1 -- 172.21.15.29:0/1382608869 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3324015090 con 0x7f33340c81b0 2023-10-06T05:26:15.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3314060550 msgr2=0x7f3314062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3314060550 0x7f3314062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33340c4670 tx=0x7f331c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33340c81b0 msgr2=0x7f3334169f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33340c81b0 0x7f3334169f60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f333406ed90 tx=0x7f3324017000 comp rx=0 tx=0).stop 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 shutdown_connections 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3314060550 0x7f3314062a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33341590b0 0x7f3334157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33340ce7f0 0x7f33340c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 --2- 172.21.15.29:0/1382608869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33340c81b0 0x7f3334169f60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 >> 172.21.15.29:0/1382608869 conn(0x7f333406d190 msgr2=0x7f33340b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 shutdown_connections 2023-10-06T05:26:15.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:15.992+0000 7f3333fff700 1 -- 172.21.15.29:0/1382608869 wait complete. 2023-10-06T05:26:16.000 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T05:26:16.012 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T05:26:16.025 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:26:16.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd83133700 1 Processor -- start 2023-10-06T05:26:16.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd83133700 1 -- start start 2023-10-06T05:26:16.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd83133700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efd7c158f10 0x7efd7c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:16.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd83133700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 0x7efd7c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:16.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd83133700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c0cacd0 con 0x7efd7c06cc00 2023-10-06T05:26:16.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd83133700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c06a600 con 0x7efd7c158f10 2023-10-06T05:26:16.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd83133700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c06d080 con 0x7efd7c15d730 2023-10-06T05:26:16.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd82932700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efd7c06cc00 0x7efd7c0cfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58154/0 (socket says 172.21.15.29:58154) 2023-10-06T05:26:16.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd82932700 1 -- 172.21.15.29:0/2696715491 learned_addr learned my addr 172.21.15.29:0/2696715491 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:16.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.112+0000 7efd82131700 1 --2- 172.21.15.29:0/2696715491 >> v2:172.21.15.173:3300/0 conn(0x7efd7c158f10 0x7efd7c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:16.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd81930700 1 --2- 172.21.15.29:0/2696715491 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 0x7efd7c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:16.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd8112f700 1 -- 172.21.15.29:0/2696715491 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467362230 0 0) 0x7efd7c0cacd0 con 0x7efd7c06cc00 2023-10-06T05:26:16.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd8112f700 1 -- 172.21.15.29:0/2696715491 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd68003570 con 0x7efd7c06cc00 2023-10-06T05:26:16.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd82131700 1 -- 172.21.15.29:0/2696715491 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 msgr2=0x7efd7c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:16.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd82131700 1 --2- 172.21.15.29:0/2696715491 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 0x7efd7c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:16.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd82131700 1 -- 172.21.15.29:0/2696715491 >> v1:172.21.15.29:6789/0 conn(0x7efd7c06cc00 legacy=0x7efd7c0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:16.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd82131700 1 -- 172.21.15.29:0/2696715491 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0cafb0 con 0x7efd7c158f10 2023-10-06T05:26:16.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd82131700 1 --2- 172.21.15.29:0/2696715491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c158f10 0x7efd7c0ca4a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd70009910 tx=0x7efd700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f699659dc774ef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd8112f700 1 -- 172.21.15.29:0/2696715491 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70011630 con 0x7efd7c158f10 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd8112f700 1 -- 172.21.15.29:0/2696715491 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd70011790 con 0x7efd7c158f10 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd8112f700 1 -- 172.21.15.29:0/2696715491 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70011b30 con 0x7efd7c158f10 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd83133700 1 -- 172.21.15.29:0/2696715491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c158f10 msgr2=0x7efd7c0ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd83133700 1 --2- 172.21.15.29:0/2696715491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c158f10 0x7efd7c0ca4a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd70009910 tx=0x7efd700091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd83133700 1 -- 172.21.15.29:0/2696715491 shutdown_connections 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd83133700 1 --2- 172.21.15.29:0/2696715491 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 0x7efd7c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd83133700 1 --2- 172.21.15.29:0/2696715491 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c158f10 0x7efd7c0ca4a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd83133700 1 -- 172.21.15.29:0/2696715491 >> 172.21.15.29:0/2696715491 conn(0x7efd7c062b60 msgr2=0x7efd7c062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd83133700 1 -- 172.21.15.29:0/2696715491 shutdown_connections 2023-10-06T05:26:16.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.116+0000 7efd83133700 1 -- 172.21.15.29:0/2696715491 wait complete. 2023-10-06T05:26:16.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 Processor -- start 2023-10-06T05:26:16.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 -- start start 2023-10-06T05:26:16.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c06cc00 0x7efd7c169e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:16.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd7c158f10 0x7efd7c0c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:16.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 0x7efd7c0c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:16.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c16a390 con 0x7efd7c158f10 2023-10-06T05:26:16.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0c7c50 con 0x7efd7c06cc00 2023-10-06T05:26:16.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0c7040 con 0x7efd7c15d730 2023-10-06T05:26:16.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd81930700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd7c158f10 0x7efd7c0c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:16.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd81930700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd7c158f10 0x7efd7c0c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35710/0 (socket says 172.21.15.29:35710) 2023-10-06T05:26:16.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd81930700 1 -- 172.21.15.29:0/1957990331 learned_addr learned my addr 172.21.15.29:0/1957990331 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd82131700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c06cc00 0x7efd7c169e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd82932700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 0x7efd7c0c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd81930700 1 -- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 msgr2=0x7efd7c0c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd81930700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 0x7efd7c0c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd81930700 1 -- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c06cc00 msgr2=0x7efd7c169e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd81930700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c06cc00 0x7efd7c169e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd81930700 1 -- 172.21.15.29:0/1957990331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009420 con 0x7efd7c158f10 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd82932700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 0x7efd7c0c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd81930700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd7c158f10 0x7efd7c0c4d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efd78009e50 tx=0x7efd7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd6e7fc700 1 -- 172.21.15.29:0/1957990331 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7800cb50 con 0x7efd7c158f10 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c0c7320 con 0x7efd7c158f10 2023-10-06T05:26:16.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd6e7fc700 1 -- 172.21.15.29:0/1957990331 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7800f040 con 0x7efd7c158f10 2023-10-06T05:26:16.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd6e7fc700 1 -- 172.21.15.29:0/1957990331 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78014480 con 0x7efd7c158f10 2023-10-06T05:26:16.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.120+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c0c78e0 con 0x7efd7c158f10 2023-10-06T05:26:16.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.124+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c04be00 con 0x7efd7c158f10 2023-10-06T05:26:16.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.124+0000 7efd6e7fc700 1 -- 172.21.15.29:0/1957990331 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efd780147f0 con 0x7efd7c158f10 2023-10-06T05:26:16.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.124+0000 7efd6e7fc700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efd60060550 0x7efd60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:16.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.124+0000 7efd6e7fc700 1 -- 172.21.15.29:0/1957990331 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6144+0+0 (secure 0 0 0) 0x7efd7807d600 con 0x7efd7c158f10 2023-10-06T05:26:16.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.124+0000 7efd82131700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efd60060550 0x7efd60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:16.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.128+0000 7efd82131700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efd60060550 0x7efd60062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd700091e0 tx=0x7efd70017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:16.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.132+0000 7efd6e7fc700 1 -- 172.21.15.29:0/1957990331 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd7804da40 con 0x7efd7c158f10 2023-10-06T05:26:16.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.328+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efd7c0c7d90 con 0x7efd7c158f10 2023-10-06T05:26:16.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.988+0000 7efd6e7fc700 1 -- 172.21.15.29:0/1957990331 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7efd78051060 con 0x7efd7c158f10 2023-10-06T05:26:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efd60060550 msgr2=0x7efd60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efd60060550 0x7efd60062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd700091e0 tx=0x7efd70017000 comp rx=0 tx=0).stop 2023-10-06T05:26:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd7c158f10 msgr2=0x7efd7c0c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:17.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd7c158f10 0x7efd7c0c4d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efd78009e50 tx=0x7efd7800b040 comp rx=0 tx=0).stop 2023-10-06T05:26:17.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 shutdown_connections 2023-10-06T05:26:17.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd7c15d730 0x7efd7c0c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd7c158f10 0x7efd7c0c4d50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efd60060550 0x7efd60062a00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 --2- 172.21.15.29:0/1957990331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd7c06cc00 0x7efd7c169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 >> 172.21.15.29:0/1957990331 conn(0x7efd7c062b60 msgr2=0x7efd7c0aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:17.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 shutdown_connections 2023-10-06T05:26:17.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:16.996+0000 7efd83133700 1 -- 172.21.15.29:0/1957990331 wait complete. 2023-10-06T05:26:17.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T05:26:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.180+0000 7f65f28ea700 1 Processor -- start 2023-10-06T05:26:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.180+0000 7f65f28ea700 1 -- start start 2023-10-06T05:26:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f28ea700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65ec158c40 0x7f65ec0d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f28ea700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec0cae30 con 0x7f65ec159010 2023-10-06T05:26:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f28ea700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec06ba70 con 0x7f65ec0ce320 2023-10-06T05:26:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f28ea700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec06b4b0 con 0x7f65ec158c40 2023-10-06T05:26:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f10e7700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f65ec159010 0x7f65ec06aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58166/0 (socket says 172.21.15.29:58166) 2023-10-06T05:26:17.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f10e7700 1 -- 172.21.15.29:0/1534153914 learned_addr learned my addr 172.21.15.29:0/1534153914 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f18e8700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65ec158c40 0x7f65ec0d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238588477 0 0) 0x7f65ec0cae30 con 0x7f65ec159010 2023-10-06T05:26:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d8003570 con 0x7f65ec159010 2023-10-06T05:26:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4193992782 0 0) 0x7f65d8003570 con 0x7f65ec159010 2023-10-06T05:26:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65ec158c40 msgr2=0x7f65ec0d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65ec158c40 0x7f65ec0d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 >> v1:172.21.15.173:6789/0 conn(0x7f65ec0ce320 legacy=0x7f65ec0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec06b790 con 0x7f65ec159010 2023-10-06T05:26:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f65dc001470 con 0x7f65ec159010 2023-10-06T05:26:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 >> v1:172.21.15.29:6789/0 conn(0x7f65ec159010 legacy=0x7f65ec06aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65d8003a90 0x7f65d8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d8004810 0x7f65d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65ec158c40 0x7f65d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec06b4b0 con 0x7f65d8004810 2023-10-06T05:26:17.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d800bb10 con 0x7f65d8003a90 2023-10-06T05:26:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d800bcd0 con 0x7f65ec158c40 2023-10-06T05:26:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f10e7700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d8004810 0x7f65d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f18e8700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65d8003a90 0x7f65d8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f20e9700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65ec158c40 0x7f65d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f18e8700 1 -- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65ec158c40 msgr2=0x7f65d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f18e8700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65ec158c40 0x7f65d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f18e8700 1 -- 172.21.15.29:0/1534153914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d8004810 msgr2=0x7f65d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f18e8700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d8004810 0x7f65d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f18e8700 1 -- 172.21.15.29:0/1534153914 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d8003570 con 0x7f65d8003a90 2023-10-06T05:26:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f10e7700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d8004810 0x7f65d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f18e8700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65d8003a90 0x7f65d8003e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009c00 tx=0x7f65e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cc4a7b632aca67b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800e710 con 0x7f65d8003a90 2023-10-06T05:26:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e800e870 con 0x7f65d8003a90 2023-10-06T05:26:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.184+0000 7f65f08e6700 1 -- 172.21.15.29:0/1534153914 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800ec30 con 0x7f65d8003a90 2023-10-06T05:26:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.188+0000 7f65f28ea700 1 -- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65d8003a90 msgr2=0x7f65d8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.188+0000 7f65f28ea700 1 --2- 172.21.15.29:0/1534153914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65d8003a90 0x7f65d8003e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009c00 tx=0x7f65e80091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.188+0000 7f65f20e9700 1 -- 172.21.15.29:0/1534153914 reap_dead start 2023-10-06T05:26:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.188+0000 7f65f28ea700 1 -- 172.21.15.29:0/1534153914 shutdown_connections 2023-10-06T05:26:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.188+0000 7f65f28ea700 1 -- 172.21.15.29:0/1534153914 >> 172.21.15.29:0/1534153914 conn(0x7f65ec0670a0 msgr2=0x7f65ec0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.188+0000 7f65f28ea700 1 -- 172.21.15.29:0/1534153914 shutdown_connections 2023-10-06T05:26:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.188+0000 7f65f28ea700 1 -- 172.21.15.29:0/1534153914 wait complete. 2023-10-06T05:26:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 Processor -- start 2023-10-06T05:26:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 -- start start 2023-10-06T05:26:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65d8003a90 0x7f65ec157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65ec1594f0 0x7f65ec159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:17.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65ec15b1d0 0x7f65ec15b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:17.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0b3be0 con 0x7f65ec15b1d0 2023-10-06T05:26:17.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0b2cf0 con 0x7f65ec1594f0 2023-10-06T05:26:17.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0b2fd0 con 0x7f65d8003a90 2023-10-06T05:26:17.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f20e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65ec15b1d0 0x7f65ec15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:17.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f20e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65ec15b1d0 0x7f65ec15b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35736/0 (socket says 172.21.15.29:35736) 2023-10-06T05:26:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f20e9700 1 -- 172.21.15.29:0/2471026680 learned_addr learned my addr 172.21.15.29:0/2471026680 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f10e7700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65ec1594f0 0x7f65ec159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f18e8700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65d8003a90 0x7f65ec157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f20e9700 1 -- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65d8003a90 msgr2=0x7f65ec157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f20e9700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65d8003a90 0x7f65ec157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f20e9700 1 -- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65ec1594f0 msgr2=0x7f65ec159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f20e9700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65ec1594f0 0x7f65ec159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f20e9700 1 -- 172.21.15.29:0/2471026680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec0b32b0 con 0x7f65ec15b1d0 2023-10-06T05:26:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f10e7700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65ec1594f0 0x7f65ec159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f20e9700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65ec15b1d0 0x7f65ec15b620 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f65ec069b10 tx=0x7f65e40016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65e1ffb700 1 -- 172.21.15.29:0/2471026680 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400c7b0 con 0x7f65ec15b1d0 2023-10-06T05:26:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65e1ffb700 1 -- 172.21.15.29:0/2471026680 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e400c930 con 0x7f65ec15b1d0 2023-10-06T05:26:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec0b3590 con 0x7f65ec15b1d0 2023-10-06T05:26:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65e1ffb700 1 -- 172.21.15.29:0/2471026680 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400ccf0 con 0x7f65ec15b1d0 2023-10-06T05:26:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.192+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec15bb60 con 0x7f65ec15b1d0 2023-10-06T05:26:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.196+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec04be00 con 0x7f65ec15b1d0 2023-10-06T05:26:17.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.196+0000 7f65e1ffb700 1 -- 172.21.15.29:0/2471026680 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f65e4015640 con 0x7f65ec15b1d0 2023-10-06T05:26:17.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.196+0000 7f65e1ffb700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d0060550 0x7f65d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:17.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.196+0000 7f65e1ffb700 1 -- 172.21.15.29:0/2471026680 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f65e407cf80 con 0x7f65ec15b1d0 2023-10-06T05:26:17.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.196+0000 7f65f18e8700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d0060550 0x7f65d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:17.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.200+0000 7f65f18e8700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d0060550 0x7f65d0062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f65e80091e0 tx=0x7f65e801a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:17.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.204+0000 7f65e1ffb700 1 -- 172.21.15.29:0/2471026680 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f65e40acbe0 con 0x7f65ec15b1d0 2023-10-06T05:26:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.364+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65ec0caac0 con 0x7f65ec15b1d0 2023-10-06T05:26:18.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:17.992+0000 7f65e1ffb700 1 -- 172.21.15.29:0/2471026680 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f65e404d3c0 con 0x7f65ec15b1d0 2023-10-06T05:26:18.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.000+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d0060550 msgr2=0x7f65d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:18.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.000+0000 7f65f28ea700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d0060550 0x7f65d0062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f65e80091e0 tx=0x7f65e801a000 comp rx=0 tx=0).stop 2023-10-06T05:26:18.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.000+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65ec15b1d0 msgr2=0x7f65ec15b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:18.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.000+0000 7f65f28ea700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65ec15b1d0 0x7f65ec15b620 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f65ec069b10 tx=0x7f65e40016d0 comp rx=0 tx=0).stop 2023-10-06T05:26:18.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.004+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 shutdown_connections 2023-10-06T05:26:18.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.004+0000 7f65f28ea700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65ec15b1d0 0x7f65ec15b620 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:18.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.004+0000 7f65f28ea700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d0060550 0x7f65d0062a00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:18.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.004+0000 7f65f28ea700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65ec1594f0 0x7f65ec159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:18.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.004+0000 7f65f28ea700 1 --2- 172.21.15.29:0/2471026680 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65d8003a90 0x7f65ec157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:18.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.004+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 >> 172.21.15.29:0/2471026680 conn(0x7f65ec0670a0 msgr2=0x7f65ec1520a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:18.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.004+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 shutdown_connections 2023-10-06T05:26:18.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.004+0000 7f65f28ea700 1 -- 172.21.15.29:0/2471026680 wait complete. 2023-10-06T05:26:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2023-10-06T05:26:18.027 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T05:26:18.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.132+0000 7f9580b23700 1 Processor -- start 2023-10-06T05:26:18.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.132+0000 7f9580b23700 1 -- start start 2023-10-06T05:26:18.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f957c0ca6b0 0x7f957c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:18.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957c15e8b0 con 0x7f957c0c87f0 2023-10-06T05:26:18.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957c161920 con 0x7f957c0c8bc0 2023-10-06T05:26:18.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957c160ff0 con 0x7f957c0ca6b0 2023-10-06T05:26:18.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957a59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f957c0c87f0 0x7f957c0c9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58172/0 (socket says 172.21.15.29:58172) 2023-10-06T05:26:18.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957a59c700 1 -- 172.21.15.29:0/402110101 learned_addr learned my addr 172.21.15.29:0/402110101 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:18.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9579d9b700 1 --2- 172.21.15.29:0/402110101 >> v2:172.21.15.173:3300/0 conn(0x7f957c0ca6b0 0x7f957c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:18.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957959a700 1 -- 172.21.15.29:0/402110101 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887763131 0 0) 0x7f957c15e8b0 con 0x7f957c0c87f0 2023-10-06T05:26:18.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957959a700 1 -- 172.21.15.29:0/402110101 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9568003570 con 0x7f957c0c87f0 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957959a700 1 -- 172.21.15.29:0/402110101 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824837712 0 0) 0x7f957c161920 con 0x7f957c0c8bc0 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957959a700 1 -- 172.21.15.29:0/402110101 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f957c15e8b0 con 0x7f957c0c8bc0 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957959a700 1 -- 172.21.15.29:0/402110101 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3700745051 0 0) 0x7f9568003570 con 0x7f957c0c87f0 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9579d9b700 1 -- 172.21.15.29:0/402110101 >> v1:172.21.15.173:6789/0 conn(0x7f957c0c8bc0 legacy=0x7f957c15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9579d9b700 1 -- 172.21.15.29:0/402110101 >> v1:172.21.15.29:6789/0 conn(0x7f957c0c87f0 legacy=0x7f957c0c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9579d9b700 1 -- 172.21.15.29:0/402110101 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c1612d0 con 0x7f957c0ca6b0 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9579d9b700 1 --2- 172.21.15.29:0/402110101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957c0ca6b0 0x7f957c15cc60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9564009910 tx=0x7f95640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b97a9a165a4cd973 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957959a700 1 -- 172.21.15.29:0/402110101 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c001470 con 0x7f957c0ca6b0 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957959a700 1 -- 172.21.15.29:0/402110101 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564011420 con 0x7f957c0ca6b0 2023-10-06T05:26:18.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f957959a700 1 -- 172.21.15.29:0/402110101 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95640117c0 con 0x7f957c0ca6b0 2023-10-06T05:26:18.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 -- 172.21.15.29:0/402110101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957c0ca6b0 msgr2=0x7f957c15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:18.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 --2- 172.21.15.29:0/402110101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957c0ca6b0 0x7f957c15cc60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9564009910 tx=0x7f95640091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:18.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 -- 172.21.15.29:0/402110101 shutdown_connections 2023-10-06T05:26:18.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 --2- 172.21.15.29:0/402110101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957c0ca6b0 0x7f957c15cc60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:18.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 -- 172.21.15.29:0/402110101 >> 172.21.15.29:0/402110101 conn(0x7f957c0670a0 msgr2=0x7f957c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:18.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 -- 172.21.15.29:0/402110101 shutdown_connections 2023-10-06T05:26:18.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.136+0000 7f9580b23700 1 -- 172.21.15.29:0/402110101 wait complete. 2023-10-06T05:26:18.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9580b23700 1 Processor -- start 2023-10-06T05:26:18.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9580b23700 1 -- start start 2023-10-06T05:26:18.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9580b23700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f957c0c87f0 0x7f957c0af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9580b23700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957c0c8bc0 0x7f957c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9580b23700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957c0ca6b0 0x7f957c0c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9580b23700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c0c3f70 con 0x7f957c0c8bc0 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9580b23700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c0af050 con 0x7f957c0ca6b0 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9580b23700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957c0c41a0 con 0x7f957c0c87f0 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9579d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957c0c8bc0 0x7f957c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9579d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957c0c8bc0 0x7f957c0b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35748/0 (socket says 172.21.15.29:35748) 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9579d9b700 1 -- 172.21.15.29:0/963565008 learned_addr learned my addr 172.21.15.29:0/963565008 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f957a59c700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f957c0c87f0 0x7f957c0af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f957ad9d700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957c0ca6b0 0x7f957c0c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9579d9b700 1 -- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f957c0c87f0 msgr2=0x7f957c0af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:18.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9579d9b700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f957c0c87f0 0x7f957c0af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:18.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9579d9b700 1 -- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957c0ca6b0 msgr2=0x7f957c0c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:18.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9579d9b700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957c0ca6b0 0x7f957c0c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:18.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9579d9b700 1 -- 172.21.15.29:0/963565008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9564009420 con 0x7f957c0c8bc0 2023-10-06T05:26:18.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f957a59c700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f957c0c87f0 0x7f957c0af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:18.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.140+0000 7f9579d9b700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957c0c8bc0 0x7f957c0b0170 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9564009860 tx=0x7f9564016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:18.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.144+0000 7f95727fc700 1 -- 172.21.15.29:0/963565008 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956401bbd0 con 0x7f957c0c8bc0 2023-10-06T05:26:18.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.144+0000 7f95727fc700 1 -- 172.21.15.29:0/963565008 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956401bd30 con 0x7f957c0c8bc0 2023-10-06T05:26:18.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.144+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957c0c4480 con 0x7f957c0c8bc0 2023-10-06T05:26:18.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.144+0000 7f95727fc700 1 -- 172.21.15.29:0/963565008 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956401bea0 con 0x7f957c0c8bc0 2023-10-06T05:26:18.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.144+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957c0aece0 con 0x7f957c0c8bc0 2023-10-06T05:26:18.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.144+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957c0af1e0 con 0x7f957c0c8bc0 2023-10-06T05:26:18.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.144+0000 7f95727fc700 1 -- 172.21.15.29:0/963565008 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f956401c910 con 0x7f957c0c8bc0 2023-10-06T05:26:18.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.148+0000 7f95727fc700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f955c060550 0x7f955c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:18.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.148+0000 7f95727fc700 1 -- 172.21.15.29:0/963565008 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f956407de60 con 0x7f957c0c8bc0 2023-10-06T05:26:18.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.148+0000 7f957a59c700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f955c060550 0x7f955c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:18.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.148+0000 7f957a59c700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f955c060550 0x7f955c062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f956c001340 tx=0x7f956c000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:18.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.152+0000 7f95727fc700 1 -- 172.21.15.29:0/963565008 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f956404e430 con 0x7f957c0c8bc0 2023-10-06T05:26:18.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.312+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f957c071120 con 0x7f957c0c8bc0 2023-10-06T05:26:19.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:18.996+0000 7f95727fc700 1 -- 172.21.15.29:0/963565008 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9564051a50 con 0x7f957c0c8bc0 2023-10-06T05:26:19.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f955c060550 msgr2=0x7f955c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:19.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f955c060550 0x7f955c062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f956c001340 tx=0x7f956c000bc0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957c0c8bc0 msgr2=0x7f957c0b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:19.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957c0c8bc0 0x7f957c0b0170 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9564009860 tx=0x7f9564016000 comp rx=0 tx=0).stop 2023-10-06T05:26:19.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 shutdown_connections 2023-10-06T05:26:19.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f955c060550 0x7f955c062a00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f957c0ca6b0 0x7f957c0c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957c0c8bc0 0x7f957c0b0170 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 --2- 172.21.15.29:0/963565008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f957c0c87f0 0x7f957c0af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 >> 172.21.15.29:0/963565008 conn(0x7f957c0670a0 msgr2=0x7f957c0c6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:19.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 shutdown_connections 2023-10-06T05:26:19.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.000+0000 7f9580b23700 1 -- 172.21.15.29:0/963565008 wait complete. 2023-10-06T05:26:19.009 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2023-10-06T05:26:19.024 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T05:26:19.024 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T05:26:19.025 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T05:26:19.025 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:26:19.025 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T05:26:19.026 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T05:26:19.026 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T05:26:19.026 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:26:19.026 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T05:26:19.027 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T05:26:19.027 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T05:26:19.027 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:26:19.027 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T05:26:19.028 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T05:26:19.028 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T05:26:19.028 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:26:19.040 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T05:26:19.041 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T05:26:19.042 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T05:26:19.042 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T05:26:19.043 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T05:26:19.043 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T05:26:19.044 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T05:26:19.044 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T05:26:19.086 INFO:tasks.ceph.mds.a:Started 2023-10-06T05:26:19.086 DEBUG:teuthology.parallel:result is None 2023-10-06T05:26:19.087 INFO:tasks.ceph.mds.b:Started 2023-10-06T05:26:19.087 INFO:tasks.ceph.mds.c:Started 2023-10-06T05:26:19.088 DEBUG:teuthology.parallel:result is None 2023-10-06T05:26:19.088 DEBUG:teuthology.parallel:result is None 2023-10-06T05:26:19.089 INFO:tasks.ceph.mds.d:Started 2023-10-06T05:26:19.089 DEBUG:teuthology.parallel:result is None 2023-10-06T05:26:19.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T05:26:19.158 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-10-06T05:26:19.162 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-10-06T05:26:19.173 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:26:19.178 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-06T05:26:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 Processor -- start 2023-10-06T05:26:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 -- start start 2023-10-06T05:26:19.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff6c40cb0a0 0x7ff6c40ab400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:19.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40cb470 0x7ff6c40aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:19.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6c40af360 0x7ff6c406e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:19.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40ac5f0 con 0x7ff6c40af360 2023-10-06T05:26:19.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40ab9e0 con 0x7ff6c40cb0a0 2023-10-06T05:26:19.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40abcc0 con 0x7ff6c40cb470 2023-10-06T05:26:19.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c8e3d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6c40af360 0x7ff6c406e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:19.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c8e3d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6c40af360 0x7ff6c406e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35778/0 (socket says 172.21.15.29:35778) 2023-10-06T05:26:19.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c8e3d700 1 -- 172.21.15.29:0/3669633416 learned_addr learned my addr 172.21.15.29:0/3669633416 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:19.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c37fe700 1 --2- 172.21.15.29:0/3669633416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40cb470 0x7ff6c40aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:19.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c3fff700 1 --2- 172.21.15.29:0/3669633416 >> v2:172.21.15.173:3300/0 conn(0x7ff6c40cb0a0 0x7ff6c40ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:19.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c8e3d700 1 -- 172.21.15.29:0/3669633416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40cb470 msgr2=0x7ff6c40aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:19.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c8e3d700 1 --2- 172.21.15.29:0/3669633416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40cb470 0x7ff6c40aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c8e3d700 1 -- 172.21.15.29:0/3669633416 >> v2:172.21.15.173:3300/0 conn(0x7ff6c40cb0a0 msgr2=0x7ff6c40ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:19.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c8e3d700 1 --2- 172.21.15.29:0/3669633416 >> v2:172.21.15.173:3300/0 conn(0x7ff6c40cb0a0 0x7ff6c40ab400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c8e3d700 1 -- 172.21.15.29:0/3669633416 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40abfa0 con 0x7ff6c40af360 2023-10-06T05:26:19.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c8e3d700 1 --2- 172.21.15.29:0/3669633416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40af360 0x7ff6c406e730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4069b90 tx=0x7ff6bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6fa1b504083057 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:19.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c2ffd700 1 -- 172.21.15.29:0/3669633416 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc00e070 con 0x7ff6c40af360 2023-10-06T05:26:19.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c2ffd700 1 -- 172.21.15.29:0/3669633416 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc00ba50 con 0x7ff6c40af360 2023-10-06T05:26:19.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6c2ffd700 1 -- 172.21.15.29:0/3669633416 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0092e0 con 0x7ff6c40af360 2023-10-06T05:26:19.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/3669633416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40af360 msgr2=0x7ff6c406e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:19.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/3669633416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40af360 0x7ff6c406e730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4069b90 tx=0x7ff6bc009840 comp rx=0 tx=0).stop 2023-10-06T05:26:19.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/3669633416 shutdown_connections 2023-10-06T05:26:19.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/3669633416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40af360 0x7ff6c406e730 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/3669633416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40cb470 0x7ff6c40aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/3669633416 >> v2:172.21.15.173:3300/0 conn(0x7ff6c40cb0a0 0x7ff6c40ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/3669633416 >> 172.21.15.29:0/3669633416 conn(0x7ff6c4067b70 msgr2=0x7ff6c406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:19.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/3669633416 shutdown_connections 2023-10-06T05:26:19.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.196+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/3669633416 wait complete. 2023-10-06T05:26:19.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6ca8a0700 1 Processor -- start 2023-10-06T05:26:19.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6ca8a0700 1 -- start start 2023-10-06T05:26:19.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6ca8a0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40af360 0x7ff6c415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:19.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6ca8a0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c40cb0a0 0x7ff6c4156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:19.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6ca8a0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40cb470 0x7ff6c4159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:19.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6ca8a0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4157460 con 0x7ff6c40cb470 2023-10-06T05:26:19.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6ca8a0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c41600c0 con 0x7ff6c40cb0a0 2023-10-06T05:26:19.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6ca8a0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c415e340 con 0x7ff6c40af360 2023-10-06T05:26:19.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c8e3d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40cb470 0x7ff6c4159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c8e3d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40cb470 0x7ff6c4159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35782/0 (socket says 172.21.15.29:35782) 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c8e3d700 1 -- 172.21.15.29:0/2888587017 learned_addr learned my addr 172.21.15.29:0/2888587017 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c3fff700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40af360 0x7ff6c415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c37fe700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c40cb0a0 0x7ff6c4156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c8e3d700 1 -- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40af360 msgr2=0x7ff6c415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c8e3d700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40af360 0x7ff6c415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c8e3d700 1 -- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c40cb0a0 msgr2=0x7ff6c4156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c8e3d700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c40cb0a0 0x7ff6c4156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c8e3d700 1 -- 172.21.15.29:0/2888587017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc009ae0 con 0x7ff6c40cb470 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6c8e3d700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40cb470 0x7ff6c4159460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4063630 tx=0x7ff6bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:19.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.200+0000 7ff6bbfff700 1 -- 172.21.15.29:0/2888587017 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0032f0 con 0x7ff6c40cb470 2023-10-06T05:26:19.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6bbfff700 1 -- 172.21.15.29:0/2888587017 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc008ce0 con 0x7ff6c40cb470 2023-10-06T05:26:19.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c40a5b00 con 0x7ff6c40cb470 2023-10-06T05:26:19.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6bbfff700 1 -- 172.21.15.29:0/2888587017 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc01c660 con 0x7ff6c40cb470 2023-10-06T05:26:19.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c41605b0 con 0x7ff6c40cb470 2023-10-06T05:26:19.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c415e4c0 con 0x7ff6c40cb470 2023-10-06T05:26:19.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6bbfff700 1 -- 172.21.15.29:0/2888587017 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff6bc003040 con 0x7ff6c40cb470 2023-10-06T05:26:19.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6bbfff700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff6a4060550 0x7ff6a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:19.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6bbfff700 1 -- 172.21.15.29:0/2888587017 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff6bc07dd90 con 0x7ff6c40cb470 2023-10-06T05:26:19.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6c3fff700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff6a4060550 0x7ff6a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.204+0000 7ff6c3fff700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff6a4060550 0x7ff6a4062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4006fd0 tx=0x7ff6b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:19.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.212+0000 7ff6bbfff700 1 -- 172.21.15.29:0/2888587017 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff6c415e4c0 con 0x7ff6c40cb470 2023-10-06T05:26:19.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:19.388+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff6c415e4c0 con 0x7ff6c40cb470 2023-10-06T05:26:20.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.540+0000 7ff6bbfff700 1 -- 172.21.15.29:0/2888587017 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff6c415e4c0 con 0x7ff6c40cb470 2023-10-06T05:26:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff6a4060550 msgr2=0x7ff6a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff6a4060550 0x7ff6a4062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4006fd0 tx=0x7ff6b4008040 comp rx=0 tx=0).stop 2023-10-06T05:26:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40cb470 msgr2=0x7ff6c4159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:20.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40cb470 0x7ff6c4159460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4063630 tx=0x7ff6bc018000 comp rx=0 tx=0).stop 2023-10-06T05:26:20.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 shutdown_connections 2023-10-06T05:26:20.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c40cb470 0x7ff6c4159460 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff6a4060550 0x7ff6a4062a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6c40cb0a0 0x7ff6c4156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 --2- 172.21.15.29:0/2888587017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6c40af360 0x7ff6c415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 >> 172.21.15.29:0/2888587017 conn(0x7ff6c4067b70 msgr2=0x7ff6c40aca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:20.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 shutdown_connections 2023-10-06T05:26:20.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.548+0000 7ff6ca8a0700 1 -- 172.21.15.29:0/2888587017 wait complete. 2023-10-06T05:26:20.556 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2023-10-06T05:26:20.568 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T05:26:20.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 Processor -- start 2023-10-06T05:26:20.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 -- start start 2023-10-06T05:26:20.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2a3806c8f0 0x7f2a3806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:20.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a380c8b50 0x7f2a3806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:20.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3806b9e0 con 0x7f2a380c9e80 2023-10-06T05:26:20.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380cb7e0 con 0x7f2a380c8b50 2023-10-06T05:26:20.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380caf80 con 0x7f2a3806c8f0 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a37fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a380c8b50 0x7f2a3806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a36ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2a380c9e80 0x7f2a381555a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58180/0 (socket says 172.21.15.29:58180) 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a37fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a380c8b50 0x7f2a3806b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35794/0 (socket says 172.21.15.29:35794) 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a36ffd700 1 -- 172.21.15.29:0/3764109483 learned_addr learned my addr 172.21.15.29:0/3764109483 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a377fe700 1 --2- 172.21.15.29:0/3764109483 >> v2:172.21.15.173:3300/0 conn(0x7f2a3806c8f0 0x7f2a3806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a37fff700 1 -- 172.21.15.29:0/3764109483 >> v2:172.21.15.173:3300/0 conn(0x7f2a3806c8f0 msgr2=0x7f2a3806ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a367fc700 1 -- 172.21.15.29:0/3764109483 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616713076 0 0) 0x7f2a2c001110 con 0x7f2a380c9e80 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a37fff700 1 --2- 172.21.15.29:0/3764109483 >> v2:172.21.15.173:3300/0 conn(0x7f2a3806c8f0 0x7f2a3806ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a37fff700 1 -- 172.21.15.29:0/3764109483 >> v1:172.21.15.29:6789/0 conn(0x7f2a380c9e80 legacy=0x7f2a381555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a37fff700 1 -- 172.21.15.29:0/3764109483 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380c7660 con 0x7f2a380c8b50 2023-10-06T05:26:20.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a37fff700 1 --2- 172.21.15.29:0/3764109483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a380c8b50 0x7f2a3806b4a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a380694b0 tx=0x7f2a30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505de777c898a9b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:20.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a367fc700 1 -- 172.21.15.29:0/3764109483 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3000e070 con 0x7f2a380c8b50 2023-10-06T05:26:20.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a367fc700 1 -- 172.21.15.29:0/3764109483 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3000bb60 con 0x7f2a380c8b50 2023-10-06T05:26:20.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a367fc700 1 -- 172.21.15.29:0/3764109483 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30012430 con 0x7f2a380c8b50 2023-10-06T05:26:20.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 -- 172.21.15.29:0/3764109483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a380c8b50 msgr2=0x7f2a3806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:20.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 --2- 172.21.15.29:0/3764109483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a380c8b50 0x7f2a3806b4a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a380694b0 tx=0x7f2a30009780 comp rx=0 tx=0).stop 2023-10-06T05:26:20.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 -- 172.21.15.29:0/3764109483 shutdown_connections 2023-10-06T05:26:20.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 --2- 172.21.15.29:0/3764109483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a380c8b50 0x7f2a3806b4a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 --2- 172.21.15.29:0/3764109483 >> v2:172.21.15.173:3300/0 conn(0x7f2a3806c8f0 0x7f2a3806ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 -- 172.21.15.29:0/3764109483 >> 172.21.15.29:0/3764109483 conn(0x7f2a380670a0 msgr2=0x7f2a380674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:20.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 -- 172.21.15.29:0/3764109483 shutdown_connections 2023-10-06T05:26:20.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.676+0000 7f2a3c88c700 1 -- 172.21.15.29:0/3764109483 wait complete. 2023-10-06T05:26:20.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.680+0000 7f2a3c88c700 1 Processor -- start 2023-10-06T05:26:20.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.680+0000 7f2a3c88c700 1 -- start start 2023-10-06T05:26:20.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.680+0000 7f2a3c88c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a3806c8f0 0x7f2a38145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:20.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.680+0000 7f2a3c88c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a380c9e80 0x7f2a3814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a3c88c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3814bf70 0x7f2a3813ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a3c88c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a38147de0 con 0x7f2a3814bf70 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a3c88c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a38154240 con 0x7f2a3806c8f0 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a3c88c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a38154520 con 0x7f2a380c9e80 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a37fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3814bf70 0x7f2a3813ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a37fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3814bf70 0x7f2a3813ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35804/0 (socket says 172.21.15.29:35804) 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a37fff700 1 -- 172.21.15.29:0/741988061 learned_addr learned my addr 172.21.15.29:0/741988061 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a36ffd700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a380c9e80 0x7f2a3814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a377fe700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a3806c8f0 0x7f2a38145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a37fff700 1 -- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a380c9e80 msgr2=0x7f2a3814ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:20.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a37fff700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a380c9e80 0x7f2a3814ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a37fff700 1 -- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a3806c8f0 msgr2=0x7f2a38145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a37fff700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a3806c8f0 0x7f2a38145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a37fff700 1 -- 172.21.15.29:0/741988061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a30009a20 con 0x7f2a3814bf70 2023-10-06T05:26:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a37fff700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3814bf70 0x7f2a3813ef50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2a3806df30 tx=0x7f2a30019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a1f7fe700 1 -- 172.21.15.29:0/741988061 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30027470 con 0x7f2a3814bf70 2023-10-06T05:26:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a1f7fe700 1 -- 172.21.15.29:0/741988061 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a300275d0 con 0x7f2a3814bf70 2023-10-06T05:26:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a38154800 con 0x7f2a3814bf70 2023-10-06T05:26:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a1f7fe700 1 -- 172.21.15.29:0/741988061 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30027990 con 0x7f2a3814bf70 2023-10-06T05:26:20.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a38149880 con 0x7f2a3814bf70 2023-10-06T05:26:20.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a381496e0 con 0x7f2a3814bf70 2023-10-06T05:26:20.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.684+0000 7f2a1f7fe700 1 -- 172.21.15.29:0/741988061 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2a30024070 con 0x7f2a3814bf70 2023-10-06T05:26:20.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.688+0000 7f2a1f7fe700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a24060580 0x7f2a24062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:20.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.688+0000 7f2a1f7fe700 1 -- 172.21.15.29:0/741988061 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2a3007f070 con 0x7f2a3814bf70 2023-10-06T05:26:20.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.688+0000 7f2a377fe700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a24060580 0x7f2a24062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:20.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.688+0000 7f2a377fe700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a24060580 0x7f2a24062a30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009d40 tx=0x7f2a28008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:20.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.692+0000 7f2a1f7fe700 1 -- 172.21.15.29:0/741988061 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2a381496e0 con 0x7f2a3814bf70 2023-10-06T05:26:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.908+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2a381496e0 con 0x7f2a3814bf70 2023-10-06T05:26:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.908+0000 7f2a1f7fe700 1 -- 172.21.15.29:0/741988061 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2a381496e0 con 0x7f2a3814bf70 2023-10-06T05:26:20.915 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:20.915 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:26:20.916 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2023-10-06T05:26:20.916 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.916 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2023-10-06T05:26:20.916 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lmmo6OBAAQpP+gZa78MNtTT1c5tK+vw==", 2023-10-06T05:26:20.916 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.916 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:26:20.917 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:26:20.917 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:26:20.917 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.917 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.918 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.918 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.918 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2023-10-06T05:26:20.918 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lOCLABhAA38TEJqLAC+ccT54rGKcRHQ==", 2023-10-06T05:26:20.919 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.919 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:26:20.919 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:26:20.919 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:26:20.919 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.920 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.920 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.920 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.920 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2023-10-06T05:26:20.920 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lLN0yABAAa4pRtt5i1VwRUls37iQ6Ng==", 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2023-10-06T05:26:20.921 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9l/IkZChAAA0KqF/fQdw+Lvfgt3G7D1Q==", 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2023-10-06T05:26:20.922 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9liLI7OhAA2q9u7NoYTihYVqDD6feWqg==", 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAdmh9lVgGUABAAT+KgCiblIExCBVOWaW1KTQ==", 2023-10-06T05:26:20.923 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAgmh9lTun5BhAAhxhwULNJol5kiIMd6cr4EQ==", 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:26:20.924 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAjmh9lJRz4DBAAPs7JW7cj58uGIh0CXjTPOA==", 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.925 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAomh9lF4v2MRAA6d30MwZe8jaJE2/KZ2v2fg==", 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2023-10-06T05:26:20.926 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAsmh9lLsIbCRAAW0z6kOmd/cRdSMyGXB43cA==", 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAvmh9lBdCTDhAACXtGHMjlSZ4mDObzP73SCw==", 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:26:20.927 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:26:20.928 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.928 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.928 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.928 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.928 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2023-10-06T05:26:20.928 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAymh9lpfyEExAAKfZ7994WtblLHuzw9X2CjA==", 2023-10-06T05:26:20.928 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.928 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9l/dfwDBAAyd4qv0io8GSbP8ukYr6WaQ==", 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:26:20.929 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lhSm7EhAA//AImYYn3pBpCmwsOv9X8g==", 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:26:20.930 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:26:20.931 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.931 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.931 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.931 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.2", 2023-10-06T05:26:20.931 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lLAPFDxAA0M9C3WbeOYjQvGGIqPRrSw==", 2023-10-06T05:26:20.931 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.931 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:26:20.931 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:26:20.931 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.3", 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lYEpMFRAAgFoS4+VPWcjT0TgyNTDFFA==", 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:26:20.932 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lrcA0KxAAl4GK+rF0VWq9nkzu1RXN1A==", 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.933 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mds", 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQA8mh9lkB0WGxAAW6WuIoXmjmpXHjL9IfaIDw==", 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQA8mh9lvTIWGxAAgDnJkzjZbXe12F7Mw32B7Q==", 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T05:26:20.934 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-osd", 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQA8mh9l+EQWGxAAjyFdon3aa0M+HDmtukMcYQ==", 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQA8mh9lQ1cWGxAAzHY6Z8dSuJEUudxddxCcBw==", 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.935 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQA8mh9lumwWGxAAh3k04O/4LYVnnGjDB46Q3Q==", 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T05:26:20.936 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQA8mh9lNH8WGxAAXJC9WsRWQoYinV8Pdfafcw==", 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9l0ABYNRAAjZ6Ji5Q1o0HKn3oDYZaZ+w==", 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.937 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lCDNrMhAA/2ymYL+jXTRPLjyoHbWzPg==", 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-06T05:26:20.938 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:26:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a24060580 msgr2=0x7f2a24062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a24060580 0x7f2a24062a30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009d40 tx=0x7f2a28008040 comp rx=0 tx=0).stop 2023-10-06T05:26:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3814bf70 msgr2=0x7f2a3813ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3814bf70 0x7f2a3813ef50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2a3806df30 tx=0x7f2a30019000 comp rx=0 tx=0).stop 2023-10-06T05:26:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 shutdown_connections 2023-10-06T05:26:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a3814bf70 0x7f2a3813ef50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a380c9e80 0x7f2a3814ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2a24060580 0x7f2a24062a30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 --2- 172.21.15.29:0/741988061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a3806c8f0 0x7f2a38145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:20.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 >> 172.21.15.29:0/741988061 conn(0x7f2a380670a0 msgr2=0x7f2a380c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:20.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 shutdown_connections 2023-10-06T05:26:20.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:20.912+0000 7f2a3c88c700 1 -- 172.21.15.29:0/741988061 wait complete. 2023-10-06T05:26:20.941 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T05:26:21.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9a73700 1 Processor -- start 2023-10-06T05:26:21.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9a73700 1 -- start start 2023-10-06T05:26:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9a73700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea40ce960 0x7faea4158f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9a73700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faea406b620 0x7faea40cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9a73700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea406b190 con 0x7faea4158b50 2023-10-06T05:26:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9a73700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea406a580 con 0x7faea406b620 2023-10-06T05:26:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9a73700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea406a860 con 0x7faea40ce960 2023-10-06T05:26:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9272700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faea406b620 0x7faea40cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9272700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faea406b620 0x7faea40cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35816/0 (socket says 172.21.15.29:35816) 2023-10-06T05:26:21.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea9272700 1 -- 172.21.15.29:0/4258976566 learned_addr learned my addr 172.21.15.29:0/4258976566 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea8a71700 1 --1- 172.21.15.29:0/4258976566 >> v1:172.21.15.29:6789/0 conn(0x7faea4158b50 0x7faea40ce250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58196/0 (socket says 172.21.15.29:58196) 2023-10-06T05:26:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.048+0000 7faea3fff700 1 --2- 172.21.15.29:0/4258976566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea40ce960 0x7faea4158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9272700 1 -- 172.21.15.29:0/4258976566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea40ce960 msgr2=0x7faea4158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9272700 1 --2- 172.21.15.29:0/4258976566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea40ce960 0x7faea4158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9272700 1 -- 172.21.15.29:0/4258976566 >> v1:172.21.15.29:6789/0 conn(0x7faea4158b50 legacy=0x7faea40ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9272700 1 -- 172.21.15.29:0/4258976566 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea406ab40 con 0x7faea406b620 2023-10-06T05:26:21.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9272700 1 --2- 172.21.15.29:0/4258976566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea406b620 0x7faea40cc810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009f20 tx=0x7fae9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619859792bd47454 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:21.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea37fe700 1 -- 172.21.15.29:0/4258976566 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c00e070 con 0x7faea406b620 2023-10-06T05:26:21.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea37fe700 1 -- 172.21.15.29:0/4258976566 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c00ba80 con 0x7faea406b620 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea37fe700 1 -- 172.21.15.29:0/4258976566 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0092e0 con 0x7faea406b620 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 -- 172.21.15.29:0/4258976566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea406b620 msgr2=0x7faea40cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 --2- 172.21.15.29:0/4258976566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea406b620 0x7faea40cc810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009f20 tx=0x7fae9c009840 comp rx=0 tx=0).stop 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 -- 172.21.15.29:0/4258976566 shutdown_connections 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 --2- 172.21.15.29:0/4258976566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea406b620 0x7faea40cc810 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 --2- 172.21.15.29:0/4258976566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea40ce960 0x7faea4158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 -- 172.21.15.29:0/4258976566 >> 172.21.15.29:0/4258976566 conn(0x7faea406c6c0 msgr2=0x7faea406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 -- 172.21.15.29:0/4258976566 shutdown_connections 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 -- 172.21.15.29:0/4258976566 wait complete. 2023-10-06T05:26:21.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 Processor -- start 2023-10-06T05:26:21.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 -- start start 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea406b620 0x7faea40c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea40ce960 0x7faea40cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea4158b50 0x7faea4167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea41493e0 con 0x7faea40ce960 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea416cf00 con 0x7faea406b620 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9a73700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea416c2f0 con 0x7faea4158b50 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea40ce960 0x7faea40cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea40ce960 0x7faea40cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35824/0 (socket says 172.21.15.29:35824) 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea3fff700 1 -- 172.21.15.29:0/181009136 learned_addr learned my addr 172.21.15.29:0/181009136 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:21.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea8a71700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea406b620 0x7faea40c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.052+0000 7faea9272700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea4158b50 0x7faea4167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea3fff700 1 -- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea4158b50 msgr2=0x7faea4167fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea3fff700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea4158b50 0x7faea4167fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea3fff700 1 -- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea406b620 msgr2=0x7faea40c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea3fff700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea406b620 0x7faea40c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea3fff700 1 -- 172.21.15.29:0/181009136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c009ae0 con 0x7faea40ce960 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea3fff700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea40ce960 0x7faea40cc880 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00d890 tx=0x7fae8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea0ff9700 1 -- 172.21.15.29:0/181009136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0125f0 con 0x7faea40ce960 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea0ff9700 1 -- 172.21.15.29:0/181009136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c012750 con 0x7faea40ce960 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea416c5d0 con 0x7faea40ce960 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea0ff9700 1 -- 172.21.15.29:0/181009136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c012ad0 con 0x7faea40ce960 2023-10-06T05:26:21.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea416cb90 con 0x7faea40ce960 2023-10-06T05:26:21.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea416d090 con 0x7faea40ce960 2023-10-06T05:26:21.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea0ff9700 1 -- 172.21.15.29:0/181009136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fae8c01e460 con 0x7faea40ce960 2023-10-06T05:26:21.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea0ff9700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fae84060550 0x7fae84062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.056+0000 7faea0ff9700 1 -- 172.21.15.29:0/181009136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fae8c07cbe0 con 0x7faea40ce960 2023-10-06T05:26:21.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.060+0000 7faea8a71700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fae84060550 0x7fae84062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.060+0000 7faea8a71700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fae84060550 0x7fae84062a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae94004fd0 tx=0x7fae94007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:21.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.064+0000 7faea0ff9700 1 -- 172.21.15.29:0/181009136 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae8c04d3c0 con 0x7faea40ce960 2023-10-06T05:26:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.284+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7faea404be00 con 0x7faea40ce960 2023-10-06T05:26:21.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea0ff9700 1 -- 172.21.15.29:0/181009136 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fae8c0509e0 con 0x7faea40ce960 2023-10-06T05:26:21.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fae84060550 msgr2=0x7fae84062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fae84060550 0x7fae84062a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae94004fd0 tx=0x7fae94007eb0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea40ce960 msgr2=0x7faea40cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea40ce960 0x7faea40cc880 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00d890 tx=0x7fae8c008040 comp rx=0 tx=0).stop 2023-10-06T05:26:21.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 shutdown_connections 2023-10-06T05:26:21.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faea4158b50 0x7faea4167fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faea40ce960 0x7faea40cc880 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fae84060550 0x7fae84062a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 --2- 172.21.15.29:0/181009136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea406b620 0x7faea40c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 >> 172.21.15.29:0/181009136 conn(0x7faea406c6c0 msgr2=0x7faea4154170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 shutdown_connections 2023-10-06T05:26:21.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.292+0000 7faea9a73700 1 -- 172.21.15.29:0/181009136 wait complete. 2023-10-06T05:26:21.313 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T05:26:21.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.420+0000 7fcf14b3b700 1 Processor -- start 2023-10-06T05:26:21.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.420+0000 7fcf14b3b700 1 -- start start 2023-10-06T05:26:21.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.420+0000 7fcf14b3b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156af0 0x7fcf100cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf10158080 con 0x7fcf100c7070 2023-10-06T05:26:21.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf100cc480 con 0x7fcf10156ec0 2023-10-06T05:26:21.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10157470 con 0x7fcf10156af0 2023-10-06T05:26:21.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcf100c7070 0x7fcf1006a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58212/0 (socket says 172.21.15.29:58212) 2023-10-06T05:26:21.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0ffff700 1 -- 172.21.15.29:0/48795723 learned_addr learned my addr 172.21.15.29:0/48795723 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:21.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0f7fe700 1 --2- 172.21.15.29:0/48795723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156af0 0x7fcf100cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0e7fc700 1 -- 172.21.15.29:0/48795723 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337720865 0 0) 0x7fcf10158080 con 0x7fcf100c7070 2023-10-06T05:26:21.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0e7fc700 1 -- 172.21.15.29:0/48795723 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef8003570 con 0x7fcf100c7070 2023-10-06T05:26:21.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/48795723 >> v1:172.21.15.173:6789/0 conn(0x7fcf10156ec0 legacy=0x7fcf100c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/48795723 >> v1:172.21.15.29:6789/0 conn(0x7fcf100c7070 legacy=0x7fcf1006a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/48795723 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10157750 con 0x7fcf10156af0 2023-10-06T05:26:21.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0f7fe700 1 --2- 172.21.15.29:0/48795723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156af0 0x7fcf100cbf40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009910 tx=0x7fcf040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0687af8d523670f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:21.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0e7fc700 1 -- 172.21.15.29:0/48795723 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0400b680 con 0x7fcf10156af0 2023-10-06T05:26:21.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0e7fc700 1 -- 172.21.15.29:0/48795723 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0400b7e0 con 0x7fcf10156af0 2023-10-06T05:26:21.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf0e7fc700 1 -- 172.21.15.29:0/48795723 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0400bb60 con 0x7fcf10156af0 2023-10-06T05:26:21.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 -- 172.21.15.29:0/48795723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156af0 msgr2=0x7fcf100cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 --2- 172.21.15.29:0/48795723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156af0 0x7fcf100cbf40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009910 tx=0x7fcf040091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 -- 172.21.15.29:0/48795723 shutdown_connections 2023-10-06T05:26:21.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 --2- 172.21.15.29:0/48795723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156af0 0x7fcf100cbf40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 -- 172.21.15.29:0/48795723 >> 172.21.15.29:0/48795723 conn(0x7fcf100670a0 msgr2=0x7fcf10067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:21.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 -- 172.21.15.29:0/48795723 shutdown_connections 2023-10-06T05:26:21.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.424+0000 7fcf14b3b700 1 -- 172.21.15.29:0/48795723 wait complete. 2023-10-06T05:26:21.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 Processor -- start 2023-10-06T05:26:21.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 -- start start 2023-10-06T05:26:21.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf100c7070 0x7fcf100c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf10156af0 0x7fcf1016c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156ec0 0x7fcf1016ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100c2f20 con 0x7fcf10156af0 2023-10-06T05:26:21.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100aa240 con 0x7fcf100c7070 2023-10-06T05:26:21.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100a96c0 con 0x7fcf10156ec0 2023-10-06T05:26:21.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf10156af0 0x7fcf1016c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf10156af0 0x7fcf1016c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35840/0 (socket says 172.21.15.29:35840) 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0effd700 1 -- 172.21.15.29:0/1047851653 learned_addr learned my addr 172.21.15.29:0/1047851653 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0f7fe700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf100c7070 0x7fcf100c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0ffff700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156ec0 0x7fcf1016ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0effd700 1 -- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156ec0 msgr2=0x7fcf1016ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0effd700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156ec0 0x7fcf1016ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0effd700 1 -- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf100c7070 msgr2=0x7fcf100c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0effd700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf100c7070 0x7fcf100c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0effd700 1 -- 172.21.15.29:0/1047851653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04009420 con 0x7fcf10156af0 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0ffff700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156ec0 0x7fcf1016ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf0effd700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf10156af0 0x7fcf1016c790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c790 tx=0x7fcf00007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcef77fe700 1 -- 172.21.15.29:0/1047851653 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00011590 con 0x7fcf10156af0 2023-10-06T05:26:21.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcef77fe700 1 -- 172.21.15.29:0/1047851653 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf000116f0 con 0x7fcf10156af0 2023-10-06T05:26:21.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcef77fe700 1 -- 172.21.15.29:0/1047851653 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00011ab0 con 0x7fcf10156af0 2023-10-06T05:26:21.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf100a99a0 con 0x7fcf10156af0 2023-10-06T05:26:21.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.428+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf100a9f60 con 0x7fcf10156af0 2023-10-06T05:26:21.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.432+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf100aea00 con 0x7fcf10156af0 2023-10-06T05:26:21.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.432+0000 7fcef77fe700 1 -- 172.21.15.29:0/1047851653 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcf0001b3b0 con 0x7fcf10156af0 2023-10-06T05:26:21.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.432+0000 7fcef77fe700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcefc060550 0x7fcefc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.432+0000 7fcef77fe700 1 -- 172.21.15.29:0/1047851653 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcf0007baa0 con 0x7fcf10156af0 2023-10-06T05:26:21.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.432+0000 7fcf0f7fe700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcefc060550 0x7fcefc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.432+0000 7fcf0f7fe700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcefc060550 0x7fcefc062a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf040091e0 tx=0x7fcf04017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:21.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.440+0000 7fcef77fe700 1 -- 172.21.15.29:0/1047851653 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcf100aea00 con 0x7fcf10156af0 2023-10-06T05:26:21.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.660+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fcf100aea00 con 0x7fcf10156af0 2023-10-06T05:26:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcef77fe700 1 -- 172.21.15.29:0/1047851653 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcf100aea00 con 0x7fcf10156af0 2023-10-06T05:26:21.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcefc060550 msgr2=0x7fcefc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcefc060550 0x7fcefc062a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf040091e0 tx=0x7fcf04017000 comp rx=0 tx=0).stop 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf10156af0 msgr2=0x7fcf1016c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf10156af0 0x7fcf1016c790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c790 tx=0x7fcf00007f40 comp rx=0 tx=0).stop 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 shutdown_connections 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf10156ec0 0x7fcf1016ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf10156af0 0x7fcf1016c790 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcefc060550 0x7fcefc062a00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 --2- 172.21.15.29:0/1047851653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf100c7070 0x7fcf100c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 >> 172.21.15.29:0/1047851653 conn(0x7fcf100670a0 msgr2=0x7fcf1006aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 shutdown_connections 2023-10-06T05:26:21.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.668+0000 7fcf14b3b700 1 -- 172.21.15.29:0/1047851653 wait complete. 2023-10-06T05:26:21.688 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T05:26:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6ae529b700 1 Processor -- start 2023-10-06T05:26:21.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6ae529b700 1 -- start start 2023-10-06T05:26:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6ae529b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ae006c6c0 0x7f6ae006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6ae529b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae015a2d0 con 0x7f6ae0158ef0 2023-10-06T05:26:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6ae529b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae00cac70 con 0x7f6ae00cfd10 2023-10-06T05:26:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6ae529b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae00d0ce0 con 0x7f6ae006c6c0 2023-10-06T05:26:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6adf7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ae006c6c0 0x7f6ae006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6adf7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ae006c6c0 0x7f6ae006cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35850/0 (socket says 172.21.15.29:35850) 2023-10-06T05:26:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6adf7fe700 1 -- 172.21.15.29:0/3077428480 learned_addr learned my addr 172.21.15.29:0/3077428480 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:21.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6adffff700 1 --1- 172.21.15.29:0/3077428480 >> v1:172.21.15.29:6789/0 conn(0x7f6ae0158ef0 0x7f6ae00cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58218/0 (socket says 172.21.15.29:58218) 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6adf7fe700 1 -- 172.21.15.29:0/3077428480 >> v1:172.21.15.173:6789/0 conn(0x7f6ae00cfd10 legacy=0x7f6ae00d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6adf7fe700 1 -- 172.21.15.29:0/3077428480 >> v1:172.21.15.29:6789/0 conn(0x7f6ae0158ef0 legacy=0x7f6ae00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6adf7fe700 1 -- 172.21.15.29:0/3077428480 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae006d050 con 0x7f6ae006c6c0 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.788+0000 7f6adf7fe700 1 --2- 172.21.15.29:0/3077428480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 0x7f6ae006cb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009f20 tx=0x7f6ad0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53046b6ac24029af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6adeffd700 1 -- 172.21.15.29:0/3077428480 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000e070 con 0x7f6ae006c6c0 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6adeffd700 1 -- 172.21.15.29:0/3077428480 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad000ba40 con 0x7f6ae006c6c0 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6adeffd700 1 -- 172.21.15.29:0/3077428480 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00092e0 con 0x7f6ae006c6c0 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 -- 172.21.15.29:0/3077428480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 msgr2=0x7f6ae006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 --2- 172.21.15.29:0/3077428480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 0x7f6ae006cb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009f20 tx=0x7f6ad0009840 comp rx=0 tx=0).stop 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 -- 172.21.15.29:0/3077428480 shutdown_connections 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 --2- 172.21.15.29:0/3077428480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 0x7f6ae006cb10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 -- 172.21.15.29:0/3077428480 >> 172.21.15.29:0/3077428480 conn(0x7f6ae0062b60 msgr2=0x7f6ae0062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 -- 172.21.15.29:0/3077428480 shutdown_connections 2023-10-06T05:26:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 -- 172.21.15.29:0/3077428480 wait complete. 2023-10-06T05:26:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 Processor -- start 2023-10-06T05:26:21.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 -- start start 2023-10-06T05:26:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 0x7f6ae00c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae00cfd10 0x7f6ae00ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae0158ef0 0x7f6ae00ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c5770 con 0x7f6ae006c6c0 2023-10-06T05:26:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c48e0 con 0x7f6ae0158ef0 2023-10-06T05:26:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6ae529b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c5c00 con 0x7f6ae00cfd10 2023-10-06T05:26:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6adffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 0x7f6ae00c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.792+0000 7f6adffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 0x7f6ae00c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35858/0 (socket says 172.21.15.29:35858) 2023-10-06T05:26:21.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6adffff700 1 -- 172.21.15.29:0/3926655674 learned_addr learned my addr 172.21.15.29:0/3926655674 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:21.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6adf7fe700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae00cfd10 0x7f6ae00ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6ae4a9a700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae0158ef0 0x7f6ae00ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6adffff700 1 -- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae00cfd10 msgr2=0x7f6ae00ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6adffff700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae00cfd10 0x7f6ae00ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6adffff700 1 -- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae0158ef0 msgr2=0x7f6ae00ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6adffff700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae0158ef0 0x7f6ae00ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6adffff700 1 -- 172.21.15.29:0/3926655674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0009ae0 con 0x7f6ae006c6c0 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6adffff700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 0x7f6ae00c60c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c7f0 tx=0x7f6ad8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6ad7fff700 1 -- 172.21.15.29:0/3926655674 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8005a70 con 0x7f6ae006c6c0 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6ad7fff700 1 -- 172.21.15.29:0/3926655674 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad8005bf0 con 0x7f6ae006c6c0 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae00c4b60 con 0x7f6ae006c6c0 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6ad7fff700 1 -- 172.21.15.29:0/3926655674 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80070d0 con 0x7f6ae006c6c0 2023-10-06T05:26:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae00c5120 con 0x7f6ae006c6c0 2023-10-06T05:26:21.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.796+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae004be00 con 0x7f6ae006c6c0 2023-10-06T05:26:21.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.800+0000 7f6ad7fff700 1 -- 172.21.15.29:0/3926655674 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6ad8007440 con 0x7f6ae006c6c0 2023-10-06T05:26:21.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.800+0000 7f6ad7fff700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6ac0060580 0x7f6ac0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:21.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.800+0000 7f6ad7fff700 1 -- 172.21.15.29:0/3926655674 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6ad807bab0 con 0x7f6ae006c6c0 2023-10-06T05:26:21.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.800+0000 7f6adf7fe700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6ac0060580 0x7f6ac0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:21.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.800+0000 7f6adf7fe700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6ac0060580 0x7f6ac0062a30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009880 tx=0x7f6ad0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:21.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:21.804+0000 7f6ad7fff700 1 -- 172.21.15.29:0/3926655674 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ad804c290 con 0x7f6ae006c6c0 2023-10-06T05:26:22.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.028+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f6ae00cd350 con 0x7f6ae006c6c0 2023-10-06T05:26:22.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.036+0000 7f6ad7fff700 1 -- 172.21.15.29:0/3926655674 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6ad80170a0 con 0x7f6ae006c6c0 2023-10-06T05:26:22.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6ac0060580 msgr2=0x7f6ac0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6ac0060580 0x7f6ac0062a30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009880 tx=0x7f6ad0017000 comp rx=0 tx=0).stop 2023-10-06T05:26:22.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 msgr2=0x7f6ae00c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 0x7f6ae00c60c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c7f0 tx=0x7f6ad8007f30 comp rx=0 tx=0).stop 2023-10-06T05:26:22.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 shutdown_connections 2023-10-06T05:26:22.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6ac0060580 0x7f6ac0062a30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae0158ef0 0x7f6ae00ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae00cfd10 0x7f6ae00ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 --2- 172.21.15.29:0/3926655674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ae006c6c0 0x7f6ae00c60c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 >> 172.21.15.29:0/3926655674 conn(0x7f6ae0062b60 msgr2=0x7f6ae00b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:22.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 shutdown_connections 2023-10-06T05:26:22.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.040+0000 7f6ae529b700 1 -- 172.21.15.29:0/3926655674 wait complete. 2023-10-06T05:26:22.059 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T05:26:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 Processor -- start 2023-10-06T05:26:22.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 -- start start 2023-10-06T05:26:22.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c7413f980 0x7f4c740c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7415a490 con 0x7f4c74069960 2023-10-06T05:26:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c740c70b0 con 0x7f4c740c8c50 2023-10-06T05:26:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c74159880 con 0x7f4c7413f980 2023-10-06T05:26:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c79c6e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c7413f980 0x7f4c740c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7ac70700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4c74069960 0x7f4c740cc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58232/0 (socket says 172.21.15.29:58232) 2023-10-06T05:26:22.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7ac70700 1 -- 172.21.15.29:0/3724383953 learned_addr learned my addr 172.21.15.29:0/3724383953 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:22.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7946d700 1 -- 172.21.15.29:0/3724383953 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470849098 0 0) 0x7f4c7415a490 con 0x7f4c74069960 2023-10-06T05:26:22.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7946d700 1 -- 172.21.15.29:0/3724383953 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c60003570 con 0x7f4c74069960 2023-10-06T05:26:22.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c79c6e700 1 -- 172.21.15.29:0/3724383953 >> v1:172.21.15.173:6789/0 conn(0x7f4c740c8c50 legacy=0x7f4c7413f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c79c6e700 1 -- 172.21.15.29:0/3724383953 >> v1:172.21.15.29:6789/0 conn(0x7f4c74069960 legacy=0x7f4c740cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c79c6e700 1 -- 172.21.15.29:0/3724383953 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c74159b60 con 0x7f4c7413f980 2023-10-06T05:26:22.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c79c6e700 1 --2- 172.21.15.29:0/3724383953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 0x7f4c740c9020 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4c680098e0 tx=0x7f4c680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c900e31b8e7c171e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:22.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7946d700 1 -- 172.21.15.29:0/3724383953 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800b640 con 0x7f4c7413f980 2023-10-06T05:26:22.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7946d700 1 -- 172.21.15.29:0/3724383953 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6800b7a0 con 0x7f4c7413f980 2023-10-06T05:26:22.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7946d700 1 -- 172.21.15.29:0/3724383953 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800bb40 con 0x7f4c7413f980 2023-10-06T05:26:22.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/3724383953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 msgr2=0x7f4c740c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 --2- 172.21.15.29:0/3724383953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 0x7f4c740c9020 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4c680098e0 tx=0x7f4c680091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/3724383953 shutdown_connections 2023-10-06T05:26:22.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.164+0000 7f4c7c6d3700 1 --2- 172.21.15.29:0/3724383953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 0x7f4c740c9020 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.168+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/3724383953 >> 172.21.15.29:0/3724383953 conn(0x7f4c7406d7d0 msgr2=0x7f4c7406dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:22.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.168+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/3724383953 shutdown_connections 2023-10-06T05:26:22.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.168+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/3724383953 wait complete. 2023-10-06T05:26:22.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.168+0000 7f4c7c6d3700 1 Processor -- start 2023-10-06T05:26:22.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.168+0000 7f4c7c6d3700 1 -- start start 2023-10-06T05:26:22.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.168+0000 7f4c7c6d3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c74069960 0x7f4c7415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.168+0000 7f4c7c6d3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c740c8c50 0x7f4c7406cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.168+0000 7f4c7c6d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 0x7f4c740b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7c6d3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7406ca30 con 0x7f4c7413f980 2023-10-06T05:26:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7c6d3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740cc5f0 con 0x7f4c740c8c50 2023-10-06T05:26:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7c6d3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740cc8d0 con 0x7f4c74069960 2023-10-06T05:26:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7ac70700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 0x7f4c740b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7ac70700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 0x7f4c740b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35888/0 (socket says 172.21.15.29:35888) 2023-10-06T05:26:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7ac70700 1 -- 172.21.15.29:0/1063732916 learned_addr learned my addr 172.21.15.29:0/1063732916 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c79c6e700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c740c8c50 0x7f4c7406cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7a46f700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c74069960 0x7f4c7415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7ac70700 1 -- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c74069960 msgr2=0x7f4c7415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7ac70700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c74069960 0x7f4c7415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7ac70700 1 -- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c740c8c50 msgr2=0x7f4c7406cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7ac70700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c740c8c50 0x7f4c7406cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7ac70700 1 -- 172.21.15.29:0/1063732916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68009420 con 0x7f4c7413f980 2023-10-06T05:26:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7ac70700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 0x7f4c740b1870 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c001460 tx=0x7f4c6c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c667fc700 1 -- 172.21.15.29:0/1063732916 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c00a890 con 0x7f4c7413f980 2023-10-06T05:26:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c667fc700 1 -- 172.21.15.29:0/1063732916 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c00a9f0 con 0x7f4c7413f980 2023-10-06T05:26:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c667fc700 1 -- 172.21.15.29:0/1063732916 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c00ad70 con 0x7f4c7413f980 2023-10-06T05:26:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c740ccbb0 con 0x7f4c7413f980 2023-10-06T05:26:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7415c020 con 0x7f4c7413f980 2023-10-06T05:26:22.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.172+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7406cba0 con 0x7f4c7413f980 2023-10-06T05:26:22.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.176+0000 7f4c667fc700 1 -- 172.21.15.29:0/1063732916 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4c6c007300 con 0x7f4c7413f980 2023-10-06T05:26:22.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.176+0000 7f4c667fc700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c58060550 0x7f4c58062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.176+0000 7f4c667fc700 1 -- 172.21.15.29:0/1063732916 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4c6c07ca30 con 0x7f4c7413f980 2023-10-06T05:26:22.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.176+0000 7f4c7a46f700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c58060550 0x7f4c58062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.176+0000 7f4c7a46f700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c58060550 0x7f4c58062a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c70003a80 tx=0x7f4c70007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:22.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.184+0000 7f4c667fc700 1 -- 172.21.15.29:0/1063732916 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c6c04d180 con 0x7f4c7413f980 2023-10-06T05:26:22.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.408+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4c74071120 con 0x7f4c7413f980 2023-10-06T05:26:22.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.416+0000 7f4c667fc700 1 -- 172.21.15.29:0/1063732916 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4c6c0507a0 con 0x7f4c7413f980 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c58060550 msgr2=0x7f4c58062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c58060550 0x7f4c58062a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c70003a80 tx=0x7f4c70007ec0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 msgr2=0x7f4c740b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 0x7f4c740b1870 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c001460 tx=0x7f4c6c001ae0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 shutdown_connections 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c7413f980 0x7f4c740b1870 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c58060550 0x7f4c58062a00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c740c8c50 0x7f4c7406cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 --2- 172.21.15.29:0/1063732916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c74069960 0x7f4c7415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 >> 172.21.15.29:0/1063732916 conn(0x7f4c7406d7d0 msgr2=0x7f4c740c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:22.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 shutdown_connections 2023-10-06T05:26:22.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.420+0000 7f4c7c6d3700 1 -- 172.21.15.29:0/1063732916 wait complete. 2023-10-06T05:26:22.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T05:26:22.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.536+0000 7ff8248ec700 1 Processor -- start 2023-10-06T05:26:22.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.536+0000 7ff8248ec700 1 -- start start 2023-10-06T05:26:22.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.536+0000 7ff8248ec700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200ca5b0 0x7ff82006b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.536+0000 7ff8248ec700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8200cc8b0 con 0x7ff82015e490 2023-10-06T05:26:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.536+0000 7ff8248ec700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82006b280 con 0x7ff82015ace0 2023-10-06T05:26:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.536+0000 7ff8248ec700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82006bc50 con 0x7ff8200ca5b0 2023-10-06T05:26:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.536+0000 7ff81e59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff82015e490 0x7ff8200c9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58234/0 (socket says 172.21.15.29:58234) 2023-10-06T05:26:22.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.536+0000 7ff81e59c700 1 -- 172.21.15.29:0/3702623426 learned_addr learned my addr 172.21.15.29:0/3702623426 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81f59e700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200ca5b0 0x7ff82006b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637919768 0 0) 0x7ff8200cc8b0 con 0x7ff82015e490 2023-10-06T05:26:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff80c003570 con 0x7ff82015e490 2023-10-06T05:26:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454404172 0 0) 0x7ff80c003570 con 0x7ff82015e490 2023-10-06T05:26:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200ca5b0 msgr2=0x7ff82006b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200ca5b0 0x7ff82006b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 >> v1:172.21.15.173:6789/0 conn(0x7ff82015ace0 legacy=0x7ff8200cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82006a670 con 0x7ff82015e490 2023-10-06T05:26:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7ff808001810 con 0x7ff82015e490 2023-10-06T05:26:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 >> v1:172.21.15.29:6789/0 conn(0x7ff82015e490 legacy=0x7ff8200c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200ca5b0 0x7ff80c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80c003fd0 0x7ff80c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff80c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82006bc50 con 0x7ff80c004d50 2023-10-06T05:26:22.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c00bb40 con 0x7ff80c003fd0 2023-10-06T05:26:22.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c00bd00 con 0x7ff8200ca5b0 2023-10-06T05:26:22.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81f59e700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff80c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81e59c700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80c003fd0 0x7ff80c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81ed9d700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200ca5b0 0x7ff80c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81f59e700 1 -- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200ca5b0 msgr2=0x7ff80c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:22.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81f59e700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200ca5b0 0x7ff80c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81f59e700 1 -- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80c003fd0 msgr2=0x7ff80c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:22.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81f59e700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80c003fd0 0x7ff80c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81f59e700 1 -- 172.21.15.29:0/3702623426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c003570 con 0x7ff80c004d50 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81e59c700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80c003fd0 0x7ff80c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81f59e700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff80c0051c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff818009c00 tx=0x7ff8180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613657aa68930119 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81800e710 con 0x7ff80c004d50 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81800e870 con 0x7ff80c004d50 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81dd9b700 1 -- 172.21.15.29:0/3702623426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81800ec30 con 0x7ff80c004d50 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff8248ec700 1 -- 172.21.15.29:0/3702623426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 msgr2=0x7ff80c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff8248ec700 1 --2- 172.21.15.29:0/3702623426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff80c0051c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff818009c00 tx=0x7ff8180091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff81f59e700 1 -- 172.21.15.29:0/3702623426 reap_dead start 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff8248ec700 1 -- 172.21.15.29:0/3702623426 shutdown_connections 2023-10-06T05:26:22.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff8248ec700 1 -- 172.21.15.29:0/3702623426 >> 172.21.15.29:0/3702623426 conn(0x7ff8200670a0 msgr2=0x7ff820067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff8248ec700 1 -- 172.21.15.29:0/3702623426 shutdown_connections 2023-10-06T05:26:22.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.540+0000 7ff8248ec700 1 -- 172.21.15.29:0/3702623426 wait complete. 2023-10-06T05:26:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff8248ec700 1 Processor -- start 2023-10-06T05:26:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff8248ec700 1 -- start start 2023-10-06T05:26:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff8248ec700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff82015c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff8248ec700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200b1080 0x7ff820155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff8248ec700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8200aef50 0x7ff8200af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff8248ec700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82015cf30 con 0x7ff80c004d50 2023-10-06T05:26:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff8248ec700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200af900 con 0x7ff8200aef50 2023-10-06T05:26:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff8248ec700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200b1810 con 0x7ff8200b1080 2023-10-06T05:26:22.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81ed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff82015c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81ed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff82015c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35908/0 (socket says 172.21.15.29:35908) 2023-10-06T05:26:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81ed9d700 1 -- 172.21.15.29:0/554903611 learned_addr learned my addr 172.21.15.29:0/554903611 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81f59e700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8200aef50 0x7ff8200af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81e59c700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200b1080 0x7ff820155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81ed9d700 1 -- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200b1080 msgr2=0x7ff820155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81ed9d700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200b1080 0x7ff820155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81ed9d700 1 -- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8200aef50 msgr2=0x7ff8200af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81ed9d700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8200aef50 0x7ff8200af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81ed9d700 1 -- 172.21.15.29:0/554903611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820157e20 con 0x7ff80c004d50 2023-10-06T05:26:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.544+0000 7ff81ed9d700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff82015c9f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff810002a90 tx=0x7ff810007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff816ffd700 1 -- 172.21.15.29:0/554903611 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810002ed0 con 0x7ff80c004d50 2023-10-06T05:26:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff816ffd700 1 -- 172.21.15.29:0/554903611 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000f870 con 0x7ff80c004d50 2023-10-06T05:26:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8201574f0 con 0x7ff80c004d50 2023-10-06T05:26:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff816ffd700 1 -- 172.21.15.29:0/554903611 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000fc10 con 0x7ff80c004d50 2023-10-06T05:26:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff820157ab0 con 0x7ff80c004d50 2023-10-06T05:26:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82004be00 con 0x7ff80c004d50 2023-10-06T05:26:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff816ffd700 1 -- 172.21.15.29:0/554903611 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff81001c400 con 0x7ff80c004d50 2023-10-06T05:26:22.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff816ffd700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff800060580 0x7ff800062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff816ffd700 1 -- 172.21.15.29:0/554903611 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff81007ca10 con 0x7ff80c004d50 2023-10-06T05:26:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.548+0000 7ff81e59c700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff800060580 0x7ff800062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.552+0000 7ff81e59c700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff800060580 0x7ff800062a30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff820158d60 tx=0x7ff808006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:22.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.556+0000 7ff816ffd700 1 -- 172.21.15.29:0/554903611 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff81004d2a0 con 0x7ff80c004d50 2023-10-06T05:26:22.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.780+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff82006a950 con 0x7ff80c004d50 2023-10-06T05:26:22.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff816ffd700 1 -- 172.21.15.29:0/554903611 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff8100170a0 con 0x7ff80c004d50 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff800060580 msgr2=0x7ff800062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff800060580 0x7ff800062a30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff820158d60 tx=0x7ff808006040 comp rx=0 tx=0).stop 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 msgr2=0x7ff82015c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff82015c9f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff810002a90 tx=0x7ff810007d10 comp rx=0 tx=0).stop 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 shutdown_connections 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff800060580 0x7ff800062a30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8200aef50 0x7ff8200af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8200b1080 0x7ff820155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 --2- 172.21.15.29:0/554903611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff80c004d50 0x7ff82015c9f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.788+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 >> 172.21.15.29:0/554903611 conn(0x7ff8200670a0 msgr2=0x7ff8200c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:22.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.792+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 shutdown_connections 2023-10-06T05:26:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.792+0000 7ff8248ec700 1 -- 172.21.15.29:0/554903611 wait complete. 2023-10-06T05:26:22.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T05:26:22.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.908+0000 7fd13eb5b700 1 Processor -- start 2023-10-06T05:26:22.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.908+0000 7fd13eb5b700 1 -- start start 2023-10-06T05:26:22.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1380ab4b0 0x7fd1380af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380afb30 0x7fd13806e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13806b390 con 0x7fd1381551f0 2023-10-06T05:26:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1380acdf0 con 0x7fd1380ab4b0 2023-10-06T05:26:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13806ab70 con 0x7fd1380afb30 2023-10-06T05:26:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd137fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1380ab4b0 0x7fd1380af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd137fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1380ab4b0 0x7fd1380af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35912/0 (socket says 172.21.15.29:35912) 2023-10-06T05:26:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd137fff700 1 -- 172.21.15.29:0/2050878270 learned_addr learned my addr 172.21.15.29:0/2050878270 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:22.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13d0f8700 1 --2- 172.21.15.29:0/2050878270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380afb30 0x7fd13806e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd137fff700 1 -- 172.21.15.29:0/2050878270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380afb30 msgr2=0x7fd13806e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd137fff700 1 --2- 172.21.15.29:0/2050878270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380afb30 0x7fd13806e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd137fff700 1 -- 172.21.15.29:0/2050878270 >> v1:172.21.15.173:6789/0 conn(0x7fd1381551f0 legacy=0x7fd13806a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd137fff700 1 -- 172.21.15.29:0/2050878270 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13806add0 con 0x7fd1380ab4b0 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd137fff700 1 --2- 172.21.15.29:0/2050878270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380ab4b0 0x7fd1380af5f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd1240099b0 tx=0x7fd124009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeee171e66acdd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd1377fe700 1 -- 172.21.15.29:0/2050878270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124009ea0 con 0x7fd1380ab4b0 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd1377fe700 1 -- 172.21.15.29:0/2050878270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12400b860 con 0x7fd1380ab4b0 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd1377fe700 1 -- 172.21.15.29:0/2050878270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12400bc00 con 0x7fd1380ab4b0 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 -- 172.21.15.29:0/2050878270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380ab4b0 msgr2=0x7fd1380af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 --2- 172.21.15.29:0/2050878270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380ab4b0 0x7fd1380af5f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd1240099b0 tx=0x7fd124009250 comp rx=0 tx=0).stop 2023-10-06T05:26:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 -- 172.21.15.29:0/2050878270 shutdown_connections 2023-10-06T05:26:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 --2- 172.21.15.29:0/2050878270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380afb30 0x7fd13806e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 --2- 172.21.15.29:0/2050878270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380ab4b0 0x7fd1380af5f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 -- 172.21.15.29:0/2050878270 >> 172.21.15.29:0/2050878270 conn(0x7fd138067b70 msgr2=0x7fd13806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 -- 172.21.15.29:0/2050878270 shutdown_connections 2023-10-06T05:26:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.912+0000 7fd13eb5b700 1 -- 172.21.15.29:0/2050878270 wait complete. 2023-10-06T05:26:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13eb5b700 1 Processor -- start 2023-10-06T05:26:22.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13eb5b700 1 -- start start 2023-10-06T05:26:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13eb5b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380ab4b0 0x7fd1381545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13eb5b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380afb30 0x7fd138157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13eb5b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1381551f0 0x7fd138157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13eb5b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd138167bf0 con 0x7fd1380afb30 2023-10-06T05:26:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13eb5b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380a7b80 con 0x7fd1381551f0 2023-10-06T05:26:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13eb5b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380a7e60 con 0x7fd1380ab4b0 2023-10-06T05:26:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd137fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380afb30 0x7fd138157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd137fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380afb30 0x7fd138157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35924/0 (socket says 172.21.15.29:35924) 2023-10-06T05:26:22.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd137fff700 1 -- 172.21.15.29:0/971758717 learned_addr learned my addr 172.21.15.29:0/971758717 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:22.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13c8f7700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380ab4b0 0x7fd1381545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.916+0000 7fd13d0f8700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1381551f0 0x7fd138157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd137fff700 1 -- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380ab4b0 msgr2=0x7fd1381545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd137fff700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380ab4b0 0x7fd1381545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd137fff700 1 -- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1381551f0 msgr2=0x7fd138157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:22.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd137fff700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1381551f0 0x7fd138157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:22.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd137fff700 1 -- 172.21.15.29:0/971758717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240094f0 con 0x7fd1380afb30 2023-10-06T05:26:22.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd137fff700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380afb30 0x7fd138157860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd138069790 tx=0x7fd124017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:22.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd134ff9700 1 -- 172.21.15.29:0/971758717 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124000d10 con 0x7fd1380afb30 2023-10-06T05:26:22.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd134ff9700 1 -- 172.21.15.29:0/971758717 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12400bbe0 con 0x7fd1380afb30 2023-10-06T05:26:22.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd138167880 con 0x7fd1380afb30 2023-10-06T05:26:22.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd134ff9700 1 -- 172.21.15.29:0/971758717 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124011650 con 0x7fd1380afb30 2023-10-06T05:26:22.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd138167500 con 0x7fd1380afb30 2023-10-06T05:26:22.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd138071120 con 0x7fd1380afb30 2023-10-06T05:26:22.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.920+0000 7fd134ff9700 1 -- 172.21.15.29:0/971758717 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd124011a80 con 0x7fd1380afb30 2023-10-06T05:26:22.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.924+0000 7fd134ff9700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd11c060550 0x7fd11c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:22.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.924+0000 7fd134ff9700 1 -- 172.21.15.29:0/971758717 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd12407de00 con 0x7fd1380afb30 2023-10-06T05:26:22.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.924+0000 7fd13c8f7700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd11c060550 0x7fd11c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:22.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.924+0000 7fd13c8f7700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd11c060550 0x7fd11c062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0039e0 tx=0x7fd12c007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:22.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:22.932+0000 7fd134ff9700 1 -- 172.21.15.29:0/971758717 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd12404e5e0 con 0x7fd1380afb30 2023-10-06T05:26:23.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.152+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd13806b0b0 con 0x7fd1380afb30 2023-10-06T05:26:23.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.160+0000 7fd134ff9700 1 -- 172.21.15.29:0/971758717 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd1240150a0 con 0x7fd1380afb30 2023-10-06T05:26:23.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd11c060550 msgr2=0x7fd11c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd11c060550 0x7fd11c062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0039e0 tx=0x7fd12c007ec0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380afb30 msgr2=0x7fd138157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380afb30 0x7fd138157860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd138069790 tx=0x7fd124017000 comp rx=0 tx=0).stop 2023-10-06T05:26:23.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 shutdown_connections 2023-10-06T05:26:23.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd11c060550 0x7fd11c062a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1381551f0 0x7fd138157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1380afb30 0x7fd138157860 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 --2- 172.21.15.29:0/971758717 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1380ab4b0 0x7fd1381545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 >> 172.21.15.29:0/971758717 conn(0x7fd138067b70 msgr2=0x7fd1380a5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:23.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 shutdown_connections 2023-10-06T05:26:23.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.164+0000 7fd13eb5b700 1 -- 172.21.15.29:0/971758717 wait complete. 2023-10-06T05:26:23.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:23.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.288+0000 7f7a7ae84700 1 Processor -- start 2023-10-06T05:26:23.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.288+0000 7f7a7ae84700 1 -- start start 2023-10-06T05:26:23.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.288+0000 7f7a7ae84700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 0x7f7a7406b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.288+0000 7f7a7ae84700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7a7406ccc0 0x7f7a74159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.288+0000 7f7a7ae84700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7406aef0 con 0x7f7a740c8370 2023-10-06T05:26:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.288+0000 7f7a7ae84700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740c8080 con 0x7f7a7406ccc0 2023-10-06T05:26:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.288+0000 7f7a7ae84700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7406a2e0 con 0x7f7a7406c8f0 2023-10-06T05:26:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.288+0000 7f7a7a683700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7a740c8370 0x7f7a740c7970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58246/0 (socket says 172.21.15.29:58246) 2023-10-06T05:26:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a7a683700 1 -- 172.21.15.29:0/1161771090 learned_addr learned my addr 172.21.15.29:0/1161771090 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a79681700 1 --2- 172.21.15.29:0/1161771090 >> v2:172.21.15.29:3300/0 conn(0x7f7a7406ccc0 0x7f7a74159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a79e82700 1 --2- 172.21.15.29:0/1161771090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 0x7f7a7406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a78e80700 1 -- 172.21.15.29:0/1161771090 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161198576 0 0) 0x7f7a7406aef0 con 0x7f7a740c8370 2023-10-06T05:26:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a78e80700 1 -- 172.21.15.29:0/1161771090 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a64003570 con 0x7f7a740c8370 2023-10-06T05:26:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a78e80700 1 -- 172.21.15.29:0/1161771090 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2377732874 0 0) 0x7f7a64003570 con 0x7f7a740c8370 2023-10-06T05:26:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a79681700 1 -- 172.21.15.29:0/1161771090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 msgr2=0x7f7a7406b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:23.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a79681700 1 --2- 172.21.15.29:0/1161771090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 0x7f7a7406b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a79681700 1 -- 172.21.15.29:0/1161771090 >> v1:172.21.15.29:6789/0 conn(0x7f7a740c8370 legacy=0x7f7a740c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a79681700 1 -- 172.21.15.29:0/1161771090 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7406a5c0 con 0x7f7a7406ccc0 2023-10-06T05:26:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a79681700 1 --2- 172.21.15.29:0/1161771090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 0x7f7a74159850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098e0 tx=0x7f7a600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8026e032f030593 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a78e80700 1 -- 172.21.15.29:0/1161771090 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c001470 con 0x7f7a7406ccc0 2023-10-06T05:26:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a78e80700 1 -- 172.21.15.29:0/1161771090 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a60011420 con 0x7f7a7406ccc0 2023-10-06T05:26:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a78e80700 1 -- 172.21.15.29:0/1161771090 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a600117c0 con 0x7f7a7406ccc0 2023-10-06T05:26:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a7ae84700 1 -- 172.21.15.29:0/1161771090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 msgr2=0x7f7a74159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a7ae84700 1 --2- 172.21.15.29:0/1161771090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 0x7f7a74159850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098e0 tx=0x7f7a600091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a7ae84700 1 -- 172.21.15.29:0/1161771090 shutdown_connections 2023-10-06T05:26:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a7ae84700 1 --2- 172.21.15.29:0/1161771090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 0x7f7a74159850 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a7ae84700 1 --2- 172.21.15.29:0/1161771090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 0x7f7a7406b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a7ae84700 1 -- 172.21.15.29:0/1161771090 >> 172.21.15.29:0/1161771090 conn(0x7f7a740670a0 msgr2=0x7f7a740674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a7ae84700 1 -- 172.21.15.29:0/1161771090 shutdown_connections 2023-10-06T05:26:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.292+0000 7f7a7ae84700 1 -- 172.21.15.29:0/1161771090 wait complete. 2023-10-06T05:26:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 Processor -- start 2023-10-06T05:26:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 -- start start 2023-10-06T05:26:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 0x7f7a7414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 0x7f7a740b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a740c8370 0x7f7a740c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740ad3f0 con 0x7f7a7406ccc0 2023-10-06T05:26:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740ad880 con 0x7f7a740c8370 2023-10-06T05:26:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740ac7e0 con 0x7f7a7406c8f0 2023-10-06T05:26:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79681700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 0x7f7a740b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79e82700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 0x7f7a7414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7a683700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a740c8370 0x7f7a740c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79681700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 0x7f7a740b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35950/0 (socket says 172.21.15.29:35950) 2023-10-06T05:26:23.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7a683700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a740c8370 0x7f7a740c0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:53420/0 (socket says 172.21.15.29:53420) 2023-10-06T05:26:23.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79681700 1 -- 172.21.15.29:0/424880582 learned_addr learned my addr 172.21.15.29:0/424880582 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:23.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79e82700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 0x7f7a7414f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:47802/0 (socket says 172.21.15.29:47802) 2023-10-06T05:26:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79681700 1 -- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 msgr2=0x7f7a7414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79681700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 0x7f7a7414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79681700 1 -- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a740c8370 msgr2=0x7f7a740c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79681700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a740c8370 0x7f7a740c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79681700 1 -- 172.21.15.29:0/424880582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a60009420 con 0x7f7a7406ccc0 2023-10-06T05:26:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a79681700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 0x7f7a740b0e80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a600030c0 tx=0x7f7a60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a71ffb700 1 -- 172.21.15.29:0/424880582 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6001cb30 con 0x7f7a7406ccc0 2023-10-06T05:26:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a71ffb700 1 -- 172.21.15.29:0/424880582 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6001cc90 con 0x7f7a7406ccc0 2023-10-06T05:26:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a740acac0 con 0x7f7a7406ccc0 2023-10-06T05:26:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a71ffb700 1 -- 172.21.15.29:0/424880582 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6001a6a0 con 0x7f7a7406ccc0 2023-10-06T05:26:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.296+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a740ad080 con 0x7f7a7406ccc0 2023-10-06T05:26:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.300+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a740ad5a0 con 0x7f7a7406ccc0 2023-10-06T05:26:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.300+0000 7f7a71ffb700 1 -- 172.21.15.29:0/424880582 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7a6001aad0 con 0x7f7a7406ccc0 2023-10-06T05:26:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.300+0000 7f7a71ffb700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7a58060580 0x7f7a58062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.300+0000 7f7a71ffb700 1 -- 172.21.15.29:0/424880582 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7a6007ddb0 con 0x7f7a7406ccc0 2023-10-06T05:26:23.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.300+0000 7f7a79e82700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7a58060580 0x7f7a58062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.300+0000 7f7a79e82700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7a58060580 0x7f7a58062a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009fd0 tx=0x7f7a6800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:23.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.308+0000 7f7a71ffb700 1 -- 172.21.15.29:0/424880582 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7a740ad5a0 con 0x7f7a7406ccc0 2023-10-06T05:26:23.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.472+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a7404be00 con 0x7f7a7406ccc0 2023-10-06T05:26:23.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a71ffb700 1 -- 172.21.15.29:0/424880582 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+13650 (secure 0 0 0) 0x7f7a60029090 con 0x7f7a7406ccc0 2023-10-06T05:26:23.481 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:23.481 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":32,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:26:20.536572+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:23.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7a58060580 msgr2=0x7f7a58062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7a58060580 0x7f7a58062a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009fd0 tx=0x7f7a6800b040 comp rx=0 tx=0).stop 2023-10-06T05:26:23.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 msgr2=0x7f7a740b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 0x7f7a740b0e80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a600030c0 tx=0x7f7a60016000 comp rx=0 tx=0).stop 2023-10-06T05:26:23.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 shutdown_connections 2023-10-06T05:26:23.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7a58060580 0x7f7a58062a30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a740c8370 0x7f7a740c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a7406ccc0 0x7f7a740b0e80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 --2- 172.21.15.29:0/424880582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7a7406c8f0 0x7f7a7414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 >> 172.21.15.29:0/424880582 conn(0x7f7a740670a0 msgr2=0x7f7a741533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:23.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 shutdown_connections 2023-10-06T05:26:23.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.476+0000 7f7a7ae84700 1 -- 172.21.15.29:0/424880582 wait complete. 2023-10-06T05:26:23.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T05:26:23.497 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:26:23.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.600+0000 7f5b9ffff700 1 Processor -- start 2023-10-06T05:26:23.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.600+0000 7f5b9ffff700 1 -- start start 2023-10-06T05:26:23.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba0159200 0x7f5ba00c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba006bf90 con 0x7f5ba00c72f0 2023-10-06T05:26:23.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9ffff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba006b6f0 con 0x7f5ba0158e30 2023-10-06T05:26:23.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba006b9d0 con 0x7f5ba0159200 2023-10-06T05:26:23.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5ba00c72f0 0x7f5ba00676f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58258/0 (socket says 172.21.15.29:58258) 2023-10-06T05:26:23.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9f7fe700 1 -- 172.21.15.29:0/1778886778 learned_addr learned my addr 172.21.15.29:0/1778886778 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:23.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b97fff700 1 --2- 172.21.15.29:0/1778886778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba0159200 0x7f5ba00c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9e7fc700 1 -- 172.21.15.29:0/1778886778 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192651857 0 0) 0x7f5ba006bf90 con 0x7f5ba00c72f0 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9e7fc700 1 -- 172.21.15.29:0/1778886778 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b8c003570 con 0x7f5ba00c72f0 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9e7fc700 1 -- 172.21.15.29:0/1778886778 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954467727 0 0) 0x7f5ba006b6f0 con 0x7f5ba0158e30 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9e7fc700 1 -- 172.21.15.29:0/1778886778 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ba006bf90 con 0x7f5ba0158e30 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b97fff700 1 -- 172.21.15.29:0/1778886778 >> v1:172.21.15.173:6789/0 conn(0x7f5ba0158e30 legacy=0x7f5ba0068260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b97fff700 1 -- 172.21.15.29:0/1778886778 >> v1:172.21.15.29:6789/0 conn(0x7f5ba00c72f0 legacy=0x7f5ba00676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b97fff700 1 -- 172.21.15.29:0/1778886778 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba006bcb0 con 0x7f5ba0159200 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b97fff700 1 --2- 172.21.15.29:0/1778886778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba0159200 0x7f5ba00c6db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009910 tx=0x7f5b880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219ab841e3036d33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9e7fc700 1 -- 172.21.15.29:0/1778886778 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88011630 con 0x7f5ba0159200 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9e7fc700 1 -- 172.21.15.29:0/1778886778 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b88011790 con 0x7f5ba0159200 2023-10-06T05:26:23.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.604+0000 7f5b9e7fc700 1 -- 172.21.15.29:0/1778886778 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88011b10 con 0x7f5ba0159200 2023-10-06T05:26:23.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.608+0000 7f5b9ffff700 1 -- 172.21.15.29:0/1778886778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba0159200 msgr2=0x7f5ba00c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.608+0000 7f5b9ffff700 1 --2- 172.21.15.29:0/1778886778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba0159200 0x7f5ba00c6db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009910 tx=0x7f5b880091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.608+0000 7f5b9ffff700 1 -- 172.21.15.29:0/1778886778 shutdown_connections 2023-10-06T05:26:23.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.608+0000 7f5b9ffff700 1 --2- 172.21.15.29:0/1778886778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba0159200 0x7f5ba00c6db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.608+0000 7f5b9ffff700 1 -- 172.21.15.29:0/1778886778 >> 172.21.15.29:0/1778886778 conn(0x7f5ba00c9830 msgr2=0x7f5ba006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:23.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.608+0000 7f5b9ffff700 1 -- 172.21.15.29:0/1778886778 shutdown_connections 2023-10-06T05:26:23.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.608+0000 7f5b9ffff700 1 -- 172.21.15.29:0/1778886778 wait complete. 2023-10-06T05:26:23.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 Processor -- start 2023-10-06T05:26:23.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 -- start start 2023-10-06T05:26:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba00c72f0 0x7f5ba0155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba0158e30 0x7f5ba00a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ba0159200 0x7f5ba00b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba016c610 con 0x7f5ba0158e30 2023-10-06T05:26:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba016c820 con 0x7f5ba0159200 2023-10-06T05:26:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba016cb00 con 0x7f5ba00c72f0 2023-10-06T05:26:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b97fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba0158e30 0x7f5ba00a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b97fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba0158e30 0x7f5ba00a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35958/0 (socket says 172.21.15.29:35958) 2023-10-06T05:26:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b97fff700 1 -- 172.21.15.29:0/989345792 learned_addr learned my addr 172.21.15.29:0/989345792 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9f7fe700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ba0159200 0x7f5ba00b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9effd700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba00c72f0 0x7f5ba0155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b97fff700 1 -- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba00c72f0 msgr2=0x7f5ba0155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b97fff700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba00c72f0 0x7f5ba0155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b97fff700 1 -- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ba0159200 msgr2=0x7f5ba00b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b97fff700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ba0159200 0x7f5ba00b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b97fff700 1 -- 172.21.15.29:0/989345792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b88009420 con 0x7f5ba0158e30 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9f7fe700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ba0159200 0x7f5ba00b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b97fff700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba0158e30 0x7f5ba00a9a70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ba006eda0 tx=0x7f5b88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b96ffd700 1 -- 172.21.15.29:0/989345792 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88011b10 con 0x7f5ba0158e30 2023-10-06T05:26:23.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b96ffd700 1 -- 172.21.15.29:0/989345792 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b88000d10 con 0x7f5ba0158e30 2023-10-06T05:26:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b96ffd700 1 -- 172.21.15.29:0/989345792 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88025640 con 0x7f5ba0158e30 2023-10-06T05:26:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba016cde0 con 0x7f5ba0158e30 2023-10-06T05:26:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.612+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba016d3a0 con 0x7f5ba0158e30 2023-10-06T05:26:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.616+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba004be00 con 0x7f5ba0158e30 2023-10-06T05:26:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.616+0000 7f5b96ffd700 1 -- 172.21.15.29:0/989345792 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5b880259f0 con 0x7f5ba0158e30 2023-10-06T05:26:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.616+0000 7f5b96ffd700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5b80060550 0x7f5b80062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.616+0000 7f5b96ffd700 1 -- 172.21.15.29:0/989345792 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5b8807dd90 con 0x7f5ba0158e30 2023-10-06T05:26:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.616+0000 7f5b9effd700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5b80060550 0x7f5b80062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.620+0000 7f5b9effd700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5b80060550 0x7f5b80062a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b900037e0 tx=0x7f5b90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:23.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.624+0000 7f5b96ffd700 1 -- 172.21.15.29:0/989345792 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5b8804e570 con 0x7f5ba0158e30 2023-10-06T05:26:23.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.784+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ba0062f90 con 0x7f5ba0158e30 2023-10-06T05:26:23.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b96ffd700 1 -- 172.21.15.29:0/989345792 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b880150a0 con 0x7f5ba0158e30 2023-10-06T05:26:23.793 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:26:23.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5b80060550 msgr2=0x7f5b80062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5b80060550 0x7f5b80062a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b900037e0 tx=0x7f5b90009040 comp rx=0 tx=0).stop 2023-10-06T05:26:23.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba0158e30 msgr2=0x7f5ba00a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba0158e30 0x7f5ba00a9a70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ba006eda0 tx=0x7f5b88017000 comp rx=0 tx=0).stop 2023-10-06T05:26:23.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 shutdown_connections 2023-10-06T05:26:23.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5b80060550 0x7f5b80062a00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ba0159200 0x7f5ba00b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba0158e30 0x7f5ba00a9a70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 --2- 172.21.15.29:0/989345792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ba00c72f0 0x7f5ba0155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 >> 172.21.15.29:0/989345792 conn(0x7f5ba00c9830 msgr2=0x7f5ba0157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:23.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 shutdown_connections 2023-10-06T05:26:23.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.788+0000 7f5b9ffff700 1 -- 172.21.15.29:0/989345792 wait complete. 2023-10-06T05:26:23.807 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:26:23.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.912+0000 7fa00759e700 1 Processor -- start 2023-10-06T05:26:23.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 -- start start 2023-10-06T05:26:23.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa0080ae9c0 0x7fa0080ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa0080c99f0 0x7fa0080c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0080afab0 con 0x7fa0080acde0 2023-10-06T05:26:23.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0080ca350 con 0x7fa0080ae9c0 2023-10-06T05:26:23.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0080cc850 con 0x7fa0080c99f0 2023-10-06T05:26:23.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa005d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa0080ae9c0 0x7fa0080ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa005d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa0080ae9c0 0x7fa0080ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35972/0 (socket says 172.21.15.29:35972) 2023-10-06T05:26:23.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa005d9b700 1 -- 172.21.15.29:0/1006231301 learned_addr learned my addr 172.21.15.29:0/1006231301 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:23.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa006d9d700 1 --2- 172.21.15.29:0/1006231301 >> v2:172.21.15.173:3300/0 conn(0x7fa0080c99f0 0x7fa0080c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa005d9b700 1 -- 172.21.15.29:0/1006231301 >> v2:172.21.15.173:3300/0 conn(0x7fa0080c99f0 msgr2=0x7fa0080c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa005d9b700 1 --2- 172.21.15.29:0/1006231301 >> v2:172.21.15.173:3300/0 conn(0x7fa0080c99f0 0x7fa0080c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa005d9b700 1 -- 172.21.15.29:0/1006231301 >> v1:172.21.15.173:6789/0 conn(0x7fa0080acde0 legacy=0x7fa00815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa005d9b700 1 -- 172.21.15.29:0/1006231301 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080aeea0 con 0x7fa0080ae9c0 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa005d9b700 1 --2- 172.21.15.29:0/1006231301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080ae9c0 0x7fa0080ad1b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa008070cb0 tx=0x7f9ff8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c71318a4512a0c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00559a700 1 -- 172.21.15.29:0/1006231301 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8009e70 con 0x7fa0080ae9c0 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00559a700 1 -- 172.21.15.29:0/1006231301 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff800b860 con 0x7fa0080ae9c0 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00559a700 1 -- 172.21.15.29:0/1006231301 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800bc00 con 0x7fa0080ae9c0 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 -- 172.21.15.29:0/1006231301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080ae9c0 msgr2=0x7fa0080ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 --2- 172.21.15.29:0/1006231301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080ae9c0 0x7fa0080ad1b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa008070cb0 tx=0x7f9ff8009250 comp rx=0 tx=0).stop 2023-10-06T05:26:23.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 -- 172.21.15.29:0/1006231301 shutdown_connections 2023-10-06T05:26:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 --2- 172.21.15.29:0/1006231301 >> v2:172.21.15.173:3300/0 conn(0x7fa0080c99f0 0x7fa0080c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 --2- 172.21.15.29:0/1006231301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080ae9c0 0x7fa0080ad1b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 -- 172.21.15.29:0/1006231301 >> 172.21.15.29:0/1006231301 conn(0x7fa00806d150 msgr2=0x7fa0080cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 -- 172.21.15.29:0/1006231301 shutdown_connections 2023-10-06T05:26:23.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.916+0000 7fa00759e700 1 -- 172.21.15.29:0/1006231301 wait complete. 2023-10-06T05:26:23.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 Processor -- start 2023-10-06T05:26:23.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 -- start start 2023-10-06T05:26:23.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080acde0 0x7fa00814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0080ae9c0 0x7fa0080c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0080c99f0 0x7fa0080c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0081696e0 con 0x7fa0080acde0 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0081699c0 con 0x7fa0080c99f0 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa008169ca0 con 0x7fa0080ae9c0 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080acde0 0x7fa00814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080acde0 0x7fa00814d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35978/0 (socket says 172.21.15.29:35978) 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00659c700 1 -- 172.21.15.29:0/1228281778 learned_addr learned my addr 172.21.15.29:0/1228281778 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa005d9b700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0080ae9c0 0x7fa0080c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa006d9d700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0080c99f0 0x7fa0080c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00659c700 1 -- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0080ae9c0 msgr2=0x7fa0080c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00659c700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0080ae9c0 0x7fa0080c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00659c700 1 -- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0080c99f0 msgr2=0x7fa0080c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00659c700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0080c99f0 0x7fa0080c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00659c700 1 -- 172.21.15.29:0/1228281778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80094f0 con 0x7fa0080acde0 2023-10-06T05:26:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00659c700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080acde0 0x7fa00814d670 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c4e0 tx=0x7f9ff000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7f9ffe7fc700 1 -- 172.21.15.29:0/1228281778 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0011590 con 0x7fa0080acde0 2023-10-06T05:26:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7f9ffe7fc700 1 -- 172.21.15.29:0/1228281778 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff0011710 con 0x7fa0080acde0 2023-10-06T05:26:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa008169f80 con 0x7fa0080acde0 2023-10-06T05:26:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7f9ffe7fc700 1 -- 172.21.15.29:0/1228281778 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0011ad0 con 0x7fa0080acde0 2023-10-06T05:26:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.920+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00814dbb0 con 0x7fa0080acde0 2023-10-06T05:26:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.924+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0080a8940 con 0x7fa0080acde0 2023-10-06T05:26:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.924+0000 7f9ffe7fc700 1 -- 172.21.15.29:0/1228281778 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9ff001b3b0 con 0x7fa0080acde0 2023-10-06T05:26:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.924+0000 7f9ffe7fc700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fe8060550 0x7f9fe8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.924+0000 7f9ffe7fc700 1 -- 172.21.15.29:0/1228281778 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9ff007b940 con 0x7fa0080acde0 2023-10-06T05:26:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.924+0000 7fa005d9b700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fe8060550 0x7f9fe8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.924+0000 7fa005d9b700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fe8060550 0x7f9fe8062a00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa008070cb0 tx=0x7f9ff8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:23.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:23.932+0000 7f9ffe7fc700 1 -- 172.21.15.29:0/1228281778 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ff004c120 con 0x7fa0080acde0 2023-10-06T05:26:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa00804be00 con 0x7fa0080acde0 2023-10-06T05:26:24.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7f9ffe7fc700 1 -- 172.21.15.29:0/1228281778 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ff004f740 con 0x7fa0080acde0 2023-10-06T05:26:24.093 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:26:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fe8060550 msgr2=0x7f9fe8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7fa00759e700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fe8060550 0x7f9fe8062a00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa008070cb0 tx=0x7f9ff8017000 comp rx=0 tx=0).stop 2023-10-06T05:26:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080acde0 msgr2=0x7fa00814d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7fa00759e700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080acde0 0x7fa00814d670 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c4e0 tx=0x7f9ff000c7f0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 shutdown_connections 2023-10-06T05:26:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7fa00759e700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fe8060550 0x7f9fe8062a00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7fa00759e700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0080c99f0 0x7fa0080c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.088+0000 7fa00759e700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0080ae9c0 0x7fa0080c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.092+0000 7fa00759e700 1 --2- 172.21.15.29:0/1228281778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0080acde0 0x7fa00814d670 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.092+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 >> 172.21.15.29:0/1228281778 conn(0x7fa00806d150 msgr2=0x7fa008158710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.092+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 shutdown_connections 2023-10-06T05:26:24.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.092+0000 7fa00759e700 1 -- 172.21.15.29:0/1228281778 wait complete. 2023-10-06T05:26:24.108 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T05:26:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee759e700 1 Processor -- start 2023-10-06T05:26:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee759e700 1 -- start start 2023-10-06T05:26:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efee8156d50 0x7efee80680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efee80c9e00 0x7efee806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee80cb1b0 con 0x7efee8156980 2023-10-06T05:26:24.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee8068610 con 0x7efee8156d50 2023-10-06T05:26:24.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee80ca5a0 con 0x7efee80c9e00 2023-10-06T05:26:24.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee659c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efee8156980 0x7efee80cb640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58266/0 (socket says 172.21.15.29:58266) 2023-10-06T05:26:24.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efedffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efee8156d50 0x7efee80680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee659c700 1 -- 172.21.15.29:0/4244482659 learned_addr learned my addr 172.21.15.29:0/4244482659 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:24.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.208+0000 7efee6d9d700 1 --2- 172.21.15.29:0/4244482659 >> v2:172.21.15.173:3300/0 conn(0x7efee80c9e00 0x7efee806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee5d9b700 1 -- 172.21.15.29:0/4244482659 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924969113 0 0) 0x7efee80cb1b0 con 0x7efee8156980 2023-10-06T05:26:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efedffff700 1 -- 172.21.15.29:0/4244482659 >> v2:172.21.15.173:3300/0 conn(0x7efee80c9e00 msgr2=0x7efee806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efedffff700 1 --2- 172.21.15.29:0/4244482659 >> v2:172.21.15.173:3300/0 conn(0x7efee80c9e00 0x7efee806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efedffff700 1 -- 172.21.15.29:0/4244482659 >> v1:172.21.15.29:6789/0 conn(0x7efee8156980 legacy=0x7efee80cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efedffff700 1 -- 172.21.15.29:0/4244482659 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee80ca880 con 0x7efee8156d50 2023-10-06T05:26:24.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efedffff700 1 --2- 172.21.15.29:0/4244482659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 0x7efee80680d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efee80c6800 tx=0x7efed00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b9873c0fd76e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee5d9b700 1 -- 172.21.15.29:0/4244482659 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000b6b0 con 0x7efee8156d50 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee5d9b700 1 -- 172.21.15.29:0/4244482659 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000b810 con 0x7efee8156d50 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee5d9b700 1 -- 172.21.15.29:0/4244482659 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000bbb0 con 0x7efee8156d50 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 -- 172.21.15.29:0/4244482659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 msgr2=0x7efee80680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 --2- 172.21.15.29:0/4244482659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 0x7efee80680d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efee80c6800 tx=0x7efed00091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 -- 172.21.15.29:0/4244482659 shutdown_connections 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 --2- 172.21.15.29:0/4244482659 >> v2:172.21.15.173:3300/0 conn(0x7efee80c9e00 0x7efee806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 --2- 172.21.15.29:0/4244482659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 0x7efee80680d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 -- 172.21.15.29:0/4244482659 >> 172.21.15.29:0/4244482659 conn(0x7efee806aaf0 msgr2=0x7efee806aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 -- 172.21.15.29:0/4244482659 shutdown_connections 2023-10-06T05:26:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 -- 172.21.15.29:0/4244482659 wait complete. 2023-10-06T05:26:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 Processor -- start 2023-10-06T05:26:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 -- start start 2023-10-06T05:26:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.212+0000 7efee759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efee80c9e00 0x7efee8155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efee8156980 0x7efee815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 0x7efee815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80c4740 con 0x7efee8156d50 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee8159b20 con 0x7efee8156980 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee80c40f0 con 0x7efee80c9e00 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 0x7efee815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 0x7efee815afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35988/0 (socket says 172.21.15.29:35988) 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee6d9d700 1 -- 172.21.15.29:0/2228363214 learned_addr learned my addr 172.21.15.29:0/2228363214 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efedffff700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efee8156980 0x7efee815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee659c700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efee80c9e00 0x7efee8155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee6d9d700 1 -- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efee80c9e00 msgr2=0x7efee8155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee6d9d700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efee80c9e00 0x7efee8155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee6d9d700 1 -- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efee8156980 msgr2=0x7efee815aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee6d9d700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efee8156980 0x7efee815aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee6d9d700 1 -- 172.21.15.29:0/2228363214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0009420 con 0x7efee8156d50 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee6d9d700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 0x7efee815afd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efee0009fa0 tx=0x7efee0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efede7fc700 1 -- 172.21.15.29:0/2228363214 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000ed20 con 0x7efee8156d50 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efede7fc700 1 -- 172.21.15.29:0/2228363214 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee000ee80 con 0x7efee8156d50 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee80c43d0 con 0x7efee8156d50 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efede7fc700 1 -- 172.21.15.29:0/2228363214 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0014670 con 0x7efee8156d50 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee8158d90 con 0x7efee8156d50 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee80c3f50 con 0x7efee8156d50 2023-10-06T05:26:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.216+0000 7efede7fc700 1 -- 172.21.15.29:0/2228363214 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efee00149e0 con 0x7efee8156d50 2023-10-06T05:26:24.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.220+0000 7efede7fc700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efec8060550 0x7efec8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.220+0000 7efede7fc700 1 -- 172.21.15.29:0/2228363214 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efee007ce70 con 0x7efee8156d50 2023-10-06T05:26:24.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.220+0000 7efee659c700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efec8060550 0x7efec8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.220+0000 7efee659c700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efec8060550 0x7efec8062a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efed80011e0 tx=0x7efed8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:24.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.228+0000 7efede7fc700 1 -- 172.21.15.29:0/2228363214 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efee80c3f50 con 0x7efee8156d50 2023-10-06T05:26:24.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efee80c3f50 con 0x7efee8156d50 2023-10-06T05:26:24.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efede7fc700 1 -- 172.21.15.29:0/2228363214 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+126 (secure 0 0 0) 0x7efee80c3f50 con 0x7efee8156d50 2023-10-06T05:26:24.397 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:24.397 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-06T05:26:24.397 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:24.397 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-06T05:26:24.397 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-06T05:26:24.397 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:24.398 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:26:24.398 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 2, 2023-10-06T05:26:24.398 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": "rbd" 2023-10-06T05:26:24.398 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:24.398 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efec8060550 msgr2=0x7efec8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efec8060550 0x7efec8062a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efed80011e0 tx=0x7efed8009040 comp rx=0 tx=0).stop 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 msgr2=0x7efee815afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 0x7efee815afd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efee0009fa0 tx=0x7efee0009900 comp rx=0 tx=0).stop 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 shutdown_connections 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee8156d50 0x7efee815afd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efec8060550 0x7efec8062a00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efee8156980 0x7efee815aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 --2- 172.21.15.29:0/2228363214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efee80c9e00 0x7efee8155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 >> 172.21.15.29:0/2228363214 conn(0x7efee806aaf0 msgr2=0x7efee806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:24.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 shutdown_connections 2023-10-06T05:26:24.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.392+0000 7efee759e700 1 -- 172.21.15.29:0/2228363214 wait complete. 2023-10-06T05:26:24.412 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T05:26:24.412 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T05:26:24.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.520+0000 7f75164c3700 1 Processor -- start 2023-10-06T05:26:24.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.520+0000 7f75164c3700 1 -- start start 2023-10-06T05:26:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.520+0000 7f75164c3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 0x7f75100c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.520+0000 7f75164c3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75100c6cc0 con 0x7f75100c9fe0 2023-10-06T05:26:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.520+0000 7f75164c3700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75100c63d0 con 0x7f751015cfd0 2023-10-06T05:26:24.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.520+0000 7f75164c3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75100ca830 con 0x7f751015d3a0 2023-10-06T05:26:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f7515cc2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f75100c9fe0 0x7f75100c81b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36490/0 (socket says 172.21.15.29:36490) 2023-10-06T05:26:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f7515cc2700 1 -- 172.21.15.29:0/3325720009 learned_addr learned my addr 172.21.15.29:0/3325720009 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f7514cc0700 1 --2- 172.21.15.29:0/3325720009 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 0x7f75100c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f750ffff700 1 -- 172.21.15.29:0/3325720009 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044664198 0 0) 0x7f75100c6cc0 con 0x7f75100c9fe0 2023-10-06T05:26:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f750ffff700 1 -- 172.21.15.29:0/3325720009 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f8003570 con 0x7f75100c9fe0 2023-10-06T05:26:24.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f750ffff700 1 -- 172.21.15.29:0/3325720009 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373856668 0 0) 0x7f75100c63d0 con 0x7f751015cfd0 2023-10-06T05:26:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f750ffff700 1 -- 172.21.15.29:0/3325720009 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75100c6cc0 con 0x7f751015cfd0 2023-10-06T05:26:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f7514cc0700 1 -- 172.21.15.29:0/3325720009 >> v1:172.21.15.173:6789/0 conn(0x7f751015cfd0 legacy=0x7f75101616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f7514cc0700 1 -- 172.21.15.29:0/3325720009 >> v1:172.21.15.29:6789/0 conn(0x7f75100c9fe0 legacy=0x7f75100c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f7514cc0700 1 -- 172.21.15.29:0/3325720009 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100ca550 con 0x7f751015d3a0 2023-10-06T05:26:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f7514cc0700 1 --2- 172.21.15.29:0/3325720009 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 0x7f75100c7150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7504009910 tx=0x7f75040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7673ba2575b6c116 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f750ffff700 1 -- 172.21.15.29:0/3325720009 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504011630 con 0x7f751015d3a0 2023-10-06T05:26:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f750ffff700 1 -- 172.21.15.29:0/3325720009 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504011790 con 0x7f751015d3a0 2023-10-06T05:26:24.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f750ffff700 1 -- 172.21.15.29:0/3325720009 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504011b10 con 0x7f751015d3a0 2023-10-06T05:26:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f75164c3700 1 -- 172.21.15.29:0/3325720009 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 msgr2=0x7f75100c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f75164c3700 1 --2- 172.21.15.29:0/3325720009 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 0x7f75100c7150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7504009910 tx=0x7f75040091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f75164c3700 1 -- 172.21.15.29:0/3325720009 shutdown_connections 2023-10-06T05:26:24.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f75164c3700 1 --2- 172.21.15.29:0/3325720009 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 0x7f75100c7150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f75164c3700 1 -- 172.21.15.29:0/3325720009 >> 172.21.15.29:0/3325720009 conn(0x7f751006c6c0 msgr2=0x7f751006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f75164c3700 1 -- 172.21.15.29:0/3325720009 shutdown_connections 2023-10-06T05:26:24.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.524+0000 7f75164c3700 1 -- 172.21.15.29:0/3325720009 wait complete. 2023-10-06T05:26:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.528+0000 7f75164c3700 1 Processor -- start 2023-10-06T05:26:24.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.528+0000 7f75164c3700 1 -- start start 2023-10-06T05:26:24.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75164c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75100c9fe0 0x7f751014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75164c3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f751015cfd0 0x7f75100c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75164c3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 0x7f75100a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75164c3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75100a59c0 con 0x7f75100c9fe0 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75164c3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751014d1e0 con 0x7f751015cfd0 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75164c3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75100a4db0 con 0x7f751015d3a0 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75154c1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75100c9fe0 0x7f751014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75154c1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75100c9fe0 0x7f751014cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34362/0 (socket says 172.21.15.29:34362) 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75154c1700 1 -- 172.21.15.29:0/4098456471 learned_addr learned my addr 172.21.15.29:0/4098456471 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f7514cc0700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f751015cfd0 0x7f75100c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f7515cc2700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 0x7f75100a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75154c1700 1 -- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 msgr2=0x7f75100a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75154c1700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 0x7f75100a5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75154c1700 1 -- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f751015cfd0 msgr2=0x7f75100c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75154c1700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f751015cfd0 0x7f75100c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75154c1700 1 -- 172.21.15.29:0/4098456471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504009420 con 0x7f75100c9fe0 2023-10-06T05:26:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75154c1700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75100c9fe0 0x7f751014cca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f750000c7c0 tx=0x7f7500007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f750d7fa700 1 -- 172.21.15.29:0/4098456471 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500002ea0 con 0x7f75100c9fe0 2023-10-06T05:26:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f750d7fa700 1 -- 172.21.15.29:0/4098456471 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7500010510 con 0x7f75100c9fe0 2023-10-06T05:26:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f750d7fa700 1 -- 172.21.15.29:0/4098456471 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75000108b0 con 0x7f75100c9fe0 2023-10-06T05:26:24.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75100a5090 con 0x7f75100c9fe0 2023-10-06T05:26:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.532+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75100a5650 con 0x7f75100c9fe0 2023-10-06T05:26:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.536+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751004be00 con 0x7f75100c9fe0 2023-10-06T05:26:24.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.536+0000 7f750d7fa700 1 -- 172.21.15.29:0/4098456471 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7500010c60 con 0x7f75100c9fe0 2023-10-06T05:26:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.536+0000 7f750d7fa700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f74fc060580 0x7f74fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.536+0000 7f750d7fa700 1 -- 172.21.15.29:0/4098456471 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f750007bc00 con 0x7f75100c9fe0 2023-10-06T05:26:24.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.536+0000 7f7514cc0700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f74fc060580 0x7f74fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:24.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.536+0000 7f7514cc0700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f74fc060580 0x7f74fc062a30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7504009860 tx=0x7f7504017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:24.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.544+0000 7f750d7fa700 1 -- 172.21.15.29:0/4098456471 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7500082080 con 0x7f75100c9fe0 2023-10-06T05:26:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:24.704+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f75100c6670 con 0x7f75100c9fe0 2023-10-06T05:26:25.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.036+0000 7f750d7fa700 1 -- 172.21.15.29:0/4098456471 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7500017070 con 0x7f75100c9fe0 2023-10-06T05:26:25.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f74fc060580 msgr2=0x7f74fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:25.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f74fc060580 0x7f74fc062a30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7504009860 tx=0x7f7504017000 comp rx=0 tx=0).stop 2023-10-06T05:26:25.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75100c9fe0 msgr2=0x7f751014cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:25.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75100c9fe0 0x7f751014cca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f750000c7c0 tx=0x7f7500007dc0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 shutdown_connections 2023-10-06T05:26:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f751015d3a0 0x7f75100a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f74fc060580 0x7f74fc062a30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f751015cfd0 0x7f75100c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 --2- 172.21.15.29:0/4098456471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75100c9fe0 0x7f751014cca0 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f750000c7c0 tx=0x7f7500007dc0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.040+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 >> 172.21.15.29:0/4098456471 conn(0x7f751006c6c0 msgr2=0x7f75100c0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.044+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 shutdown_connections 2023-10-06T05:26:25.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.044+0000 7f75164c3700 1 -- 172.21.15.29:0/4098456471 wait complete. 2023-10-06T05:26:25.052 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-06T05:26:25.065 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T05:26:25.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.176+0000 7f4c6209a700 1 Processor -- start 2023-10-06T05:26:25.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.176+0000 7f4c6209a700 1 -- start start 2023-10-06T05:26:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c6209a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c5c155f30 0x7f4c5c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c6209a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c06bbd0 con 0x7f4c5c15a410 2023-10-06T05:26:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c6209a700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c06beb0 con 0x7f4c5c155b60 2023-10-06T05:26:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c6209a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c159ff0 con 0x7f4c5c155f30 2023-10-06T05:26:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61899700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4c5c15a410 0x7f4c5c06d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36500/0 (socket says 172.21.15.29:36500) 2023-10-06T05:26:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61899700 1 -- 172.21.15.29:0/691757868 learned_addr learned my addr 172.21.15.29:0/691757868 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:25.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c60897700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c5c155f30 0x7f4c5c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347626873 0 0) 0x7f4c5c06bbd0 con 0x7f4c5c15a410 2023-10-06T05:26:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c48003570 con 0x7f4c5c15a410 2023-10-06T05:26:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12662991 0 0) 0x7f4c5c06beb0 con 0x7f4c5c155b60 2023-10-06T05:26:25.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c5c06bbd0 con 0x7f4c5c155b60 2023-10-06T05:26:25.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1156127130 0 0) 0x7f4c48003570 con 0x7f4c5c15a410 2023-10-06T05:26:25.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c5c155f30 msgr2=0x7f4c5c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:25.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c5c155f30 0x7f4c5c0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 >> v1:172.21.15.173:6789/0 conn(0x7f4c5c155b60 legacy=0x7f4c5c06b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c159930 con 0x7f4c5c15a410 2023-10-06T05:26:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f4c540017f0 con 0x7f4c5c15a410 2023-10-06T05:26:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 >> v1:172.21.15.29:6789/0 conn(0x7f4c5c15a410 legacy=0x7f4c5c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c48003c20 0x7f4c48004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c48004810 0x7f4c48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c480051c0 0x7f4c4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c159ff0 con 0x7f4c480051c0 2023-10-06T05:26:25.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4800c020 con 0x7f4c48003c20 2023-10-06T05:26:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4800c1e0 con 0x7f4c48004810 2023-10-06T05:26:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c60897700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c5c155f30 0x7f4c5c0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61899700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c480051c0 0x7f4c4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61098700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c48003c20 0x7f4c48004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c60897700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c48004810 0x7f4c48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61899700 1 -- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c48004810 msgr2=0x7f4c48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61899700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c48004810 0x7f4c48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61899700 1 -- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c48003c20 msgr2=0x7f4c48004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:25.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61899700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c48003c20 0x7f4c48004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61899700 1 -- 172.21.15.29:0/691757868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48003570 con 0x7f4c480051c0 2023-10-06T05:26:25.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c60897700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c48004810 0x7f4c48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:26:25.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.180+0000 7f4c61899700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c480051c0 0x7f4c4800ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400a8f0 tx=0x7f4c54002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7261a58d0a43e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:25.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c540070d0 con 0x7f4c480051c0 2023-10-06T05:26:25.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c54007250 con 0x7f4c480051c0 2023-10-06T05:26:25.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c53fff700 1 -- 172.21.15.29:0/691757868 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54007610 con 0x7f4c480051c0 2023-10-06T05:26:25.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c6209a700 1 -- 172.21.15.29:0/691757868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c480051c0 msgr2=0x7f4c4800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c6209a700 1 --2- 172.21.15.29:0/691757868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c480051c0 0x7f4c4800ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400a8f0 tx=0x7f4c54002190 comp rx=0 tx=0).stop 2023-10-06T05:26:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c61899700 1 -- 172.21.15.29:0/691757868 reap_dead start 2023-10-06T05:26:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c6209a700 1 -- 172.21.15.29:0/691757868 shutdown_connections 2023-10-06T05:26:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c6209a700 1 -- 172.21.15.29:0/691757868 >> 172.21.15.29:0/691757868 conn(0x7f4c5c0c9830 msgr2=0x7f4c5c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c6209a700 1 -- 172.21.15.29:0/691757868 shutdown_connections 2023-10-06T05:26:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c6209a700 1 -- 172.21.15.29:0/691757868 wait complete. 2023-10-06T05:26:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c6209a700 1 Processor -- start 2023-10-06T05:26:25.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.184+0000 7f4c6209a700 1 -- start start 2023-10-06T05:26:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c6209a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c480051c0 0x7f4c5c0b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c6209a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c5c1674b0 0x7f4c5c147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c6209a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c151450 0x7f4c5c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c6209a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c151e30 con 0x7f4c5c1674b0 2023-10-06T05:26:25.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c6209a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c16adc0 con 0x7f4c5c151450 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c6209a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c16a1b0 con 0x7f4c480051c0 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c60897700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c5c1674b0 0x7f4c5c147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c60897700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c5c1674b0 0x7f4c5c147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34380/0 (socket says 172.21.15.29:34380) 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c60897700 1 -- 172.21.15.29:0/948869972 learned_addr learned my addr 172.21.15.29:0/948869972 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c61098700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c480051c0 0x7f4c5c0b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c61899700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c151450 0x7f4c5c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c60897700 1 -- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c480051c0 msgr2=0x7f4c5c0b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c60897700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c480051c0 0x7f4c5c0b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c60897700 1 -- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c151450 msgr2=0x7f4c5c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c60897700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c151450 0x7f4c5c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:25.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c60897700 1 -- 172.21.15.29:0/948869972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c16a490 con 0x7f4c5c1674b0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c60897700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c5c1674b0 0x7f4c5c147720 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009270 tx=0x7f4c4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c517fa700 1 -- 172.21.15.29:0/948869972 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00e840 con 0x7f4c5c1674b0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c517fa700 1 -- 172.21.15.29:0/948869972 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c00e9a0 con 0x7f4c5c1674b0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c16a770 con 0x7f4c5c1674b0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c517fa700 1 -- 172.21.15.29:0/948869972 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00ed20 con 0x7f4c5c1674b0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c167920 con 0x7f4c5c1674b0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.188+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c04be00 con 0x7f4c5c1674b0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.192+0000 7f4c517fa700 1 -- 172.21.15.29:0/948869972 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4c4c01c610 con 0x7f4c5c1674b0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.192+0000 7f4c517fa700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c40060550 0x7f4c40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.192+0000 7f4c517fa700 1 -- 172.21.15.29:0/948869972 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f4c4c07cbd0 con 0x7f4c5c1674b0 2023-10-06T05:26:25.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.192+0000 7f4c61098700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c40060550 0x7f4c40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:25.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.192+0000 7f4c61098700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c40060550 0x7f4c40062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0c2970 tx=0x7f4c58007d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:25.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.200+0000 7f4c517fa700 1 -- 172.21.15.29:0/948869972 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c4c04d1a0 con 0x7f4c5c1674b0 2023-10-06T05:26:25.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:25.364+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4c5c16af00 con 0x7f4c5c1674b0 2023-10-06T05:26:26.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.048+0000 7f4c517fa700 1 -- 172.21.15.29:0/948869972 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4c4c0507c0 con 0x7f4c5c1674b0 2023-10-06T05:26:26.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.064+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c40060550 msgr2=0x7f4c40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:26.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.064+0000 7f4c6209a700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c40060550 0x7f4c40062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0c2970 tx=0x7f4c58007d10 comp rx=0 tx=0).stop 2023-10-06T05:26:26.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.064+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c5c1674b0 msgr2=0x7f4c5c147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:26.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.064+0000 7f4c6209a700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c5c1674b0 0x7f4c5c147720 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009270 tx=0x7f4c4c008040 comp rx=0 tx=0).stop 2023-10-06T05:26:26.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.072+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 shutdown_connections 2023-10-06T05:26:26.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.072+0000 7f4c6209a700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c40060550 0x7f4c40062a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.072+0000 7f4c6209a700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c151450 0x7f4c5c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.072+0000 7f4c6209a700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c5c1674b0 0x7f4c5c147720 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.072+0000 7f4c6209a700 1 --2- 172.21.15.29:0/948869972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c480051c0 0x7f4c5c0b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.072+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 >> 172.21.15.29:0/948869972 conn(0x7f4c5c0c9830 msgr2=0x7f4c5c152550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:26.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.072+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 shutdown_connections 2023-10-06T05:26:26.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.072+0000 7f4c6209a700 1 -- 172.21.15.29:0/948869972 wait complete. 2023-10-06T05:26:26.079 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-06T05:26:26.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T05:26:26.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.188+0000 7f813a40c700 1 Processor -- start 2023-10-06T05:26:26.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.188+0000 7f813a40c700 1 -- start start 2023-10-06T05:26:26.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8134156f20 0x7f81340ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:26.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81340cabd0 0x7f81340ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:26.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340c4380 con 0x7f8134156b50 2023-10-06T05:26:26.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81340cb050 con 0x7f8134156f20 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81340c4810 con 0x7f81340cabd0 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f8138c09700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8134156f20 0x7f81340ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813940a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8134156b50 0x7f81340c8ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36510/0 (socket says 172.21.15.29:36510) 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f8138c09700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8134156f20 0x7f81340ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34388/0 (socket says 172.21.15.29:34388) 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813940a700 1 -- 172.21.15.29:0/2417288705 learned_addr learned my addr 172.21.15.29:0/2417288705 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f8139c0b700 1 --2- 172.21.15.29:0/2417288705 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81340cabd0 0x7f81340ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f8138c09700 1 -- 172.21.15.29:0/2417288705 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81340cabd0 msgr2=0x7f81340ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f8138c09700 1 --2- 172.21.15.29:0/2417288705 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81340cabd0 0x7f81340ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f8138c09700 1 -- 172.21.15.29:0/2417288705 >> v1:172.21.15.29:6789/0 conn(0x7f8134156b50 legacy=0x7f81340c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f8138c09700 1 -- 172.21.15.29:0/2417288705 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340c3770 con 0x7f8134156f20 2023-10-06T05:26:26.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f8138c09700 1 --2- 172.21.15.29:0/2417288705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 0x7f81340ca690 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f81240098e0 tx=0x7f81240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0956476ddd495e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f812bfff700 1 -- 172.21.15.29:0/2417288705 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812400b640 con 0x7f8134156f20 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f812bfff700 1 -- 172.21.15.29:0/2417288705 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812400b7a0 con 0x7f8134156f20 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f812bfff700 1 -- 172.21.15.29:0/2417288705 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812400bb40 con 0x7f8134156f20 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 -- 172.21.15.29:0/2417288705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 msgr2=0x7f81340ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 --2- 172.21.15.29:0/2417288705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 0x7f81340ca690 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f81240098e0 tx=0x7f81240091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 -- 172.21.15.29:0/2417288705 shutdown_connections 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 --2- 172.21.15.29:0/2417288705 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81340cabd0 0x7f81340ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 --2- 172.21.15.29:0/2417288705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 0x7f81340ca690 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 -- 172.21.15.29:0/2417288705 >> 172.21.15.29:0/2417288705 conn(0x7f8134069d50 msgr2=0x7f813406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 -- 172.21.15.29:0/2417288705 shutdown_connections 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.192+0000 7f813a40c700 1 -- 172.21.15.29:0/2417288705 wait complete. 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813a40c700 1 Processor -- start 2023-10-06T05:26:26.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813a40c700 1 -- start start 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813a40c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81340cabd0 0x7f813414efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813a40c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8134156b50 0x7f8134067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813a40c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 0x7f81340cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813a40c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813414f500 con 0x7f8134156f20 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813a40c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8134067ff0 con 0x7f81340cabd0 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813a40c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8134155200 con 0x7f8134156b50 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8139c0b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 0x7f81340cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8138c09700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8134156b50 0x7f8134067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8139c0b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 0x7f81340cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34394/0 (socket says 172.21.15.29:34394) 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8139c0b700 1 -- 172.21.15.29:0/957476620 learned_addr learned my addr 172.21.15.29:0/957476620 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813940a700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81340cabd0 0x7f813414efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:26.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8139c0b700 1 -- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8134156b50 msgr2=0x7f8134067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8139c0b700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8134156b50 0x7f8134067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8139c0b700 1 -- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81340cabd0 msgr2=0x7f813414efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8139c0b700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81340cabd0 0x7f813414efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8139c0b700 1 -- 172.21.15.29:0/957476620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8124009420 con 0x7f8134156f20 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813940a700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81340cabd0 0x7f813414efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f8139c0b700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 0x7f81340cbd30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f812c009df0 tx=0x7f812c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f81297fa700 1 -- 172.21.15.29:0/957476620 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00cb50 con 0x7f8134156f20 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f81297fa700 1 -- 172.21.15.29:0/957476620 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00f040 con 0x7f8134156f20 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81341554e0 con 0x7f8134156f20 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.196+0000 7f81297fa700 1 -- 172.21.15.29:0/957476620 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c014480 con 0x7f8134156f20 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.200+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8134155aa0 con 0x7f8134156f20 2023-10-06T05:26:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.200+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813414f670 con 0x7f8134156f20 2023-10-06T05:26:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.200+0000 7f81297fa700 1 -- 172.21.15.29:0/957476620 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f812c014830 con 0x7f8134156f20 2023-10-06T05:26:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.200+0000 7f81297fa700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8118060550 0x7f8118062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.200+0000 7f81297fa700 1 -- 172.21.15.29:0/957476620 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f812c07d240 con 0x7f8134156f20 2023-10-06T05:26:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.200+0000 7f813940a700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8118060550 0x7f8118062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:26.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.204+0000 7f813940a700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8118060550 0x7f8118062a00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f81300018c0 tx=0x7f8130009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:26.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.208+0000 7f81297fa700 1 -- 172.21.15.29:0/957476620 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f813414f670 con 0x7f8134156f20 2023-10-06T05:26:26.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:26.400+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f813414f640 con 0x7f8134156f20 2023-10-06T05:26:27.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.408+0000 7f81297fa700 1 -- 172.21.15.29:0/957476620 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f812c051120 con 0x7f8134156f20 2023-10-06T05:26:27.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8118060550 msgr2=0x7f8118062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8118060550 0x7f8118062a00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f81300018c0 tx=0x7f8130009040 comp rx=0 tx=0).stop 2023-10-06T05:26:27.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 msgr2=0x7f81340cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 0x7f81340cbd30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f812c009df0 tx=0x7f812c00b040 comp rx=0 tx=0).stop 2023-10-06T05:26:27.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 shutdown_connections 2023-10-06T05:26:27.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8134156f20 0x7f81340cbd30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8134156b50 0x7f8134067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8118060550 0x7f8118062a00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 --2- 172.21.15.29:0/957476620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81340cabd0 0x7f813414efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.416+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 >> 172.21.15.29:0/957476620 conn(0x7f8134069d50 msgr2=0x7f813414ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:27.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.420+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 shutdown_connections 2023-10-06T05:26:27.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.420+0000 7f813a40c700 1 -- 172.21.15.29:0/957476620 wait complete. 2023-10-06T05:26:27.427 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T05:26:27.440 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:27.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed9a66700 1 Processor -- start 2023-10-06T05:26:27.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed9a66700 1 -- start start 2023-10-06T05:26:27.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed9a66700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed40cb0b0 0x7f3ed406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed9a66700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed406e070 con 0x7f3ed4158cd0 2023-10-06T05:26:27.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed9a66700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed4068de0 con 0x7f3ed406dc10 2023-10-06T05:26:27.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed9a66700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed40681d0 con 0x7f3ed40cb0b0 2023-10-06T05:26:27.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed8a64700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3ed4158cd0 0x7f3ed4067710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36514/0 (socket says 172.21.15.29:36514) 2023-10-06T05:26:27.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed8a64700 1 -- 172.21.15.29:0/3809988941 learned_addr learned my addr 172.21.15.29:0/3809988941 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:27.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed3fff700 1 --2- 172.21.15.29:0/3809988941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed40cb0b0 0x7f3ed406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed37fe700 1 -- 172.21.15.29:0/3809988941 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456930633 0 0) 0x7f3ec8001110 con 0x7f3ed4158cd0 2023-10-06T05:26:27.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed37fe700 1 -- 172.21.15.29:0/3809988941 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec4003570 con 0x7f3ed4158cd0 2023-10-06T05:26:27.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed37fe700 1 -- 172.21.15.29:0/3809988941 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939914356 0 0) 0x7f3ed4068de0 con 0x7f3ed406dc10 2023-10-06T05:26:27.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.540+0000 7f3ed37fe700 1 -- 172.21.15.29:0/3809988941 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec8001110 con 0x7f3ed406dc10 2023-10-06T05:26:27.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed3fff700 1 -- 172.21.15.29:0/3809988941 >> v1:172.21.15.173:6789/0 conn(0x7f3ed406dc10 legacy=0x7f3ed40c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed3fff700 1 -- 172.21.15.29:0/3809988941 >> v1:172.21.15.29:6789/0 conn(0x7f3ed4158cd0 legacy=0x7f3ed4067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed3fff700 1 -- 172.21.15.29:0/3809988941 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40684b0 con 0x7f3ed40cb0b0 2023-10-06T05:26:27.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed3fff700 1 --2- 172.21.15.29:0/3809988941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed40cb0b0 0x7f3ed406d6d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009910 tx=0x7f3ec00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222db8424681af6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:27.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed37fe700 1 -- 172.21.15.29:0/3809988941 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0011630 con 0x7f3ed40cb0b0 2023-10-06T05:26:27.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed37fe700 1 -- 172.21.15.29:0/3809988941 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0011790 con 0x7f3ed40cb0b0 2023-10-06T05:26:27.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed37fe700 1 -- 172.21.15.29:0/3809988941 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0011b30 con 0x7f3ed40cb0b0 2023-10-06T05:26:27.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed9a66700 1 -- 172.21.15.29:0/3809988941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed40cb0b0 msgr2=0x7f3ed406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed9a66700 1 --2- 172.21.15.29:0/3809988941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed40cb0b0 0x7f3ed406d6d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009910 tx=0x7f3ec00091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed9a66700 1 -- 172.21.15.29:0/3809988941 shutdown_connections 2023-10-06T05:26:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed9a66700 1 --2- 172.21.15.29:0/3809988941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed40cb0b0 0x7f3ed406d6d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed9a66700 1 -- 172.21.15.29:0/3809988941 >> 172.21.15.29:0/3809988941 conn(0x7f3ed406aaf0 msgr2=0x7f3ed406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed9a66700 1 -- 172.21.15.29:0/3809988941 shutdown_connections 2023-10-06T05:26:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.544+0000 7f3ed9a66700 1 -- 172.21.15.29:0/3809988941 wait complete. 2023-10-06T05:26:27.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 Processor -- start 2023-10-06T05:26:27.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 -- start start 2023-10-06T05:26:27.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed406dc10 0x7f3ed40c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed4158cd0 0x7f3ed40c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed40c85f0 0x7f3ed40c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4156dd0 con 0x7f3ed40c85f0 2023-10-06T05:26:27.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed40c3380 con 0x7f3ed4158cd0 2023-10-06T05:26:27.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed40c3620 con 0x7f3ed406dc10 2023-10-06T05:26:27.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9265700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed40c85f0 0x7f3ed40c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed4158cd0 0x7f3ed40c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9265700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed40c85f0 0x7f3ed40c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34410/0 (socket says 172.21.15.29:34410) 2023-10-06T05:26:27.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9265700 1 -- 172.21.15.29:0/4272931130 learned_addr learned my addr 172.21.15.29:0/4272931130 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:27.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed8a64700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed406dc10 0x7f3ed40c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed3fff700 1 -- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed406dc10 msgr2=0x7f3ed40c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed3fff700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed406dc10 0x7f3ed40c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed3fff700 1 -- 172.21.15.29:0/4272931130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed40c85f0 msgr2=0x7f3ed40c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed3fff700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed40c85f0 0x7f3ed40c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed3fff700 1 -- 172.21.15.29:0/4272931130 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009420 con 0x7f3ed4158cd0 2023-10-06T05:26:27.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed3fff700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed4158cd0 0x7f3ed40c4a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0016000 tx=0x7f3ec0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:27.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed0ff9700 1 -- 172.21.15.29:0/4272931130 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec001f070 con 0x7f3ed4158cd0 2023-10-06T05:26:27.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed0ff9700 1 -- 172.21.15.29:0/4272931130 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0002f70 con 0x7f3ed4158cd0 2023-10-06T05:26:27.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed0ff9700 1 -- 172.21.15.29:0/4272931130 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0011900 con 0x7f3ed4158cd0 2023-10-06T05:26:27.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed40c3900 con 0x7f3ed4158cd0 2023-10-06T05:26:27.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.548+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed40c3ec0 con 0x7f3ed4158cd0 2023-10-06T05:26:27.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.552+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed40c40e0 con 0x7f3ed4158cd0 2023-10-06T05:26:27.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.552+0000 7f3ed0ff9700 1 -- 172.21.15.29:0/4272931130 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3ec0023070 con 0x7f3ed4158cd0 2023-10-06T05:26:27.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.552+0000 7f3ed0ff9700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eb8060550 0x7f3eb8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.552+0000 7f3ed0ff9700 1 -- 172.21.15.29:0/4272931130 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ec007d7e0 con 0x7f3ed4158cd0 2023-10-06T05:26:27.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.552+0000 7f3ed8a64700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eb8060550 0x7f3eb8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.552+0000 7f3ed8a64700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eb8060550 0x7f3eb8062a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8007fd0 tx=0x7f3ec8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:27.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.560+0000 7f3ed0ff9700 1 -- 172.21.15.29:0/4272931130 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3ec004dd90 con 0x7f3ed4158cd0 2023-10-06T05:26:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.728+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ed404be00 con 0x7f3ed4158cd0 2023-10-06T05:26:27.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.732+0000 7f3ed0ff9700 1 -- 172.21.15.29:0/4272931130 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f3ec0015090 con 0x7f3ed4158cd0 2023-10-06T05:26:27.737 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:27.737 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":35,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:26:26.406417+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:26:24.748472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T05:26:25.410229+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:27.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eb8060550 msgr2=0x7f3eb8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eb8060550 0x7f3eb8062a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8007fd0 tx=0x7f3ec8009040 comp rx=0 tx=0).stop 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed4158cd0 msgr2=0x7f3ed40c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed4158cd0 0x7f3ed40c4a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0016000 tx=0x7f3ec0017000 comp rx=0 tx=0).stop 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 shutdown_connections 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ed40c85f0 0x7f3ed40c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eb8060550 0x7f3eb8062a00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ed4158cd0 0x7f3ed40c4a10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 --2- 172.21.15.29:0/4272931130 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ed406dc10 0x7f3ed40c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 >> 172.21.15.29:0/4272931130 conn(0x7f3ed406aaf0 msgr2=0x7f3ed40c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:27.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 shutdown_connections 2023-10-06T05:26:27.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.736+0000 7f3ed9a66700 1 -- 172.21.15.29:0/4272931130 wait complete. 2023-10-06T05:26:27.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:27.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.860+0000 7fd7ad276700 1 Processor -- start 2023-10-06T05:26:27.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.860+0000 7fd7ad276700 1 -- start start 2023-10-06T05:26:27.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.860+0000 7fd7ad276700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a815a790 0x7fd7a8157c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.860+0000 7fd7ad276700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a80ab4d0 con 0x7fd7a80aab80 2023-10-06T05:26:27.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.860+0000 7fd7ad276700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a8158150 con 0x7fd7a80aaf50 2023-10-06T05:26:27.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.860+0000 7fd7ad276700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80c6b00 con 0x7fd7a815a790 2023-10-06T05:26:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.860+0000 7fd7a7fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd7a80aab80 0x7fd7a80c8060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36526/0 (socket says 172.21.15.29:36526) 2023-10-06T05:26:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.860+0000 7fd7a7fff700 1 -- 172.21.15.29:0/1672724499 learned_addr learned my addr 172.21.15.29:0/1672724499 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.860+0000 7fd7a77fe700 1 --2- 172.21.15.29:0/1672724499 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a815a790 0x7fd7a8157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7a6ffd700 1 -- 172.21.15.29:0/1672724499 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577530340 0 0) 0x7fd7a80ab4d0 con 0x7fd7a80aab80 2023-10-06T05:26:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7a6ffd700 1 -- 172.21.15.29:0/1672724499 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd794003570 con 0x7fd7a80aab80 2023-10-06T05:26:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7a77fe700 1 -- 172.21.15.29:0/1672724499 >> v1:172.21.15.173:6789/0 conn(0x7fd7a80aaf50 legacy=0x7fd7a806a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7a77fe700 1 -- 172.21.15.29:0/1672724499 >> v1:172.21.15.29:6789/0 conn(0x7fd7a80aab80 legacy=0x7fd7a80c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7a77fe700 1 -- 172.21.15.29:0/1672724499 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a815ac00 con 0x7fd7a815a790 2023-10-06T05:26:27.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7a77fe700 1 --2- 172.21.15.29:0/1672724499 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a815a790 0x7fd7a8157c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd790009890 tx=0x7fd7900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32cbf3810cca959 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:27.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7a6ffd700 1 -- 172.21.15.29:0/1672724499 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790011630 con 0x7fd7a815a790 2023-10-06T05:26:27.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7a6ffd700 1 -- 172.21.15.29:0/1672724499 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790011790 con 0x7fd7a815a790 2023-10-06T05:26:27.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7a6ffd700 1 -- 172.21.15.29:0/1672724499 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790011b50 con 0x7fd7a815a790 2023-10-06T05:26:27.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7ad276700 1 -- 172.21.15.29:0/1672724499 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a815a790 msgr2=0x7fd7a8157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7ad276700 1 --2- 172.21.15.29:0/1672724499 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a815a790 0x7fd7a8157c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd790009890 tx=0x7fd7900091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7ad276700 1 -- 172.21.15.29:0/1672724499 shutdown_connections 2023-10-06T05:26:27.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7ad276700 1 --2- 172.21.15.29:0/1672724499 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a815a790 0x7fd7a8157c10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7ad276700 1 -- 172.21.15.29:0/1672724499 >> 172.21.15.29:0/1672724499 conn(0x7fd7a80670a0 msgr2=0x7fd7a8067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:27.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7ad276700 1 -- 172.21.15.29:0/1672724499 shutdown_connections 2023-10-06T05:26:27.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7ad276700 1 -- 172.21.15.29:0/1672724499 wait complete. 2023-10-06T05:26:27.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7ad276700 1 Processor -- start 2023-10-06T05:26:27.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.864+0000 7fd7ad276700 1 -- start start 2023-10-06T05:26:27.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7ad276700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a80aab80 0x7fd7a80cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7ad276700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a80aaf50 0x7fd7a8149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7ad276700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7a815a790 0x7fd7a80ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7ad276700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80cbb50 con 0x7fd7a815a790 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7ad276700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80caf40 con 0x7fd7a80aab80 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7ad276700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80cb220 con 0x7fd7a80aaf50 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7aca75700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7a815a790 0x7fd7a80ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7aca75700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7a815a790 0x7fd7a80ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34418/0 (socket says 172.21.15.29:34418) 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7aca75700 1 -- 172.21.15.29:0/499062154 learned_addr learned my addr 172.21.15.29:0/499062154 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7a7fff700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a80aab80 0x7fd7a80cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7a77fe700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a80aaf50 0x7fd7a8149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7aca75700 1 -- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a80aaf50 msgr2=0x7fd7a8149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7aca75700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a80aaf50 0x7fd7a8149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7aca75700 1 -- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a80aab80 msgr2=0x7fd7a80cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7aca75700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a80aab80 0x7fd7a80cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7aca75700 1 -- 172.21.15.29:0/499062154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790009420 con 0x7fd7a815a790 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7a7fff700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a80aab80 0x7fd7a80cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7aca75700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7a815a790 0x7fd7a80ca560 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000cc10 tx=0x7fd7a00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd79ffff700 1 -- 172.21.15.29:0/499062154 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000a860 con 0x7fd7a815a790 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd79ffff700 1 -- 172.21.15.29:0/499062154 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a000a9c0 con 0x7fd7a815a790 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a80cb500 con 0x7fd7a815a790 2023-10-06T05:26:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd79ffff700 1 -- 172.21.15.29:0/499062154 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000ad80 con 0x7fd7a815a790 2023-10-06T05:26:27.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.868+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a8149880 con 0x7fd7a815a790 2023-10-06T05:26:27.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.872+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a80cbcc0 con 0x7fd7a815a790 2023-10-06T05:26:27.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.872+0000 7fd79ffff700 1 -- 172.21.15.29:0/499062154 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd7a0003030 con 0x7fd7a815a790 2023-10-06T05:26:27.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.872+0000 7fd79ffff700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd788060580 0x7fd788062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:27.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.872+0000 7fd79ffff700 1 -- 172.21.15.29:0/499062154 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd7a007ca10 con 0x7fd7a815a790 2023-10-06T05:26:27.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.872+0000 7fd7a7fff700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd788060580 0x7fd788062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:27.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.872+0000 7fd7a7fff700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd788060580 0x7fd788062a30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd7980058d0 tx=0x7fd798009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:27.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:27.880+0000 7fd79ffff700 1 -- 172.21.15.29:0/499062154 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd7a004cea0 con 0x7fd7a815a790 2023-10-06T05:26:28.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.040+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7a815aee0 con 0x7fd7a815a790 2023-10-06T05:26:28.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.040+0000 7fd79ffff700 1 -- 172.21.15.29:0/499062154 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fd7a00504c0 con 0x7fd7a815a790 2023-10-06T05:26:28.048 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:28.048 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":35,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:26:26.406417+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:26:24.748472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T05:26:25.410229+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:28.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd788060580 msgr2=0x7fd788062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd788060580 0x7fd788062a30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd7980058d0 tx=0x7fd798009040 comp rx=0 tx=0).stop 2023-10-06T05:26:28.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7a815a790 msgr2=0x7fd7a80ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7a815a790 0x7fd7a80ca560 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000cc10 tx=0x7fd7a00019b0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 shutdown_connections 2023-10-06T05:26:28.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7a815a790 0x7fd7a80ca560 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7a80aaf50 0x7fd7a8149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd788060580 0x7fd788062a30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 --2- 172.21.15.29:0/499062154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7a80aab80 0x7fd7a80cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 >> 172.21.15.29:0/499062154 conn(0x7fd7a80670a0 msgr2=0x7fd7a806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:28.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 shutdown_connections 2023-10-06T05:26:28.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.044+0000 7fd7ad276700 1 -- 172.21.15.29:0/499062154 wait complete. 2023-10-06T05:26:28.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T05:26:28.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.164+0000 7f1c58787700 1 Processor -- start 2023-10-06T05:26:28.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.164+0000 7f1c58787700 1 -- start start 2023-10-06T05:26:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.164+0000 7f1c58787700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50158c30 0x7f1c50159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.164+0000 7f1c58787700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5006b380 con 0x7f1c5015d890 2023-10-06T05:26:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c58787700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5006bc70 con 0x7f1c5006b810 2023-10-06T05:26:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c58787700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5006a770 con 0x7f1c50158c30 2023-10-06T05:26:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55d22700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1c5015d890 0x7f1c500ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36538/0 (socket says 172.21.15.29:36538) 2023-10-06T05:26:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55d22700 1 -- 172.21.15.29:0/1435052302 learned_addr learned my addr 172.21.15.29:0/1435052302 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c56523700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50158c30 0x7f1c50159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622606981 0 0) 0x7f1c5006b380 con 0x7f1c5015d890 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c3c003570 con 0x7f1c5015d890 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273352062 0 0) 0x7f1c5006bc70 con 0x7f1c5006b810 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c5006b380 con 0x7f1c5006b810 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 138595931 0 0) 0x7f1c3c003570 con 0x7f1c5015d890 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50158c30 msgr2=0x7f1c50159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50158c30 0x7f1c50159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 >> v1:172.21.15.173:6789/0 conn(0x7f1c5006b810 legacy=0x7f1c500cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5006aa50 con 0x7f1c5015d890 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f1c4c001470 con 0x7f1c5015d890 2023-10-06T05:26:28.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 >> v1:172.21.15.29:6789/0 conn(0x7f1c5015d890 legacy=0x7f1c500ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50158c30 0x7f1c3c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c3c004d50 0x7f1c3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5006a770 con 0x7f1c3c0041d0 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c00bbf0 con 0x7f1c3c004d50 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c00bdb0 con 0x7f1c50158c30 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55d22700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c56523700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50158c30 0x7f1c3c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c56d24700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c3c004d50 0x7f1c3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55d22700 1 -- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50158c30 msgr2=0x7f1c3c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55d22700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50158c30 0x7f1c3c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55d22700 1 -- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c3c004d50 msgr2=0x7f1c3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55d22700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c3c004d50 0x7f1c3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55d22700 1 -- 172.21.15.29:0/1435052302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c003570 con 0x7f1c3c0041d0 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55d22700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c3c004810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c210 tx=0x7f1c50159540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91a7290ca48c019 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00cc10 con 0x7f1c3c0041d0 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00cd70 con 0x7f1c3c0041d0 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c55521700 1 -- 172.21.15.29:0/1435052302 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c005b70 con 0x7f1c3c0041d0 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c58787700 1 -- 172.21.15.29:0/1435052302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 msgr2=0x7f1c3c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c58787700 1 --2- 172.21.15.29:0/1435052302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c3c004810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c210 tx=0x7f1c50159540 comp rx=0 tx=0).stop 2023-10-06T05:26:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c56d24700 1 -- 172.21.15.29:0/1435052302 reap_dead start 2023-10-06T05:26:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c58787700 1 -- 172.21.15.29:0/1435052302 shutdown_connections 2023-10-06T05:26:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c58787700 1 -- 172.21.15.29:0/1435052302 >> 172.21.15.29:0/1435052302 conn(0x7f1c500670a0 msgr2=0x7f1c500674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c58787700 1 -- 172.21.15.29:0/1435052302 shutdown_connections 2023-10-06T05:26:28.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.168+0000 7f1c58787700 1 -- 172.21.15.29:0/1435052302 wait complete. 2023-10-06T05:26:28.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c58787700 1 Processor -- start 2023-10-06T05:26:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c58787700 1 -- start start 2023-10-06T05:26:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c58787700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c50149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c58787700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50154a80 0x7f1c500b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c58787700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50157060 0x7f1c501574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c58787700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50157a10 con 0x7f1c3c0041d0 2023-10-06T05:26:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c58787700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50169de0 con 0x7f1c50157060 2023-10-06T05:26:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c58787700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50149f50 con 0x7f1c50154a80 2023-10-06T05:26:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c56523700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c50149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c56523700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c50149a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34430/0 (socket says 172.21.15.29:34430) 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c56523700 1 -- 172.21.15.29:0/1568085844 learned_addr learned my addr 172.21.15.29:0/1568085844 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c55d22700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50154a80 0x7f1c500b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.172+0000 7f1c56d24700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50157060 0x7f1c501574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c55d22700 1 -- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50157060 msgr2=0x7f1c501574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c55d22700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50157060 0x7f1c501574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c55d22700 1 -- 172.21.15.29:0/1568085844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 msgr2=0x7f1c50149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c55d22700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c50149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c55d22700 1 -- 172.21.15.29:0/1568085844 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c501694b0 con 0x7f1c50154a80 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c56523700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c50149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:28.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c55d22700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50154a80 0x7f1c500b1b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c1e0 tx=0x7f1c4c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:28.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c427fc700 1 -- 172.21.15.29:0/1568085844 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c001580 con 0x7f1c50154a80 2023-10-06T05:26:28.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c427fc700 1 -- 172.21.15.29:0/1568085844 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c0016e0 con 0x7f1c50154a80 2023-10-06T05:26:28.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c50169790 con 0x7f1c50154a80 2023-10-06T05:26:28.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c427fc700 1 -- 172.21.15.29:0/1568085844 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c007320 con 0x7f1c50154a80 2023-10-06T05:26:28.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c501691c0 con 0x7f1c50154a80 2023-10-06T05:26:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.176+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50149f50 con 0x7f1c50154a80 2023-10-06T05:26:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.180+0000 7f1c427fc700 1 -- 172.21.15.29:0/1568085844 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1c4c019030 con 0x7f1c50154a80 2023-10-06T05:26:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.180+0000 7f1c427fc700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1c34060580 0x7f1c34062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.180+0000 7f1c427fc700 1 -- 172.21.15.29:0/1568085844 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1c4c07de00 con 0x7f1c50154a80 2023-10-06T05:26:28.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.180+0000 7f1c56523700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1c34060580 0x7f1c34062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.180+0000 7f1c56523700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1c34060580 0x7f1c34062a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1c44006ac0 tx=0x7f1c440091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:28.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.192+0000 7f1c427fc700 1 -- 172.21.15.29:0/1568085844 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1c4c04e290 con 0x7f1c50154a80 2023-10-06T05:26:28.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.392+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1c5006eaa0 con 0x7f1c50154a80 2023-10-06T05:26:28.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.412+0000 7f1c427fc700 1 -- 172.21.15.29:0/1568085844 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1c5006eaa0 con 0x7f1c50154a80 2023-10-06T05:26:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1c34060580 msgr2=0x7f1c34062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1c34060580 0x7f1c34062a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1c44006ac0 tx=0x7f1c440091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50154a80 msgr2=0x7f1c500b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50154a80 0x7f1c500b1b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c1e0 tx=0x7f1c4c015000 comp rx=0 tx=0).stop 2023-10-06T05:26:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 shutdown_connections 2023-10-06T05:26:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1c34060580 0x7f1c34062a30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50157060 0x7f1c501574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c50154a80 0x7f1c500b1b60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 --2- 172.21.15.29:0/1568085844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c3c0041d0 0x7f1c50149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 >> 172.21.15.29:0/1568085844 conn(0x7f1c500670a0 msgr2=0x7f1c50155540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:28.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 shutdown_connections 2023-10-06T05:26:28.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.416+0000 7f1c58787700 1 -- 172.21.15.29:0/1568085844 wait complete. 2023-10-06T05:26:28.437 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T05:26:28.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.548+0000 7efde69e0700 1 Processor -- start 2023-10-06T05:26:28.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.548+0000 7efde69e0700 1 -- start start 2023-10-06T05:26:28.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde69e0700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efde013ecb0 0x7efde0159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde69e0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde69e0700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde00c8930 con 0x7efde013f080 2023-10-06T05:26:28.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde69e0700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00688a0 con 0x7efde013ecb0 2023-10-06T05:26:28.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde69e0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde00c7d20 con 0x7efde006dde0 2023-10-06T05:26:28.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde61df700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde59de700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efde013ecb0 0x7efde0159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde61df700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:33648/0 (socket says 172.21.15.29:33648) 2023-10-06T05:26:28.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde61df700 1 -- 172.21.15.29:0/805011365 learned_addr learned my addr 172.21.15.29:0/805011365 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:28.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde51dd700 1 --1- 172.21.15.29:0/805011365 >> v1:172.21.15.173:6789/0 conn(0x7efde013f080 0x7efde006d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:36716/0 (socket says 172.21.15.29:36716) 2023-10-06T05:26:28.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde49dc700 1 -- 172.21.15.29:0/805011365 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71983525 0 0) 0x7efde00c8930 con 0x7efde013f080 2023-10-06T05:26:28.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde49dc700 1 -- 172.21.15.29:0/805011365 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdcc004680 con 0x7efde013f080 2023-10-06T05:26:28.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde61df700 1 -- 172.21.15.29:0/805011365 >> v2:172.21.15.173:3300/0 conn(0x7efde013ecb0 msgr2=0x7efde0159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:28.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde61df700 1 --2- 172.21.15.29:0/805011365 >> v2:172.21.15.173:3300/0 conn(0x7efde013ecb0 0x7efde0159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde61df700 1 -- 172.21.15.29:0/805011365 >> v1:172.21.15.173:6789/0 conn(0x7efde013f080 legacy=0x7efde006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde61df700 1 -- 172.21.15.29:0/805011365 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00c8000 con 0x7efde006dde0 2023-10-06T05:26:28.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde59de700 1 --2- 172.21.15.29:0/805011365 >> v2:172.21.15.173:3300/0 conn(0x7efde013ecb0 0x7efde0159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:28.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde61df700 1 --2- 172.21.15.29:0/805011365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00c9f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009f20 tx=0x7efdd8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf598fa2c48e4de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:28.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde49dc700 1 -- 172.21.15.29:0/805011365 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800e070 con 0x7efde006dde0 2023-10-06T05:26:28.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde49dc700 1 -- 172.21.15.29:0/805011365 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd800b970 con 0x7efde006dde0 2023-10-06T05:26:28.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.552+0000 7efde49dc700 1 -- 172.21.15.29:0/805011365 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80092e0 con 0x7efde006dde0 2023-10-06T05:26:28.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 -- 172.21.15.29:0/805011365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 msgr2=0x7efde00c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 --2- 172.21.15.29:0/805011365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00c9f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009f20 tx=0x7efdd8009840 comp rx=0 tx=0).stop 2023-10-06T05:26:28.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 -- 172.21.15.29:0/805011365 shutdown_connections 2023-10-06T05:26:28.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 --2- 172.21.15.29:0/805011365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00c9f50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 --2- 172.21.15.29:0/805011365 >> v2:172.21.15.173:3300/0 conn(0x7efde013ecb0 0x7efde0159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 -- 172.21.15.29:0/805011365 >> 172.21.15.29:0/805011365 conn(0x7efde00c9830 msgr2=0x7efde006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:28.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 -- 172.21.15.29:0/805011365 shutdown_connections 2023-10-06T05:26:28.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 -- 172.21.15.29:0/805011365 wait complete. 2023-10-06T05:26:28.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 Processor -- start 2023-10-06T05:26:28.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.556+0000 7efde69e0700 1 -- start start 2023-10-06T05:26:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde69e0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde69e0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efde013ecb0 0x7efde0168c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde69e0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde013f080 0x7efde01691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde69e0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00a8940 con 0x7efde013ecb0 2023-10-06T05:26:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde69e0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0169c40 con 0x7efde013f080 2023-10-06T05:26:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde69e0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde0169710 con 0x7efde006dde0 2023-10-06T05:26:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde51dd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efde013ecb0 0x7efde0168c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde51dd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efde013ecb0 0x7efde0168c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34434/0 (socket says 172.21.15.29:34434) 2023-10-06T05:26:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde51dd700 1 -- 172.21.15.29:0/2201043722 learned_addr learned my addr 172.21.15.29:0/2201043722 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde59de700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde61df700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde013f080 0x7efde01691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde51dd700 1 -- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 msgr2=0x7efde00b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde51dd700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde51dd700 1 -- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde013f080 msgr2=0x7efde01691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde51dd700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde013f080 0x7efde01691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde51dd700 1 -- 172.21.15.29:0/2201043722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc009420 con 0x7efde013ecb0 2023-10-06T05:26:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde51dd700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efde013ecb0 0x7efde0168c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c590 tx=0x7efdd0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efdd5ffb700 1 -- 172.21.15.29:0/2201043722 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0005a70 con 0x7efde013ecb0 2023-10-06T05:26:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efdd5ffb700 1 -- 172.21.15.29:0/2201043722 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0005bf0 con 0x7efde013ecb0 2023-10-06T05:26:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efdd5ffb700 1 -- 172.21.15.29:0/2201043722 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd00070d0 con 0x7efde013ecb0 2023-10-06T05:26:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd8009ae0 con 0x7efde013ecb0 2023-10-06T05:26:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.560+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde0155e60 con 0x7efde013ecb0 2023-10-06T05:26:28.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.564+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde004be00 con 0x7efde013ecb0 2023-10-06T05:26:28.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.564+0000 7efdd5ffb700 1 -- 172.21.15.29:0/2201043722 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efdd0007480 con 0x7efde013ecb0 2023-10-06T05:26:28.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.564+0000 7efdd5ffb700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efdc4060580 0x7efdc4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:28.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.564+0000 7efdd5ffb700 1 -- 172.21.15.29:0/2201043722 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efdd007bcf0 con 0x7efde013ecb0 2023-10-06T05:26:28.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.564+0000 7efde59de700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efdc4060580 0x7efdc4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:28.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.564+0000 7efde59de700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efdc4060580 0x7efdc4062a30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efde006ccc0 tx=0x7efddc0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:28.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.568+0000 7efdd5ffb700 1 -- 172.21.15.29:0/2201043722 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efdd0080070 con 0x7efde013ecb0 2023-10-06T05:26:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:28.768+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efde00683c0 con 0x7efde013ecb0 2023-10-06T05:26:29.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.420+0000 7efdd5ffb700 1 -- 172.21.15.29:0/2201043722 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7efdd004c180 con 0x7efde013ecb0 2023-10-06T05:26:29.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efdc4060580 msgr2=0x7efdc4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efdc4060580 0x7efdc4062a30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efde006ccc0 tx=0x7efddc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efde013ecb0 msgr2=0x7efde0168c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efde013ecb0 0x7efde0168c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c590 tx=0x7efdd0007dd0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 shutdown_connections 2023-10-06T05:26:29.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efdc4060580 0x7efdc4062a30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efde013f080 0x7efde01691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efde013ecb0 0x7efde0168c90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 --2- 172.21.15.29:0/2201043722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efde006dde0 0x7efde00b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 >> 172.21.15.29:0/2201043722 conn(0x7efde00c9830 msgr2=0x7efde00cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:29.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 shutdown_connections 2023-10-06T05:26:29.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.424+0000 7efde69e0700 1 -- 172.21.15.29:0/2201043722 wait complete. 2023-10-06T05:26:29.449 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:29.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.556+0000 7f463e025700 1 Processor -- start 2023-10-06T05:26:29.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.556+0000 7f463e025700 1 -- start start 2023-10-06T05:26:29.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.556+0000 7f463e025700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f463806dde0 0x7f46380b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.556+0000 7f463e025700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4638156cb0 con 0x7f463814ffd0 2023-10-06T05:26:29.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.556+0000 7f463e025700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46380af150 con 0x7f46381503a0 2023-10-06T05:26:29.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.556+0000 7f463e025700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46380ae750 con 0x7f463806dde0 2023-10-06T05:26:29.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.556+0000 7f46377fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f463814ffd0 0x7f463806d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36550/0 (socket says 172.21.15.29:36550) 2023-10-06T05:26:29.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.556+0000 7f46377fe700 1 -- 172.21.15.29:0/3060192481 learned_addr learned my addr 172.21.15.29:0/3060192481 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:29.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.556+0000 7f4636ffd700 1 --2- 172.21.15.29:0/3060192481 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f463806dde0 0x7f46380b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f46367fc700 1 -- 172.21.15.29:0/3060192481 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475952506 0 0) 0x7f4638156cb0 con 0x7f463814ffd0 2023-10-06T05:26:29.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f46367fc700 1 -- 172.21.15.29:0/3060192481 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4624003570 con 0x7f463814ffd0 2023-10-06T05:26:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f4636ffd700 1 -- 172.21.15.29:0/3060192481 >> v1:172.21.15.173:6789/0 conn(0x7f46381503a0 legacy=0x7f4638159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f46367fc700 1 -- 172.21.15.29:0/3060192481 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755132516 0 0) 0x7f46380af150 con 0x7f46381503a0 2023-10-06T05:26:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f4636ffd700 1 -- 172.21.15.29:0/3060192481 >> v1:172.21.15.29:6789/0 conn(0x7f463814ffd0 legacy=0x7f463806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f4636ffd700 1 -- 172.21.15.29:0/3060192481 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4638156380 con 0x7f463806dde0 2023-10-06T05:26:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f4636ffd700 1 --2- 172.21.15.29:0/3060192481 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f463806dde0 0x7f46380b0c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4620009910 tx=0x7f46200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac04d1ee30d4366f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f46367fc700 1 -- 172.21.15.29:0/3060192481 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000b680 con 0x7f463806dde0 2023-10-06T05:26:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f46367fc700 1 -- 172.21.15.29:0/3060192481 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462000b7e0 con 0x7f463806dde0 2023-10-06T05:26:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f46367fc700 1 -- 172.21.15.29:0/3060192481 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000bba0 con 0x7f463806dde0 2023-10-06T05:26:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f463e025700 1 -- 172.21.15.29:0/3060192481 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f463806dde0 msgr2=0x7f46380b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f463e025700 1 --2- 172.21.15.29:0/3060192481 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f463806dde0 0x7f46380b0c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4620009910 tx=0x7f46200091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f463e025700 1 -- 172.21.15.29:0/3060192481 shutdown_connections 2023-10-06T05:26:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f463e025700 1 --2- 172.21.15.29:0/3060192481 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f463806dde0 0x7f46380b0c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f463e025700 1 -- 172.21.15.29:0/3060192481 >> 172.21.15.29:0/3060192481 conn(0x7f463806b770 msgr2=0x7f46380690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:29.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f463e025700 1 -- 172.21.15.29:0/3060192481 shutdown_connections 2023-10-06T05:26:29.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.560+0000 7f463e025700 1 -- 172.21.15.29:0/3060192481 wait complete. 2023-10-06T05:26:29.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 Processor -- start 2023-10-06T05:26:29.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 -- start start 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f463806dde0 0x7f4638168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f463814ffd0 0x7f4638153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46381503a0 0x7f46380abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4638150b00 con 0x7f463806dde0 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380a8dd0 con 0x7f463814ffd0 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46380a90b0 con 0x7f46381503a0 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f46377fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f463806dde0 0x7f4638168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f46377fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f463806dde0 0x7f4638168c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34444/0 (socket says 172.21.15.29:34444) 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f4636ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f463814ffd0 0x7f4638153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f4637fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46381503a0 0x7f46380abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f46377fe700 1 -- 172.21.15.29:0/2782249419 learned_addr learned my addr 172.21.15.29:0/2782249419 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f46377fe700 1 -- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46381503a0 msgr2=0x7f46380abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f46377fe700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46381503a0 0x7f46380abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f46377fe700 1 -- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f463814ffd0 msgr2=0x7f4638153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f46377fe700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f463814ffd0 0x7f4638153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f46377fe700 1 -- 172.21.15.29:0/2782249419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620009420 con 0x7f463806dde0 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f4636ffd700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f463814ffd0 0x7f4638153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f46377fe700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f463806dde0 0x7f4638168c50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f46280011e0 tx=0x7f4628007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f462f7fe700 1 -- 172.21.15.29:0/2782249419 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628005b30 con 0x7f463806dde0 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f462f7fe700 1 -- 172.21.15.29:0/2782249419 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4628005c90 con 0x7f463806dde0 2023-10-06T05:26:29.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f462f7fe700 1 -- 172.21.15.29:0/2782249419 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628007300 con 0x7f463806dde0 2023-10-06T05:26:29.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46380a9390 con 0x7f463806dde0 2023-10-06T05:26:29.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.564+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46380a9950 con 0x7f463806dde0 2023-10-06T05:26:29.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.568+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463804be00 con 0x7f463806dde0 2023-10-06T05:26:29.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.568+0000 7f462f7fe700 1 -- 172.21.15.29:0/2782249419 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4628007670 con 0x7f463806dde0 2023-10-06T05:26:29.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.568+0000 7f462f7fe700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4618060550 0x7f4618062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.568+0000 7f462f7fe700 1 -- 172.21.15.29:0/2782249419 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f462807bd20 con 0x7f463806dde0 2023-10-06T05:26:29.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.568+0000 7f4636ffd700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4618060550 0x7f4618062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.572+0000 7f4636ffd700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4618060550 0x7f4618062a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f46200093f0 tx=0x7f4620017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:29.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.576+0000 7f462f7fe700 1 -- 172.21.15.29:0/2782249419 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f462804c1b0 con 0x7f463806dde0 2023-10-06T05:26:29.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.776+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f463814f7b0 con 0x7f463806dde0 2023-10-06T05:26:29.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.776+0000 7f462f7fe700 1 -- 172.21.15.29:0/2782249419 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f462804f7d0 con 0x7f463806dde0 2023-10-06T05:26:29.783 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:29.783 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3342279357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3342279357},{"type":"v1","addr":"172.21.15.173:6835","nonce":3342279357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2659141401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2659141401},{"type":"v1","addr":"172.21.15.173:6837","nonce":2659141401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/648720882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":648720882},{"type":"v1","addr":"172.21.15.29:6833","nonce":648720882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:26:26.407210+0000","modified":"2023-10-06T05:26:29.412409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/244763098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":244763098},{"type":"v1","addr":"172.21.15.29:6835","nonce":244763098}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T05:26:29.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4618060550 msgr2=0x7f4618062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4618060550 0x7f4618062a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f46200093f0 tx=0x7f4620017000 comp rx=0 tx=0).stop 2023-10-06T05:26:29.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f463806dde0 msgr2=0x7f4638168c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f463806dde0 0x7f4638168c50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f46280011e0 tx=0x7f4628007df0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 shutdown_connections 2023-10-06T05:26:29.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46381503a0 0x7f46380abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4618060550 0x7f4618062a00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f463814ffd0 0x7f4638153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 --2- 172.21.15.29:0/2782249419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f463806dde0 0x7f4638168c50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 >> 172.21.15.29:0/2782249419 conn(0x7f463806b770 msgr2=0x7f4638155170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:29.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 shutdown_connections 2023-10-06T05:26:29.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.780+0000 7f463e025700 1 -- 172.21.15.29:0/2782249419 wait complete. 2023-10-06T05:26:29.788 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-10-06T05:26:29.804 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:29.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.904+0000 7f660a0ca700 1 Processor -- start 2023-10-06T05:26:29.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.904+0000 7f660a0ca700 1 -- start start 2023-10-06T05:26:29.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f66040cc930 0x7f66040ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a710 0x7f660415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6604161c40 con 0x7f660406a290 2023-10-06T05:26:29.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66040caa10 con 0x7f66040cc930 2023-10-06T05:26:29.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66040cacf0 con 0x7f660406a710 2023-10-06T05:26:29.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f66090c8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f66040cc930 0x7f66040ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f66090c8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f66040cc930 0x7f66040ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34452/0 (socket says 172.21.15.29:34452) 2023-10-06T05:26:29.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f66090c8700 1 -- 172.21.15.29:0/539464669 learned_addr learned my addr 172.21.15.29:0/539464669 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:29.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f66098c9700 1 --2- 172.21.15.29:0/539464669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a710 0x7f660415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f65fbfff700 1 -- 172.21.15.29:0/539464669 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473029806 0 0) 0x7f6604161c40 con 0x7f660406a290 2023-10-06T05:26:29.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f66090c8700 1 -- 172.21.15.29:0/539464669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a710 msgr2=0x7f660415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:29.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f66090c8700 1 --2- 172.21.15.29:0/539464669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a710 0x7f660415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f66090c8700 1 -- 172.21.15.29:0/539464669 >> v1:172.21.15.173:6789/0 conn(0x7f660406a290 legacy=0x7f66040cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f66090c8700 1 -- 172.21.15.29:0/539464669 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040cafd0 con 0x7f66040cc930 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f66090c8700 1 --2- 172.21.15.29:0/539464669 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 0x7f66040ccd00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f65f40099b0 tx=0x7f65f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad92c39846bb69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f65fbfff700 1 -- 172.21.15.29:0/539464669 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4009ea0 con 0x7f66040cc930 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f65fbfff700 1 -- 172.21.15.29:0/539464669 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f400b860 con 0x7f66040cc930 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f65fbfff700 1 -- 172.21.15.29:0/539464669 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f400bc00 con 0x7f66040cc930 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 -- 172.21.15.29:0/539464669 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 msgr2=0x7f66040ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 --2- 172.21.15.29:0/539464669 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 0x7f66040ccd00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f65f40099b0 tx=0x7f65f4009250 comp rx=0 tx=0).stop 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 -- 172.21.15.29:0/539464669 shutdown_connections 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 --2- 172.21.15.29:0/539464669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a710 0x7f660415cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 --2- 172.21.15.29:0/539464669 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 0x7f66040ccd00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 -- 172.21.15.29:0/539464669 >> 172.21.15.29:0/539464669 conn(0x7f6604067b30 msgr2=0x7f660406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:29.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 -- 172.21.15.29:0/539464669 shutdown_connections 2023-10-06T05:26:29.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.908+0000 7f660a0ca700 1 -- 172.21.15.29:0/539464669 wait complete. 2023-10-06T05:26:29.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 Processor -- start 2023-10-06T05:26:29.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 -- start start 2023-10-06T05:26:29.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a290 0x7f660416d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f660406a710 0x7f660414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 0x7f66040c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660414e490 con 0x7f66040cc930 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660415cc50 con 0x7f660406a710 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66040ca120 con 0x7f660406a290 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66098c9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 0x7f66040c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66098c9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 0x7f66040c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34460/0 (socket says 172.21.15.29:34460) 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66098c9700 1 -- 172.21.15.29:0/546653437 learned_addr learned my addr 172.21.15.29:0/546653437 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66090c8700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a290 0x7f660416d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66098c9700 1 -- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a290 msgr2=0x7f660416d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66088c7700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f660406a710 0x7f660414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66098c9700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a290 0x7f660416d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66098c9700 1 -- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f660406a710 msgr2=0x7f660414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66098c9700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f660406a710 0x7f660414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66098c9700 1 -- 172.21.15.29:0/546653437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f40094f0 con 0x7f66040cc930 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66088c7700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f660406a710 0x7f660414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f66098c9700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 0x7f66040c9be0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009e90 tx=0x7f65fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f65f97fa700 1 -- 172.21.15.29:0/546653437 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00cbc0 con 0x7f66040cc930 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f65f97fa700 1 -- 172.21.15.29:0/546653437 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc00f040 con 0x7f66040cc930 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66041593b0 con 0x7f66040cc930 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f65f97fa700 1 -- 172.21.15.29:0/546653437 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc014480 con 0x7f66040cc930 2023-10-06T05:26:29.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6604088170 con 0x7f66040cc930 2023-10-06T05:26:29.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.912+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6604069b20 con 0x7f66040cc930 2023-10-06T05:26:29.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.916+0000 7f65f97fa700 1 -- 172.21.15.29:0/546653437 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f65fc0147f0 con 0x7f66040cc930 2023-10-06T05:26:29.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.916+0000 7f65f97fa700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65f0060580 0x7f65f0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:29.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.916+0000 7f65f97fa700 1 -- 172.21.15.29:0/546653437 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f65fc07d6f0 con 0x7f66040cc930 2023-10-06T05:26:29.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.916+0000 7f66090c8700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65f0060580 0x7f65f0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:29.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.916+0000 7f66090c8700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65f0060580 0x7f65f0062a30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f65f40099b0 tx=0x7f65f4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:29.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:29.924+0000 7f65f97fa700 1 -- 172.21.15.29:0/546653437 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6604069b20 con 0x7f66040cc930 2023-10-06T05:26:30.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.088+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6604069b20 con 0x7f66040cc930 2023-10-06T05:26:30.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f65f97fa700 1 -- 172.21.15.29:0/546653437 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f6604069b20 con 0x7f66040cc930 2023-10-06T05:26:30.097 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:30.097 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":36,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:26:28.049454+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:26:24.748472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T05:26:25.410229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:30.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65f0060580 msgr2=0x7f65f0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65f0060580 0x7f65f0062a30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f65f40099b0 tx=0x7f65f4017000 comp rx=0 tx=0).stop 2023-10-06T05:26:30.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 msgr2=0x7f66040c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 0x7f66040c9be0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009e90 tx=0x7f65fc00b040 comp rx=0 tx=0).stop 2023-10-06T05:26:30.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 shutdown_connections 2023-10-06T05:26:30.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66040cc930 0x7f66040c9be0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65f0060580 0x7f65f0062a30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f660406a710 0x7f660414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 --2- 172.21.15.29:0/546653437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f660406a290 0x7f660416d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 >> 172.21.15.29:0/546653437 conn(0x7f6604067b30 msgr2=0x7f6604159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:30.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 shutdown_connections 2023-10-06T05:26:30.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.092+0000 7f660a0ca700 1 -- 172.21.15.29:0/546653437 wait complete. 2023-10-06T05:26:30.111 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T05:26:30.111 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:26:30.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.208+0000 7f011d125700 1 Processor -- start 2023-10-06T05:26:30.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f011d125700 1 -- start start 2023-10-06T05:26:30.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f011d125700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118158da0 0x7f011815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f011d125700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0118159170 0x7f01180c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f011d125700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011815da10 con 0x7f011806cd30 2023-10-06T05:26:30.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f011d125700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011806ddd0 con 0x7f0118159170 2023-10-06T05:26:30.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f011d125700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011806d1c0 con 0x7f0118158da0 2023-10-06T05:26:30.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f01177fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f011806cd30 0x7f01180c93f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36556/0 (socket says 172.21.15.29:36556) 2023-10-06T05:26:30.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f01177fe700 1 -- 172.21.15.29:0/84788098 learned_addr learned my addr 172.21.15.29:0/84788098 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f011c924700 1 --2- 172.21.15.29:0/84788098 >> v2:172.21.15.173:3300/0 conn(0x7f0118159170 0x7f01180c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0117fff700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118158da0 0x7f011815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422231792 0 0) 0x7f0108001110 con 0x7f011806cd30 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0104003570 con 0x7f011806cd30 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2673233077 0 0) 0x7f0104003570 con 0x7f011806cd30 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118158da0 msgr2=0x7f011815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118158da0 0x7f011815d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 >> v2:172.21.15.173:3300/0 conn(0x7f0118159170 msgr2=0x7f01180c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 --2- 172.21.15.29:0/84788098 >> v2:172.21.15.173:3300/0 conn(0x7f0118159170 0x7f01180c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011806d4a0 con 0x7f011806cd30 2023-10-06T05:26:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f0108001600 con 0x7f011806cd30 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 >> v1:172.21.15.29:6789/0 conn(0x7f011806cd30 legacy=0x7f01180c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118158da0 0x7f0104003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0104003fe0 0x7f0104004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0104004d50 0x7f01040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011806ddd0 con 0x7f0104003fe0 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011806d1c0 con 0x7f0104004d50 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010400ba90 con 0x7f0118158da0 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f01177fe700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0104003fe0 0x7f0104004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0117fff700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118158da0 0x7f0104003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f011c924700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0104004d50 0x7f01040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f01177fe700 1 -- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118158da0 msgr2=0x7f0104003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f01177fe700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118158da0 0x7f0104003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f01177fe700 1 -- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0104004d50 msgr2=0x7f01040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f01177fe700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0104004d50 0x7f01040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f01177fe700 1 -- 172.21.15.29:0/84788098 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104003570 con 0x7f0104003fe0 2023-10-06T05:26:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f01177fe700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0104003fe0 0x7f0104004810 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f010800c5f0 tx=0x7f0108007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811c01dba70e2bed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010800cd90 con 0x7f0104003fe0 2023-10-06T05:26:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0108005920 con 0x7f0104003fe0 2023-10-06T05:26:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.212+0000 7f0116ffd700 1 -- 172.21.15.29:0/84788098 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108005ce0 con 0x7f0104003fe0 2023-10-06T05:26:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.216+0000 7f011d125700 1 -- 172.21.15.29:0/84788098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0104003fe0 msgr2=0x7f0104004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.216+0000 7f011d125700 1 --2- 172.21.15.29:0/84788098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0104003fe0 0x7f0104004810 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f010800c5f0 tx=0x7f0108007a80 comp rx=0 tx=0).stop 2023-10-06T05:26:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.216+0000 7f011c924700 1 -- 172.21.15.29:0/84788098 reap_dead start 2023-10-06T05:26:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.216+0000 7f011d125700 1 -- 172.21.15.29:0/84788098 shutdown_connections 2023-10-06T05:26:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.216+0000 7f011d125700 1 -- 172.21.15.29:0/84788098 >> 172.21.15.29:0/84788098 conn(0x7f0118067530 msgr2=0x7f0118067930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.216+0000 7f011d125700 1 -- 172.21.15.29:0/84788098 shutdown_connections 2023-10-06T05:26:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.216+0000 7f011d125700 1 -- 172.21.15.29:0/84788098 wait complete. 2023-10-06T05:26:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.216+0000 7f011d125700 1 Processor -- start 2023-10-06T05:26:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.216+0000 7f011d125700 1 -- start start 2023-10-06T05:26:30.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011d125700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0104003fe0 0x7f01181537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011d125700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118153d10 0x7f01180c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011d125700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01180c3fe0 0x7f01180c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011d125700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180c5cc0 con 0x7f01180c3fe0 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011d125700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180c5eb0 con 0x7f0104003fe0 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011d125700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01180c6190 con 0x7f0118153d10 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011c924700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01180c3fe0 0x7f01180c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011c924700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01180c3fe0 0x7f01180c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34474/0 (socket says 172.21.15.29:34474) 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011c924700 1 -- 172.21.15.29:0/3283759217 learned_addr learned my addr 172.21.15.29:0/3283759217 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f0117fff700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0104003fe0 0x7f01181537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f01177fe700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118153d10 0x7f01180c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011c924700 1 -- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118153d10 msgr2=0x7f01180c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011c924700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118153d10 0x7f01180c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011c924700 1 -- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0104003fe0 msgr2=0x7f01181537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011c924700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0104003fe0 0x7f01181537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011c924700 1 -- 172.21.15.29:0/3283759217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180c6470 con 0x7f01180c3fe0 2023-10-06T05:26:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011c924700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01180c3fe0 0x7f01180c4440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f01180c8870 tx=0x7f011000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f010ffff700 1 -- 172.21.15.29:0/3283759217 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000e040 con 0x7f01180c3fe0 2023-10-06T05:26:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f010ffff700 1 -- 172.21.15.29:0/3283759217 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011000f040 con 0x7f01180c3fe0 2023-10-06T05:26:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f010ffff700 1 -- 172.21.15.29:0/3283759217 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000fd70 con 0x7f01180c3fe0 2023-10-06T05:26:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01180c6750 con 0x7f01180c3fe0 2023-10-06T05:26:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.220+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0118151d10 con 0x7f01180c3fe0 2023-10-06T05:26:30.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.224+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0118151f90 con 0x7f01180c3fe0 2023-10-06T05:26:30.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.224+0000 7f010ffff700 1 -- 172.21.15.29:0/3283759217 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0110015640 con 0x7f01180c3fe0 2023-10-06T05:26:30.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.224+0000 7f010ffff700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00f8060550 0x7f00f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.224+0000 7f010ffff700 1 -- 172.21.15.29:0/3283759217 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f011007d160 con 0x7f01180c3fe0 2023-10-06T05:26:30.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.224+0000 7f0117fff700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00f8060550 0x7f00f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.224+0000 7f0117fff700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00f8060550 0x7f00f8062a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0100006f00 tx=0x7f01000091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:30.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.232+0000 7f010ffff700 1 -- 172.21.15.29:0/3283759217 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f011004d550 con 0x7f01180c3fe0 2023-10-06T05:26:30.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.388+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f011804be00 con 0x7f00f8060550 2023-10-06T05:26:30.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.408+0000 7f010ffff700 1 -- 172.21.15.29:0/3283759217 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289512 (secure 0 0 0) 0x7f011804be00 con 0x7f00f8060550 2023-10-06T05:26:30.416 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:30.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00f8060550 msgr2=0x7f00f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00f8060550 0x7f00f8062a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0100006f00 tx=0x7f01000091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01180c3fe0 msgr2=0x7f01180c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01180c3fe0 0x7f01180c4440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f01180c8870 tx=0x7f011000b040 comp rx=0 tx=0).stop 2023-10-06T05:26:30.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 shutdown_connections 2023-10-06T05:26:30.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01180c3fe0 0x7f01180c4440 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0118153d10 0x7f01180c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00f8060550 0x7f00f8062a00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 --2- 172.21.15.29:0/3283759217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0104003fe0 0x7f01181537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 >> 172.21.15.29:0/3283759217 conn(0x7f0118067530 msgr2=0x7f01180cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:30.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 shutdown_connections 2023-10-06T05:26:30.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.412+0000 7f011d125700 1 -- 172.21.15.29:0/3283759217 wait complete. 2023-10-06T05:26:30.421 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:26:30.432 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-10-06T05:26:28.665614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398944,"kb_used_data":4256,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575776,"statfs":{"total":773094113280,"available":770637594624,"internally_reserved":0,"allocated":4358144,"data_stored":2441176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001317"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.078368+0000","last_change":"2023-10-06T05:26:27.078368+0000","last_active":"2023-10-06T05:26:27.078368+0000","last_peered":"2023-10-06T05:26:27.078368+0000","last_clean":"2023-10-06T05:26:27.078368+0000","last_became_active":"2023-10-06T05:26:27.078021+0000","last_became_peered":"2023-10-06T05:26:27.078021+0000","last_unstale":"2023-10-06T05:26:27.078368+0000","last_undegraded":"2023-10-06T05:26:27.078368+0000","last_fullsized":"2023-10-06T05:26:27.078368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:57.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.084277+0000","last_change":"2023-10-06T05:26:27.084277+0000","last_active":"2023-10-06T05:26:27.084277+0000","last_peered":"2023-10-06T05:26:27.084277+0000","last_clean":"2023-10-06T05:26:27.084277+0000","last_became_active":"2023-10-06T05:26:27.083866+0000","last_became_peered":"2023-10-06T05:26:27.083866+0000","last_unstale":"2023-10-06T05:26:27.084277+0000","last_undegraded":"2023-10-06T05:26:27.084277+0000","last_fullsized":"2023-10-06T05:26:27.084277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:33.461500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.082663+0000","last_change":"2023-10-06T05:26:27.082663+0000","last_active":"2023-10-06T05:26:27.082663+0000","last_peered":"2023-10-06T05:26:27.082663+0000","last_clean":"2023-10-06T05:26:27.082663+0000","last_became_active":"2023-10-06T05:26:27.082325+0000","last_became_peered":"2023-10-06T05:26:27.082325+0000","last_unstale":"2023-10-06T05:26:27.082663+0000","last_undegraded":"2023-10-06T05:26:27.082663+0000","last_fullsized":"2023-10-06T05:26:27.082663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:51.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076446+0000","last_change":"2023-10-06T05:26:27.076446+0000","last_active":"2023-10-06T05:26:27.076446+0000","last_peered":"2023-10-06T05:26:27.076446+0000","last_clean":"2023-10-06T05:26:27.076446+0000","last_became_active":"2023-10-06T05:26:27.076080+0000","last_became_peered":"2023-10-06T05:26:27.076080+0000","last_unstale":"2023-10-06T05:26:27.076446+0000","last_undegraded":"2023-10-06T05:26:27.076446+0000","last_fullsized":"2023-10-06T05:26:27.076446+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:26.449369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073150+0000","last_change":"2023-10-06T05:26:27.073150+0000","last_active":"2023-10-06T05:26:27.073150+0000","last_peered":"2023-10-06T05:26:27.073150+0000","last_clean":"2023-10-06T05:26:27.073150+0000","last_became_active":"2023-10-06T05:26:27.072677+0000","last_became_peered":"2023-10-06T05:26:27.072677+0000","last_unstale":"2023-10-06T05:26:27.073150+0000","last_undegraded":"2023-10-06T05:26:27.073150+0000","last_fullsized":"2023-10-06T05:26:27.073150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:10.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075426+0000","last_change":"2023-10-06T05:26:27.075426+0000","last_active":"2023-10-06T05:26:27.075426+0000","last_peered":"2023-10-06T05:26:27.075426+0000","last_clean":"2023-10-06T05:26:27.075426+0000","last_became_active":"2023-10-06T05:26:27.075045+0000","last_became_peered":"2023-10-06T05:26:27.075045+0000","last_unstale":"2023-10-06T05:26:27.075426+0000","last_undegraded":"2023-10-06T05:26:27.075426+0000","last_fullsized":"2023-10-06T05:26:27.075426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:35.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.085725+0000","last_change":"2023-10-06T05:26:27.085725+0000","last_active":"2023-10-06T05:26:27.085725+0000","last_peered":"2023-10-06T05:26:27.085725+0000","last_clean":"2023-10-06T05:26:27.085725+0000","last_became_active":"2023-10-06T05:26:27.085348+0000","last_became_peered":"2023-10-06T05:26:27.085348+0000","last_unstale":"2023-10-06T05:26:27.085725+0000","last_undegraded":"2023-10-06T05:26:27.085725+0000","last_fullsized":"2023-10-06T05:26:27.085725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:50.566027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074643+0000","last_change":"2023-10-06T05:26:27.074643+0000","last_active":"2023-10-06T05:26:27.074643+0000","last_peered":"2023-10-06T05:26:27.074643+0000","last_clean":"2023-10-06T05:26:27.074643+0000","last_became_active":"2023-10-06T05:26:27.074116+0000","last_became_peered":"2023-10-06T05:26:27.074116+0000","last_unstale":"2023-10-06T05:26:27.074643+0000","last_undegraded":"2023-10-06T05:26:27.074643+0000","last_fullsized":"2023-10-06T05:26:27.074643+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:22.276067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.082648+0000","last_change":"2023-10-06T05:26:27.082648+0000","last_active":"2023-10-06T05:26:27.082648+0000","last_peered":"2023-10-06T05:26:27.082648+0000","last_clean":"2023-10-06T05:26:27.082648+0000","last_became_active":"2023-10-06T05:26:27.082270+0000","last_became_peered":"2023-10-06T05:26:27.082270+0000","last_unstale":"2023-10-06T05:26:27.082648+0000","last_undegraded":"2023-10-06T05:26:27.082648+0000","last_fullsized":"2023-10-06T05:26:27.082648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:55.440636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074246+0000","last_change":"2023-10-06T05:26:27.074246+0000","last_active":"2023-10-06T05:26:27.074246+0000","last_peered":"2023-10-06T05:26:27.074246+0000","last_clean":"2023-10-06T05:26:27.074246+0000","last_became_active":"2023-10-06T05:26:27.073936+0000","last_became_peered":"2023-10-06T05:26:27.073936+0000","last_unstale":"2023-10-06T05:26:27.074246+0000","last_undegraded":"2023-10-06T05:26:27.074246+0000","last_fullsized":"2023-10-06T05:26:27.074246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:44.877585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073631+0000","last_change":"2023-10-06T05:26:27.073631+0000","last_active":"2023-10-06T05:26:27.073631+0000","last_peered":"2023-10-06T05:26:27.073631+0000","last_clean":"2023-10-06T05:26:27.073631+0000","last_became_active":"2023-10-06T05:26:27.073373+0000","last_became_peered":"2023-10-06T05:26:27.073373+0000","last_unstale":"2023-10-06T05:26:27.073631+0000","last_undegraded":"2023-10-06T05:26:27.073631+0000","last_fullsized":"2023-10-06T05:26:27.073631+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:27.314928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076732+0000","last_change":"2023-10-06T05:26:27.076732+0000","last_active":"2023-10-06T05:26:27.076732+0000","last_peered":"2023-10-06T05:26:27.076732+0000","last_clean":"2023-10-06T05:26:27.076732+0000","last_became_active":"2023-10-06T05:26:27.076405+0000","last_became_peered":"2023-10-06T05:26:27.076405+0000","last_unstale":"2023-10-06T05:26:27.076732+0000","last_undegraded":"2023-10-06T05:26:27.076732+0000","last_fullsized":"2023-10-06T05:26:27.076732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:15.006844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073334+0000","last_change":"2023-10-06T05:26:27.073334+0000","last_active":"2023-10-06T05:26:27.073334+0000","last_peered":"2023-10-06T05:26:27.073334+0000","last_clean":"2023-10-06T05:26:27.073334+0000","last_became_active":"2023-10-06T05:26:27.073048+0000","last_became_peered":"2023-10-06T05:26:27.073048+0000","last_unstale":"2023-10-06T05:26:27.073334+0000","last_undegraded":"2023-10-06T05:26:27.073334+0000","last_fullsized":"2023-10-06T05:26:27.073334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:17.504859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.071431+0000","last_change":"2023-10-06T05:26:27.071431+0000","last_active":"2023-10-06T05:26:27.071431+0000","last_peered":"2023-10-06T05:26:27.071431+0000","last_clean":"2023-10-06T05:26:27.071431+0000","last_became_active":"2023-10-06T05:26:27.071105+0000","last_became_peered":"2023-10-06T05:26:27.071105+0000","last_unstale":"2023-10-06T05:26:27.071431+0000","last_undegraded":"2023-10-06T05:26:27.071431+0000","last_fullsized":"2023-10-06T05:26:27.071431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:08.887562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.082886+0000","last_change":"2023-10-06T05:26:27.082886+0000","last_active":"2023-10-06T05:26:27.082886+0000","last_peered":"2023-10-06T05:26:27.082886+0000","last_clean":"2023-10-06T05:26:27.082886+0000","last_became_active":"2023-10-06T05:26:27.082566+0000","last_became_peered":"2023-10-06T05:26:27.082566+0000","last_unstale":"2023-10-06T05:26:27.082886+0000","last_undegraded":"2023-10-06T05:26:27.082886+0000","last_fullsized":"2023-10-06T05:26:27.082886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:25.145735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073755+0000","last_change":"2023-10-06T05:26:27.073755+0000","last_active":"2023-10-06T05:26:27.073755+0000","last_peered":"2023-10-06T05:26:27.073755+0000","last_clean":"2023-10-06T05:26:27.073755+0000","last_became_active":"2023-10-06T05:26:27.073428+0000","last_became_peered":"2023-10-06T05:26:27.073428+0000","last_unstale":"2023-10-06T05:26:27.073755+0000","last_undegraded":"2023-10-06T05:26:27.073755+0000","last_fullsized":"2023-10-06T05:26:27.073755+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:35.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074371+0000","last_change":"2023-10-06T05:26:27.074371+0000","last_active":"2023-10-06T05:26:27.074371+0000","last_peered":"2023-10-06T05:26:27.074371+0000","last_clean":"2023-10-06T05:26:27.074371+0000","last_became_active":"2023-10-06T05:26:27.074083+0000","last_became_peered":"2023-10-06T05:26:27.074083+0000","last_unstale":"2023-10-06T05:26:27.074371+0000","last_undegraded":"2023-10-06T05:26:27.074371+0000","last_fullsized":"2023-10-06T05:26:27.074371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:55.440636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075233+0000","last_change":"2023-10-06T05:26:27.075233+0000","last_active":"2023-10-06T05:26:27.075233+0000","last_peered":"2023-10-06T05:26:27.075233+0000","last_clean":"2023-10-06T05:26:27.075233+0000","last_became_active":"2023-10-06T05:26:27.074965+0000","last_became_peered":"2023-10-06T05:26:27.074965+0000","last_unstale":"2023-10-06T05:26:27.075233+0000","last_undegraded":"2023-10-06T05:26:27.075233+0000","last_fullsized":"2023-10-06T05:26:27.075233+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:48.973602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076390+0000","last_change":"2023-10-06T05:26:27.076390+0000","last_active":"2023-10-06T05:26:27.076390+0000","last_peered":"2023-10-06T05:26:27.076390+0000","last_clean":"2023-10-06T05:26:27.076390+0000","last_became_active":"2023-10-06T05:26:27.074056+0000","last_became_peered":"2023-10-06T05:26:27.074056+0000","last_unstale":"2023-10-06T05:26:27.076390+0000","last_undegraded":"2023-10-06T05:26:27.076390+0000","last_fullsized":"2023-10-06T05:26:27.076390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:14.849149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074363+0000","last_change":"2023-10-06T05:26:27.074363+0000","last_active":"2023-10-06T05:26:27.074363+0000","last_peered":"2023-10-06T05:26:27.074363+0000","last_clean":"2023-10-06T05:26:27.074363+0000","last_became_active":"2023-10-06T05:26:27.074075+0000","last_became_peered":"2023-10-06T05:26:27.074075+0000","last_unstale":"2023-10-06T05:26:27.074363+0000","last_undegraded":"2023-10-06T05:26:27.074363+0000","last_fullsized":"2023-10-06T05:26:27.074363+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:56.220503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.077029+0000","last_change":"2023-10-06T05:26:27.077029+0000","last_active":"2023-10-06T05:26:27.077029+0000","last_peered":"2023-10-06T05:26:27.077029+0000","last_clean":"2023-10-06T05:26:27.077029+0000","last_became_active":"2023-10-06T05:26:27.074681+0000","last_became_peered":"2023-10-06T05:26:27.074681+0000","last_unstale":"2023-10-06T05:26:27.077029+0000","last_undegraded":"2023-10-06T05:26:27.077029+0000","last_fullsized":"2023-10-06T05:26:27.077029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:08.887562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.078521+0000","last_change":"2023-10-06T05:26:27.078521+0000","last_active":"2023-10-06T05:26:27.078521+0000","last_peered":"2023-10-06T05:26:27.078521+0000","last_clean":"2023-10-06T05:26:27.078521+0000","last_became_active":"2023-10-06T05:26:27.078179+0000","last_became_peered":"2023-10-06T05:26:27.078179+0000","last_unstale":"2023-10-06T05:26:27.078521+0000","last_undegraded":"2023-10-06T05:26:27.078521+0000","last_fullsized":"2023-10-06T05:26:27.078521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:33.461500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.078252+0000","last_change":"2023-10-06T05:26:27.078252+0000","last_active":"2023-10-06T05:26:27.078252+0000","last_peered":"2023-10-06T05:26:27.078252+0000","last_clean":"2023-10-06T05:26:27.078252+0000","last_became_active":"2023-10-06T05:26:27.077981+0000","last_became_peered":"2023-10-06T05:26:27.077981+0000","last_unstale":"2023-10-06T05:26:27.078252+0000","last_undegraded":"2023-10-06T05:26:27.078252+0000","last_fullsized":"2023-10-06T05:26:27.078252+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:50.686847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073081+0000","last_change":"2023-10-06T05:26:27.073081+0000","last_active":"2023-10-06T05:26:27.073081+0000","last_peered":"2023-10-06T05:26:27.073081+0000","last_clean":"2023-10-06T05:26:27.073081+0000","last_became_active":"2023-10-06T05:26:27.072522+0000","last_became_peered":"2023-10-06T05:26:27.072522+0000","last_unstale":"2023-10-06T05:26:27.073081+0000","last_undegraded":"2023-10-06T05:26:27.073081+0000","last_fullsized":"2023-10-06T05:26:27.073081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:05.634987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075949+0000","last_change":"2023-10-06T05:26:27.075949+0000","last_active":"2023-10-06T05:26:27.075949+0000","last_peered":"2023-10-06T05:26:27.075949+0000","last_clean":"2023-10-06T05:26:27.075949+0000","last_became_active":"2023-10-06T05:26:27.075677+0000","last_became_peered":"2023-10-06T05:26:27.075677+0000","last_unstale":"2023-10-06T05:26:27.075949+0000","last_undegraded":"2023-10-06T05:26:27.075949+0000","last_fullsized":"2023-10-06T05:26:27.075949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:14.849149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.083264+0000","last_change":"2023-10-06T05:26:27.083264+0000","last_active":"2023-10-06T05:26:27.083264+0000","last_peered":"2023-10-06T05:26:27.083264+0000","last_clean":"2023-10-06T05:26:27.083264+0000","last_became_active":"2023-10-06T05:26:27.082990+0000","last_became_peered":"2023-10-06T05:26:27.082990+0000","last_unstale":"2023-10-06T05:26:27.083264+0000","last_undegraded":"2023-10-06T05:26:27.083264+0000","last_fullsized":"2023-10-06T05:26:27.083264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:51.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074236+0000","last_change":"2023-10-06T05:26:27.074236+0000","last_active":"2023-10-06T05:26:27.074236+0000","last_peered":"2023-10-06T05:26:27.074236+0000","last_clean":"2023-10-06T05:26:27.074236+0000","last_became_active":"2023-10-06T05:26:27.073953+0000","last_became_peered":"2023-10-06T05:26:27.073953+0000","last_unstale":"2023-10-06T05:26:27.074236+0000","last_undegraded":"2023-10-06T05:26:27.074236+0000","last_fullsized":"2023-10-06T05:26:27.074236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:20.290448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.083343+0000","last_change":"2023-10-06T05:26:27.083343+0000","last_active":"2023-10-06T05:26:27.083343+0000","last_peered":"2023-10-06T05:26:27.083343+0000","last_clean":"2023-10-06T05:26:27.083343+0000","last_became_active":"2023-10-06T05:26:27.082979+0000","last_became_peered":"2023-10-06T05:26:27.082979+0000","last_unstale":"2023-10-06T05:26:27.083343+0000","last_undegraded":"2023-10-06T05:26:27.083343+0000","last_fullsized":"2023-10-06T05:26:27.083343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.072397+0000","last_change":"2023-10-06T05:26:27.072397+0000","last_active":"2023-10-06T05:26:27.072397+0000","last_peered":"2023-10-06T05:26:27.072397+0000","last_clean":"2023-10-06T05:26:27.072397+0000","last_became_active":"2023-10-06T05:26:27.071976+0000","last_became_peered":"2023-10-06T05:26:27.071976+0000","last_unstale":"2023-10-06T05:26:27.072397+0000","last_undegraded":"2023-10-06T05:26:27.072397+0000","last_fullsized":"2023-10-06T05:26:27.072397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:34.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.085779+0000","last_change":"2023-10-06T05:26:27.085779+0000","last_active":"2023-10-06T05:26:27.085779+0000","last_peered":"2023-10-06T05:26:27.085779+0000","last_clean":"2023-10-06T05:26:27.085779+0000","last_became_active":"2023-10-06T05:26:27.085478+0000","last_became_peered":"2023-10-06T05:26:27.085478+0000","last_unstale":"2023-10-06T05:26:27.085779+0000","last_undegraded":"2023-10-06T05:26:27.085779+0000","last_fullsized":"2023-10-06T05:26:27.085779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:44.356097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.077477+0000","last_change":"2023-10-06T05:26:27.077477+0000","last_active":"2023-10-06T05:26:27.077477+0000","last_peered":"2023-10-06T05:26:27.077477+0000","last_clean":"2023-10-06T05:26:27.077477+0000","last_became_active":"2023-10-06T05:26:27.077194+0000","last_became_peered":"2023-10-06T05:26:27.077194+0000","last_unstale":"2023-10-06T05:26:27.077477+0000","last_undegraded":"2023-10-06T05:26:27.077477+0000","last_fullsized":"2023-10-06T05:26:27.077477+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:20.016532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075205+0000","last_change":"2023-10-06T05:26:27.075205+0000","last_active":"2023-10-06T05:26:27.075205+0000","last_peered":"2023-10-06T05:26:27.075205+0000","last_clean":"2023-10-06T05:26:27.075205+0000","last_became_active":"2023-10-06T05:26:27.073588+0000","last_became_peered":"2023-10-06T05:26:27.073588+0000","last_unstale":"2023-10-06T05:26:27.075205+0000","last_undegraded":"2023-10-06T05:26:27.075205+0000","last_fullsized":"2023-10-06T05:26:27.075205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:51.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075070+0000","last_change":"2023-10-06T05:26:27.075070+0000","last_active":"2023-10-06T05:26:27.075070+0000","last_peered":"2023-10-06T05:26:27.075070+0000","last_clean":"2023-10-06T05:26:27.075070+0000","last_became_active":"2023-10-06T05:26:27.074789+0000","last_became_peered":"2023-10-06T05:26:27.074789+0000","last_unstale":"2023-10-06T05:26:27.075070+0000","last_undegraded":"2023-10-06T05:26:27.075070+0000","last_fullsized":"2023-10-06T05:26:27.075070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:51.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.430228+0000","last_change":"2023-10-06T05:26:26.069320+0000","last_active":"2023-10-06T05:26:27.430228+0000","last_peered":"2023-10-06T05:26:27.430228+0000","last_clean":"2023-10-06T05:26:27.430228+0000","last_became_active":"2023-10-06T05:26:26.068983+0000","last_became_peered":"2023-10-06T05:26:26.068983+0000","last_unstale":"2023-10-06T05:26:27.430228+0000","last_undegraded":"2023-10-06T05:26:27.430228+0000","last_fullsized":"2023-10-06T05:26:27.430228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:57.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.082451+0000","last_change":"2023-10-06T05:26:27.082451+0000","last_active":"2023-10-06T05:26:27.082451+0000","last_peered":"2023-10-06T05:26:27.082451+0000","last_clean":"2023-10-06T05:26:27.082451+0000","last_became_active":"2023-10-06T05:26:27.082036+0000","last_became_peered":"2023-10-06T05:26:27.082036+0000","last_unstale":"2023-10-06T05:26:27.082451+0000","last_undegraded":"2023-10-06T05:26:27.082451+0000","last_fullsized":"2023-10-06T05:26:27.082451+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:50.686847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.061894+0000","last_change":"2023-10-06T05:26:26.071874+0000","last_active":"2023-10-06T05:26:27.061894+0000","last_peered":"2023-10-06T05:26:27.061894+0000","last_clean":"2023-10-06T05:26:27.061894+0000","last_became_active":"2023-10-06T05:26:26.071539+0000","last_became_peered":"2023-10-06T05:26:26.071539+0000","last_unstale":"2023-10-06T05:26:27.061894+0000","last_undegraded":"2023-10-06T05:26:27.061894+0000","last_fullsized":"2023-10-06T05:26:27.061894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:09.196805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074153+0000","last_change":"2023-10-06T05:26:27.074153+0000","last_active":"2023-10-06T05:26:27.074153+0000","last_peered":"2023-10-06T05:26:27.074153+0000","last_clean":"2023-10-06T05:26:27.074153+0000","last_became_active":"2023-10-06T05:26:27.073886+0000","last_became_peered":"2023-10-06T05:26:27.073886+0000","last_unstale":"2023-10-06T05:26:27.074153+0000","last_undegraded":"2023-10-06T05:26:27.074153+0000","last_fullsized":"2023-10-06T05:26:27.074153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:22.276067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.426055+0000","last_change":"2023-10-06T05:26:26.075515+0000","last_active":"2023-10-06T05:26:27.426055+0000","last_peered":"2023-10-06T05:26:27.426055+0000","last_clean":"2023-10-06T05:26:27.426055+0000","last_became_active":"2023-10-06T05:26:26.075303+0000","last_became_peered":"2023-10-06T05:26:26.075303+0000","last_unstale":"2023-10-06T05:26:27.426055+0000","last_undegraded":"2023-10-06T05:26:27.426055+0000","last_fullsized":"2023-10-06T05:26:27.426055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:13.836135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.077349+0000","last_change":"2023-10-06T05:26:27.077349+0000","last_active":"2023-10-06T05:26:27.077349+0000","last_peered":"2023-10-06T05:26:27.077349+0000","last_clean":"2023-10-06T05:26:27.077349+0000","last_became_active":"2023-10-06T05:26:27.077000+0000","last_became_peered":"2023-10-06T05:26:27.077000+0000","last_unstale":"2023-10-06T05:26:27.077349+0000","last_undegraded":"2023-10-06T05:26:27.077349+0000","last_fullsized":"2023-10-06T05:26:27.077349+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:35.542864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.426753+0000","last_change":"2023-10-06T05:26:26.071329+0000","last_active":"2023-10-06T05:26:27.426753+0000","last_peered":"2023-10-06T05:26:27.426753+0000","last_clean":"2023-10-06T05:26:27.426753+0000","last_became_active":"2023-10-06T05:26:26.071036+0000","last_became_peered":"2023-10-06T05:26:26.071036+0000","last_unstale":"2023-10-06T05:26:27.426753+0000","last_undegraded":"2023-10-06T05:26:27.426753+0000","last_fullsized":"2023-10-06T05:26:27.426753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:50.012792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.079943+0000","last_change":"2023-10-06T05:26:27.079943+0000","last_active":"2023-10-06T05:26:27.079943+0000","last_peered":"2023-10-06T05:26:27.079943+0000","last_clean":"2023-10-06T05:26:27.079943+0000","last_became_active":"2023-10-06T05:26:27.079532+0000","last_became_peered":"2023-10-06T05:26:27.079532+0000","last_unstale":"2023-10-06T05:26:27.079943+0000","last_undegraded":"2023-10-06T05:26:27.079943+0000","last_fullsized":"2023-10-06T05:26:27.079943+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:20.016532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.067284+0000","last_change":"2023-10-06T05:26:26.075003+0000","last_active":"2023-10-06T05:26:27.067284+0000","last_peered":"2023-10-06T05:26:27.067284+0000","last_clean":"2023-10-06T05:26:27.067284+0000","last_became_active":"2023-10-06T05:26:26.074676+0000","last_became_peered":"2023-10-06T05:26:26.074676+0000","last_unstale":"2023-10-06T05:26:27.067284+0000","last_undegraded":"2023-10-06T05:26:27.067284+0000","last_fullsized":"2023-10-06T05:26:27.067284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:55.207489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073577+0000","last_change":"2023-10-06T05:26:27.073577+0000","last_active":"2023-10-06T05:26:27.073577+0000","last_peered":"2023-10-06T05:26:27.073577+0000","last_clean":"2023-10-06T05:26:27.073577+0000","last_became_active":"2023-10-06T05:26:27.073044+0000","last_became_peered":"2023-10-06T05:26:27.073044+0000","last_unstale":"2023-10-06T05:26:27.073577+0000","last_undegraded":"2023-10-06T05:26:27.073577+0000","last_fullsized":"2023-10-06T05:26:27.073577+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:33.461500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.057575+0000","last_change":"2023-10-06T05:26:26.069123+0000","last_active":"2023-10-06T05:26:27.057575+0000","last_peered":"2023-10-06T05:26:27.057575+0000","last_clean":"2023-10-06T05:26:27.057575+0000","last_became_active":"2023-10-06T05:26:26.068843+0000","last_became_peered":"2023-10-06T05:26:26.068843+0000","last_unstale":"2023-10-06T05:26:27.057575+0000","last_undegraded":"2023-10-06T05:26:27.057575+0000","last_fullsized":"2023-10-06T05:26:27.057575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:48.272688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075114+0000","last_change":"2023-10-06T05:26:27.075114+0000","last_active":"2023-10-06T05:26:27.075114+0000","last_peered":"2023-10-06T05:26:27.075114+0000","last_clean":"2023-10-06T05:26:27.075114+0000","last_became_active":"2023-10-06T05:26:27.074760+0000","last_became_peered":"2023-10-06T05:26:27.074760+0000","last_unstale":"2023-10-06T05:26:27.075114+0000","last_undegraded":"2023-10-06T05:26:27.075114+0000","last_fullsized":"2023-10-06T05:26:27.075114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:50.566027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.077780+0000","last_change":"2023-10-06T05:26:26.072791+0000","last_active":"2023-10-06T05:26:26.077780+0000","last_peered":"2023-10-06T05:26:26.077780+0000","last_clean":"2023-10-06T05:26:26.077780+0000","last_became_active":"2023-10-06T05:26:26.072487+0000","last_became_peered":"2023-10-06T05:26:26.072487+0000","last_unstale":"2023-10-06T05:26:26.077780+0000","last_undegraded":"2023-10-06T05:26:26.077780+0000","last_fullsized":"2023-10-06T05:26:26.077780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:19.277435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.081083+0000","last_change":"2023-10-06T05:26:27.081083+0000","last_active":"2023-10-06T05:26:27.081083+0000","last_peered":"2023-10-06T05:26:27.081083+0000","last_clean":"2023-10-06T05:26:27.081083+0000","last_became_active":"2023-10-06T05:26:27.080777+0000","last_became_peered":"2023-10-06T05:26:27.080777+0000","last_unstale":"2023-10-06T05:26:27.081083+0000","last_undegraded":"2023-10-06T05:26:27.081083+0000","last_fullsized":"2023-10-06T05:26:27.081083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:57.520031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.071857+0000","last_change":"2023-10-06T05:26:26.068143+0000","last_active":"2023-10-06T05:26:26.071857+0000","last_peered":"2023-10-06T05:26:26.071857+0000","last_clean":"2023-10-06T05:26:26.071857+0000","last_became_active":"2023-10-06T05:26:26.067840+0000","last_became_peered":"2023-10-06T05:26:26.067840+0000","last_unstale":"2023-10-06T05:26:26.071857+0000","last_undegraded":"2023-10-06T05:26:26.071857+0000","last_fullsized":"2023-10-06T05:26:26.071857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:34.167867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074083+0000","last_change":"2023-10-06T05:26:27.074083+0000","last_active":"2023-10-06T05:26:27.074083+0000","last_peered":"2023-10-06T05:26:27.074083+0000","last_clean":"2023-10-06T05:26:27.074083+0000","last_became_active":"2023-10-06T05:26:27.073793+0000","last_became_peered":"2023-10-06T05:26:27.073793+0000","last_unstale":"2023-10-06T05:26:27.074083+0000","last_undegraded":"2023-10-06T05:26:27.074083+0000","last_fullsized":"2023-10-06T05:26:27.074083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:49.285701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.075306+0000","last_change":"2023-10-06T05:26:26.074056+0000","last_active":"2023-10-06T05:26:26.075306+0000","last_peered":"2023-10-06T05:26:26.075306+0000","last_clean":"2023-10-06T05:26:26.075306+0000","last_became_active":"2023-10-06T05:26:26.073764+0000","last_became_peered":"2023-10-06T05:26:26.073764+0000","last_unstale":"2023-10-06T05:26:26.075306+0000","last_undegraded":"2023-10-06T05:26:26.075306+0000","last_fullsized":"2023-10-06T05:26:26.075306+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:16.789123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.072049+0000","last_change":"2023-10-06T05:26:27.072049+0000","last_active":"2023-10-06T05:26:27.072049+0000","last_peered":"2023-10-06T05:26:27.072049+0000","last_clean":"2023-10-06T05:26:27.072049+0000","last_became_active":"2023-10-06T05:26:27.071735+0000","last_became_peered":"2023-10-06T05:26:27.071735+0000","last_unstale":"2023-10-06T05:26:27.072049+0000","last_undegraded":"2023-10-06T05:26:27.072049+0000","last_fullsized":"2023-10-06T05:26:27.072049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:51.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.080056+0000","last_change":"2023-10-06T05:26:26.073636+0000","last_active":"2023-10-06T05:26:26.080056+0000","last_peered":"2023-10-06T05:26:26.080056+0000","last_clean":"2023-10-06T05:26:26.080056+0000","last_became_active":"2023-10-06T05:26:26.072902+0000","last_became_peered":"2023-10-06T05:26:26.072902+0000","last_unstale":"2023-10-06T05:26:26.080056+0000","last_undegraded":"2023-10-06T05:26:26.080056+0000","last_fullsized":"2023-10-06T05:26:26.080056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.881267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074455+0000","last_change":"2023-10-06T05:26:27.074455+0000","last_active":"2023-10-06T05:26:27.074455+0000","last_peered":"2023-10-06T05:26:27.074455+0000","last_clean":"2023-10-06T05:26:27.074455+0000","last_became_active":"2023-10-06T05:26:27.073595+0000","last_became_peered":"2023-10-06T05:26:27.073595+0000","last_unstale":"2023-10-06T05:26:27.074455+0000","last_undegraded":"2023-10-06T05:26:27.074455+0000","last_fullsized":"2023-10-06T05:26:27.074455+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:39.968744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.428474+0000","last_change":"2023-10-06T05:26:26.075467+0000","last_active":"2023-10-06T05:26:27.428474+0000","last_peered":"2023-10-06T05:26:27.428474+0000","last_clean":"2023-10-06T05:26:27.428474+0000","last_became_active":"2023-10-06T05:26:26.075044+0000","last_became_peered":"2023-10-06T05:26:26.075044+0000","last_unstale":"2023-10-06T05:26:27.428474+0000","last_undegraded":"2023-10-06T05:26:27.428474+0000","last_fullsized":"2023-10-06T05:26:27.428474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:16.571702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.080744+0000","last_change":"2023-10-06T05:26:27.080744+0000","last_active":"2023-10-06T05:26:27.080744+0000","last_peered":"2023-10-06T05:26:27.080744+0000","last_clean":"2023-10-06T05:26:27.080744+0000","last_became_active":"2023-10-06T05:26:27.080400+0000","last_became_peered":"2023-10-06T05:26:27.080400+0000","last_unstale":"2023-10-06T05:26:27.080744+0000","last_undegraded":"2023-10-06T05:26:27.080744+0000","last_fullsized":"2023-10-06T05:26:27.080744+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:57.520031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.427565+0000","last_change":"2023-10-06T05:26:26.068931+0000","last_active":"2023-10-06T05:26:27.427565+0000","last_peered":"2023-10-06T05:26:27.427565+0000","last_clean":"2023-10-06T05:26:27.427565+0000","last_became_active":"2023-10-06T05:26:26.068623+0000","last_became_peered":"2023-10-06T05:26:26.068623+0000","last_unstale":"2023-10-06T05:26:27.427565+0000","last_undegraded":"2023-10-06T05:26:27.427565+0000","last_fullsized":"2023-10-06T05:26:27.427565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:16.571702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.083462+0000","last_change":"2023-10-06T05:26:27.083462+0000","last_active":"2023-10-06T05:26:27.083462+0000","last_peered":"2023-10-06T05:26:27.083462+0000","last_clean":"2023-10-06T05:26:27.083462+0000","last_became_active":"2023-10-06T05:26:27.083117+0000","last_became_peered":"2023-10-06T05:26:27.083117+0000","last_unstale":"2023-10-06T05:26:27.083462+0000","last_undegraded":"2023-10-06T05:26:27.083462+0000","last_fullsized":"2023-10-06T05:26:27.083462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:51.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.424393+0000","last_change":"2023-10-06T05:26:26.074660+0000","last_active":"2023-10-06T05:26:27.424393+0000","last_peered":"2023-10-06T05:26:27.424393+0000","last_clean":"2023-10-06T05:26:27.424393+0000","last_became_active":"2023-10-06T05:26:26.074355+0000","last_became_peered":"2023-10-06T05:26:26.074355+0000","last_unstale":"2023-10-06T05:26:27.424393+0000","last_undegraded":"2023-10-06T05:26:27.424393+0000","last_fullsized":"2023-10-06T05:26:27.424393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.881267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076250+0000","last_change":"2023-10-06T05:26:27.076250+0000","last_active":"2023-10-06T05:26:27.076250+0000","last_peered":"2023-10-06T05:26:27.076250+0000","last_clean":"2023-10-06T05:26:27.076250+0000","last_became_active":"2023-10-06T05:26:27.075812+0000","last_became_peered":"2023-10-06T05:26:27.075812+0000","last_unstale":"2023-10-06T05:26:27.076250+0000","last_undegraded":"2023-10-06T05:26:27.076250+0000","last_fullsized":"2023-10-06T05:26:27.076250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:25.145735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.077767+0000","last_change":"2023-10-06T05:26:26.072763+0000","last_active":"2023-10-06T05:26:26.077767+0000","last_peered":"2023-10-06T05:26:26.077767+0000","last_clean":"2023-10-06T05:26:26.077767+0000","last_became_active":"2023-10-06T05:26:26.072433+0000","last_became_peered":"2023-10-06T05:26:26.072433+0000","last_unstale":"2023-10-06T05:26:26.077767+0000","last_undegraded":"2023-10-06T05:26:26.077767+0000","last_fullsized":"2023-10-06T05:26:26.077767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:33.447514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075721+0000","last_change":"2023-10-06T05:26:27.075721+0000","last_active":"2023-10-06T05:26:27.075721+0000","last_peered":"2023-10-06T05:26:27.075721+0000","last_clean":"2023-10-06T05:26:27.075721+0000","last_became_active":"2023-10-06T05:26:27.075389+0000","last_became_peered":"2023-10-06T05:26:27.075389+0000","last_unstale":"2023-10-06T05:26:27.075721+0000","last_undegraded":"2023-10-06T05:26:27.075721+0000","last_fullsized":"2023-10-06T05:26:27.075721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:15.006844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.070173+0000","last_change":"2023-10-06T05:26:26.068967+0000","last_active":"2023-10-06T05:26:26.070173+0000","last_peered":"2023-10-06T05:26:26.070173+0000","last_clean":"2023-10-06T05:26:26.070173+0000","last_became_active":"2023-10-06T05:26:26.068654+0000","last_became_peered":"2023-10-06T05:26:26.068654+0000","last_unstale":"2023-10-06T05:26:26.070173+0000","last_undegraded":"2023-10-06T05:26:26.070173+0000","last_fullsized":"2023-10-06T05:26:26.070173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:42.262006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076423+0000","last_change":"2023-10-06T05:26:27.076423+0000","last_active":"2023-10-06T05:26:27.076423+0000","last_peered":"2023-10-06T05:26:27.076423+0000","last_clean":"2023-10-06T05:26:27.076423+0000","last_became_active":"2023-10-06T05:26:27.076121+0000","last_became_peered":"2023-10-06T05:26:27.076121+0000","last_unstale":"2023-10-06T05:26:27.076423+0000","last_undegraded":"2023-10-06T05:26:27.076423+0000","last_fullsized":"2023-10-06T05:26:27.076423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:08.887562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.430899+0000","last_change":"2023-10-06T05:26:26.068196+0000","last_active":"2023-10-06T05:26:27.430899+0000","last_peered":"2023-10-06T05:26:27.430899+0000","last_clean":"2023-10-06T05:26:27.430899+0000","last_became_active":"2023-10-06T05:26:26.067918+0000","last_became_peered":"2023-10-06T05:26:26.067918+0000","last_unstale":"2023-10-06T05:26:27.430899+0000","last_undegraded":"2023-10-06T05:26:27.430899+0000","last_fullsized":"2023-10-06T05:26:27.430899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:04.621974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.077283+0000","last_change":"2023-10-06T05:26:27.077283+0000","last_active":"2023-10-06T05:26:27.077283+0000","last_peered":"2023-10-06T05:26:27.077283+0000","last_clean":"2023-10-06T05:26:27.077283+0000","last_became_active":"2023-10-06T05:26:27.076552+0000","last_became_peered":"2023-10-06T05:26:27.076552+0000","last_unstale":"2023-10-06T05:26:27.077283+0000","last_undegraded":"2023-10-06T05:26:27.077283+0000","last_fullsized":"2023-10-06T05:26:27.077283+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:44.877585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.070374+0000","last_change":"2023-10-06T05:26:26.067341+0000","last_active":"2023-10-06T05:26:27.070374+0000","last_peered":"2023-10-06T05:26:27.070374+0000","last_clean":"2023-10-06T05:26:27.070374+0000","last_became_active":"2023-10-06T05:26:26.067036+0000","last_became_peered":"2023-10-06T05:26:26.067036+0000","last_unstale":"2023-10-06T05:26:27.070374+0000","last_undegraded":"2023-10-06T05:26:27.070374+0000","last_fullsized":"2023-10-06T05:26:27.070374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:33.447514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076436+0000","last_change":"2023-10-06T05:26:27.076436+0000","last_active":"2023-10-06T05:26:27.076436+0000","last_peered":"2023-10-06T05:26:27.076436+0000","last_clean":"2023-10-06T05:26:27.076436+0000","last_became_active":"2023-10-06T05:26:27.076194+0000","last_became_peered":"2023-10-06T05:26:27.076194+0000","last_unstale":"2023-10-06T05:26:27.076436+0000","last_undegraded":"2023-10-06T05:26:27.076436+0000","last_fullsized":"2023-10-06T05:26:27.076436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:57.520031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.428411+0000","last_change":"2023-10-06T05:26:26.072396+0000","last_active":"2023-10-06T05:26:27.428411+0000","last_peered":"2023-10-06T05:26:27.428411+0000","last_clean":"2023-10-06T05:26:27.428411+0000","last_became_active":"2023-10-06T05:26:26.072105+0000","last_became_peered":"2023-10-06T05:26:26.072105+0000","last_unstale":"2023-10-06T05:26:27.428411+0000","last_undegraded":"2023-10-06T05:26:27.428411+0000","last_fullsized":"2023-10-06T05:26:27.428411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:13.993831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073447+0000","last_change":"2023-10-06T05:26:27.073447+0000","last_active":"2023-10-06T05:26:27.073447+0000","last_peered":"2023-10-06T05:26:27.073447+0000","last_clean":"2023-10-06T05:26:27.073447+0000","last_became_active":"2023-10-06T05:26:27.073190+0000","last_became_peered":"2023-10-06T05:26:27.073190+0000","last_unstale":"2023-10-06T05:26:27.073447+0000","last_undegraded":"2023-10-06T05:26:27.073447+0000","last_fullsized":"2023-10-06T05:26:27.073447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.064165+0000","last_change":"2023-10-06T05:26:26.068934+0000","last_active":"2023-10-06T05:26:27.064165+0000","last_peered":"2023-10-06T05:26:27.064165+0000","last_clean":"2023-10-06T05:26:27.064165+0000","last_became_active":"2023-10-06T05:26:26.068619+0000","last_became_peered":"2023-10-06T05:26:26.068619+0000","last_unstale":"2023-10-06T05:26:27.064165+0000","last_undegraded":"2023-10-06T05:26:27.064165+0000","last_fullsized":"2023-10-06T05:26:27.064165+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:20.606758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.085500+0000","last_change":"2023-10-06T05:26:27.085500+0000","last_active":"2023-10-06T05:26:27.085500+0000","last_peered":"2023-10-06T05:26:27.085500+0000","last_clean":"2023-10-06T05:26:27.085500+0000","last_became_active":"2023-10-06T05:26:27.085234+0000","last_became_peered":"2023-10-06T05:26:27.085234+0000","last_unstale":"2023-10-06T05:26:27.085500+0000","last_undegraded":"2023-10-06T05:26:27.085500+0000","last_fullsized":"2023-10-06T05:26:27.085500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:44.356097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.076982+0000","last_change":"2023-10-06T05:26:26.071158+0000","last_active":"2023-10-06T05:26:26.076982+0000","last_peered":"2023-10-06T05:26:26.076982+0000","last_clean":"2023-10-06T05:26:26.076982+0000","last_became_active":"2023-10-06T05:26:26.070787+0000","last_became_peered":"2023-10-06T05:26:26.070787+0000","last_unstale":"2023-10-06T05:26:26.076982+0000","last_undegraded":"2023-10-06T05:26:26.076982+0000","last_fullsized":"2023-10-06T05:26:26.076982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:55.207489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.079517+0000","last_change":"2023-10-06T05:26:27.079517+0000","last_active":"2023-10-06T05:26:27.079517+0000","last_peered":"2023-10-06T05:26:27.079517+0000","last_clean":"2023-10-06T05:26:27.079517+0000","last_became_active":"2023-10-06T05:26:27.079170+0000","last_became_peered":"2023-10-06T05:26:27.079170+0000","last_unstale":"2023-10-06T05:26:27.079517+0000","last_undegraded":"2023-10-06T05:26:27.079517+0000","last_fullsized":"2023-10-06T05:26:27.079517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:35.542864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.426114+0000","last_change":"2023-10-06T05:26:26.074248+0000","last_active":"2023-10-06T05:26:27.426114+0000","last_peered":"2023-10-06T05:26:27.426114+0000","last_clean":"2023-10-06T05:26:27.426114+0000","last_became_active":"2023-10-06T05:26:26.073958+0000","last_became_peered":"2023-10-06T05:26:26.073958+0000","last_unstale":"2023-10-06T05:26:27.426114+0000","last_undegraded":"2023-10-06T05:26:27.426114+0000","last_fullsized":"2023-10-06T05:26:27.426114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:45.557588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074096+0000","last_change":"2023-10-06T05:26:27.074096+0000","last_active":"2023-10-06T05:26:27.074096+0000","last_peered":"2023-10-06T05:26:27.074096+0000","last_clean":"2023-10-06T05:26:27.074096+0000","last_became_active":"2023-10-06T05:26:27.073795+0000","last_became_peered":"2023-10-06T05:26:27.073795+0000","last_unstale":"2023-10-06T05:26:27.074096+0000","last_undegraded":"2023-10-06T05:26:27.074096+0000","last_fullsized":"2023-10-06T05:26:27.074096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:17.802137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.075249+0000","last_change":"2023-10-06T05:26:26.073060+0000","last_active":"2023-10-06T05:26:26.075249+0000","last_peered":"2023-10-06T05:26:26.075249+0000","last_clean":"2023-10-06T05:26:26.075249+0000","last_became_active":"2023-10-06T05:26:26.072768+0000","last_became_peered":"2023-10-06T05:26:26.072768+0000","last_unstale":"2023-10-06T05:26:26.075249+0000","last_undegraded":"2023-10-06T05:26:26.075249+0000","last_fullsized":"2023-10-06T05:26:26.075249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:36.687338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073599+0000","last_change":"2023-10-06T05:26:27.073599+0000","last_active":"2023-10-06T05:26:27.073599+0000","last_peered":"2023-10-06T05:26:27.073599+0000","last_clean":"2023-10-06T05:26:27.073599+0000","last_became_active":"2023-10-06T05:26:27.073119+0000","last_became_peered":"2023-10-06T05:26:27.073119+0000","last_unstale":"2023-10-06T05:26:27.073599+0000","last_undegraded":"2023-10-06T05:26:27.073599+0000","last_fullsized":"2023-10-06T05:26:27.073599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:15.006844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.067229+0000","last_change":"2023-10-06T05:26:26.061050+0000","last_active":"2023-10-06T05:26:26.067229+0000","last_peered":"2023-10-06T05:26:26.067229+0000","last_clean":"2023-10-06T05:26:26.067229+0000","last_became_active":"2023-10-06T05:26:26.060751+0000","last_became_peered":"2023-10-06T05:26:26.060751+0000","last_unstale":"2023-10-06T05:26:26.067229+0000","last_undegraded":"2023-10-06T05:26:26.067229+0000","last_fullsized":"2023-10-06T05:26:26.067229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:49.162098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.080852+0000","last_change":"2023-10-06T05:26:27.080852+0000","last_active":"2023-10-06T05:26:27.080852+0000","last_peered":"2023-10-06T05:26:27.080852+0000","last_clean":"2023-10-06T05:26:27.080852+0000","last_became_active":"2023-10-06T05:26:27.080490+0000","last_became_peered":"2023-10-06T05:26:27.080490+0000","last_unstale":"2023-10-06T05:26:27.080852+0000","last_undegraded":"2023-10-06T05:26:27.080852+0000","last_fullsized":"2023-10-06T05:26:27.080852+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:50.566027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.076187+0000","last_change":"2023-10-06T05:26:26.074238+0000","last_active":"2023-10-06T05:26:26.076187+0000","last_peered":"2023-10-06T05:26:26.076187+0000","last_clean":"2023-10-06T05:26:26.076187+0000","last_became_active":"2023-10-06T05:26:26.073942+0000","last_became_peered":"2023-10-06T05:26:26.073942+0000","last_unstale":"2023-10-06T05:26:26.076187+0000","last_undegraded":"2023-10-06T05:26:26.076187+0000","last_fullsized":"2023-10-06T05:26:26.076187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:53.403588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.086347+0000","last_change":"2023-10-06T05:26:27.086347+0000","last_active":"2023-10-06T05:26:27.086347+0000","last_peered":"2023-10-06T05:26:27.086347+0000","last_clean":"2023-10-06T05:26:27.086347+0000","last_became_active":"2023-10-06T05:26:27.086020+0000","last_became_peered":"2023-10-06T05:26:27.086020+0000","last_unstale":"2023-10-06T05:26:27.086347+0000","last_undegraded":"2023-10-06T05:26:27.086347+0000","last_fullsized":"2023-10-06T05:26:27.086347+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:57.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.074771+0000","last_change":"2023-10-06T05:26:26.072080+0000","last_active":"2023-10-06T05:26:26.074771+0000","last_peered":"2023-10-06T05:26:26.074771+0000","last_clean":"2023-10-06T05:26:26.074771+0000","last_became_active":"2023-10-06T05:26:26.071719+0000","last_became_peered":"2023-10-06T05:26:26.071719+0000","last_unstale":"2023-10-06T05:26:26.074771+0000","last_undegraded":"2023-10-06T05:26:26.074771+0000","last_fullsized":"2023-10-06T05:26:26.074771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:09.196805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.051969+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:26:26.051969+0000","last_peered":"2023-10-06T05:26:26.051969+0000","last_clean":"2023-10-06T05:26:26.051969+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:26:26.051969+0000","last_undegraded":"2023-10-06T05:26:26.051969+0000","last_fullsized":"2023-10-06T05:26:26.051969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.065357+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:26:26.065357+0000","last_peered":"2023-10-06T05:26:26.065357+0000","last_clean":"2023-10-06T05:26:26.065357+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:26:26.065357+0000","last_undegraded":"2023-10-06T05:26:26.065357+0000","last_fullsized":"2023-10-06T05:26:26.065357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.083296+0000","last_change":"2023-10-06T05:26:27.083296+0000","last_active":"2023-10-06T05:26:27.083296+0000","last_peered":"2023-10-06T05:26:27.083296+0000","last_clean":"2023-10-06T05:26:27.083296+0000","last_became_active":"2023-10-06T05:26:27.082957+0000","last_became_peered":"2023-10-06T05:26:27.082957+0000","last_unstale":"2023-10-06T05:26:27.083296+0000","last_undegraded":"2023-10-06T05:26:27.083296+0000","last_fullsized":"2023-10-06T05:26:27.083296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:20.016532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.428200+0000","last_change":"2023-10-06T05:26:26.074753+0000","last_active":"2023-10-06T05:26:27.428200+0000","last_peered":"2023-10-06T05:26:27.428200+0000","last_clean":"2023-10-06T05:26:27.428200+0000","last_became_active":"2023-10-06T05:26:26.074420+0000","last_became_peered":"2023-10-06T05:26:26.074420+0000","last_unstale":"2023-10-06T05:26:27.428200+0000","last_undegraded":"2023-10-06T05:26:27.428200+0000","last_fullsized":"2023-10-06T05:26:27.428200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:41.640711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.051740+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:26:26.051740+0000","last_peered":"2023-10-06T05:26:26.051740+0000","last_clean":"2023-10-06T05:26:26.051740+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:26:26.051740+0000","last_undegraded":"2023-10-06T05:26:26.051740+0000","last_fullsized":"2023-10-06T05:26:26.051740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.072035+0000","last_change":"2023-10-06T05:26:27.072035+0000","last_active":"2023-10-06T05:26:27.072035+0000","last_peered":"2023-10-06T05:26:27.072035+0000","last_clean":"2023-10-06T05:26:27.072035+0000","last_became_active":"2023-10-06T05:26:27.071329+0000","last_became_peered":"2023-10-06T05:26:27.071329+0000","last_unstale":"2023-10-06T05:26:27.072035+0000","last_undegraded":"2023-10-06T05:26:27.072035+0000","last_fullsized":"2023-10-06T05:26:27.072035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:08.417592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.073234+0000","last_change":"2023-10-06T05:26:26.071516+0000","last_active":"2023-10-06T05:26:26.073234+0000","last_peered":"2023-10-06T05:26:26.073234+0000","last_clean":"2023-10-06T05:26:26.073234+0000","last_became_active":"2023-10-06T05:26:26.071207+0000","last_became_peered":"2023-10-06T05:26:26.071207+0000","last_unstale":"2023-10-06T05:26:26.073234+0000","last_undegraded":"2023-10-06T05:26:26.073234+0000","last_fullsized":"2023-10-06T05:26:26.073234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.682610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.065049+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:26:26.065049+0000","last_peered":"2023-10-06T05:26:26.065049+0000","last_clean":"2023-10-06T05:26:26.065049+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:26:26.065049+0000","last_undegraded":"2023-10-06T05:26:26.065049+0000","last_fullsized":"2023-10-06T05:26:26.065049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.078239+0000","last_change":"2023-10-06T05:26:27.078239+0000","last_active":"2023-10-06T05:26:27.078239+0000","last_peered":"2023-10-06T05:26:27.078239+0000","last_clean":"2023-10-06T05:26:27.078239+0000","last_became_active":"2023-10-06T05:26:27.077963+0000","last_became_peered":"2023-10-06T05:26:27.077963+0000","last_unstale":"2023-10-06T05:26:27.078239+0000","last_undegraded":"2023-10-06T05:26:27.078239+0000","last_fullsized":"2023-10-06T05:26:27.078239+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.077426+0000","last_change":"2023-10-06T05:26:26.074226+0000","last_active":"2023-10-06T05:26:26.077426+0000","last_peered":"2023-10-06T05:26:26.077426+0000","last_clean":"2023-10-06T05:26:26.077426+0000","last_became_active":"2023-10-06T05:26:26.073937+0000","last_became_peered":"2023-10-06T05:26:26.073937+0000","last_unstale":"2023-10-06T05:26:26.077426+0000","last_undegraded":"2023-10-06T05:26:26.077426+0000","last_fullsized":"2023-10-06T05:26:26.077426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:25.436355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.065932+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:26:26.065932+0000","last_peered":"2023-10-06T05:26:26.065932+0000","last_clean":"2023-10-06T05:26:26.065932+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:26:26.065932+0000","last_undegraded":"2023-10-06T05:26:26.065932+0000","last_fullsized":"2023-10-06T05:26:26.065932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.086057+0000","last_change":"2023-10-06T05:26:27.086057+0000","last_active":"2023-10-06T05:26:27.086057+0000","last_peered":"2023-10-06T05:26:27.086057+0000","last_clean":"2023-10-06T05:26:27.086057+0000","last_became_active":"2023-10-06T05:26:27.085685+0000","last_became_peered":"2023-10-06T05:26:27.085685+0000","last_unstale":"2023-10-06T05:26:27.086057+0000","last_undegraded":"2023-10-06T05:26:27.086057+0000","last_fullsized":"2023-10-06T05:26:27.086057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:35.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.072585+0000","last_change":"2023-10-06T05:26:26.068954+0000","last_active":"2023-10-06T05:26:26.072585+0000","last_peered":"2023-10-06T05:26:26.072585+0000","last_clean":"2023-10-06T05:26:26.072585+0000","last_became_active":"2023-10-06T05:26:26.068629+0000","last_became_peered":"2023-10-06T05:26:26.068629+0000","last_unstale":"2023-10-06T05:26:26.072585+0000","last_undegraded":"2023-10-06T05:26:26.072585+0000","last_fullsized":"2023-10-06T05:26:26.072585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:48.272688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.066823+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:26:26.066823+0000","last_peered":"2023-10-06T05:26:26.066823+0000","last_clean":"2023-10-06T05:26:26.066823+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:26:26.066823+0000","last_undegraded":"2023-10-06T05:26:26.066823+0000","last_fullsized":"2023-10-06T05:26:26.066823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.070620+0000","last_change":"2023-10-06T05:26:27.070620+0000","last_active":"2023-10-06T05:26:27.070620+0000","last_peered":"2023-10-06T05:26:27.070620+0000","last_clean":"2023-10-06T05:26:27.070620+0000","last_became_active":"2023-10-06T05:26:27.070325+0000","last_became_peered":"2023-10-06T05:26:27.070325+0000","last_unstale":"2023-10-06T05:26:27.070620+0000","last_undegraded":"2023-10-06T05:26:27.070620+0000","last_fullsized":"2023-10-06T05:26:27.070620+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:15.006844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.074577+0000","last_change":"2023-10-06T05:26:26.073339+0000","last_active":"2023-10-06T05:26:26.074577+0000","last_peered":"2023-10-06T05:26:26.074577+0000","last_clean":"2023-10-06T05:26:26.074577+0000","last_became_active":"2023-10-06T05:26:26.073046+0000","last_became_peered":"2023-10-06T05:26:26.073046+0000","last_unstale":"2023-10-06T05:26:26.074577+0000","last_undegraded":"2023-10-06T05:26:26.074577+0000","last_fullsized":"2023-10-06T05:26:26.074577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:05.289719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.052362+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:26:26.052362+0000","last_peered":"2023-10-06T05:26:26.052362+0000","last_clean":"2023-10-06T05:26:26.052362+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:26:26.052362+0000","last_undegraded":"2023-10-06T05:26:26.052362+0000","last_fullsized":"2023-10-06T05:26:26.052362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.085874+0000","last_change":"2023-10-06T05:26:27.085874+0000","last_active":"2023-10-06T05:26:27.085874+0000","last_peered":"2023-10-06T05:26:27.085874+0000","last_clean":"2023-10-06T05:26:27.085874+0000","last_became_active":"2023-10-06T05:26:27.085552+0000","last_became_peered":"2023-10-06T05:26:27.085552+0000","last_unstale":"2023-10-06T05:26:27.085874+0000","last_undegraded":"2023-10-06T05:26:27.085874+0000","last_fullsized":"2023-10-06T05:26:27.085874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:57.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.079902+0000","last_change":"2023-10-06T05:26:26.071981+0000","last_active":"2023-10-06T05:26:26.079902+0000","last_peered":"2023-10-06T05:26:26.079902+0000","last_clean":"2023-10-06T05:26:26.079902+0000","last_became_active":"2023-10-06T05:26:26.071599+0000","last_became_peered":"2023-10-06T05:26:26.071599+0000","last_unstale":"2023-10-06T05:26:26.079902+0000","last_undegraded":"2023-10-06T05:26:26.079902+0000","last_fullsized":"2023-10-06T05:26:26.079902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:50.621519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.067538+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:26:26.067538+0000","last_peered":"2023-10-06T05:26:26.067538+0000","last_clean":"2023-10-06T05:26:26.067538+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:26:26.067538+0000","last_undegraded":"2023-10-06T05:26:26.067538+0000","last_fullsized":"2023-10-06T05:26:26.067538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.069986+0000","last_change":"2023-10-06T05:26:27.069986+0000","last_active":"2023-10-06T05:26:27.069986+0000","last_peered":"2023-10-06T05:26:27.069986+0000","last_clean":"2023-10-06T05:26:27.069986+0000","last_became_active":"2023-10-06T05:26:27.069715+0000","last_became_peered":"2023-10-06T05:26:27.069715+0000","last_unstale":"2023-10-06T05:26:27.069986+0000","last_undegraded":"2023-10-06T05:26:27.069986+0000","last_fullsized":"2023-10-06T05:26:27.069986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:34.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.075280+0000","last_change":"2023-10-06T05:26:26.074106+0000","last_active":"2023-10-06T05:26:26.075280+0000","last_peered":"2023-10-06T05:26:26.075280+0000","last_clean":"2023-10-06T05:26:26.075280+0000","last_became_active":"2023-10-06T05:26:26.073812+0000","last_became_peered":"2023-10-06T05:26:26.073812+0000","last_unstale":"2023-10-06T05:26:26.075280+0000","last_undegraded":"2023-10-06T05:26:26.075280+0000","last_fullsized":"2023-10-06T05:26:26.075280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:38.955730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.057560+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:26:26.057560+0000","last_peered":"2023-10-06T05:26:26.057560+0000","last_clean":"2023-10-06T05:26:26.057560+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:26:26.057560+0000","last_undegraded":"2023-10-06T05:26:26.057560+0000","last_fullsized":"2023-10-06T05:26:26.057560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":750312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":160498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":160056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297664,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074176,"statfs":{"total":96636764160,"available":96331956224,"internally_reserved":0,"allocated":385024,"data_stored":152828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":161514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301760,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070080,"statfs":{"total":96636764160,"available":96327761920,"internally_reserved":0,"allocated":385024,"data_stored":152828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.94199999999999995}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.88600000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.272},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.333}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301760,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070080,"statfs":{"total":96636764160,"available":96327761920,"internally_reserved":0,"allocated":385024,"data_stored":152828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302352,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069488,"statfs":{"total":96636764160,"available":96327155712,"internally_reserved":0,"allocated":991232,"data_stored":750312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:26:30.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:26:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd2555c5700 1 Processor -- start 2023-10-06T05:26:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd2555c5700 1 -- start start 2023-10-06T05:26:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd2555c5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2500c6540 0x7fd2500c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd2555c5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500ca1f0 0x7fd2500c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd2555c5700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2500c2980 con 0x7fd2501605e0 2023-10-06T05:26:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd2555c5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500c69c0 con 0x7fd2500c6540 2023-10-06T05:26:30.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd2555c5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500ca630 con 0x7fd2500ca1f0 2023-10-06T05:26:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd254dc4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500ca1f0 0x7fd2500c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd254dc4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500ca1f0 0x7fd2500c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:33734/0 (socket says 172.21.15.29:33734) 2023-10-06T05:26:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd24f7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2500c6540 0x7fd2500c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.540+0000 7fd254dc4700 1 -- 172.21.15.29:0/2349877691 learned_addr learned my addr 172.21.15.29:0/2349877691 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd254dc4700 1 -- 172.21.15.29:0/2349877691 >> v2:172.21.15.173:3300/0 conn(0x7fd2500c6540 msgr2=0x7fd2500c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd254dc4700 1 --2- 172.21.15.29:0/2349877691 >> v2:172.21.15.173:3300/0 conn(0x7fd2500c6540 0x7fd2500c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd254dc4700 1 -- 172.21.15.29:0/2349877691 >> v1:172.21.15.173:6789/0 conn(0x7fd2501605e0 legacy=0x7fd25006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd254dc4700 1 -- 172.21.15.29:0/2349877691 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500c6bb0 con 0x7fd2500ca1f0 2023-10-06T05:26:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd24f7fe700 1 --2- 172.21.15.29:0/2349877691 >> v2:172.21.15.173:3300/0 conn(0x7fd2500c6540 0x7fd2500c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:30.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd254dc4700 1 --2- 172.21.15.29:0/2349877691 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500ca1f0 0x7fd2500c7c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2400099b0 tx=0x7fd240009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa10584805e91872 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd24effd700 1 -- 172.21.15.29:0/2349877691 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240009ea0 con 0x7fd2500ca1f0 2023-10-06T05:26:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd24effd700 1 -- 172.21.15.29:0/2349877691 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24000b860 con 0x7fd2500ca1f0 2023-10-06T05:26:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd24effd700 1 -- 172.21.15.29:0/2349877691 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24000bc00 con 0x7fd2500ca1f0 2023-10-06T05:26:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd2555c5700 1 -- 172.21.15.29:0/2349877691 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500ca1f0 msgr2=0x7fd2500c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd2555c5700 1 --2- 172.21.15.29:0/2349877691 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500ca1f0 0x7fd2500c7c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2400099b0 tx=0x7fd240009250 comp rx=0 tx=0).stop 2023-10-06T05:26:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd2555c5700 1 -- 172.21.15.29:0/2349877691 shutdown_connections 2023-10-06T05:26:30.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd2555c5700 1 --2- 172.21.15.29:0/2349877691 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500ca1f0 0x7fd2500c7c50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd2555c5700 1 --2- 172.21.15.29:0/2349877691 >> v2:172.21.15.173:3300/0 conn(0x7fd2500c6540 0x7fd2500c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd2555c5700 1 -- 172.21.15.29:0/2349877691 >> 172.21.15.29:0/2349877691 conn(0x7fd2500670a0 msgr2=0x7fd2500674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd2555c5700 1 -- 172.21.15.29:0/2349877691 shutdown_connections 2023-10-06T05:26:30.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.544+0000 7fd2555c5700 1 -- 172.21.15.29:0/2349877691 wait complete. 2023-10-06T05:26:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd2555c5700 1 Processor -- start 2023-10-06T05:26:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd2555c5700 1 -- start start 2023-10-06T05:26:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd2555c5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500c6540 0x7fd2500c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd2555c5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2500ca1f0 0x7fd2500b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd2555c5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2501605e0 0x7fd2500c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd2555c5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500b1360 con 0x7fd2501605e0 2023-10-06T05:26:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd2555c5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25016d250 con 0x7fd2500ca1f0 2023-10-06T05:26:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd2555c5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25016d4d0 con 0x7fd2500c6540 2023-10-06T05:26:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd254dc4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2501605e0 0x7fd2500c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd254dc4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2501605e0 0x7fd2500c17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34482/0 (socket says 172.21.15.29:34482) 2023-10-06T05:26:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd254dc4700 1 -- 172.21.15.29:0/2645304082 learned_addr learned my addr 172.21.15.29:0/2645304082 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd24ffff700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500c6540 0x7fd2500c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.548+0000 7fd24f7fe700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2500ca1f0 0x7fd2500b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd254dc4700 1 -- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500c6540 msgr2=0x7fd2500c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd254dc4700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500c6540 0x7fd2500c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd254dc4700 1 -- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2500ca1f0 msgr2=0x7fd2500b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd254dc4700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2500ca1f0 0x7fd2500b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd254dc4700 1 -- 172.21.15.29:0/2645304082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244009420 con 0x7fd2501605e0 2023-10-06T05:26:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd254dc4700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2501605e0 0x7fd2500c17b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2500ca770 tx=0x7fd240017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:30.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd237fff700 1 -- 172.21.15.29:0/2645304082 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24000baa0 con 0x7fd2501605e0 2023-10-06T05:26:30.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd237fff700 1 -- 172.21.15.29:0/2645304082 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240025420 con 0x7fd2501605e0 2023-10-06T05:26:30.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd237fff700 1 -- 172.21.15.29:0/2645304082 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24000bc00 con 0x7fd2501605e0 2023-10-06T05:26:30.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2400094f0 con 0x7fd2501605e0 2023-10-06T05:26:30.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2500b0da0 con 0x7fd2501605e0 2023-10-06T05:26:30.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd237fff700 1 -- 172.21.15.29:0/2645304082 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd240023070 con 0x7fd2501605e0 2023-10-06T05:26:30.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25004be00 con 0x7fd2501605e0 2023-10-06T05:26:30.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd237fff700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd23c060550 0x7fd23c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd237fff700 1 -- 172.21.15.29:0/2645304082 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd24007df50 con 0x7fd2501605e0 2023-10-06T05:26:30.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.552+0000 7fd24ffff700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd23c060550 0x7fd23c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.556+0000 7fd24ffff700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd23c060550 0x7fd23c062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd248007fd0 tx=0x7fd248001650 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:30.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.560+0000 7fd237fff700 1 -- 172.21.15.29:0/2645304082 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd24004e3e0 con 0x7fd2501605e0 2023-10-06T05:26:30.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.720+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2500c6e90 con 0x7fd23c060550 2023-10-06T05:26:30.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.736+0000 7fd237fff700 1 -- 172.21.15.29:0/2645304082 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289512 (secure 0 0 0) 0x7fd2500c6e90 con 0x7fd23c060550 2023-10-06T05:26:30.747 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:30.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd23c060550 msgr2=0x7fd23c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd23c060550 0x7fd23c062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd248007fd0 tx=0x7fd248001650 comp rx=0 tx=0).stop 2023-10-06T05:26:30.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2501605e0 msgr2=0x7fd2500c17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2501605e0 0x7fd2500c17b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2500ca770 tx=0x7fd240017000 comp rx=0 tx=0).stop 2023-10-06T05:26:30.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 shutdown_connections 2023-10-06T05:26:30.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2501605e0 0x7fd2500c17b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd23c060550 0x7fd23c062a00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2500ca1f0 0x7fd2500b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 --2- 172.21.15.29:0/2645304082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd2500c6540 0x7fd2500c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 >> 172.21.15.29:0/2645304082 conn(0x7fd2500670a0 msgr2=0x7fd2500c7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:30.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 shutdown_connections 2023-10-06T05:26:30.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.740+0000 7fd2555c5700 1 -- 172.21.15.29:0/2645304082 wait complete. 2023-10-06T05:26:30.753 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:26:30.762 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-06T05:26:30.666390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398944,"kb_used_data":4256,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575776,"statfs":{"total":773094113280,"available":770637594624,"internally_reserved":0,"allocated":4358144,"data_stored":2441176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.629248"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.078368+0000","last_change":"2023-10-06T05:26:27.078368+0000","last_active":"2023-10-06T05:26:27.078368+0000","last_peered":"2023-10-06T05:26:27.078368+0000","last_clean":"2023-10-06T05:26:27.078368+0000","last_became_active":"2023-10-06T05:26:27.078021+0000","last_became_peered":"2023-10-06T05:26:27.078021+0000","last_unstale":"2023-10-06T05:26:27.078368+0000","last_undegraded":"2023-10-06T05:26:27.078368+0000","last_fullsized":"2023-10-06T05:26:27.078368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:57.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.084277+0000","last_change":"2023-10-06T05:26:27.084277+0000","last_active":"2023-10-06T05:26:27.084277+0000","last_peered":"2023-10-06T05:26:27.084277+0000","last_clean":"2023-10-06T05:26:27.084277+0000","last_became_active":"2023-10-06T05:26:27.083866+0000","last_became_peered":"2023-10-06T05:26:27.083866+0000","last_unstale":"2023-10-06T05:26:27.084277+0000","last_undegraded":"2023-10-06T05:26:27.084277+0000","last_fullsized":"2023-10-06T05:26:27.084277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:33.461500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.082663+0000","last_change":"2023-10-06T05:26:27.082663+0000","last_active":"2023-10-06T05:26:27.082663+0000","last_peered":"2023-10-06T05:26:27.082663+0000","last_clean":"2023-10-06T05:26:27.082663+0000","last_became_active":"2023-10-06T05:26:27.082325+0000","last_became_peered":"2023-10-06T05:26:27.082325+0000","last_unstale":"2023-10-06T05:26:27.082663+0000","last_undegraded":"2023-10-06T05:26:27.082663+0000","last_fullsized":"2023-10-06T05:26:27.082663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:51.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076446+0000","last_change":"2023-10-06T05:26:27.076446+0000","last_active":"2023-10-06T05:26:27.076446+0000","last_peered":"2023-10-06T05:26:27.076446+0000","last_clean":"2023-10-06T05:26:27.076446+0000","last_became_active":"2023-10-06T05:26:27.076080+0000","last_became_peered":"2023-10-06T05:26:27.076080+0000","last_unstale":"2023-10-06T05:26:27.076446+0000","last_undegraded":"2023-10-06T05:26:27.076446+0000","last_fullsized":"2023-10-06T05:26:27.076446+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:26.449369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073150+0000","last_change":"2023-10-06T05:26:27.073150+0000","last_active":"2023-10-06T05:26:27.073150+0000","last_peered":"2023-10-06T05:26:27.073150+0000","last_clean":"2023-10-06T05:26:27.073150+0000","last_became_active":"2023-10-06T05:26:27.072677+0000","last_became_peered":"2023-10-06T05:26:27.072677+0000","last_unstale":"2023-10-06T05:26:27.073150+0000","last_undegraded":"2023-10-06T05:26:27.073150+0000","last_fullsized":"2023-10-06T05:26:27.073150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:10.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075426+0000","last_change":"2023-10-06T05:26:27.075426+0000","last_active":"2023-10-06T05:26:27.075426+0000","last_peered":"2023-10-06T05:26:27.075426+0000","last_clean":"2023-10-06T05:26:27.075426+0000","last_became_active":"2023-10-06T05:26:27.075045+0000","last_became_peered":"2023-10-06T05:26:27.075045+0000","last_unstale":"2023-10-06T05:26:27.075426+0000","last_undegraded":"2023-10-06T05:26:27.075426+0000","last_fullsized":"2023-10-06T05:26:27.075426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:35.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.085725+0000","last_change":"2023-10-06T05:26:27.085725+0000","last_active":"2023-10-06T05:26:27.085725+0000","last_peered":"2023-10-06T05:26:27.085725+0000","last_clean":"2023-10-06T05:26:27.085725+0000","last_became_active":"2023-10-06T05:26:27.085348+0000","last_became_peered":"2023-10-06T05:26:27.085348+0000","last_unstale":"2023-10-06T05:26:27.085725+0000","last_undegraded":"2023-10-06T05:26:27.085725+0000","last_fullsized":"2023-10-06T05:26:27.085725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:50.566027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074643+0000","last_change":"2023-10-06T05:26:27.074643+0000","last_active":"2023-10-06T05:26:27.074643+0000","last_peered":"2023-10-06T05:26:27.074643+0000","last_clean":"2023-10-06T05:26:27.074643+0000","last_became_active":"2023-10-06T05:26:27.074116+0000","last_became_peered":"2023-10-06T05:26:27.074116+0000","last_unstale":"2023-10-06T05:26:27.074643+0000","last_undegraded":"2023-10-06T05:26:27.074643+0000","last_fullsized":"2023-10-06T05:26:27.074643+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:22.276067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.082648+0000","last_change":"2023-10-06T05:26:27.082648+0000","last_active":"2023-10-06T05:26:27.082648+0000","last_peered":"2023-10-06T05:26:27.082648+0000","last_clean":"2023-10-06T05:26:27.082648+0000","last_became_active":"2023-10-06T05:26:27.082270+0000","last_became_peered":"2023-10-06T05:26:27.082270+0000","last_unstale":"2023-10-06T05:26:27.082648+0000","last_undegraded":"2023-10-06T05:26:27.082648+0000","last_fullsized":"2023-10-06T05:26:27.082648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:55.440636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074246+0000","last_change":"2023-10-06T05:26:27.074246+0000","last_active":"2023-10-06T05:26:27.074246+0000","last_peered":"2023-10-06T05:26:27.074246+0000","last_clean":"2023-10-06T05:26:27.074246+0000","last_became_active":"2023-10-06T05:26:27.073936+0000","last_became_peered":"2023-10-06T05:26:27.073936+0000","last_unstale":"2023-10-06T05:26:27.074246+0000","last_undegraded":"2023-10-06T05:26:27.074246+0000","last_fullsized":"2023-10-06T05:26:27.074246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:44.877585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073631+0000","last_change":"2023-10-06T05:26:27.073631+0000","last_active":"2023-10-06T05:26:27.073631+0000","last_peered":"2023-10-06T05:26:27.073631+0000","last_clean":"2023-10-06T05:26:27.073631+0000","last_became_active":"2023-10-06T05:26:27.073373+0000","last_became_peered":"2023-10-06T05:26:27.073373+0000","last_unstale":"2023-10-06T05:26:27.073631+0000","last_undegraded":"2023-10-06T05:26:27.073631+0000","last_fullsized":"2023-10-06T05:26:27.073631+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:27.314928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076732+0000","last_change":"2023-10-06T05:26:27.076732+0000","last_active":"2023-10-06T05:26:27.076732+0000","last_peered":"2023-10-06T05:26:27.076732+0000","last_clean":"2023-10-06T05:26:27.076732+0000","last_became_active":"2023-10-06T05:26:27.076405+0000","last_became_peered":"2023-10-06T05:26:27.076405+0000","last_unstale":"2023-10-06T05:26:27.076732+0000","last_undegraded":"2023-10-06T05:26:27.076732+0000","last_fullsized":"2023-10-06T05:26:27.076732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:15.006844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073334+0000","last_change":"2023-10-06T05:26:27.073334+0000","last_active":"2023-10-06T05:26:27.073334+0000","last_peered":"2023-10-06T05:26:27.073334+0000","last_clean":"2023-10-06T05:26:27.073334+0000","last_became_active":"2023-10-06T05:26:27.073048+0000","last_became_peered":"2023-10-06T05:26:27.073048+0000","last_unstale":"2023-10-06T05:26:27.073334+0000","last_undegraded":"2023-10-06T05:26:27.073334+0000","last_fullsized":"2023-10-06T05:26:27.073334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:17.504859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.071431+0000","last_change":"2023-10-06T05:26:27.071431+0000","last_active":"2023-10-06T05:26:27.071431+0000","last_peered":"2023-10-06T05:26:27.071431+0000","last_clean":"2023-10-06T05:26:27.071431+0000","last_became_active":"2023-10-06T05:26:27.071105+0000","last_became_peered":"2023-10-06T05:26:27.071105+0000","last_unstale":"2023-10-06T05:26:27.071431+0000","last_undegraded":"2023-10-06T05:26:27.071431+0000","last_fullsized":"2023-10-06T05:26:27.071431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:08.887562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.082886+0000","last_change":"2023-10-06T05:26:27.082886+0000","last_active":"2023-10-06T05:26:27.082886+0000","last_peered":"2023-10-06T05:26:27.082886+0000","last_clean":"2023-10-06T05:26:27.082886+0000","last_became_active":"2023-10-06T05:26:27.082566+0000","last_became_peered":"2023-10-06T05:26:27.082566+0000","last_unstale":"2023-10-06T05:26:27.082886+0000","last_undegraded":"2023-10-06T05:26:27.082886+0000","last_fullsized":"2023-10-06T05:26:27.082886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:25.145735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073755+0000","last_change":"2023-10-06T05:26:27.073755+0000","last_active":"2023-10-06T05:26:27.073755+0000","last_peered":"2023-10-06T05:26:27.073755+0000","last_clean":"2023-10-06T05:26:27.073755+0000","last_became_active":"2023-10-06T05:26:27.073428+0000","last_became_peered":"2023-10-06T05:26:27.073428+0000","last_unstale":"2023-10-06T05:26:27.073755+0000","last_undegraded":"2023-10-06T05:26:27.073755+0000","last_fullsized":"2023-10-06T05:26:27.073755+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:35.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074371+0000","last_change":"2023-10-06T05:26:27.074371+0000","last_active":"2023-10-06T05:26:27.074371+0000","last_peered":"2023-10-06T05:26:27.074371+0000","last_clean":"2023-10-06T05:26:27.074371+0000","last_became_active":"2023-10-06T05:26:27.074083+0000","last_became_peered":"2023-10-06T05:26:27.074083+0000","last_unstale":"2023-10-06T05:26:27.074371+0000","last_undegraded":"2023-10-06T05:26:27.074371+0000","last_fullsized":"2023-10-06T05:26:27.074371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:55.440636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075233+0000","last_change":"2023-10-06T05:26:27.075233+0000","last_active":"2023-10-06T05:26:27.075233+0000","last_peered":"2023-10-06T05:26:27.075233+0000","last_clean":"2023-10-06T05:26:27.075233+0000","last_became_active":"2023-10-06T05:26:27.074965+0000","last_became_peered":"2023-10-06T05:26:27.074965+0000","last_unstale":"2023-10-06T05:26:27.075233+0000","last_undegraded":"2023-10-06T05:26:27.075233+0000","last_fullsized":"2023-10-06T05:26:27.075233+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:48.973602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076390+0000","last_change":"2023-10-06T05:26:27.076390+0000","last_active":"2023-10-06T05:26:27.076390+0000","last_peered":"2023-10-06T05:26:27.076390+0000","last_clean":"2023-10-06T05:26:27.076390+0000","last_became_active":"2023-10-06T05:26:27.074056+0000","last_became_peered":"2023-10-06T05:26:27.074056+0000","last_unstale":"2023-10-06T05:26:27.076390+0000","last_undegraded":"2023-10-06T05:26:27.076390+0000","last_fullsized":"2023-10-06T05:26:27.076390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:14.849149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074363+0000","last_change":"2023-10-06T05:26:27.074363+0000","last_active":"2023-10-06T05:26:27.074363+0000","last_peered":"2023-10-06T05:26:27.074363+0000","last_clean":"2023-10-06T05:26:27.074363+0000","last_became_active":"2023-10-06T05:26:27.074075+0000","last_became_peered":"2023-10-06T05:26:27.074075+0000","last_unstale":"2023-10-06T05:26:27.074363+0000","last_undegraded":"2023-10-06T05:26:27.074363+0000","last_fullsized":"2023-10-06T05:26:27.074363+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:56.220503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.077029+0000","last_change":"2023-10-06T05:26:27.077029+0000","last_active":"2023-10-06T05:26:27.077029+0000","last_peered":"2023-10-06T05:26:27.077029+0000","last_clean":"2023-10-06T05:26:27.077029+0000","last_became_active":"2023-10-06T05:26:27.074681+0000","last_became_peered":"2023-10-06T05:26:27.074681+0000","last_unstale":"2023-10-06T05:26:27.077029+0000","last_undegraded":"2023-10-06T05:26:27.077029+0000","last_fullsized":"2023-10-06T05:26:27.077029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:08.887562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.078521+0000","last_change":"2023-10-06T05:26:27.078521+0000","last_active":"2023-10-06T05:26:27.078521+0000","last_peered":"2023-10-06T05:26:27.078521+0000","last_clean":"2023-10-06T05:26:27.078521+0000","last_became_active":"2023-10-06T05:26:27.078179+0000","last_became_peered":"2023-10-06T05:26:27.078179+0000","last_unstale":"2023-10-06T05:26:27.078521+0000","last_undegraded":"2023-10-06T05:26:27.078521+0000","last_fullsized":"2023-10-06T05:26:27.078521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:33.461500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.078252+0000","last_change":"2023-10-06T05:26:27.078252+0000","last_active":"2023-10-06T05:26:27.078252+0000","last_peered":"2023-10-06T05:26:27.078252+0000","last_clean":"2023-10-06T05:26:27.078252+0000","last_became_active":"2023-10-06T05:26:27.077981+0000","last_became_peered":"2023-10-06T05:26:27.077981+0000","last_unstale":"2023-10-06T05:26:27.078252+0000","last_undegraded":"2023-10-06T05:26:27.078252+0000","last_fullsized":"2023-10-06T05:26:27.078252+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:50.686847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073081+0000","last_change":"2023-10-06T05:26:27.073081+0000","last_active":"2023-10-06T05:26:27.073081+0000","last_peered":"2023-10-06T05:26:27.073081+0000","last_clean":"2023-10-06T05:26:27.073081+0000","last_became_active":"2023-10-06T05:26:27.072522+0000","last_became_peered":"2023-10-06T05:26:27.072522+0000","last_unstale":"2023-10-06T05:26:27.073081+0000","last_undegraded":"2023-10-06T05:26:27.073081+0000","last_fullsized":"2023-10-06T05:26:27.073081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:05.634987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075949+0000","last_change":"2023-10-06T05:26:27.075949+0000","last_active":"2023-10-06T05:26:27.075949+0000","last_peered":"2023-10-06T05:26:27.075949+0000","last_clean":"2023-10-06T05:26:27.075949+0000","last_became_active":"2023-10-06T05:26:27.075677+0000","last_became_peered":"2023-10-06T05:26:27.075677+0000","last_unstale":"2023-10-06T05:26:27.075949+0000","last_undegraded":"2023-10-06T05:26:27.075949+0000","last_fullsized":"2023-10-06T05:26:27.075949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:14.849149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.083264+0000","last_change":"2023-10-06T05:26:27.083264+0000","last_active":"2023-10-06T05:26:27.083264+0000","last_peered":"2023-10-06T05:26:27.083264+0000","last_clean":"2023-10-06T05:26:27.083264+0000","last_became_active":"2023-10-06T05:26:27.082990+0000","last_became_peered":"2023-10-06T05:26:27.082990+0000","last_unstale":"2023-10-06T05:26:27.083264+0000","last_undegraded":"2023-10-06T05:26:27.083264+0000","last_fullsized":"2023-10-06T05:26:27.083264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:51.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074236+0000","last_change":"2023-10-06T05:26:27.074236+0000","last_active":"2023-10-06T05:26:27.074236+0000","last_peered":"2023-10-06T05:26:27.074236+0000","last_clean":"2023-10-06T05:26:27.074236+0000","last_became_active":"2023-10-06T05:26:27.073953+0000","last_became_peered":"2023-10-06T05:26:27.073953+0000","last_unstale":"2023-10-06T05:26:27.074236+0000","last_undegraded":"2023-10-06T05:26:27.074236+0000","last_fullsized":"2023-10-06T05:26:27.074236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:20.290448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.083343+0000","last_change":"2023-10-06T05:26:27.083343+0000","last_active":"2023-10-06T05:26:27.083343+0000","last_peered":"2023-10-06T05:26:27.083343+0000","last_clean":"2023-10-06T05:26:27.083343+0000","last_became_active":"2023-10-06T05:26:27.082979+0000","last_became_peered":"2023-10-06T05:26:27.082979+0000","last_unstale":"2023-10-06T05:26:27.083343+0000","last_undegraded":"2023-10-06T05:26:27.083343+0000","last_fullsized":"2023-10-06T05:26:27.083343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.072397+0000","last_change":"2023-10-06T05:26:27.072397+0000","last_active":"2023-10-06T05:26:27.072397+0000","last_peered":"2023-10-06T05:26:27.072397+0000","last_clean":"2023-10-06T05:26:27.072397+0000","last_became_active":"2023-10-06T05:26:27.071976+0000","last_became_peered":"2023-10-06T05:26:27.071976+0000","last_unstale":"2023-10-06T05:26:27.072397+0000","last_undegraded":"2023-10-06T05:26:27.072397+0000","last_fullsized":"2023-10-06T05:26:27.072397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:34.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.085779+0000","last_change":"2023-10-06T05:26:27.085779+0000","last_active":"2023-10-06T05:26:27.085779+0000","last_peered":"2023-10-06T05:26:27.085779+0000","last_clean":"2023-10-06T05:26:27.085779+0000","last_became_active":"2023-10-06T05:26:27.085478+0000","last_became_peered":"2023-10-06T05:26:27.085478+0000","last_unstale":"2023-10-06T05:26:27.085779+0000","last_undegraded":"2023-10-06T05:26:27.085779+0000","last_fullsized":"2023-10-06T05:26:27.085779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:44.356097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.077477+0000","last_change":"2023-10-06T05:26:27.077477+0000","last_active":"2023-10-06T05:26:27.077477+0000","last_peered":"2023-10-06T05:26:27.077477+0000","last_clean":"2023-10-06T05:26:27.077477+0000","last_became_active":"2023-10-06T05:26:27.077194+0000","last_became_peered":"2023-10-06T05:26:27.077194+0000","last_unstale":"2023-10-06T05:26:27.077477+0000","last_undegraded":"2023-10-06T05:26:27.077477+0000","last_fullsized":"2023-10-06T05:26:27.077477+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:20.016532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075205+0000","last_change":"2023-10-06T05:26:27.075205+0000","last_active":"2023-10-06T05:26:27.075205+0000","last_peered":"2023-10-06T05:26:27.075205+0000","last_clean":"2023-10-06T05:26:27.075205+0000","last_became_active":"2023-10-06T05:26:27.073588+0000","last_became_peered":"2023-10-06T05:26:27.073588+0000","last_unstale":"2023-10-06T05:26:27.075205+0000","last_undegraded":"2023-10-06T05:26:27.075205+0000","last_fullsized":"2023-10-06T05:26:27.075205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:51.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075070+0000","last_change":"2023-10-06T05:26:27.075070+0000","last_active":"2023-10-06T05:26:27.075070+0000","last_peered":"2023-10-06T05:26:27.075070+0000","last_clean":"2023-10-06T05:26:27.075070+0000","last_became_active":"2023-10-06T05:26:27.074789+0000","last_became_peered":"2023-10-06T05:26:27.074789+0000","last_unstale":"2023-10-06T05:26:27.075070+0000","last_undegraded":"2023-10-06T05:26:27.075070+0000","last_fullsized":"2023-10-06T05:26:27.075070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:51.634533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.430228+0000","last_change":"2023-10-06T05:26:26.069320+0000","last_active":"2023-10-06T05:26:27.430228+0000","last_peered":"2023-10-06T05:26:27.430228+0000","last_clean":"2023-10-06T05:26:27.430228+0000","last_became_active":"2023-10-06T05:26:26.068983+0000","last_became_peered":"2023-10-06T05:26:26.068983+0000","last_unstale":"2023-10-06T05:26:27.430228+0000","last_undegraded":"2023-10-06T05:26:27.430228+0000","last_fullsized":"2023-10-06T05:26:27.430228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:57.307012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.082451+0000","last_change":"2023-10-06T05:26:27.082451+0000","last_active":"2023-10-06T05:26:27.082451+0000","last_peered":"2023-10-06T05:26:27.082451+0000","last_clean":"2023-10-06T05:26:27.082451+0000","last_became_active":"2023-10-06T05:26:27.082036+0000","last_became_peered":"2023-10-06T05:26:27.082036+0000","last_unstale":"2023-10-06T05:26:27.082451+0000","last_undegraded":"2023-10-06T05:26:27.082451+0000","last_fullsized":"2023-10-06T05:26:27.082451+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:50.686847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.061894+0000","last_change":"2023-10-06T05:26:26.071874+0000","last_active":"2023-10-06T05:26:27.061894+0000","last_peered":"2023-10-06T05:26:27.061894+0000","last_clean":"2023-10-06T05:26:27.061894+0000","last_became_active":"2023-10-06T05:26:26.071539+0000","last_became_peered":"2023-10-06T05:26:26.071539+0000","last_unstale":"2023-10-06T05:26:27.061894+0000","last_undegraded":"2023-10-06T05:26:27.061894+0000","last_fullsized":"2023-10-06T05:26:27.061894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:09.196805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074153+0000","last_change":"2023-10-06T05:26:27.074153+0000","last_active":"2023-10-06T05:26:27.074153+0000","last_peered":"2023-10-06T05:26:27.074153+0000","last_clean":"2023-10-06T05:26:27.074153+0000","last_became_active":"2023-10-06T05:26:27.073886+0000","last_became_peered":"2023-10-06T05:26:27.073886+0000","last_unstale":"2023-10-06T05:26:27.074153+0000","last_undegraded":"2023-10-06T05:26:27.074153+0000","last_fullsized":"2023-10-06T05:26:27.074153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:22.276067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.426055+0000","last_change":"2023-10-06T05:26:26.075515+0000","last_active":"2023-10-06T05:26:27.426055+0000","last_peered":"2023-10-06T05:26:27.426055+0000","last_clean":"2023-10-06T05:26:27.426055+0000","last_became_active":"2023-10-06T05:26:26.075303+0000","last_became_peered":"2023-10-06T05:26:26.075303+0000","last_unstale":"2023-10-06T05:26:27.426055+0000","last_undegraded":"2023-10-06T05:26:27.426055+0000","last_fullsized":"2023-10-06T05:26:27.426055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:13.836135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.077349+0000","last_change":"2023-10-06T05:26:27.077349+0000","last_active":"2023-10-06T05:26:27.077349+0000","last_peered":"2023-10-06T05:26:27.077349+0000","last_clean":"2023-10-06T05:26:27.077349+0000","last_became_active":"2023-10-06T05:26:27.077000+0000","last_became_peered":"2023-10-06T05:26:27.077000+0000","last_unstale":"2023-10-06T05:26:27.077349+0000","last_undegraded":"2023-10-06T05:26:27.077349+0000","last_fullsized":"2023-10-06T05:26:27.077349+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:35.542864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.426753+0000","last_change":"2023-10-06T05:26:26.071329+0000","last_active":"2023-10-06T05:26:27.426753+0000","last_peered":"2023-10-06T05:26:27.426753+0000","last_clean":"2023-10-06T05:26:27.426753+0000","last_became_active":"2023-10-06T05:26:26.071036+0000","last_became_peered":"2023-10-06T05:26:26.071036+0000","last_unstale":"2023-10-06T05:26:27.426753+0000","last_undegraded":"2023-10-06T05:26:27.426753+0000","last_fullsized":"2023-10-06T05:26:27.426753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:50.012792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.079943+0000","last_change":"2023-10-06T05:26:27.079943+0000","last_active":"2023-10-06T05:26:27.079943+0000","last_peered":"2023-10-06T05:26:27.079943+0000","last_clean":"2023-10-06T05:26:27.079943+0000","last_became_active":"2023-10-06T05:26:27.079532+0000","last_became_peered":"2023-10-06T05:26:27.079532+0000","last_unstale":"2023-10-06T05:26:27.079943+0000","last_undegraded":"2023-10-06T05:26:27.079943+0000","last_fullsized":"2023-10-06T05:26:27.079943+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:20.016532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.067284+0000","last_change":"2023-10-06T05:26:26.075003+0000","last_active":"2023-10-06T05:26:27.067284+0000","last_peered":"2023-10-06T05:26:27.067284+0000","last_clean":"2023-10-06T05:26:27.067284+0000","last_became_active":"2023-10-06T05:26:26.074676+0000","last_became_peered":"2023-10-06T05:26:26.074676+0000","last_unstale":"2023-10-06T05:26:27.067284+0000","last_undegraded":"2023-10-06T05:26:27.067284+0000","last_fullsized":"2023-10-06T05:26:27.067284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:55.207489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073577+0000","last_change":"2023-10-06T05:26:27.073577+0000","last_active":"2023-10-06T05:26:27.073577+0000","last_peered":"2023-10-06T05:26:27.073577+0000","last_clean":"2023-10-06T05:26:27.073577+0000","last_became_active":"2023-10-06T05:26:27.073044+0000","last_became_peered":"2023-10-06T05:26:27.073044+0000","last_unstale":"2023-10-06T05:26:27.073577+0000","last_undegraded":"2023-10-06T05:26:27.073577+0000","last_fullsized":"2023-10-06T05:26:27.073577+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:33.461500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.057575+0000","last_change":"2023-10-06T05:26:26.069123+0000","last_active":"2023-10-06T05:26:27.057575+0000","last_peered":"2023-10-06T05:26:27.057575+0000","last_clean":"2023-10-06T05:26:27.057575+0000","last_became_active":"2023-10-06T05:26:26.068843+0000","last_became_peered":"2023-10-06T05:26:26.068843+0000","last_unstale":"2023-10-06T05:26:27.057575+0000","last_undegraded":"2023-10-06T05:26:27.057575+0000","last_fullsized":"2023-10-06T05:26:27.057575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:48.272688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075114+0000","last_change":"2023-10-06T05:26:27.075114+0000","last_active":"2023-10-06T05:26:27.075114+0000","last_peered":"2023-10-06T05:26:27.075114+0000","last_clean":"2023-10-06T05:26:27.075114+0000","last_became_active":"2023-10-06T05:26:27.074760+0000","last_became_peered":"2023-10-06T05:26:27.074760+0000","last_unstale":"2023-10-06T05:26:27.075114+0000","last_undegraded":"2023-10-06T05:26:27.075114+0000","last_fullsized":"2023-10-06T05:26:27.075114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:50.566027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.077780+0000","last_change":"2023-10-06T05:26:26.072791+0000","last_active":"2023-10-06T05:26:26.077780+0000","last_peered":"2023-10-06T05:26:26.077780+0000","last_clean":"2023-10-06T05:26:26.077780+0000","last_became_active":"2023-10-06T05:26:26.072487+0000","last_became_peered":"2023-10-06T05:26:26.072487+0000","last_unstale":"2023-10-06T05:26:26.077780+0000","last_undegraded":"2023-10-06T05:26:26.077780+0000","last_fullsized":"2023-10-06T05:26:26.077780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:19.277435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.081083+0000","last_change":"2023-10-06T05:26:27.081083+0000","last_active":"2023-10-06T05:26:27.081083+0000","last_peered":"2023-10-06T05:26:27.081083+0000","last_clean":"2023-10-06T05:26:27.081083+0000","last_became_active":"2023-10-06T05:26:27.080777+0000","last_became_peered":"2023-10-06T05:26:27.080777+0000","last_unstale":"2023-10-06T05:26:27.081083+0000","last_undegraded":"2023-10-06T05:26:27.081083+0000","last_fullsized":"2023-10-06T05:26:27.081083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:57.520031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.071857+0000","last_change":"2023-10-06T05:26:26.068143+0000","last_active":"2023-10-06T05:26:26.071857+0000","last_peered":"2023-10-06T05:26:26.071857+0000","last_clean":"2023-10-06T05:26:26.071857+0000","last_became_active":"2023-10-06T05:26:26.067840+0000","last_became_peered":"2023-10-06T05:26:26.067840+0000","last_unstale":"2023-10-06T05:26:26.071857+0000","last_undegraded":"2023-10-06T05:26:26.071857+0000","last_fullsized":"2023-10-06T05:26:26.071857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:34.167867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074083+0000","last_change":"2023-10-06T05:26:27.074083+0000","last_active":"2023-10-06T05:26:27.074083+0000","last_peered":"2023-10-06T05:26:27.074083+0000","last_clean":"2023-10-06T05:26:27.074083+0000","last_became_active":"2023-10-06T05:26:27.073793+0000","last_became_peered":"2023-10-06T05:26:27.073793+0000","last_unstale":"2023-10-06T05:26:27.074083+0000","last_undegraded":"2023-10-06T05:26:27.074083+0000","last_fullsized":"2023-10-06T05:26:27.074083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:49.285701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.075306+0000","last_change":"2023-10-06T05:26:26.074056+0000","last_active":"2023-10-06T05:26:26.075306+0000","last_peered":"2023-10-06T05:26:26.075306+0000","last_clean":"2023-10-06T05:26:26.075306+0000","last_became_active":"2023-10-06T05:26:26.073764+0000","last_became_peered":"2023-10-06T05:26:26.073764+0000","last_unstale":"2023-10-06T05:26:26.075306+0000","last_undegraded":"2023-10-06T05:26:26.075306+0000","last_fullsized":"2023-10-06T05:26:26.075306+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:16.789123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.072049+0000","last_change":"2023-10-06T05:26:27.072049+0000","last_active":"2023-10-06T05:26:27.072049+0000","last_peered":"2023-10-06T05:26:27.072049+0000","last_clean":"2023-10-06T05:26:27.072049+0000","last_became_active":"2023-10-06T05:26:27.071735+0000","last_became_peered":"2023-10-06T05:26:27.071735+0000","last_unstale":"2023-10-06T05:26:27.072049+0000","last_undegraded":"2023-10-06T05:26:27.072049+0000","last_fullsized":"2023-10-06T05:26:27.072049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:51.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.080056+0000","last_change":"2023-10-06T05:26:26.073636+0000","last_active":"2023-10-06T05:26:26.080056+0000","last_peered":"2023-10-06T05:26:26.080056+0000","last_clean":"2023-10-06T05:26:26.080056+0000","last_became_active":"2023-10-06T05:26:26.072902+0000","last_became_peered":"2023-10-06T05:26:26.072902+0000","last_unstale":"2023-10-06T05:26:26.080056+0000","last_undegraded":"2023-10-06T05:26:26.080056+0000","last_fullsized":"2023-10-06T05:26:26.080056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.881267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074455+0000","last_change":"2023-10-06T05:26:27.074455+0000","last_active":"2023-10-06T05:26:27.074455+0000","last_peered":"2023-10-06T05:26:27.074455+0000","last_clean":"2023-10-06T05:26:27.074455+0000","last_became_active":"2023-10-06T05:26:27.073595+0000","last_became_peered":"2023-10-06T05:26:27.073595+0000","last_unstale":"2023-10-06T05:26:27.074455+0000","last_undegraded":"2023-10-06T05:26:27.074455+0000","last_fullsized":"2023-10-06T05:26:27.074455+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:39.968744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.428474+0000","last_change":"2023-10-06T05:26:26.075467+0000","last_active":"2023-10-06T05:26:27.428474+0000","last_peered":"2023-10-06T05:26:27.428474+0000","last_clean":"2023-10-06T05:26:27.428474+0000","last_became_active":"2023-10-06T05:26:26.075044+0000","last_became_peered":"2023-10-06T05:26:26.075044+0000","last_unstale":"2023-10-06T05:26:27.428474+0000","last_undegraded":"2023-10-06T05:26:27.428474+0000","last_fullsized":"2023-10-06T05:26:27.428474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:16.571702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.080744+0000","last_change":"2023-10-06T05:26:27.080744+0000","last_active":"2023-10-06T05:26:27.080744+0000","last_peered":"2023-10-06T05:26:27.080744+0000","last_clean":"2023-10-06T05:26:27.080744+0000","last_became_active":"2023-10-06T05:26:27.080400+0000","last_became_peered":"2023-10-06T05:26:27.080400+0000","last_unstale":"2023-10-06T05:26:27.080744+0000","last_undegraded":"2023-10-06T05:26:27.080744+0000","last_fullsized":"2023-10-06T05:26:27.080744+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:57.520031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.427565+0000","last_change":"2023-10-06T05:26:26.068931+0000","last_active":"2023-10-06T05:26:27.427565+0000","last_peered":"2023-10-06T05:26:27.427565+0000","last_clean":"2023-10-06T05:26:27.427565+0000","last_became_active":"2023-10-06T05:26:26.068623+0000","last_became_peered":"2023-10-06T05:26:26.068623+0000","last_unstale":"2023-10-06T05:26:27.427565+0000","last_undegraded":"2023-10-06T05:26:27.427565+0000","last_fullsized":"2023-10-06T05:26:27.427565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:16.571702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.083462+0000","last_change":"2023-10-06T05:26:27.083462+0000","last_active":"2023-10-06T05:26:27.083462+0000","last_peered":"2023-10-06T05:26:27.083462+0000","last_clean":"2023-10-06T05:26:27.083462+0000","last_became_active":"2023-10-06T05:26:27.083117+0000","last_became_peered":"2023-10-06T05:26:27.083117+0000","last_unstale":"2023-10-06T05:26:27.083462+0000","last_undegraded":"2023-10-06T05:26:27.083462+0000","last_fullsized":"2023-10-06T05:26:27.083462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:51.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.424393+0000","last_change":"2023-10-06T05:26:26.074660+0000","last_active":"2023-10-06T05:26:27.424393+0000","last_peered":"2023-10-06T05:26:27.424393+0000","last_clean":"2023-10-06T05:26:27.424393+0000","last_became_active":"2023-10-06T05:26:26.074355+0000","last_became_peered":"2023-10-06T05:26:26.074355+0000","last_unstale":"2023-10-06T05:26:27.424393+0000","last_undegraded":"2023-10-06T05:26:27.424393+0000","last_fullsized":"2023-10-06T05:26:27.424393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.881267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076250+0000","last_change":"2023-10-06T05:26:27.076250+0000","last_active":"2023-10-06T05:26:27.076250+0000","last_peered":"2023-10-06T05:26:27.076250+0000","last_clean":"2023-10-06T05:26:27.076250+0000","last_became_active":"2023-10-06T05:26:27.075812+0000","last_became_peered":"2023-10-06T05:26:27.075812+0000","last_unstale":"2023-10-06T05:26:27.076250+0000","last_undegraded":"2023-10-06T05:26:27.076250+0000","last_fullsized":"2023-10-06T05:26:27.076250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:25.145735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.077767+0000","last_change":"2023-10-06T05:26:26.072763+0000","last_active":"2023-10-06T05:26:26.077767+0000","last_peered":"2023-10-06T05:26:26.077767+0000","last_clean":"2023-10-06T05:26:26.077767+0000","last_became_active":"2023-10-06T05:26:26.072433+0000","last_became_peered":"2023-10-06T05:26:26.072433+0000","last_unstale":"2023-10-06T05:26:26.077767+0000","last_undegraded":"2023-10-06T05:26:26.077767+0000","last_fullsized":"2023-10-06T05:26:26.077767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:33.447514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.075721+0000","last_change":"2023-10-06T05:26:27.075721+0000","last_active":"2023-10-06T05:26:27.075721+0000","last_peered":"2023-10-06T05:26:27.075721+0000","last_clean":"2023-10-06T05:26:27.075721+0000","last_became_active":"2023-10-06T05:26:27.075389+0000","last_became_peered":"2023-10-06T05:26:27.075389+0000","last_unstale":"2023-10-06T05:26:27.075721+0000","last_undegraded":"2023-10-06T05:26:27.075721+0000","last_fullsized":"2023-10-06T05:26:27.075721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:15.006844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.070173+0000","last_change":"2023-10-06T05:26:26.068967+0000","last_active":"2023-10-06T05:26:26.070173+0000","last_peered":"2023-10-06T05:26:26.070173+0000","last_clean":"2023-10-06T05:26:26.070173+0000","last_became_active":"2023-10-06T05:26:26.068654+0000","last_became_peered":"2023-10-06T05:26:26.068654+0000","last_unstale":"2023-10-06T05:26:26.070173+0000","last_undegraded":"2023-10-06T05:26:26.070173+0000","last_fullsized":"2023-10-06T05:26:26.070173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:42.262006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076423+0000","last_change":"2023-10-06T05:26:27.076423+0000","last_active":"2023-10-06T05:26:27.076423+0000","last_peered":"2023-10-06T05:26:27.076423+0000","last_clean":"2023-10-06T05:26:27.076423+0000","last_became_active":"2023-10-06T05:26:27.076121+0000","last_became_peered":"2023-10-06T05:26:27.076121+0000","last_unstale":"2023-10-06T05:26:27.076423+0000","last_undegraded":"2023-10-06T05:26:27.076423+0000","last_fullsized":"2023-10-06T05:26:27.076423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:08.887562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.430899+0000","last_change":"2023-10-06T05:26:26.068196+0000","last_active":"2023-10-06T05:26:27.430899+0000","last_peered":"2023-10-06T05:26:27.430899+0000","last_clean":"2023-10-06T05:26:27.430899+0000","last_became_active":"2023-10-06T05:26:26.067918+0000","last_became_peered":"2023-10-06T05:26:26.067918+0000","last_unstale":"2023-10-06T05:26:27.430899+0000","last_undegraded":"2023-10-06T05:26:27.430899+0000","last_fullsized":"2023-10-06T05:26:27.430899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:04.621974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.077283+0000","last_change":"2023-10-06T05:26:27.077283+0000","last_active":"2023-10-06T05:26:27.077283+0000","last_peered":"2023-10-06T05:26:27.077283+0000","last_clean":"2023-10-06T05:26:27.077283+0000","last_became_active":"2023-10-06T05:26:27.076552+0000","last_became_peered":"2023-10-06T05:26:27.076552+0000","last_unstale":"2023-10-06T05:26:27.077283+0000","last_undegraded":"2023-10-06T05:26:27.077283+0000","last_fullsized":"2023-10-06T05:26:27.077283+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:44.877585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.070374+0000","last_change":"2023-10-06T05:26:26.067341+0000","last_active":"2023-10-06T05:26:27.070374+0000","last_peered":"2023-10-06T05:26:27.070374+0000","last_clean":"2023-10-06T05:26:27.070374+0000","last_became_active":"2023-10-06T05:26:26.067036+0000","last_became_peered":"2023-10-06T05:26:26.067036+0000","last_unstale":"2023-10-06T05:26:27.070374+0000","last_undegraded":"2023-10-06T05:26:27.070374+0000","last_fullsized":"2023-10-06T05:26:27.070374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:33.447514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.076436+0000","last_change":"2023-10-06T05:26:27.076436+0000","last_active":"2023-10-06T05:26:27.076436+0000","last_peered":"2023-10-06T05:26:27.076436+0000","last_clean":"2023-10-06T05:26:27.076436+0000","last_became_active":"2023-10-06T05:26:27.076194+0000","last_became_peered":"2023-10-06T05:26:27.076194+0000","last_unstale":"2023-10-06T05:26:27.076436+0000","last_undegraded":"2023-10-06T05:26:27.076436+0000","last_fullsized":"2023-10-06T05:26:27.076436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:57.520031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.428411+0000","last_change":"2023-10-06T05:26:26.072396+0000","last_active":"2023-10-06T05:26:27.428411+0000","last_peered":"2023-10-06T05:26:27.428411+0000","last_clean":"2023-10-06T05:26:27.428411+0000","last_became_active":"2023-10-06T05:26:26.072105+0000","last_became_peered":"2023-10-06T05:26:26.072105+0000","last_unstale":"2023-10-06T05:26:27.428411+0000","last_undegraded":"2023-10-06T05:26:27.428411+0000","last_fullsized":"2023-10-06T05:26:27.428411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:13.993831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073447+0000","last_change":"2023-10-06T05:26:27.073447+0000","last_active":"2023-10-06T05:26:27.073447+0000","last_peered":"2023-10-06T05:26:27.073447+0000","last_clean":"2023-10-06T05:26:27.073447+0000","last_became_active":"2023-10-06T05:26:27.073190+0000","last_became_peered":"2023-10-06T05:26:27.073190+0000","last_unstale":"2023-10-06T05:26:27.073447+0000","last_undegraded":"2023-10-06T05:26:27.073447+0000","last_fullsized":"2023-10-06T05:26:27.073447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.064165+0000","last_change":"2023-10-06T05:26:26.068934+0000","last_active":"2023-10-06T05:26:27.064165+0000","last_peered":"2023-10-06T05:26:27.064165+0000","last_clean":"2023-10-06T05:26:27.064165+0000","last_became_active":"2023-10-06T05:26:26.068619+0000","last_became_peered":"2023-10-06T05:26:26.068619+0000","last_unstale":"2023-10-06T05:26:27.064165+0000","last_undegraded":"2023-10-06T05:26:27.064165+0000","last_fullsized":"2023-10-06T05:26:27.064165+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:20.606758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.085500+0000","last_change":"2023-10-06T05:26:27.085500+0000","last_active":"2023-10-06T05:26:27.085500+0000","last_peered":"2023-10-06T05:26:27.085500+0000","last_clean":"2023-10-06T05:26:27.085500+0000","last_became_active":"2023-10-06T05:26:27.085234+0000","last_became_peered":"2023-10-06T05:26:27.085234+0000","last_unstale":"2023-10-06T05:26:27.085500+0000","last_undegraded":"2023-10-06T05:26:27.085500+0000","last_fullsized":"2023-10-06T05:26:27.085500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:44.356097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.076982+0000","last_change":"2023-10-06T05:26:26.071158+0000","last_active":"2023-10-06T05:26:26.076982+0000","last_peered":"2023-10-06T05:26:26.076982+0000","last_clean":"2023-10-06T05:26:26.076982+0000","last_became_active":"2023-10-06T05:26:26.070787+0000","last_became_peered":"2023-10-06T05:26:26.070787+0000","last_unstale":"2023-10-06T05:26:26.076982+0000","last_undegraded":"2023-10-06T05:26:26.076982+0000","last_fullsized":"2023-10-06T05:26:26.076982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:55.207489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.079517+0000","last_change":"2023-10-06T05:26:27.079517+0000","last_active":"2023-10-06T05:26:27.079517+0000","last_peered":"2023-10-06T05:26:27.079517+0000","last_clean":"2023-10-06T05:26:27.079517+0000","last_became_active":"2023-10-06T05:26:27.079170+0000","last_became_peered":"2023-10-06T05:26:27.079170+0000","last_unstale":"2023-10-06T05:26:27.079517+0000","last_undegraded":"2023-10-06T05:26:27.079517+0000","last_fullsized":"2023-10-06T05:26:27.079517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:35.542864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.426114+0000","last_change":"2023-10-06T05:26:26.074248+0000","last_active":"2023-10-06T05:26:27.426114+0000","last_peered":"2023-10-06T05:26:27.426114+0000","last_clean":"2023-10-06T05:26:27.426114+0000","last_became_active":"2023-10-06T05:26:26.073958+0000","last_became_peered":"2023-10-06T05:26:26.073958+0000","last_unstale":"2023-10-06T05:26:27.426114+0000","last_undegraded":"2023-10-06T05:26:27.426114+0000","last_fullsized":"2023-10-06T05:26:27.426114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:45.557588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.074096+0000","last_change":"2023-10-06T05:26:27.074096+0000","last_active":"2023-10-06T05:26:27.074096+0000","last_peered":"2023-10-06T05:26:27.074096+0000","last_clean":"2023-10-06T05:26:27.074096+0000","last_became_active":"2023-10-06T05:26:27.073795+0000","last_became_peered":"2023-10-06T05:26:27.073795+0000","last_unstale":"2023-10-06T05:26:27.074096+0000","last_undegraded":"2023-10-06T05:26:27.074096+0000","last_fullsized":"2023-10-06T05:26:27.074096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:17.802137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.075249+0000","last_change":"2023-10-06T05:26:26.073060+0000","last_active":"2023-10-06T05:26:26.075249+0000","last_peered":"2023-10-06T05:26:26.075249+0000","last_clean":"2023-10-06T05:26:26.075249+0000","last_became_active":"2023-10-06T05:26:26.072768+0000","last_became_peered":"2023-10-06T05:26:26.072768+0000","last_unstale":"2023-10-06T05:26:26.075249+0000","last_undegraded":"2023-10-06T05:26:26.075249+0000","last_fullsized":"2023-10-06T05:26:26.075249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:36.687338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.073599+0000","last_change":"2023-10-06T05:26:27.073599+0000","last_active":"2023-10-06T05:26:27.073599+0000","last_peered":"2023-10-06T05:26:27.073599+0000","last_clean":"2023-10-06T05:26:27.073599+0000","last_became_active":"2023-10-06T05:26:27.073119+0000","last_became_peered":"2023-10-06T05:26:27.073119+0000","last_unstale":"2023-10-06T05:26:27.073599+0000","last_undegraded":"2023-10-06T05:26:27.073599+0000","last_fullsized":"2023-10-06T05:26:27.073599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:15.006844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.067229+0000","last_change":"2023-10-06T05:26:26.061050+0000","last_active":"2023-10-06T05:26:26.067229+0000","last_peered":"2023-10-06T05:26:26.067229+0000","last_clean":"2023-10-06T05:26:26.067229+0000","last_became_active":"2023-10-06T05:26:26.060751+0000","last_became_peered":"2023-10-06T05:26:26.060751+0000","last_unstale":"2023-10-06T05:26:26.067229+0000","last_undegraded":"2023-10-06T05:26:26.067229+0000","last_fullsized":"2023-10-06T05:26:26.067229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:49.162098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.080852+0000","last_change":"2023-10-06T05:26:27.080852+0000","last_active":"2023-10-06T05:26:27.080852+0000","last_peered":"2023-10-06T05:26:27.080852+0000","last_clean":"2023-10-06T05:26:27.080852+0000","last_became_active":"2023-10-06T05:26:27.080490+0000","last_became_peered":"2023-10-06T05:26:27.080490+0000","last_unstale":"2023-10-06T05:26:27.080852+0000","last_undegraded":"2023-10-06T05:26:27.080852+0000","last_fullsized":"2023-10-06T05:26:27.080852+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:50.566027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.076187+0000","last_change":"2023-10-06T05:26:26.074238+0000","last_active":"2023-10-06T05:26:26.076187+0000","last_peered":"2023-10-06T05:26:26.076187+0000","last_clean":"2023-10-06T05:26:26.076187+0000","last_became_active":"2023-10-06T05:26:26.073942+0000","last_became_peered":"2023-10-06T05:26:26.073942+0000","last_unstale":"2023-10-06T05:26:26.076187+0000","last_undegraded":"2023-10-06T05:26:26.076187+0000","last_fullsized":"2023-10-06T05:26:26.076187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:53.403588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.086347+0000","last_change":"2023-10-06T05:26:27.086347+0000","last_active":"2023-10-06T05:26:27.086347+0000","last_peered":"2023-10-06T05:26:27.086347+0000","last_clean":"2023-10-06T05:26:27.086347+0000","last_became_active":"2023-10-06T05:26:27.086020+0000","last_became_peered":"2023-10-06T05:26:27.086020+0000","last_unstale":"2023-10-06T05:26:27.086347+0000","last_undegraded":"2023-10-06T05:26:27.086347+0000","last_fullsized":"2023-10-06T05:26:27.086347+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:57.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.074771+0000","last_change":"2023-10-06T05:26:26.072080+0000","last_active":"2023-10-06T05:26:26.074771+0000","last_peered":"2023-10-06T05:26:26.074771+0000","last_clean":"2023-10-06T05:26:26.074771+0000","last_became_active":"2023-10-06T05:26:26.071719+0000","last_became_peered":"2023-10-06T05:26:26.071719+0000","last_unstale":"2023-10-06T05:26:26.074771+0000","last_undegraded":"2023-10-06T05:26:26.074771+0000","last_fullsized":"2023-10-06T05:26:26.074771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:09.196805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.051969+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:26:26.051969+0000","last_peered":"2023-10-06T05:26:26.051969+0000","last_clean":"2023-10-06T05:26:26.051969+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:26:26.051969+0000","last_undegraded":"2023-10-06T05:26:26.051969+0000","last_fullsized":"2023-10-06T05:26:26.051969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.065357+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:26:26.065357+0000","last_peered":"2023-10-06T05:26:26.065357+0000","last_clean":"2023-10-06T05:26:26.065357+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:26:26.065357+0000","last_undegraded":"2023-10-06T05:26:26.065357+0000","last_fullsized":"2023-10-06T05:26:26.065357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.083296+0000","last_change":"2023-10-06T05:26:27.083296+0000","last_active":"2023-10-06T05:26:27.083296+0000","last_peered":"2023-10-06T05:26:27.083296+0000","last_clean":"2023-10-06T05:26:27.083296+0000","last_became_active":"2023-10-06T05:26:27.082957+0000","last_became_peered":"2023-10-06T05:26:27.082957+0000","last_unstale":"2023-10-06T05:26:27.083296+0000","last_undegraded":"2023-10-06T05:26:27.083296+0000","last_fullsized":"2023-10-06T05:26:27.083296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:20.016532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.428200+0000","last_change":"2023-10-06T05:26:26.074753+0000","last_active":"2023-10-06T05:26:27.428200+0000","last_peered":"2023-10-06T05:26:27.428200+0000","last_clean":"2023-10-06T05:26:27.428200+0000","last_became_active":"2023-10-06T05:26:26.074420+0000","last_became_peered":"2023-10-06T05:26:26.074420+0000","last_unstale":"2023-10-06T05:26:27.428200+0000","last_undegraded":"2023-10-06T05:26:27.428200+0000","last_fullsized":"2023-10-06T05:26:27.428200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:41.640711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.051740+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:26:26.051740+0000","last_peered":"2023-10-06T05:26:26.051740+0000","last_clean":"2023-10-06T05:26:26.051740+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:26:26.051740+0000","last_undegraded":"2023-10-06T05:26:26.051740+0000","last_fullsized":"2023-10-06T05:26:26.051740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.072035+0000","last_change":"2023-10-06T05:26:27.072035+0000","last_active":"2023-10-06T05:26:27.072035+0000","last_peered":"2023-10-06T05:26:27.072035+0000","last_clean":"2023-10-06T05:26:27.072035+0000","last_became_active":"2023-10-06T05:26:27.071329+0000","last_became_peered":"2023-10-06T05:26:27.071329+0000","last_unstale":"2023-10-06T05:26:27.072035+0000","last_undegraded":"2023-10-06T05:26:27.072035+0000","last_fullsized":"2023-10-06T05:26:27.072035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:08.417592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.073234+0000","last_change":"2023-10-06T05:26:26.071516+0000","last_active":"2023-10-06T05:26:26.073234+0000","last_peered":"2023-10-06T05:26:26.073234+0000","last_clean":"2023-10-06T05:26:26.073234+0000","last_became_active":"2023-10-06T05:26:26.071207+0000","last_became_peered":"2023-10-06T05:26:26.071207+0000","last_unstale":"2023-10-06T05:26:26.073234+0000","last_undegraded":"2023-10-06T05:26:26.073234+0000","last_fullsized":"2023-10-06T05:26:26.073234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.682610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.065049+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:26:26.065049+0000","last_peered":"2023-10-06T05:26:26.065049+0000","last_clean":"2023-10-06T05:26:26.065049+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:26:26.065049+0000","last_undegraded":"2023-10-06T05:26:26.065049+0000","last_fullsized":"2023-10-06T05:26:26.065049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.078239+0000","last_change":"2023-10-06T05:26:27.078239+0000","last_active":"2023-10-06T05:26:27.078239+0000","last_peered":"2023-10-06T05:26:27.078239+0000","last_clean":"2023-10-06T05:26:27.078239+0000","last_became_active":"2023-10-06T05:26:27.077963+0000","last_became_peered":"2023-10-06T05:26:27.077963+0000","last_unstale":"2023-10-06T05:26:27.078239+0000","last_undegraded":"2023-10-06T05:26:27.078239+0000","last_fullsized":"2023-10-06T05:26:27.078239+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.077426+0000","last_change":"2023-10-06T05:26:26.074226+0000","last_active":"2023-10-06T05:26:26.077426+0000","last_peered":"2023-10-06T05:26:26.077426+0000","last_clean":"2023-10-06T05:26:26.077426+0000","last_became_active":"2023-10-06T05:26:26.073937+0000","last_became_peered":"2023-10-06T05:26:26.073937+0000","last_unstale":"2023-10-06T05:26:26.077426+0000","last_undegraded":"2023-10-06T05:26:26.077426+0000","last_fullsized":"2023-10-06T05:26:26.077426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:25.436355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.065932+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:26:26.065932+0000","last_peered":"2023-10-06T05:26:26.065932+0000","last_clean":"2023-10-06T05:26:26.065932+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:26:26.065932+0000","last_undegraded":"2023-10-06T05:26:26.065932+0000","last_fullsized":"2023-10-06T05:26:26.065932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.086057+0000","last_change":"2023-10-06T05:26:27.086057+0000","last_active":"2023-10-06T05:26:27.086057+0000","last_peered":"2023-10-06T05:26:27.086057+0000","last_clean":"2023-10-06T05:26:27.086057+0000","last_became_active":"2023-10-06T05:26:27.085685+0000","last_became_peered":"2023-10-06T05:26:27.085685+0000","last_unstale":"2023-10-06T05:26:27.086057+0000","last_undegraded":"2023-10-06T05:26:27.086057+0000","last_fullsized":"2023-10-06T05:26:27.086057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:35.180880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.072585+0000","last_change":"2023-10-06T05:26:26.068954+0000","last_active":"2023-10-06T05:26:26.072585+0000","last_peered":"2023-10-06T05:26:26.072585+0000","last_clean":"2023-10-06T05:26:26.072585+0000","last_became_active":"2023-10-06T05:26:26.068629+0000","last_became_peered":"2023-10-06T05:26:26.068629+0000","last_unstale":"2023-10-06T05:26:26.072585+0000","last_undegraded":"2023-10-06T05:26:26.072585+0000","last_fullsized":"2023-10-06T05:26:26.072585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:48.272688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.066823+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:26:26.066823+0000","last_peered":"2023-10-06T05:26:26.066823+0000","last_clean":"2023-10-06T05:26:26.066823+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:26:26.066823+0000","last_undegraded":"2023-10-06T05:26:26.066823+0000","last_fullsized":"2023-10-06T05:26:26.066823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.070620+0000","last_change":"2023-10-06T05:26:27.070620+0000","last_active":"2023-10-06T05:26:27.070620+0000","last_peered":"2023-10-06T05:26:27.070620+0000","last_clean":"2023-10-06T05:26:27.070620+0000","last_became_active":"2023-10-06T05:26:27.070325+0000","last_became_peered":"2023-10-06T05:26:27.070325+0000","last_unstale":"2023-10-06T05:26:27.070620+0000","last_undegraded":"2023-10-06T05:26:27.070620+0000","last_fullsized":"2023-10-06T05:26:27.070620+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:15.006844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.074577+0000","last_change":"2023-10-06T05:26:26.073339+0000","last_active":"2023-10-06T05:26:26.074577+0000","last_peered":"2023-10-06T05:26:26.074577+0000","last_clean":"2023-10-06T05:26:26.074577+0000","last_became_active":"2023-10-06T05:26:26.073046+0000","last_became_peered":"2023-10-06T05:26:26.073046+0000","last_unstale":"2023-10-06T05:26:26.074577+0000","last_undegraded":"2023-10-06T05:26:26.074577+0000","last_fullsized":"2023-10-06T05:26:26.074577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:05.289719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.052362+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:26:26.052362+0000","last_peered":"2023-10-06T05:26:26.052362+0000","last_clean":"2023-10-06T05:26:26.052362+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:26:26.052362+0000","last_undegraded":"2023-10-06T05:26:26.052362+0000","last_fullsized":"2023-10-06T05:26:26.052362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.085874+0000","last_change":"2023-10-06T05:26:27.085874+0000","last_active":"2023-10-06T05:26:27.085874+0000","last_peered":"2023-10-06T05:26:27.085874+0000","last_clean":"2023-10-06T05:26:27.085874+0000","last_became_active":"2023-10-06T05:26:27.085552+0000","last_became_peered":"2023-10-06T05:26:27.085552+0000","last_unstale":"2023-10-06T05:26:27.085874+0000","last_undegraded":"2023-10-06T05:26:27.085874+0000","last_fullsized":"2023-10-06T05:26:27.085874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:57.105244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.079902+0000","last_change":"2023-10-06T05:26:26.071981+0000","last_active":"2023-10-06T05:26:26.079902+0000","last_peered":"2023-10-06T05:26:26.079902+0000","last_clean":"2023-10-06T05:26:26.079902+0000","last_became_active":"2023-10-06T05:26:26.071599+0000","last_became_peered":"2023-10-06T05:26:26.071599+0000","last_unstale":"2023-10-06T05:26:26.079902+0000","last_undegraded":"2023-10-06T05:26:26.079902+0000","last_fullsized":"2023-10-06T05:26:26.079902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:50.621519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.067538+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:26:26.067538+0000","last_peered":"2023-10-06T05:26:26.067538+0000","last_clean":"2023-10-06T05:26:26.067538+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:26:26.067538+0000","last_undegraded":"2023-10-06T05:26:26.067538+0000","last_fullsized":"2023-10-06T05:26:26.067538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T05:26:27.069986+0000","last_change":"2023-10-06T05:26:27.069986+0000","last_active":"2023-10-06T05:26:27.069986+0000","last_peered":"2023-10-06T05:26:27.069986+0000","last_clean":"2023-10-06T05:26:27.069986+0000","last_became_active":"2023-10-06T05:26:27.069715+0000","last_became_peered":"2023-10-06T05:26:27.069715+0000","last_unstale":"2023-10-06T05:26:27.069986+0000","last_undegraded":"2023-10-06T05:26:27.069986+0000","last_fullsized":"2023-10-06T05:26:27.069986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:26.034582+0000","last_clean_scrub_stamp":"2023-10-06T05:26:26.034582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:34.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.075280+0000","last_change":"2023-10-06T05:26:26.074106+0000","last_active":"2023-10-06T05:26:26.075280+0000","last_peered":"2023-10-06T05:26:26.075280+0000","last_clean":"2023-10-06T05:26:26.075280+0000","last_became_active":"2023-10-06T05:26:26.073812+0000","last_became_peered":"2023-10-06T05:26:26.073812+0000","last_unstale":"2023-10-06T05:26:26.075280+0000","last_undegraded":"2023-10-06T05:26:26.075280+0000","last_fullsized":"2023-10-06T05:26:26.075280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:26:25.021569+0000","last_clean_scrub_stamp":"2023-10-06T05:26:25.021569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:38.955730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T05:26:26.057560+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:26:26.057560+0000","last_peered":"2023-10-06T05:26:26.057560+0000","last_clean":"2023-10-06T05:26:26.057560+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:26:26.057560+0000","last_undegraded":"2023-10-06T05:26:26.057560+0000","last_fullsized":"2023-10-06T05:26:26.057560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":750312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":160498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":160056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297664,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074176,"statfs":{"total":96636764160,"available":96331956224,"internally_reserved":0,"allocated":385024,"data_stored":152828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070052,"statfs":{"total":96636764160,"available":96327733248,"internally_reserved":0,"allocated":413696,"data_stored":161514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301760,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070080,"statfs":{"total":96636764160,"available":96327761920,"internally_reserved":0,"allocated":385024,"data_stored":152828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.94199999999999995}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.88600000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.272},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.333}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301760,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070080,"statfs":{"total":96636764160,"available":96327761920,"internally_reserved":0,"allocated":385024,"data_stored":152828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302352,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069488,"statfs":{"total":96636764160,"available":96327155712,"internally_reserved":0,"allocated":991232,"data_stored":750312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:26:30.774 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T05:26:30.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T05:26:30.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.924+0000 7f7f1a697700 1 Processor -- start 2023-10-06T05:26:30.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.924+0000 7f7f1a697700 1 -- start start 2023-10-06T05:26:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.924+0000 7f7f1a697700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f14158c40 0x7f7f140d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.924+0000 7f7f1a697700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14159010 0x7f7f1406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.924+0000 7f7f1a697700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7f140ce320 0x7f7f140ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f140ced00 con 0x7f7f14158c40 2023-10-06T05:26:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f140cae30 con 0x7f7f140ce320 2023-10-06T05:26:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1406ba70 con 0x7f7f14159010 2023-10-06T05:26:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19695700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f14158c40 0x7f7f140d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19695700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f14158c40 0x7f7f140d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34496/0 (socket says 172.21.15.29:34496) 2023-10-06T05:26:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19695700 1 -- 172.21.15.29:0/3062013701 learned_addr learned my addr 172.21.15.29:0/3062013701 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19e96700 1 --2- 172.21.15.29:0/3062013701 >> v2:172.21.15.173:3300/0 conn(0x7f7f140ce320 0x7f7f140ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f18e94700 1 --2- 172.21.15.29:0/3062013701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14159010 0x7f7f1406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19695700 1 -- 172.21.15.29:0/3062013701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14159010 msgr2=0x7f7f1406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:30.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19695700 1 --2- 172.21.15.29:0/3062013701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14159010 0x7f7f1406aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19695700 1 -- 172.21.15.29:0/3062013701 >> v2:172.21.15.173:3300/0 conn(0x7f7f140ce320 msgr2=0x7f7f140ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:30.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19695700 1 --2- 172.21.15.29:0/3062013701 >> v2:172.21.15.173:3300/0 conn(0x7f7f140ce320 0x7f7f140ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19695700 1 -- 172.21.15.29:0/3062013701 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1406b1e0 con 0x7f7f14158c40 2023-10-06T05:26:30.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19e96700 1 --2- 172.21.15.29:0/3062013701 >> v2:172.21.15.173:3300/0 conn(0x7f7f140ce320 0x7f7f140ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:30.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f19695700 1 --2- 172.21.15.29:0/3062013701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14158c40 0x7f7f140d0570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7f1415dae0 tx=0x7f7f08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a85fa24b9ddf78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f07fff700 1 -- 172.21.15.29:0/3062013701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800b640 con 0x7f7f14158c40 2023-10-06T05:26:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f07fff700 1 -- 172.21.15.29:0/3062013701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800b7a0 con 0x7f7f14158c40 2023-10-06T05:26:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f07fff700 1 -- 172.21.15.29:0/3062013701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800bb60 con 0x7f7f14158c40 2023-10-06T05:26:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 -- 172.21.15.29:0/3062013701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14158c40 msgr2=0x7f7f140d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 --2- 172.21.15.29:0/3062013701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14158c40 0x7f7f140d0570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7f1415dae0 tx=0x7f7f08009250 comp rx=0 tx=0).stop 2023-10-06T05:26:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 -- 172.21.15.29:0/3062013701 shutdown_connections 2023-10-06T05:26:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 --2- 172.21.15.29:0/3062013701 >> v2:172.21.15.173:3300/0 conn(0x7f7f140ce320 0x7f7f140ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 --2- 172.21.15.29:0/3062013701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14159010 0x7f7f1406aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 --2- 172.21.15.29:0/3062013701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14158c40 0x7f7f140d0570 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 -- 172.21.15.29:0/3062013701 >> 172.21.15.29:0/3062013701 conn(0x7f7f140670a0 msgr2=0x7f7f140674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 -- 172.21.15.29:0/3062013701 shutdown_connections 2023-10-06T05:26:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.928+0000 7f7f1a697700 1 -- 172.21.15.29:0/3062013701 wait complete. 2023-10-06T05:26:30.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f1a697700 1 Processor -- start 2023-10-06T05:26:30.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f1a697700 1 -- start start 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f1a697700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f140ce320 0x7f7f1414b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f1a697700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14158c40 0x7f7f1415b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f1a697700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14159010 0x7f7f140c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f1a697700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1415b2c0 con 0x7f7f14159010 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f1a697700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1416dde0 con 0x7f7f140ce320 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f1a697700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1415a990 con 0x7f7f14158c40 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f19e96700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14159010 0x7f7f140c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f19e96700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14159010 0x7f7f140c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34502/0 (socket says 172.21.15.29:34502) 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f19e96700 1 -- 172.21.15.29:0/1665655542 learned_addr learned my addr 172.21.15.29:0/1665655542 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f18e94700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14158c40 0x7f7f1415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f19695700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f140ce320 0x7f7f1414b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f19e96700 1 -- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14158c40 msgr2=0x7f7f1415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f19e96700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14158c40 0x7f7f1415b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f19e96700 1 -- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f140ce320 msgr2=0x7f7f1414b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f19e96700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f140ce320 0x7f7f1414b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.932+0000 7f7f19e96700 1 -- 172.21.15.29:0/1665655542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c009a20 con 0x7f7f14159010 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f19e96700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14159010 0x7f7f140c91c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009fc0 tx=0x7f7f0c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f057fa700 1 -- 172.21.15.29:0/1665655542 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c00cbd0 con 0x7f7f14159010 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f057fa700 1 -- 172.21.15.29:0/1665655542 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c00f040 con 0x7f7f14159010 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f080094f0 con 0x7f7f14159010 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f057fa700 1 -- 172.21.15.29:0/1665655542 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c014480 con 0x7f7f14159010 2023-10-06T05:26:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1415af50 con 0x7f7f14159010 2023-10-06T05:26:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1415b470 con 0x7f7f14159010 2023-10-06T05:26:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f057fa700 1 -- 172.21.15.29:0/1665655542 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7f0c003020 con 0x7f7f14159010 2023-10-06T05:26:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f057fa700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7ef8060580 0x7f7ef8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f057fa700 1 -- 172.21.15.29:0/1665655542 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7f0c07d270 con 0x7f7f14159010 2023-10-06T05:26:30.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f19695700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7ef8060580 0x7f7ef8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:30.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.936+0000 7f7f19695700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7ef8060580 0x7f7ef8062a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7f1415dae0 tx=0x7f7f08017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:30.948+0000 7f7f057fa700 1 -- 172.21.15.29:0/1665655542 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7f1415b470 con 0x7f7f14159010 2023-10-06T05:26:31.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.164+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7f1404be00 con 0x7f7f14159010 2023-10-06T05:26:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.168+0000 7f7f057fa700 1 -- 172.21.15.29:0/1665655542 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7f0c04d700 con 0x7f7f14159010 2023-10-06T05:26:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7ef8060580 msgr2=0x7f7ef8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7ef8060580 0x7f7ef8062a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7f1415dae0 tx=0x7f7f08017000 comp rx=0 tx=0).stop 2023-10-06T05:26:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14159010 msgr2=0x7f7f140c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14159010 0x7f7f140c91c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009fc0 tx=0x7f7f0c00b040 comp rx=0 tx=0).stop 2023-10-06T05:26:31.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 shutdown_connections 2023-10-06T05:26:31.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f14159010 0x7f7f140c91c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f14158c40 0x7f7f1415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7ef8060580 0x7f7ef8062a30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 --2- 172.21.15.29:0/1665655542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f140ce320 0x7f7f1414b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 >> 172.21.15.29:0/1665655542 conn(0x7f7f140670a0 msgr2=0x7f7f140c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:31.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 shutdown_connections 2023-10-06T05:26:31.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.172+0000 7f7f1a697700 1 -- 172.21.15.29:0/1665655542 wait complete. 2023-10-06T05:26:31.179 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2023-10-06T05:26:31.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:31.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.292+0000 7f366ffff700 1 Processor -- start 2023-10-06T05:26:31.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.292+0000 7f366ffff700 1 -- start start 2023-10-06T05:26:31.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.292+0000 7f366ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f36700ab220 0x7f3670156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:31.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.292+0000 7f366ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36700c68b0 0x7f36700c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:31.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.292+0000 7f366ffff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367006a5b0 con 0x7f36701569f0 2023-10-06T05:26:31.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.292+0000 7f366ffff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700c7290 con 0x7f36700c68b0 2023-10-06T05:26:31.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.292+0000 7f366ffff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367015b0a0 con 0x7f36700ab220 2023-10-06T05:26:31.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36700c68b0 0x7f36700c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:31.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36700c68b0 0x7f36700c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34504/0 (socket says 172.21.15.29:34504) 2023-10-06T05:26:31.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366f7fe700 1 -- 172.21.15.29:0/200066565 learned_addr learned my addr 172.21.15.29:0/200066565 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366e7fc700 1 --2- 172.21.15.29:0/200066565 >> v2:172.21.15.173:3300/0 conn(0x7f36700ab220 0x7f3670156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366e7fc700 1 -- 172.21.15.29:0/200066565 >> v2:172.21.15.29:3300/0 conn(0x7f36700c68b0 msgr2=0x7f36700c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366e7fc700 1 --2- 172.21.15.29:0/200066565 >> v2:172.21.15.29:3300/0 conn(0x7f36700c68b0 0x7f36700c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366e7fc700 1 -- 172.21.15.29:0/200066565 >> v1:172.21.15.173:6789/0 conn(0x7f36701569f0 legacy=0x7f367015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366e7fc700 1 -- 172.21.15.29:0/200066565 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367015b380 con 0x7f36700ab220 2023-10-06T05:26:31.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366e7fc700 1 --2- 172.21.15.29:0/200066565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36700ab220 0x7f3670156dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f367015b960 tx=0x7f36600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3073f859d99c8d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:31.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366dffb700 1 -- 172.21.15.29:0/200066565 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660011630 con 0x7f36700ab220 2023-10-06T05:26:31.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366dffb700 1 -- 172.21.15.29:0/200066565 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3660011790 con 0x7f36700ab220 2023-10-06T05:26:31.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366dffb700 1 -- 172.21.15.29:0/200066565 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660011b30 con 0x7f36700ab220 2023-10-06T05:26:31.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366ffff700 1 -- 172.21.15.29:0/200066565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36700ab220 msgr2=0x7f3670156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366ffff700 1 --2- 172.21.15.29:0/200066565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36700ab220 0x7f3670156dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f367015b960 tx=0x7f36600091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366ffff700 1 -- 172.21.15.29:0/200066565 shutdown_connections 2023-10-06T05:26:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366ffff700 1 --2- 172.21.15.29:0/200066565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36700ab220 0x7f3670156dc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366ffff700 1 --2- 172.21.15.29:0/200066565 >> v2:172.21.15.29:3300/0 conn(0x7f36700c68b0 0x7f36700c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366ffff700 1 -- 172.21.15.29:0/200066565 >> 172.21.15.29:0/200066565 conn(0x7f36700670a0 msgr2=0x7f36700674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366ffff700 1 -- 172.21.15.29:0/200066565 shutdown_connections 2023-10-06T05:26:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.296+0000 7f366ffff700 1 -- 172.21.15.29:0/200066565 wait complete. 2023-10-06T05:26:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366ffff700 1 Processor -- start 2023-10-06T05:26:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366ffff700 1 -- start start 2023-10-06T05:26:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36700ab220 0x7f3670149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36700c68b0 0x7f36700c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36701569f0 0x7f36700c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36700ac350 con 0x7f36700ab220 2023-10-06T05:26:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366ffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36700acbf0 con 0x7f36701569f0 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367014a4b0 con 0x7f36700c68b0 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36700ab220 0x7f3670149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36700ab220 0x7f3670149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34520/0 (socket says 172.21.15.29:34520) 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366effd700 1 -- 172.21.15.29:0/1040261202 learned_addr learned my addr 172.21.15.29:0/1040261202 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366f7fe700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36701569f0 0x7f36700c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366e7fc700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36700c68b0 0x7f36700c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366effd700 1 -- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36700c68b0 msgr2=0x7f36700c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366effd700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36700c68b0 0x7f36700c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366effd700 1 -- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36701569f0 msgr2=0x7f36700c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366effd700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36701569f0 0x7f36700c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.300+0000 7f366effd700 1 -- 172.21.15.29:0/1040261202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3660009420 con 0x7f36700ab220 2023-10-06T05:26:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.304+0000 7f366effd700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36700ab220 0x7f3670149f70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f366400c5c0 tx=0x7f3664007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.304+0000 7f3656ffd700 1 -- 172.21.15.29:0/1040261202 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664011590 con 0x7f36700ab220 2023-10-06T05:26:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.304+0000 7f3656ffd700 1 -- 172.21.15.29:0/1040261202 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664011730 con 0x7f36700ab220 2023-10-06T05:26:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.304+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36700c5670 con 0x7f36700ab220 2023-10-06T05:26:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.304+0000 7f3656ffd700 1 -- 172.21.15.29:0/1040261202 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664011af0 con 0x7f36700ab220 2023-10-06T05:26:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.304+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36700ac880 con 0x7f36700ab220 2023-10-06T05:26:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.304+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367004be00 con 0x7f36700ab220 2023-10-06T05:26:31.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.308+0000 7f3656ffd700 1 -- 172.21.15.29:0/1040261202 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3664012420 con 0x7f36700ab220 2023-10-06T05:26:31.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.308+0000 7f3656ffd700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f365c060550 0x7f365c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:31.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.308+0000 7f3656ffd700 1 -- 172.21.15.29:0/1040261202 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f366407c2e0 con 0x7f36700ab220 2023-10-06T05:26:31.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.308+0000 7f366e7fc700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f365c060550 0x7f365c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:31.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.308+0000 7f366e7fc700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f365c060550 0x7f365c062a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f367015b960 tx=0x7f3660017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:31.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.312+0000 7f3656ffd700 1 -- 172.21.15.29:0/1040261202 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f366404c8a0 con 0x7f36700ab220 2023-10-06T05:26:31.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.504+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f367015b660 con 0x7f36700ab220 2023-10-06T05:26:31.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f3656ffd700 1 -- 172.21.15.29:0/1040261202 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f3664021090 con 0x7f36700ab220 2023-10-06T05:26:31.513 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:31.513 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3342279357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3342279357},{"type":"v1","addr":"172.21.15.173:6835","nonce":3342279357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2659141401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2659141401},{"type":"v1","addr":"172.21.15.173:6837","nonce":2659141401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/648720882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":648720882},{"type":"v1","addr":"172.21.15.29:6833","nonce":648720882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:26:26.407210+0000","modified":"2023-10-06T05:26:29.412409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/244763098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":244763098},{"type":"v1","addr":"172.21.15.29:6835","nonce":244763098}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T05:26:31.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f365c060550 msgr2=0x7f365c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:31.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f365c060550 0x7f365c062a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f367015b960 tx=0x7f3660017000 comp rx=0 tx=0).stop 2023-10-06T05:26:31.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36700ab220 msgr2=0x7f3670149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:31.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36700ab220 0x7f3670149f70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f366400c5c0 tx=0x7f3664007f30 comp rx=0 tx=0).stop 2023-10-06T05:26:31.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 shutdown_connections 2023-10-06T05:26:31.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f365c060550 0x7f365c062a00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36701569f0 0x7f36700c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36700c68b0 0x7f36700c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 --2- 172.21.15.29:0/1040261202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36700ab220 0x7f3670149f70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:31.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 >> 172.21.15.29:0/1040261202 conn(0x7f36700670a0 msgr2=0x7f36700c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:31.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 shutdown_connections 2023-10-06T05:26:31.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:31.508+0000 7f366ffff700 1 -- 172.21.15.29:0/1040261202 wait complete. 2023-10-06T05:26:31.516 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-10-06T05:26:31.929 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:26:26.407210+0000', 'modified': '2023-10-06T05:26:29.412409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5037}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5037': {'gid': 5037, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.29:6835/244763098', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 244763098}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 244763098}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:26:31.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T05:26:31.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T05:26:32.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.044+0000 7f27fd090700 1 Processor -- start 2023-10-06T05:26:32.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.044+0000 7f27fd090700 1 -- start start 2023-10-06T05:26:32.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f27f815e490 0x7f27f806b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f80cc8b0 con 0x7f27f815ace0 2023-10-06T05:26:32.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f806b280 con 0x7f27f80c9ea0 2023-10-06T05:26:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f806bc50 con 0x7f27f815e490 2023-10-06T05:26:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f27f815e490 0x7f27f806b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f27f815e490 0x7f27f806b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34536/0 (socket says 172.21.15.29:34536) 2023-10-06T05:26:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f7fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f27f815ace0 0x7f27f80cc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36562/0 (socket says 172.21.15.29:36562) 2023-10-06T05:26:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f77fe700 1 -- 172.21.15.29:0/280012229 learned_addr learned my addr 172.21.15.29:0/280012229 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:32.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f77fe700 1 -- 172.21.15.29:0/280012229 >> v1:172.21.15.173:6789/0 conn(0x7f27f80c9ea0 legacy=0x7f27f80ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f77fe700 1 -- 172.21.15.29:0/280012229 >> v1:172.21.15.29:6789/0 conn(0x7f27f815ace0 legacy=0x7f27f80cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f77fe700 1 -- 172.21.15.29:0/280012229 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f806a670 con 0x7f27f815e490 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f77fe700 1 --2- 172.21.15.29:0/280012229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 0x7f27f806b710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f27e00099b0 tx=0x7f27e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37458a5e9015740 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f6ffd700 1 -- 172.21.15.29:0/280012229 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000b860 con 0x7f27f815e490 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f6ffd700 1 -- 172.21.15.29:0/280012229 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e000b9c0 con 0x7f27f815e490 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27f6ffd700 1 -- 172.21.15.29:0/280012229 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000bd60 con 0x7f27f815e490 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 -- 172.21.15.29:0/280012229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 msgr2=0x7f27f806b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 --2- 172.21.15.29:0/280012229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 0x7f27f806b710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f27e00099b0 tx=0x7f27e0009250 comp rx=0 tx=0).stop 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 -- 172.21.15.29:0/280012229 shutdown_connections 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 --2- 172.21.15.29:0/280012229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 0x7f27f806b710 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 -- 172.21.15.29:0/280012229 >> 172.21.15.29:0/280012229 conn(0x7f27f80670a0 msgr2=0x7f27f8067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 -- 172.21.15.29:0/280012229 shutdown_connections 2023-10-06T05:26:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.048+0000 7f27fd090700 1 -- 172.21.15.29:0/280012229 wait complete. 2023-10-06T05:26:32.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.052+0000 7f27fd090700 1 Processor -- start 2023-10-06T05:26:32.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.052+0000 7f27fd090700 1 -- start start 2023-10-06T05:26:32.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.052+0000 7f27fd090700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f80c9ea0 0x7f27f80b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fd090700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f815ace0 0x7f27f8159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fd090700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 0x7f27f8159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fd090700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f816dea0 con 0x7f27f815e490 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fd090700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80b1660 con 0x7f27f815ace0 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fd090700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f816d850 con 0x7f27f80c9ea0 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fc88f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 0x7f27f8159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fc88f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 0x7f27f8159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34546/0 (socket says 172.21.15.29:34546) 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fc88f700 1 -- 172.21.15.29:0/2149381557 learned_addr learned my addr 172.21.15.29:0/2149381557 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f80c9ea0 0x7f27f80b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27f77fe700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f815ace0 0x7f27f8159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fc88f700 1 -- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f80c9ea0 msgr2=0x7f27f80b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fc88f700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f80c9ea0 0x7f27f80b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fc88f700 1 -- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f815ace0 msgr2=0x7f27f8159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fc88f700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f815ace0 0x7f27f8159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fc88f700 1 -- 172.21.15.29:0/2149381557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e00094f0 con 0x7f27f815e490 2023-10-06T05:26:32.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fc88f700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 0x7f27f8159db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c560 tx=0x7f27f0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27effff700 1 -- 172.21.15.29:0/2149381557 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011590 con 0x7f27f815e490 2023-10-06T05:26:32.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27effff700 1 -- 172.21.15.29:0/2149381557 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f00116f0 con 0x7f27f815e490 2023-10-06T05:26:32.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fd090700 1 -- 172.21.15.29:0/2149381557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f816db30 con 0x7f27f815e490 2023-10-06T05:26:32.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27effff700 1 -- 172.21.15.29:0/2149381557 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011ab0 con 0x7f27f815e490 2023-10-06T05:26:32.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.056+0000 7f27fd090700 1 -- 172.21.15.29:0/2149381557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f816e330 con 0x7f27f815e490 2023-10-06T05:26:32.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.060+0000 7f27effff700 1 -- 172.21.15.29:0/2149381557 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f27f001b3b0 con 0x7f27f815e490 2023-10-06T05:26:32.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.060+0000 7f27effff700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f27d8060580 0x7f27d8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.060+0000 7f27effff700 1 -- 172.21.15.29:0/2149381557 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f27f007bd70 con 0x7f27f815e490 2023-10-06T05:26:32.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.060+0000 7f27f7fff700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f27d8060580 0x7f27d8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.060+0000 7f27f7fff700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f27d8060580 0x7f27d8062a30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f27f80c72d0 tx=0x7f27e8001ad0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.060+0000 7f280059b740 1 Processor -- start 2023-10-06T05:26:32.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.060+0000 7f280059b740 1 -- start start 2023-10-06T05:26:32.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ce710 0x1c4bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c4c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b79f30 con 0x19ceae0 2023-10-06T05:26:32.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b75ed0 con 0x1a19790 2023-10-06T05:26:32.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b3c0b0 con 0x19ce710 2023-10-06T05:26:32.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f77fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ce710 0x1c4bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f77fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ce710 0x1c4bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:33810/0 (socket says 172.21.15.29:33810) 2023-10-06T05:26:32.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27fc88f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c4c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34562/0 (socket says 172.21.15.29:34562) 2023-10-06T05:26:32.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f77fe700 1 -- 172.21.15.29:0/3599658616 learned_addr learned my addr 172.21.15.29:0/3599658616 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:32.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f77fe700 1 -- 172.21.15.29:0/3599658616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 msgr2=0x1c4c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:32.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f77fe700 1 --2- 172.21.15.29:0/3599658616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c4c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f77fe700 1 -- 172.21.15.29:0/3599658616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 msgr2=0x1c4b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:32.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f77fe700 1 --2- 172.21.15.29:0/3599658616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f77fe700 1 -- 172.21.15.29:0/3599658616 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a1a9e0 con 0x19ce710 2023-10-06T05:26:32.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27f77fe700 1 --2- 172.21.15.29:0/3599658616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ce710 0x1c4bb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f27f80697b0 tx=0x7f27e0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ff8733400cc487 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27ed7fa700 1 -- 172.21.15.29:0/3599658616 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0021070 con 0x19ce710 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27ed7fa700 1 -- 172.21.15.29:0/3599658616 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0000bc0 con 0x19ce710 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f27ed7fa700 1 -- 172.21.15.29:0/3599658616 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000bb30 con 0x19ce710 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 -- 172.21.15.29:0/3599658616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ce710 msgr2=0x1c4bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 --2- 172.21.15.29:0/3599658616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ce710 0x1c4bb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f27f80697b0 tx=0x7f27e0017000 comp rx=0 tx=0).stop 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 -- 172.21.15.29:0/3599658616 shutdown_connections 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 --2- 172.21.15.29:0/3599658616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c4c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 --2- 172.21.15.29:0/3599658616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ce710 0x1c4bb70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 --2- 172.21.15.29:0/3599658616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 -- 172.21.15.29:0/3599658616 >> 172.21.15.29:0/3599658616 conn(0x19ceeb0 msgr2=0x1c08060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:32.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 -- 172.21.15.29:0/3599658616 shutdown_connections 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.064+0000 7f280059b740 1 -- 172.21.15.29:0/3599658616 wait complete. 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 -- start start 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 Processor -- start 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1c4fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 0x1c50180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c05c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b3bd50 con 0x19ce710 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b14970 con 0x1a19790 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b27550 con 0x19ceae0 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 10 client.0 _ll_register_callbacks cb 0x1b18b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:26:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1c4fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1c4fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34572/0 (socket says 172.21.15.29:34572) 2023-10-06T05:26:32.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f7fff700 1 -- 172.21.15.29:0/97861122 learned_addr learned my addr 172.21.15.29:0/97861122 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:32.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f77fe700 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 0x1c50180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27fc88f700 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c05c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f7fff700 1 -- 172.21.15.29:0/97861122 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 msgr2=0x1c50180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:32.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f7fff700 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 0x1c50180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f7fff700 1 -- 172.21.15.29:0/97861122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 msgr2=0x1c05c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f7fff700 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c05c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f7fff700 1 -- 172.21.15.29:0/97861122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f806a670 con 0x19ce710 2023-10-06T05:26:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27f7fff700 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1c4fc40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f27e8013ee0 tx=0x7f27e8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93f33fd63e28afc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27d67fc700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:26:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27d67fc700 1 -- 172.21.15.29:0/97861122 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8007a00 con 0x19ce710 2023-10-06T05:26:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27d67fc700 1 -- 172.21.15.29:0/97861122 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f27e801b070 con 0x19ce710 2023-10-06T05:26:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 -- 172.21.15.29:0/97861122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b14cc0 con 0x19ce710 2023-10-06T05:26:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27d67fc700 1 -- 172.21.15.29:0/97861122 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27e8012c00 con 0x19ce710 2023-10-06T05:26:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 10 client.5217 fetch_fsmap learned FSMap version 13 2023-10-06T05:26:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 -- 172.21.15.29:0/97861122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x1b44370 con 0x19ce710 2023-10-06T05:26:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27d67fc700 1 -- 172.21.15.29:0/97861122 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b14cc0 con 0x19ce710 2023-10-06T05:26:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f27d67fc700 1 -- 172.21.15.29:0/97861122 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 13) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f27e8021410 con 0x19ce710 2023-10-06T05:26:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 10 client.5217 fetch_fsmap finished waiting for FSMap version 13 2023-10-06T05:26:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 10 client.5217 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T05:26:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 20 client.5217 populate_metadata read hostname 'smithi029' 2023-10-06T05:26:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] conn(0x1c07280 0x1c5ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 4 client.5217 mds_command: new command op to 5037 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:26:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.068+0000 7f280059b740 1 -- 172.21.15.29:0/97861122 --> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b183e0 con 0x1c07280 2023-10-06T05:26:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f27f77fe700 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] conn(0x1c07280 0x1c5ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f27d67fc700 10 client.5217 ms_handle_connect on v2:172.21.15.29:6834/244763098 2023-10-06T05:26:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f27f77fe700 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] conn(0x1c07280 0x1c5ade0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1024d2a602702832 server_cookie=4920d4e0f0708e3 in_seq=0 out_seq=0 2023-10-06T05:26:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f27d67fc700 1 -- 172.21.15.29:0/97861122 <== mds.0 v2:172.21.15.29:6834/244763098 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1b183e0 con 0x1c07280 2023-10-06T05:26:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f27d67fc700 10 client.5217 handle_command_reply: tid=0 2023-10-06T05:26:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 client.5217 shutdown 2023-10-06T05:26:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 -- 172.21.15.29:0/97861122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 msgr2=0x1c4fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1c4fc40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f27e8013ee0 tx=0x7f27e8014000 comp rx=0 tx=0).stop 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 -- 172.21.15.29:0/97861122 shutdown_connections 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] conn(0x1c07280 0x1c5ade0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c05c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 0x1c50180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 --2- 172.21.15.29:0/97861122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1c4fc40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f27d67fc700 0 client.5217 ms_handle_reset on v2:172.21.15.29:6834/244763098 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 -- 172.21.15.29:0/97861122 >> 172.21.15.29:0/97861122 conn(0x19ceeb0 msgr2=0x1c2f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 -- 172.21.15.29:0/97861122 shutdown_connections 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 1 -- 172.21.15.29:0/97861122 wait complete. 2023-10-06T05:26:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.072+0000 7f280059b740 20 client.5217 trim_cache size 0 max 16384 2023-10-06T05:26:32.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 Processor -- start 2023-10-06T05:26:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 -- start start 2023-10-06T05:26:32.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19ce710 0x1c4e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a19790 0x1c5bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b580d0 con 0x19ceae0 2023-10-06T05:26:32.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b72150 con 0x19ce710 2023-10-06T05:26:32.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b3dbe0 con 0x1a19790 2023-10-06T05:26:32.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19ce710 0x1c4e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27fc88f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a19790 0x1c5bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19ce710 0x1c4e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:41930/0 (socket says 172.21.15.29:41930) 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f7fff700 1 -- 172.21.15.29:0/3531625576 learned_addr learned my addr 172.21.15.29:0/3531625576 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f77fe700 1 --2- 172.21.15.29:0/3531625576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34580/0 (socket says 172.21.15.29:34580) 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f7fff700 1 -- 172.21.15.29:0/3531625576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a19790 msgr2=0x1c5bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f7fff700 1 --2- 172.21.15.29:0/3531625576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a19790 0x1c5bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f7fff700 1 -- 172.21.15.29:0/3531625576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 msgr2=0x1c4ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f7fff700 1 --2- 172.21.15.29:0/3531625576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f7fff700 1 -- 172.21.15.29:0/3531625576 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80af820 con 0x19ce710 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f77fe700 1 --2- 172.21.15.29:0/3531625576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27f7fff700 1 --2- 172.21.15.29:0/3531625576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19ce710 0x1c4e500 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f27e802c040 tx=0x7f27e8015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a31771be273aa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27edffb700 1 -- 172.21.15.29:0/3531625576 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8012630 con 0x19ce710 2023-10-06T05:26:32.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27edffb700 1 -- 172.21.15.29:0/3531625576 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e800b030 con 0x19ce710 2023-10-06T05:26:32.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f27edffb700 1 -- 172.21.15.29:0/3531625576 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8021970 con 0x19ce710 2023-10-06T05:26:32.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 -- 172.21.15.29:0/3531625576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19ce710 msgr2=0x1c4e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.096+0000 7f280059b740 1 --2- 172.21.15.29:0/3531625576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19ce710 0x1c4e500 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f27e802c040 tx=0x7f27e8015000 comp rx=0 tx=0).stop 2023-10-06T05:26:32.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- 172.21.15.29:0/3531625576 shutdown_connections 2023-10-06T05:26:32.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 --2- 172.21.15.29:0/3531625576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a19790 0x1c5bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 --2- 172.21.15.29:0/3531625576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ceae0 0x1c4ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 --2- 172.21.15.29:0/3531625576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19ce710 0x1c4e500 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- 172.21.15.29:0/3531625576 >> 172.21.15.29:0/3531625576 conn(0x19ceeb0 msgr2=0x1c07ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- 172.21.15.29:0/3531625576 shutdown_connections 2023-10-06T05:26:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- 172.21.15.29:0/3531625576 wait complete. 2023-10-06T05:26:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- start start 2023-10-06T05:26:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 Processor -- start 2023-10-06T05:26:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1ca4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 0x1ca5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b78e70 con 0x19ce710 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bcc270 con 0x1a19790 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b719b0 con 0x19ceae0 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 10 client.0 _ll_register_callbacks cb 0x1b41110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1ca4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1ca4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34586/0 (socket says 172.21.15.29:34586) 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f7fff700 1 -- 172.21.15.29:0/1962888663 learned_addr learned my addr 172.21.15.29:0/1962888663 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27fc88f700 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f77fe700 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 0x1ca5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f7fff700 1 -- 172.21.15.29:0/1962888663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 msgr2=0x1ca5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f7fff700 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 0x1ca5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f7fff700 1 -- 172.21.15.29:0/1962888663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 msgr2=0x1c290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f7fff700 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c290c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f7fff700 1 -- 172.21.15.29:0/1962888663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1a1a9e0 con 0x19ce710 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27fc88f700 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27f7fff700 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1ca4c00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x1b7c1d0 tx=0x7f27e8035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9852b6fb5b8dfefd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27d67fc700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27d67fc700 1 -- 172.21.15.29:0/1962888663 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8040070 con 0x19ce710 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27d67fc700 1 -- 172.21.15.29:0/1962888663 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f27e8012e10 con 0x19ce710 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- 172.21.15.29:0/1962888663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27e0000bc0 con 0x19ce710 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27d67fc700 1 -- 172.21.15.29:0/1962888663 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27e80219d0 con 0x19ce710 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 10 client.5223 fetch_fsmap learned FSMap version 13 2023-10-06T05:26:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 -- 172.21.15.29:0/1962888663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x1b44370 con 0x19ce710 2023-10-06T05:26:32.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27d67fc700 1 -- 172.21.15.29:0/1962888663 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0000bc0 con 0x19ce710 2023-10-06T05:26:32.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f27d67fc700 1 -- 172.21.15.29:0/1962888663 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 13) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f27e8043030 con 0x19ce710 2023-10-06T05:26:32.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 10 client.5223 fetch_fsmap finished waiting for FSMap version 13 2023-10-06T05:26:32.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 10 client.5223 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T05:26:32.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 20 client.5223 populate_metadata read hostname 'smithi029' 2023-10-06T05:26:32.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.100+0000 7f280059b740 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] conn(0x1c29a20 0x1c29df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 4 client.5223 mds_command: new command op to 5037 tid=0[{"prefix": "status"}] 2023-10-06T05:26:32.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 -- 172.21.15.29:0/1962888663 --> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1b4a410 con 0x1c29a20 2023-10-06T05:26:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27f77fe700 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] conn(0x1c29a20 0x1c29df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27d67fc700 10 client.5223 ms_handle_connect on v2:172.21.15.29:6834/244763098 2023-10-06T05:26:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27f77fe700 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] conn(0x1c29a20 0x1c29df0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a19646751b80efc2 server_cookie=f74f9e78bb1f89cb in_seq=0 out_seq=0 2023-10-06T05:26:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27d67fc700 1 -- 172.21.15.29:0/1962888663 <== mds.0 v2:172.21.15.29:6834/244763098 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1b4a410 con 0x1c29a20 2023-10-06T05:26:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27d67fc700 10 client.5223 handle_command_reply: tid=0 2023-10-06T05:26:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 client.5223 shutdown 2023-10-06T05:26:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 -- 172.21.15.29:0/1962888663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 msgr2=0x1ca4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1ca4c00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x1b7c1d0 tx=0x7f27e8035040 comp rx=0 tx=0).stop 2023-10-06T05:26:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 -- 172.21.15.29:0/1962888663 shutdown_connections 2023-10-06T05:26:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.29:6834/244763098,v1:172.21.15.29:6835/244763098] conn(0x1c29a20 0x1c29df0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a19790 0x1c290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19ceae0 0x1ca5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 --2- 172.21.15.29:0/1962888663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19ce710 0x1ca4c00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 -- 172.21.15.29:0/1962888663 >> 172.21.15.29:0/1962888663 conn(0x19ceeb0 msgr2=0x1c4e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27d67fc700 0 client.5223 ms_handle_reset on v2:172.21.15.29:6834/244763098 2023-10-06T05:26:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 -- 172.21.15.29:0/1962888663 shutdown_connections 2023-10-06T05:26:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 1 -- 172.21.15.29:0/1962888663 wait complete. 2023-10-06T05:26:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f280059b740 20 client.5223 trim_cache size 0 max 16384 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "bd99696d-d9bf-47c8-93f5-f978334ae590", 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5037, 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 4.6977608630000001, 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 13, 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 36, 2023-10-06T05:26:32.117 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 36, 2023-10-06T05:26:32.118 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 12.927595498000001 2023-10-06T05:26:32.118 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 -- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f27d8060580 msgr2=0x7f27d8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f27d8060580 0x7f27d8062a30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f27f80c72d0 tx=0x7f27e8001ad0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 -- 172.21.15.29:0/2149381557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 msgr2=0x7f27f8159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 0x7f27f8159db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c560 tx=0x7f27f0007ef0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 -- 172.21.15.29:0/2149381557 shutdown_connections 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27f815e490 0x7f27f8159db0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f27d8060580 0x7f27d8062a30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f815ace0 0x7f27f8159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 --2- 172.21.15.29:0/2149381557 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f80c9ea0 0x7f27f80b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 -- 172.21.15.29:0/2149381557 >> 172.21.15.29:0/2149381557 conn(0x7f27f80670a0 msgr2=0x7f27f80c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 -- 172.21.15.29:0/2149381557 shutdown_connections 2023-10-06T05:26:32.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.104+0000 7f27fd090700 1 -- 172.21.15.29:0/2149381557 wait complete. 2023-10-06T05:26:32.129 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:26:32.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.236+0000 7fa2b1376700 1 Processor -- start 2023-10-06T05:26:32.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.236+0000 7fa2b1376700 1 -- start start 2023-10-06T05:26:32.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.236+0000 7fa2b1376700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2ac158bd0 0x7fa2ac158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.236+0000 7fa2b1376700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac0c7090 con 0x7fa2ac06b720 2023-10-06T05:26:32.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.236+0000 7fa2b1376700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac06bc80 con 0x7fa2ac06b2a0 2023-10-06T05:26:32.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.236+0000 7fa2b1376700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac06bf60 con 0x7fa2ac158bd0 2023-10-06T05:26:32.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.236+0000 7fa2b0b75700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa2ac06b720 0x7fa2ac0c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36576/0 (socket says 172.21.15.29:36576) 2023-10-06T05:26:32.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.236+0000 7fa2b0b75700 1 -- 172.21.15.29:0/3991929529 learned_addr learned my addr 172.21.15.29:0/3991929529 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:32.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.236+0000 7fa2abfff700 1 --2- 172.21.15.29:0/3991929529 >> v2:172.21.15.29:3300/0 conn(0x7fa2ac158bd0 0x7fa2ac158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2aaffd700 1 -- 172.21.15.29:0/3991929529 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579976853 0 0) 0x7fa2ac0c7090 con 0x7fa2ac06b720 2023-10-06T05:26:32.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2aaffd700 1 -- 172.21.15.29:0/3991929529 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa298003570 con 0x7fa2ac06b720 2023-10-06T05:26:32.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2aaffd700 1 -- 172.21.15.29:0/3991929529 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100485897 0 0) 0x7fa2ac06bc80 con 0x7fa2ac06b2a0 2023-10-06T05:26:32.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2aaffd700 1 -- 172.21.15.29:0/3991929529 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2ac0c7090 con 0x7fa2ac06b2a0 2023-10-06T05:26:32.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2abfff700 1 -- 172.21.15.29:0/3991929529 >> v1:172.21.15.173:6789/0 conn(0x7fa2ac06b2a0 legacy=0x7fa2ac0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2abfff700 1 -- 172.21.15.29:0/3991929529 >> v1:172.21.15.29:6789/0 conn(0x7fa2ac06b720 legacy=0x7fa2ac0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2abfff700 1 -- 172.21.15.29:0/3991929529 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0c7300 con 0x7fa2ac158bd0 2023-10-06T05:26:32.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2abfff700 1 --2- 172.21.15.29:0/3991929529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 0x7fa2ac158fa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa2940098e0 tx=0x7fa2940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b3efdbc3c36022 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2aaffd700 1 -- 172.21.15.29:0/3991929529 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294011630 con 0x7fa2ac158bd0 2023-10-06T05:26:32.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2aaffd700 1 -- 172.21.15.29:0/3991929529 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294011790 con 0x7fa2ac158bd0 2023-10-06T05:26:32.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2aaffd700 1 -- 172.21.15.29:0/3991929529 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294011b10 con 0x7fa2ac158bd0 2023-10-06T05:26:32.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2b1376700 1 -- 172.21.15.29:0/3991929529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 msgr2=0x7fa2ac158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2b1376700 1 --2- 172.21.15.29:0/3991929529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 0x7fa2ac158fa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa2940098e0 tx=0x7fa2940091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2b1376700 1 -- 172.21.15.29:0/3991929529 shutdown_connections 2023-10-06T05:26:32.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2b1376700 1 --2- 172.21.15.29:0/3991929529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 0x7fa2ac158fa0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2b1376700 1 -- 172.21.15.29:0/3991929529 >> 172.21.15.29:0/3991929529 conn(0x7fa2ac06d7d0 msgr2=0x7fa2ac06dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:32.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2b1376700 1 -- 172.21.15.29:0/3991929529 shutdown_connections 2023-10-06T05:26:32.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.240+0000 7fa2b1376700 1 -- 172.21.15.29:0/3991929529 wait complete. 2023-10-06T05:26:32.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b1376700 1 Processor -- start 2023-10-06T05:26:32.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b1376700 1 -- start start 2023-10-06T05:26:32.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b1376700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2ac06b2a0 0x7fa2ac155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b1376700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac06b720 0x7fa2ac0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b1376700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 0x7fa2ac0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b1376700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1598e0 con 0x7fa2ac158bd0 2023-10-06T05:26:32.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b1376700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c4790 con 0x7fa2ac06b720 2023-10-06T05:26:32.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b1376700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c4a70 con 0x7fa2ac06b2a0 2023-10-06T05:26:32.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b0b75700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 0x7fa2ac0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b0b75700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 0x7fa2ac0c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34592/0 (socket says 172.21.15.29:34592) 2023-10-06T05:26:32.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b0b75700 1 -- 172.21.15.29:0/1825848760 learned_addr learned my addr 172.21.15.29:0/1825848760 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:32.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2abfff700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2ac06b2a0 0x7fa2ac155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2ab7fe700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac06b720 0x7fa2ac0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b0b75700 1 -- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2ac06b2a0 msgr2=0x7fa2ac155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b0b75700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2ac06b2a0 0x7fa2ac155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b0b75700 1 -- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac06b720 msgr2=0x7fa2ac0c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b0b75700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac06b720 0x7fa2ac0c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b0b75700 1 -- 172.21.15.29:0/1825848760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009420 con 0x7fa2ac158bd0 2023-10-06T05:26:32.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2abfff700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2ac06b2a0 0x7fa2ac155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:32.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b0b75700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 0x7fa2ac0c5dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40010e0 tx=0x7fa2a4007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2a3fff700 1 -- 172.21.15.29:0/1825848760 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4005c00 con 0x7fa2ac158bd0 2023-10-06T05:26:32.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2a3fff700 1 -- 172.21.15.29:0/1825848760 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a4005d60 con 0x7fa2ac158bd0 2023-10-06T05:26:32.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac0c4d50 con 0x7fa2ac158bd0 2023-10-06T05:26:32.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.244+0000 7fa2a3fff700 1 -- 172.21.15.29:0/1825848760 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40072e0 con 0x7fa2ac158bd0 2023-10-06T05:26:32.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.248+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac155860 con 0x7fa2ac158bd0 2023-10-06T05:26:32.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.248+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac159a50 con 0x7fa2ac158bd0 2023-10-06T05:26:32.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.248+0000 7fa2a3fff700 1 -- 172.21.15.29:0/1825848760 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa2a4012400 con 0x7fa2ac158bd0 2023-10-06T05:26:32.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.248+0000 7fa2a3fff700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa28c060580 0x7fa28c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:32.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.248+0000 7fa2a3fff700 1 -- 172.21.15.29:0/1825848760 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa2a407c450 con 0x7fa2ac158bd0 2023-10-06T05:26:32.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.248+0000 7fa2abfff700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa28c060580 0x7fa28c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:32.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.252+0000 7fa2abfff700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa28c060580 0x7fa28c062a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa2940091e0 tx=0x7fa294016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:32.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.256+0000 7fa2a3fff700 1 -- 172.21.15.29:0/1825848760 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2a404c980 con 0x7fa2ac158bd0 2023-10-06T05:26:32.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2ac04be00 con 0x7fa2ac158bd0 2023-10-06T05:26:32.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2a3fff700 1 -- 172.21.15.29:0/1825848760 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa2a4017070 con 0x7fa2ac158bd0 2023-10-06T05:26:32.461 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa28c060580 msgr2=0x7fa28c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa28c060580 0x7fa28c062a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa2940091e0 tx=0x7fa294016000 comp rx=0 tx=0).stop 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 msgr2=0x7fa2ac0c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 0x7fa2ac0c5dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40010e0 tx=0x7fa2a4007dd0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 shutdown_connections 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2ac158bd0 0x7fa2ac0c5dd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa28c060580 0x7fa28c062a30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2ac06b720 0x7fa2ac0c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 --2- 172.21.15.29:0/1825848760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2ac06b2a0 0x7fa2ac155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 >> 172.21.15.29:0/1825848760 conn(0x7fa2ac06d7d0 msgr2=0x7fa2ac0ae180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:32.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 shutdown_connections 2023-10-06T05:26:32.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:32.456+0000 7fa2b1376700 1 -- 172.21.15.29:0/1825848760 wait complete. 2023-10-06T05:26:32.476 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:26:32.476 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:26:32.476 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:26:32.477 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T05:26:32.477 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:32.477 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:26:32.477 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:26:32.477 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:26:32.477 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:26:32.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:32.478 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:26:32.484 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:26:32.484 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:26:32.484 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:26:32.484 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:32.484 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:26:32.484 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:32.485 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:26:32.485 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:32.485 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:26:32.485 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:32.485 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:26:32.486 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:32.486 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:26:32.486 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42535sec preferred_lft 42535sec 2023-10-06T05:26:32.486 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:26:32.487 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:32.487 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:26:32.487 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:32.487 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:26:32.487 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::38dc:3fff:fed0:feb0/64 scope link 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c88:ceff:fe77:b613/64 scope link 2023-10-06T05:26:32.488 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:32.489 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:26:32.489 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether aa:ad:a4:57:7d:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:26:32.489 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a8ad:a4ff:fe57:7d6d/64 scope link 2023-10-06T05:26:32.489 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:26:32.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:32.489 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:26:32.505 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:26:32.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:32.507 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:26:32.559 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:26:32.559 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:26:32.559 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:26:32.559 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:26:32.559 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:26:32.560 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:26:32.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:32.560 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:26:32.560 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:26:32.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:26:32.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:26:32.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:26:32.561 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:26:32.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:32.601 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:26:32.651 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T05:26:32.651 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:26:32.651 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:26:32.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:32.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-06T05:26:32.664 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T05:26:32.664 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:26:32.664 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:32.672 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:26:32.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:26:32.672 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:32.722 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:26:32.739 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:26:32.739 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:26:32.756 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:26:32.757 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:26:32.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:32.757 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:26:32.763 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:26:32.764 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T05:26:32.766 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:26:32.781 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:26:32.781 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:26:32.836 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:26:32.837 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:26:32.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:32.837 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:26:32.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2023-10-06T05:26:32.844+0000 7eff9b33b380 -1 init, newargv = 0x555fb04eed40 newargc=15 2023-10-06T05:26:32.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[42508]: starting ceph client 2023-10-06T05:26:32.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[42508]: starting fuse 2023-10-06T05:26:33.944 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:26:33.964 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:26:33.964 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:26:34.023 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:26:34.024 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:26:34.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.025 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:26:34.029 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:26:34.029 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:26:34.030 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:26:34.031 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:26:34.032 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:26:34.032 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:34.032 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2023-10-06T05:26:34.032 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:26:34.121 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.42508.asok 2023-10-06T05:26:34.303 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42508.asok 2023-10-06T05:26:34.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.303 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42508.asok status 2023-10-06T05:26:34.448 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "42508", 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:34.449 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5241, 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 5241 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 439729335 2023-10-06T05:26:34.450 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 439729335 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.5241 192.168.0.1:0/439729335", 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/439729335", 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 13, 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 36, 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:26:34.451 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:26:34.452 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:26:34.452 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:26:34.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.458 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:26:34.458 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:34.467 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:26:34.467 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:34.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.467 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:34.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.479 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2023-10-06T05:26:34.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.540 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2023-10-06T05:26:34.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.553 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2023-10-06T05:26:34.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.567 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2023-10-06T05:26:34.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.630 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2023-10-06T05:26:34.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:26:34.642 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T05:26:34.670 INFO:teuthology.orchestra.run.smithi029.stdout:./ 2023-10-06T05:26:34.671 INFO:teuthology.orchestra.run.smithi029.stdout:./rfile 2023-10-06T05:26:34.671 INFO:teuthology.orchestra.run.smithi029.stdout:./parentdir 2023-10-06T05:26:34.671 INFO:teuthology.orchestra.run.smithi029.stdout:./parentdir/pfile 2023-10-06T05:26:34.671 INFO:teuthology.orchestra.run.smithi029.stdout:./parentdir/childdir 2023-10-06T05:26:34.671 INFO:teuthology.orchestra.run.smithi029.stdout:./parentdir/childdir/cfile 2023-10-06T05:26:34.672 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:26:34.672 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:26:34.672 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:26:34.672 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:34.672 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T05:26:34.672 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:26:34.741 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:26:34.931 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:26:34.931 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:26:34.931 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:26:34.931 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:34.931 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2023-10-06T05:26:34.931 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:26:35.001 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627778 2023-10-06T05:26:35.191 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:26:35.191 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:26:35.191 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:26:35.191 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:35.192 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2023-10-06T05:26:35.192 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:26:35.300 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627776 2023-10-06T05:26:35.488 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:26:35.489 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:26:35.489 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:26:35.489 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:35.489 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2023-10-06T05:26:35.489 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:26:35.561 INFO:teuthology.orchestra.run.smithi029.stdout:1099511628279 2023-10-06T05:26:35.750 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:26:35.750 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:26:35.750 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:26:35.750 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:35.750 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2023-10-06T05:26:35.750 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:26:35.821 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627777 2023-10-06T05:26:36.009 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:26:36.009 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:26:36.009 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:26:36.009 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:26:36.009 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2023-10-06T05:26:36.009 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:26:36.079 INFO:teuthology.orchestra.run.smithi029.stdout:1099511628280 2023-10-06T05:26:36.267 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:26:36.268 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:26:36.268 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T05:26:36.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[42508]: fuse finished with error 0 and tester_r 0 2023-10-06T05:26:36.281 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:26:39.984 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:26:39.987 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:26:42.382 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:26:42.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:42.382 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:26:42.391 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf3fff700 1 Processor -- start 2023-10-06T05:26:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf3fff700 1 -- start start 2023-10-06T05:26:42.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf41607e0 0x7efcf406b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf3fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40c6a40 con 0x7efcf40ca440 2023-10-06T05:26:42.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf3fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40c89f0 con 0x7efcf4160410 2023-10-06T05:26:42.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf3fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4160c80 con 0x7efcf41607e0 2023-10-06T05:26:42.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf27fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efcf40ca440 0x7efcf40c6ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57172/0 (socket says 172.21.15.29:57172) 2023-10-06T05:26:42.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf27fc700 1 -- 172.21.15.29:0/3012695897 learned_addr learned my addr 172.21.15.29:0/3012695897 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:42.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf37fe700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf41607e0 0x7efcf406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066491275 0 0) 0x7efcf40c6a40 con 0x7efcf40ca440 2023-10-06T05:26:42.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcdc003570 con 0x7efcf40ca440 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 931374313 0 0) 0x7efcdc003570 con 0x7efcf40ca440 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf41607e0 msgr2=0x7efcf406b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf1ffb700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf41607e0 0x7efcf406b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 >> v1:172.21.15.173:6789/0 conn(0x7efcf4160410 legacy=0x7efcf40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40c8cd0 con 0x7efcf40ca440 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.500+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7efce4001470 con 0x7efcf40ca440 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 >> v1:172.21.15.29:6789/0 conn(0x7efcf40ca440 legacy=0x7efcf40c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf41607e0 0x7efcdc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc004d50 0x7efcdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc00bb10 con 0x7efcdc003fd0 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc00bc80 con 0x7efcdc004d50 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc00be40 con 0x7efcf41607e0 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf27fc700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf37fe700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc004d50 0x7efcdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf2ffd700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf41607e0 0x7efcdc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf27fc700 1 -- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf41607e0 msgr2=0x7efcdc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf27fc700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf41607e0 0x7efcdc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf27fc700 1 -- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc004d50 msgr2=0x7efcdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf27fc700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc004d50 0x7efcdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf27fc700 1 -- 172.21.15.29:0/3012695897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc003570 con 0x7efcdc003fd0 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf37fe700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcdc004d50 0x7efcdc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf27fc700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcdc004810 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efce400c3c0 tx=0x7efce4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14c68123959fdd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce400cc90 con 0x7efcdc003fd0 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce400cdf0 con 0x7efcdc003fd0 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf1ffb700 1 -- 172.21.15.29:0/3012695897 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4005b70 con 0x7efcdc003fd0 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf3fff700 1 -- 172.21.15.29:0/3012695897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 msgr2=0x7efcdc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf3fff700 1 --2- 172.21.15.29:0/3012695897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcdc004810 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efce400c3c0 tx=0x7efce4001e70 comp rx=0 tx=0).stop 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf37fe700 1 -- 172.21.15.29:0/3012695897 reap_dead start 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf3fff700 1 -- 172.21.15.29:0/3012695897 shutdown_connections 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf3fff700 1 -- 172.21.15.29:0/3012695897 >> 172.21.15.29:0/3012695897 conn(0x7efcf40670a0 msgr2=0x7efcf4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf3fff700 1 -- 172.21.15.29:0/3012695897 shutdown_connections 2023-10-06T05:26:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.504+0000 7efcf3fff700 1 -- 172.21.15.29:0/3012695897 wait complete. 2023-10-06T05:26:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf3fff700 1 Processor -- start 2023-10-06T05:26:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf3fff700 1 -- start start 2023-10-06T05:26:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcf4162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcf4160be0 0x7efcf415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf40a4ef0 0x7efcf40a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4160170 con 0x7efcdc003fd0 2023-10-06T05:26:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf3fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4161cf0 con 0x7efcf4160be0 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf3fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41610e0 con 0x7efcf40a4ef0 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcf4162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcf4162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39604/0 (socket says 172.21.15.29:39604) 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf2ffd700 1 -- 172.21.15.29:0/3996629799 learned_addr learned my addr 172.21.15.29:0/3996629799 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf37fe700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf40a4ef0 0x7efcf40a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf27fc700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcf4160be0 0x7efcf415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf2ffd700 1 -- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf40a4ef0 msgr2=0x7efcf40a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf2ffd700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf40a4ef0 0x7efcf40a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf2ffd700 1 -- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcf4160be0 msgr2=0x7efcf415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf2ffd700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcf4160be0 0x7efcf415fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf2ffd700 1 -- 172.21.15.29:0/3996629799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf41613c0 con 0x7efcdc003fd0 2023-10-06T05:26:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.508+0000 7efcf27fc700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcf4160be0 0x7efcf415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:42.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.512+0000 7efcf2ffd700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcf4162180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efce8002b30 tx=0x7efce8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:42.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.512+0000 7efcdaffd700 1 -- 172.21.15.29:0/3996629799 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce800f920 con 0x7efcdc003fd0 2023-10-06T05:26:42.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.512+0000 7efcdaffd700 1 -- 172.21.15.29:0/3996629799 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce800fa80 con 0x7efcdc003fd0 2023-10-06T05:26:42.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.512+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf41616a0 con 0x7efcdc003fd0 2023-10-06T05:26:42.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.512+0000 7efcdaffd700 1 -- 172.21.15.29:0/3996629799 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce800fe40 con 0x7efcdc003fd0 2023-10-06T05:26:42.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.512+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf40a5360 con 0x7efcdc003fd0 2023-10-06T05:26:42.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.512+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf40a55b0 con 0x7efcdc003fd0 2023-10-06T05:26:42.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.512+0000 7efcdaffd700 1 -- 172.21.15.29:0/3996629799 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efce8013600 con 0x7efcdc003fd0 2023-10-06T05:26:42.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.512+0000 7efcdaffd700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efce0060580 0x7efce0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.516+0000 7efcdaffd700 1 -- 172.21.15.29:0/3996629799 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efce807cfd0 con 0x7efcdc003fd0 2023-10-06T05:26:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.516+0000 7efcf27fc700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efce0060580 0x7efce0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.516+0000 7efcf27fc700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efce0060580 0x7efce0062a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efcf4163070 tx=0x7efce4015000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:42.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.520+0000 7efcdaffd700 1 -- 172.21.15.29:0/3996629799 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efce804d3c0 con 0x7efcdc003fd0 2023-10-06T05:26:42.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcf40c66d0 con 0x7efcdc003fd0 2023-10-06T05:26:42.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcdaffd700 1 -- 172.21.15.29:0/3996629799 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4597 (secure 0 0 0) 0x7efce8017090 con 0x7efcdc003fd0 2023-10-06T05:26:42.729 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:42.729 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3342279357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3342279357},{"type":"v1","addr":"172.21.15.173:6835","nonce":3342279357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2659141401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2659141401},{"type":"v1","addr":"172.21.15.173:6837","nonce":2659141401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/648720882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":648720882},{"type":"v1","addr":"172.21.15.29:6833","nonce":648720882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:26:26.407210+0000","modified":"2023-10-06T05:26:29.412409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/244763098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":244763098},{"type":"v1","addr":"172.21.15.29:6835","nonce":244763098}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T05:26:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efce0060580 msgr2=0x7efce0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efce0060580 0x7efce0062a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efcf4163070 tx=0x7efce4015000 comp rx=0 tx=0).stop 2023-10-06T05:26:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 msgr2=0x7efcf4162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcf4162180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efce8002b30 tx=0x7efce8007d10 comp rx=0 tx=0).stop 2023-10-06T05:26:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 shutdown_connections 2023-10-06T05:26:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcf40a4ef0 0x7efcf40a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efce0060580 0x7efce0062a30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcf4160be0 0x7efcf415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 --2- 172.21.15.29:0/3996629799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc003fd0 0x7efcf4162180 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 >> 172.21.15.29:0/3996629799 conn(0x7efcf40670a0 msgr2=0x7efcf40c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 shutdown_connections 2023-10-06T05:26:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.724+0000 7efcf3fff700 1 -- 172.21.15.29:0/3996629799 wait complete. 2023-10-06T05:26:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-10-06T05:26:42.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T05:26:42.876 INFO:teuthology.orchestra.run.smithi029.stdout:{"message":"","return_code":0} 2023-10-06T05:26:42.877 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T05:26:42.877 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:42.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe50dae700 1 Processor -- start 2023-10-06T05:26:42.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe50dae700 1 -- start start 2023-10-06T05:26:42.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe50dae700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c1569f0 0x7fbe4c0ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe50dae700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbe4c156dc0 0x7fbe4c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe50dae700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c06a5b0 con 0x7fbe4c0c68b0 2023-10-06T05:26:42.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe50dae700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c15b0a0 con 0x7fbe4c156dc0 2023-10-06T05:26:42.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe50dae700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c15b380 con 0x7fbe4c1569f0 2023-10-06T05:26:42.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe4bfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbe4c0c68b0 0x7fbe4c06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57188/0 (socket says 172.21.15.29:57188) 2023-10-06T05:26:42.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe4bfff700 1 -- 172.21.15.29:0/1840800376 learned_addr learned my addr 172.21.15.29:0/1840800376 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:42.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe4affd700 1 --2- 172.21.15.29:0/1840800376 >> v2:172.21.15.173:3300/0 conn(0x7fbe4c156dc0 0x7fbe4c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe4b7fe700 1 --2- 172.21.15.29:0/1840800376 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c1569f0 0x7fbe4c0ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe4a7fc700 1 -- 172.21.15.29:0/1840800376 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452513483 0 0) 0x7fbe4c06a5b0 con 0x7fbe4c0c68b0 2023-10-06T05:26:42.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe4a7fc700 1 -- 172.21.15.29:0/1840800376 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe34003570 con 0x7fbe4c0c68b0 2023-10-06T05:26:42.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe4b7fe700 1 -- 172.21.15.29:0/1840800376 >> v2:172.21.15.173:3300/0 conn(0x7fbe4c156dc0 msgr2=0x7fbe4c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:42.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe4b7fe700 1 --2- 172.21.15.29:0/1840800376 >> v2:172.21.15.173:3300/0 conn(0x7fbe4c156dc0 0x7fbe4c15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.976+0000 7fbe4b7fe700 1 -- 172.21.15.29:0/1840800376 >> v1:172.21.15.29:6789/0 conn(0x7fbe4c0c68b0 legacy=0x7fbe4c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe4b7fe700 1 -- 172.21.15.29:0/1840800376 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c15b660 con 0x7fbe4c1569f0 2023-10-06T05:26:42.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe4affd700 1 --2- 172.21.15.29:0/1840800376 >> v2:172.21.15.173:3300/0 conn(0x7fbe4c156dc0 0x7fbe4c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:42.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe4b7fe700 1 --2- 172.21.15.29:0/1840800376 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c1569f0 0x7fbe4c0ab220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe400098e0 tx=0x7fbe400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=244fe9f563d2a85d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:42.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe4a7fc700 1 -- 172.21.15.29:0/1840800376 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40011630 con 0x7fbe4c1569f0 2023-10-06T05:26:42.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe4a7fc700 1 -- 172.21.15.29:0/1840800376 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40011790 con 0x7fbe4c1569f0 2023-10-06T05:26:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe4a7fc700 1 -- 172.21.15.29:0/1840800376 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40011b10 con 0x7fbe4c1569f0 2023-10-06T05:26:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 -- 172.21.15.29:0/1840800376 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c1569f0 msgr2=0x7fbe4c0ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 --2- 172.21.15.29:0/1840800376 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c1569f0 0x7fbe4c0ab220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe400098e0 tx=0x7fbe400091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 -- 172.21.15.29:0/1840800376 shutdown_connections 2023-10-06T05:26:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 --2- 172.21.15.29:0/1840800376 >> v2:172.21.15.173:3300/0 conn(0x7fbe4c156dc0 0x7fbe4c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 --2- 172.21.15.29:0/1840800376 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c1569f0 0x7fbe4c0ab220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 -- 172.21.15.29:0/1840800376 >> 172.21.15.29:0/1840800376 conn(0x7fbe4c0670a0 msgr2=0x7fbe4c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 -- 172.21.15.29:0/1840800376 shutdown_connections 2023-10-06T05:26:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 -- 172.21.15.29:0/1840800376 wait complete. 2023-10-06T05:26:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 Processor -- start 2023-10-06T05:26:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.980+0000 7fbe50dae700 1 -- start start 2023-10-06T05:26:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe50dae700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe4c0c68b0 0x7fbe4c0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe50dae700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe4c1569f0 0x7fbe4c0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe50dae700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c156dc0 0x7fbe4c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe50dae700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0aca00 con 0x7fbe4c1569f0 2023-10-06T05:26:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe50dae700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0abdf0 con 0x7fbe4c0c68b0 2023-10-06T05:26:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe50dae700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0ac0d0 con 0x7fbe4c156dc0 2023-10-06T05:26:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe4c1569f0 0x7fbe4c0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe4c1569f0 0x7fbe4c0ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39608/0 (socket says 172.21.15.29:39608) 2023-10-06T05:26:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4affd700 1 -- 172.21.15.29:0/1440073292 learned_addr learned my addr 172.21.15.29:0/1440073292 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4b7fe700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe4c0c68b0 0x7fbe4c0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4bfff700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c156dc0 0x7fbe4c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4affd700 1 -- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c156dc0 msgr2=0x7fbe4c157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4affd700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c156dc0 0x7fbe4c157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4affd700 1 -- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe4c0c68b0 msgr2=0x7fbe4c0c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:42.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4affd700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe4c0c68b0 0x7fbe4c0c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:42.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4affd700 1 -- 172.21.15.29:0/1440073292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c009a20 con 0x7fbe4c1569f0 2023-10-06T05:26:42.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4bfff700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c156dc0 0x7fbe4c157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:42.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe4affd700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe4c1569f0 0x7fbe4c0ace90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c170 tx=0x7fbe3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:42.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe337fe700 1 -- 172.21.15.29:0/1440073292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00cd60 con 0x7fbe4c1569f0 2023-10-06T05:26:42.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe40009420 con 0x7fbe4c1569f0 2023-10-06T05:26:42.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe337fe700 1 -- 172.21.15.29:0/1440073292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00f040 con 0x7fbe4c1569f0 2023-10-06T05:26:42.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe337fe700 1 -- 172.21.15.29:0/1440073292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c014690 con 0x7fbe4c1569f0 2023-10-06T05:26:42.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.984+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c0ac690 con 0x7fbe4c1569f0 2023-10-06T05:26:42.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.988+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c04be00 con 0x7fbe4c1569f0 2023-10-06T05:26:42.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.988+0000 7fbe337fe700 1 -- 172.21.15.29:0/1440073292 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbe3c014a00 con 0x7fbe4c1569f0 2023-10-06T05:26:42.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.988+0000 7fbe337fe700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe38064960 0x7fbe38066e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:42.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.988+0000 7fbe337fe700 1 -- 172.21.15.29:0/1440073292 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbe3c07d800 con 0x7fbe4c1569f0 2023-10-06T05:26:42.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.988+0000 7fbe4b7fe700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe38064960 0x7fbe38066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:42.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.988+0000 7fbe4b7fe700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe38064960 0x7fbe38066e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbe400091e0 tx=0x7fbe40017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:43.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:42.996+0000 7fbe337fe700 1 -- 172.21.15.29:0/1440073292 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbe3c04dc90 con 0x7fbe4c1569f0 2023-10-06T05:26:43.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.192+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe4c14f160 con 0x7fbe4c1569f0 2023-10-06T05:26:43.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe337fe700 1 -- 172.21.15.29:0/1440073292 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fbe3c014cb0 con 0x7fbe4c1569f0 2023-10-06T05:26:43.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:43.201 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3342279357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3342279357},{"type":"v1","addr":"172.21.15.173:6835","nonce":3342279357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2659141401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2659141401},{"type":"v1","addr":"172.21.15.173:6837","nonce":2659141401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/648720882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":648720882},{"type":"v1","addr":"172.21.15.29:6833","nonce":648720882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:26:26.407210+0000","modified":"2023-10-06T05:26:29.412409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/244763098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":244763098},{"type":"v1","addr":"172.21.15.29:6835","nonce":244763098}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T05:26:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe38064960 msgr2=0x7fbe38066e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe38064960 0x7fbe38066e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbe400091e0 tx=0x7fbe40017000 comp rx=0 tx=0).stop 2023-10-06T05:26:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe4c1569f0 msgr2=0x7fbe4c0ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe4c1569f0 0x7fbe4c0ace90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c170 tx=0x7fbe3c00b040 comp rx=0 tx=0).stop 2023-10-06T05:26:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 shutdown_connections 2023-10-06T05:26:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbe4c156dc0 0x7fbe4c157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe4c1569f0 0x7fbe4c0ace90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:43.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbe38064960 0x7fbe38066e10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:43.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 --2- 172.21.15.29:0/1440073292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe4c0c68b0 0x7fbe4c0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:43.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 >> 172.21.15.29:0/1440073292 conn(0x7fbe4c0670a0 msgr2=0x7fbe4c0c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:43.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 shutdown_connections 2023-10-06T05:26:43.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:43.196+0000 7fbe50dae700 1 -- 172.21.15.29:0/1440073292 wait complete. 2023-10-06T05:26:43.204 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-10-06T05:26:43.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2023-10-06T05:26:43.336 INFO:teuthology.orchestra.run.smithi029.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2023-10-06T05:26:43.336 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2023-10-06T05:26:53.337 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2023-10-06T05:26:53.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.368+0000 7f847cabce80 1 Processor -- start 2023-10-06T05:26:53.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.368+0000 7f847cabce80 1 -- start start 2023-10-06T05:26:53.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364e459e0 0x565364dfcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364ece2a0 0x565364e49750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565364ece670 0x565364e48370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x565364d4a840 con 0x565364ece2a0 2023-10-06T05:26:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x565364d4a4e0 con 0x565364ece670 2023-10-06T05:26:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x565364d41270 con 0x565364e459e0 2023-10-06T05:26:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f8479df2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364ece2a0 0x565364e49750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f8479df2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364ece2a0 0x565364e49750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38736/0 (socket says 172.21.15.29:38736) 2023-10-06T05:26:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f8479df2700 1 -- 172.21.15.29:0/3876260338 learned_addr learned my addr 172.21.15.29:0/3876260338 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847a5f3700 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364e459e0 0x565364dfcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847adf4700 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565364ece670 0x565364e48370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847a5f3700 1 -- 172.21.15.29:0/3876260338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565364ece670 msgr2=0x565364e48370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847a5f3700 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565364ece670 0x565364e48370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847a5f3700 1 -- 172.21.15.29:0/3876260338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364ece2a0 msgr2=0x565364e49750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847a5f3700 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364ece2a0 0x565364e49750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847a5f3700 1 -- 172.21.15.29:0/3876260338 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8464005cf0 con 0x565364e459e0 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f8479df2700 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364ece2a0 0x565364e49750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847a5f3700 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364e459e0 0x565364dfcae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f846c001e40 tx=0x7f846c001710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71a44b916c2b095f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f8478df0700 1 -- 172.21.15.29:0/3876260338 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00bb90 con 0x565364e459e0 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f8478df0700 1 -- 172.21.15.29:0/3876260338 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c00bcf0 con 0x565364e459e0 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f8478df0700 1 -- 172.21.15.29:0/3876260338 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00e6c0 con 0x565364e459e0 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 -- 172.21.15.29:0/3876260338 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364e459e0 msgr2=0x565364dfcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364e459e0 0x565364dfcae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f846c001e40 tx=0x7f846c001710 comp rx=0 tx=0).stop 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 -- 172.21.15.29:0/3876260338 shutdown_connections 2023-10-06T05:26:53.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565364ece670 0x565364e48370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364ece2a0 0x565364e49750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 --2- 172.21.15.29:0/3876260338 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364e459e0 0x565364dfcae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 -- 172.21.15.29:0/3876260338 >> 172.21.15.29:0/3876260338 conn(0x565364e4b9d0 msgr2=0x565364e45db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 -- 172.21.15.29:0/3876260338 shutdown_connections 2023-10-06T05:26:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 -- 172.21.15.29:0/3876260338 wait complete. 2023-10-06T05:26:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 Processor -- start 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.372+0000 7f847cabce80 1 -- start start 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847cabce80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364e459e0 0x565364ec7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847cabce80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364ece2a0 0x565364ecd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847cabce80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565364ece670 0x565364ecd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847cabce80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x565364e3e780 con 0x565364e459e0 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847cabce80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x565364e3f190 con 0x565364ece670 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847cabce80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x565364e48d70 con 0x565364ece2a0 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847a5f3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364e459e0 0x565364ec7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847a5f3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364e459e0 0x565364ec7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38750/0 (socket says 172.21.15.29:38750) 2023-10-06T05:26:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847a5f3700 1 -- 172.21.15.29:0/3305094447 learned_addr learned my addr 172.21.15.29:0/3305094447 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f8479df2700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364ece2a0 0x565364ecd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847adf4700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565364ece670 0x565364ecd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847a5f3700 1 -- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364ece2a0 msgr2=0x565364ecd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847a5f3700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x565364ece2a0 0x565364ecd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847a5f3700 1 -- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565364ece670 msgr2=0x565364ecd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847a5f3700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x565364ece670 0x565364ecd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847a5f3700 1 -- 172.21.15.29:0/3305094447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565364d73040 con 0x565364e459e0 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847a5f3700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364e459e0 0x565364ec7240 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f846c00b8b0 tx=0x7f846c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f8472ffd700 1 -- 172.21.15.29:0/3305094447 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c01f070 con 0x565364e459e0 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f8472ffd700 1 -- 172.21.15.29:0/3305094447 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c01a2e0 con 0x565364e459e0 2023-10-06T05:26:53.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c0019f0 con 0x565364e459e0 2023-10-06T05:26:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f8472ffd700 1 -- 172.21.15.29:0/3305094447 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c01ab00 con 0x565364e459e0 2023-10-06T05:26:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.376+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565364d59250 con 0x565364e459e0 2023-10-06T05:26:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f8472ffd700 1 -- 172.21.15.29:0/3305094447 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f846c02d440 con 0x565364e459e0 2023-10-06T05:26:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f8472ffd700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f845c05eee0 0x7f845c061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f8472ffd700 1 -- 172.21.15.29:0/3305094447 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f846c07d5a0 con 0x565364e459e0 2023-10-06T05:26:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f847cabce80 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x565364ec8e70 0x565364e41090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x565364dfdc70 con 0x565364ec8e70 2023-10-06T05:26:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f8479df2700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f845c05eee0 0x7f845c061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f847adf4700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x565364ec8e70 0x565364e41090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f847adf4700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x565364ec8e70 0x565364e41090 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f8479df2700 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f845c05eee0 0x7f845c061390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x565364ecdc80 tx=0x7f8464016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f847adf4700 1 -- 172.21.15.29:0/3305094447 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f8474002d60 con 0x565364ec8e70 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x565364ec8e70 msgr2=0x565364e41090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f847cabce80 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x565364ec8e70 0x565364e41090 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.380+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f845c05eee0 msgr2=0x7f845c061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.384+0000 7f847cabce80 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f845c05eee0 0x7f845c061390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x565364ecdc80 tx=0x7f8464016000 comp rx=0 tx=0).stop 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.384+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364e459e0 msgr2=0x565364ec7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.384+0000 7f847cabce80 1 --2- 172.21.15.29:0/3305094447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565364e459e0 0x565364ec7240 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f846c00b8b0 tx=0x7f846c014000 comp rx=0 tx=0).stop 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.384+0000 7f847adf4700 1 -- 172.21.15.29:0/3305094447 reap_dead start 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.384+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 shutdown_connections 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.384+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 >> 172.21.15.29:0/3305094447 conn(0x565364e4b9d0 msgr2=0x565364ed30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.384+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 shutdown_connections 2023-10-06T05:26:53.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.384+0000 7f847cabce80 1 -- 172.21.15.29:0/3305094447 wait complete. 2023-10-06T05:26:53.390 INFO:teuthology.orchestra.run.smithi029.stdout:mytag 2023-10-06T05:26:53.390 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2023-10-06T05:26:53.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.464+0000 7f1491021e80 1 Processor -- start 2023-10-06T05:26:53.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.464+0000 7f1491021e80 1 -- start start 2023-10-06T05:26:53.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674ee7850 0x55b674eed590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 0x55b674eec040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674f704e0 0x55b674eec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b674deb840 con 0x55b674ee7850 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b674deb4e0 con 0x55b674eebc70 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b674de2270 con 0x55b674f704e0 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148eb58700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674ee7850 0x55b674eed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148e357700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 0x55b674eec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148eb58700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674ee7850 0x55b674eed590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38770/0 (socket says 172.21.15.29:38770) 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148eb58700 1 -- 172.21.15.29:0/2748473090 learned_addr learned my addr 172.21.15.29:0/2748473090 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148f359700 1 --2- 172.21.15.29:0/2748473090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674f704e0 0x55b674eec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148eb58700 1 -- 172.21.15.29:0/2748473090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674f704e0 msgr2=0x55b674eec580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148eb58700 1 --2- 172.21.15.29:0/2748473090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674f704e0 0x55b674eec580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148eb58700 1 -- 172.21.15.29:0/2748473090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 msgr2=0x55b674eec040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148eb58700 1 --2- 172.21.15.29:0/2748473090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 0x55b674eec040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148eb58700 1 -- 172.21.15.29:0/2748473090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488005db0 con 0x55b674ee7850 2023-10-06T05:26:53.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148eb58700 1 --2- 172.21.15.29:0/2748473090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674ee7850 0x55b674eed590 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f148000c540 tx=0x7f1480007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5736e9ac4fab53e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148d355700 1 -- 172.21.15.29:0/2748473090 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480010590 con 0x55b674ee7850 2023-10-06T05:26:53.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148d355700 1 -- 172.21.15.29:0/2748473090 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14800106f0 con 0x55b674ee7850 2023-10-06T05:26:53.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f148d355700 1 -- 172.21.15.29:0/2748473090 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480010ab0 con 0x55b674ee7850 2023-10-06T05:26:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 -- 172.21.15.29:0/2748473090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674ee7850 msgr2=0x55b674eed590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 --2- 172.21.15.29:0/2748473090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674ee7850 0x55b674eed590 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f148000c540 tx=0x7f1480007040 comp rx=0 tx=0).stop 2023-10-06T05:26:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 -- 172.21.15.29:0/2748473090 shutdown_connections 2023-10-06T05:26:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 --2- 172.21.15.29:0/2748473090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674f704e0 0x55b674eec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 --2- 172.21.15.29:0/2748473090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 0x55b674eec040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 --2- 172.21.15.29:0/2748473090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674ee7850 0x55b674eed590 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.468+0000 7f1491021e80 1 -- 172.21.15.29:0/2748473090 >> 172.21.15.29:0/2748473090 conn(0x55b674ea0ca0 msgr2=0x55b674f6da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 -- 172.21.15.29:0/2748473090 shutdown_connections 2023-10-06T05:26:53.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 -- 172.21.15.29:0/2748473090 wait complete. 2023-10-06T05:26:53.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 Processor -- start 2023-10-06T05:26:53.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 -- start start 2023-10-06T05:26:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674ee7850 0x55b674ee5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 0x55b674f66d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674f704e0 0x55b674ee4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b674f68850 con 0x55b674f704e0 2023-10-06T05:26:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b674f6c830 con 0x55b674eebc70 2023-10-06T05:26:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.472+0000 7f1491021e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b674f67c40 con 0x55b674ee7850 2023-10-06T05:26:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148f359700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674f704e0 0x55b674ee4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148f359700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674f704e0 0x55b674ee4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38778/0 (socket says 172.21.15.29:38778) 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148f359700 1 -- 172.21.15.29:0/959952230 learned_addr learned my addr 172.21.15.29:0/959952230 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148eb58700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674ee7850 0x55b674ee5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148e357700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 0x55b674f66d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148f359700 1 -- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674ee7850 msgr2=0x55b674ee5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148f359700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674ee7850 0x55b674ee5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148f359700 1 -- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 msgr2=0x55b674f66d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148f359700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 0x55b674f66d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148f359700 1 -- 172.21.15.29:0/959952230 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148000d040 con 0x55b674f704e0 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148e357700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b674eebc70 0x55b674f66d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148eb58700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55b674ee7850 0x55b674ee5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:53.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f148f359700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674f704e0 0x55b674ee4e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f148800c010 tx=0x7f1488013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f147f7fe700 1 -- 172.21.15.29:0/959952230 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488012e40 con 0x55b674f704e0 2023-10-06T05:26:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f147f7fe700 1 -- 172.21.15.29:0/959952230 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488008e50 con 0x55b674f704e0 2023-10-06T05:26:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b674dfa250 con 0x55b674f704e0 2023-10-06T05:26:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f147f7fe700 1 -- 172.21.15.29:0/959952230 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488025650 con 0x55b674f704e0 2023-10-06T05:26:53.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b674ded770 con 0x55b674f704e0 2023-10-06T05:26:53.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f147f7fe700 1 -- 172.21.15.29:0/959952230 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f148802e450 con 0x55b674f704e0 2023-10-06T05:26:53.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.476+0000 7f147f7fe700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f147405eeb0 0x7f1474061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f147f7fe700 1 -- 172.21.15.29:0/959952230 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f148807cff0 con 0x55b674f704e0 2023-10-06T05:26:53.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f148eb58700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f147405eeb0 0x7f1474061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55b674f68ce0 0x55b674f690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x55b674f69610 con 0x55b674f68ce0 2023-10-06T05:26:53.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f148e357700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55b674f68ce0 0x55b674f690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f148eb58700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f147405eeb0 0x7f1474061360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f148000c250 tx=0x7f1480018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f148e357700 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55b674f68ce0 0x55b674f690d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f148e357700 1 -- 172.21.15.29:0/959952230 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f148400b040 con 0x55b674f68ce0 2023-10-06T05:26:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55b674f68ce0 msgr2=0x55b674f690d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55b674f68ce0 0x55b674f690d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f147405eeb0 msgr2=0x7f1474061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f147405eeb0 0x7f1474061360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f148000c250 tx=0x7f1480018000 comp rx=0 tx=0).stop 2023-10-06T05:26:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674f704e0 msgr2=0x55b674ee4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 --2- 172.21.15.29:0/959952230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b674f704e0 0x55b674ee4e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f148800c010 tx=0x7f1488013000 comp rx=0 tx=0).stop 2023-10-06T05:26:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f148f359700 1 -- 172.21.15.29:0/959952230 reap_dead start 2023-10-06T05:26:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 shutdown_connections 2023-10-06T05:26:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 >> 172.21.15.29:0/959952230 conn(0x55b674ea0ca0 msgr2=0x55b674f6da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 shutdown_connections 2023-10-06T05:26:53.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.480+0000 7f1491021e80 1 -- 172.21.15.29:0/959952230 wait complete. 2023-10-06T05:26:53.489 INFO:teuthology.orchestra.run.smithi029.stdout:mytag 2023-10-06T05:26:53.489 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-10-06T05:26:53.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff21225e80 1 Processor -- start 2023-10-06T05:26:53.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff21225e80 1 -- start start 2023-10-06T05:26:53.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff21225e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa816b1ee0 0x55aa8177d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff21225e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 0x55aa816f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff21225e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa8177e4e0 0x55aa816f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff21225e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa815f9840 con 0x55aa8177e4e0 2023-10-06T05:26:53.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff21225e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa815f94e0 con 0x55aa816f5850 2023-10-06T05:26:53.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff21225e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa815f0270 con 0x55aa816b1ee0 2023-10-06T05:26:53.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff1f55d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa8177e4e0 0x55aa816f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff1f55d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa8177e4e0 0x55aa816f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38800/0 (socket says 172.21.15.29:38800) 2023-10-06T05:26:53.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff1f55d700 1 -- 172.21.15.29:0/668351461 learned_addr learned my addr 172.21.15.29:0/668351461 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff1ed5c700 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa816b1ee0 0x55aa8177d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.520+0000 7eff1e55b700 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 0x55aa816f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1ed5c700 1 -- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 msgr2=0x55aa816f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1ed5c700 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 0x55aa816f20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1ed5c700 1 -- 172.21.15.29:0/668351461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa8177e4e0 msgr2=0x55aa816f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1ed5c700 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa8177e4e0 0x55aa816f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1ed5c700 1 -- 172.21.15.29:0/668351461 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08005db0 con 0x55aa816b1ee0 2023-10-06T05:26:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1e55b700 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 0x55aa816f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1f55d700 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa8177e4e0 0x55aa816f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1ed5c700 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa816b1ee0 0x55aa8177d240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff10009830 tx=0x7eff1000c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=673874c33a133b7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1d559700 1 -- 172.21.15.29:0/668351461 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000f040 con 0x55aa816b1ee0 2023-10-06T05:26:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1d559700 1 -- 172.21.15.29:0/668351461 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10008700 con 0x55aa816b1ee0 2023-10-06T05:26:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff1d559700 1 -- 172.21.15.29:0/668351461 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10008aa0 con 0x55aa816b1ee0 2023-10-06T05:26:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff21225e80 1 -- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa816b1ee0 msgr2=0x55aa8177d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff21225e80 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa816b1ee0 0x55aa8177d240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff10009830 tx=0x7eff1000c040 comp rx=0 tx=0).stop 2023-10-06T05:26:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff21225e80 1 -- 172.21.15.29:0/668351461 shutdown_connections 2023-10-06T05:26:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff21225e80 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa8177e4e0 0x55aa816f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff21225e80 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 0x55aa816f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff21225e80 1 --2- 172.21.15.29:0/668351461 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa816b1ee0 0x55aa8177d240 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff21225e80 1 -- 172.21.15.29:0/668351461 >> 172.21.15.29:0/668351461 conn(0x55aa816aeca0 msgr2=0x55aa816b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff21225e80 1 -- 172.21.15.29:0/668351461 shutdown_connections 2023-10-06T05:26:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.524+0000 7eff21225e80 1 -- 172.21.15.29:0/668351461 wait complete. 2023-10-06T05:26:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff21225e80 1 Processor -- start 2023-10-06T05:26:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff21225e80 1 -- start start 2023-10-06T05:26:53.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff21225e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa816b1ee0 0x55aa81779db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff21225e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 0x55aa8177c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff21225e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa8177e4e0 0x55aa81782050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff21225e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa816df1d0 con 0x55aa816b1ee0 2023-10-06T05:26:53.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff21225e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa8177cc20 con 0x55aa816f5850 2023-10-06T05:26:53.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff21225e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa816df420 con 0x55aa8177e4e0 2023-10-06T05:26:53.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1ed5c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa816b1ee0 0x55aa81779db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1ed5c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa816b1ee0 0x55aa81779db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38802/0 (socket says 172.21.15.29:38802) 2023-10-06T05:26:53.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1ed5c700 1 -- 172.21.15.29:0/1014413227 learned_addr learned my addr 172.21.15.29:0/1014413227 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1e55b700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 0x55aa8177c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1f55d700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa8177e4e0 0x55aa81782050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1ed5c700 1 -- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa8177e4e0 msgr2=0x55aa81782050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1ed5c700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aa8177e4e0 0x55aa81782050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1ed5c700 1 -- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 msgr2=0x55aa8177c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1ed5c700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa816f5850 0x55aa8177c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1ed5c700 1 -- 172.21.15.29:0/1014413227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa81622040 con 0x55aa816b1ee0 2023-10-06T05:26:53.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.528+0000 7eff1ed5c700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa816b1ee0 0x55aa81779db0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7eff10009e20 tx=0x7eff10018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff177fe700 1 -- 172.21.15.29:0/1014413227 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000f040 con 0x55aa816b1ee0 2023-10-06T05:26:53.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff177fe700 1 -- 172.21.15.29:0/1014413227 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10008e90 con 0x55aa816b1ee0 2023-10-06T05:26:53.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff177fe700 1 -- 172.21.15.29:0/1014413227 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1001e410 con 0x55aa816b1ee0 2023-10-06T05:26:53.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff18006c60 con 0x55aa816b1ee0 2023-10-06T05:26:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff10009430 con 0x55aa816b1ee0 2023-10-06T05:26:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff177fe700 1 -- 172.21.15.29:0/1014413227 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7eff1001e800 con 0x55aa816b1ee0 2023-10-06T05:26:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff177fe700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff0005eeb0 0x7eff00061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff177fe700 1 -- 172.21.15.29:0/1014413227 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff1007d910 con 0x55aa816b1ee0 2023-10-06T05:26:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff21225e80 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55aa8177c700 0x55aa816dff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff1e55b700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff0005eeb0 0x7eff00061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x55aa81782590 con 0x55aa8177c700 2023-10-06T05:26:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff1f55d700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55aa8177c700 0x55aa816dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff1e55b700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff0005eeb0 0x7eff00061360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7eff08005b50 tx=0x7eff08016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.532+0000 7eff1f55d700 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55aa8177c700 0x55aa816dff00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff1f55d700 1 -- 172.21.15.29:0/1014413227 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7eff18003700 con 0x55aa8177c700 2023-10-06T05:26:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55aa8177c700 msgr2=0x55aa816dff00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55aa8177c700 0x55aa816dff00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff0005eeb0 msgr2=0x7eff00061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff0005eeb0 0x7eff00061360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7eff08005b50 tx=0x7eff08016000 comp rx=0 tx=0).stop 2023-10-06T05:26:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa816b1ee0 msgr2=0x55aa81779db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 --2- 172.21.15.29:0/1014413227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa816b1ee0 0x55aa81779db0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7eff10009e20 tx=0x7eff10018000 comp rx=0 tx=0).stop 2023-10-06T05:26:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff1f55d700 1 -- 172.21.15.29:0/1014413227 reap_dead start 2023-10-06T05:26:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 shutdown_connections 2023-10-06T05:26:53.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 >> 172.21.15.29:0/1014413227 conn(0x55aa816aeca0 msgr2=0x55aa8177a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 shutdown_connections 2023-10-06T05:26:53.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.536+0000 7eff21225e80 1 -- 172.21.15.29:0/1014413227 wait complete. 2023-10-06T05:26:53.543 INFO:teuthology.orchestra.run.smithi029.stdout:mytag 2023-10-06T05:26:53.544 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-10-06T05:26:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.572+0000 7fc1c91ebe80 1 Processor -- start 2023-10-06T05:26:53.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c91ebe80 1 -- start start 2023-10-06T05:26:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c91ebe80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f0fb4850 0x5577f0fb69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c91ebe80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 0x5577f1042000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c91ebe80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5577f103d4e0 0x5577f1037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c91ebe80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f0f14220 con 0x5577f0fb4850 2023-10-06T05:26:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c91ebe80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f0eb8840 con 0x5577f0fb8c70 2023-10-06T05:26:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c91ebe80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577f0eb84e0 con 0x5577f103d4e0 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6d22700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f0fb4850 0x5577f0fb69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6d22700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f0fb4850 0x5577f0fb69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38824/0 (socket says 172.21.15.29:38824) 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6d22700 1 -- 172.21.15.29:0/1779817892 learned_addr learned my addr 172.21.15.29:0/1779817892 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6521700 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 0x5577f1042000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c7523700 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5577f103d4e0 0x5577f1037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6d22700 1 -- 172.21.15.29:0/1779817892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5577f103d4e0 msgr2=0x5577f1037b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6d22700 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5577f103d4e0 0x5577f1037b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6d22700 1 -- 172.21.15.29:0/1779817892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 msgr2=0x5577f1042000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6d22700 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 0x5577f1042000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6d22700 1 -- 172.21.15.29:0/1779817892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0005cf0 con 0x5577f0fb4850 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6521700 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 0x5577f1042000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c6d22700 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f0fb4850 0x5577f0fb69b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000b320 tx=0x7fc1c00068f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5480c105cfff3b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c551f700 1 -- 172.21.15.29:0/1779817892 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000bdd0 con 0x5577f0fb4850 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c551f700 1 -- 172.21.15.29:0/1779817892 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c000e470 con 0x5577f0fb4850 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.576+0000 7fc1c551f700 1 -- 172.21.15.29:0/1779817892 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000e830 con 0x5577f0fb4850 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/1779817892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f0fb4850 msgr2=0x5577f0fb69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f0fb4850 0x5577f0fb69b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000b320 tx=0x7fc1c00068f0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/1779817892 shutdown_connections 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5577f103d4e0 0x5577f1037b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 0x5577f1042000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 --2- 172.21.15.29:0/1779817892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f0fb4850 0x5577f0fb69b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/1779817892 >> 172.21.15.29:0/1779817892 conn(0x5577f0f6dca0 msgr2=0x5577f103aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/1779817892 shutdown_connections 2023-10-06T05:26:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/1779817892 wait complete. 2023-10-06T05:26:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 Processor -- start 2023-10-06T05:26:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.580+0000 7fc1c91ebe80 1 -- start start 2023-10-06T05:26:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c91ebe80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5577f0fb4850 0x5577f1039600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c91ebe80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 0x5577f0f6bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c91ebe80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f103d4e0 0x5577f1031440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c91ebe80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f0eaf270 con 0x5577f103d4e0 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c91ebe80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577f0f6cad0 con 0x5577f0fb8c70 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c91ebe80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577f1038bf0 con 0x5577f0fb4850 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c7523700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f103d4e0 0x5577f1031440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c7523700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f103d4e0 0x5577f1031440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38834/0 (socket says 172.21.15.29:38834) 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c7523700 1 -- 172.21.15.29:0/3343956207 learned_addr learned my addr 172.21.15.29:0/3343956207 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c6521700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 0x5577f0f6bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c6d22700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5577f0fb4850 0x5577f1039600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c7523700 1 -- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5577f0fb4850 msgr2=0x5577f1039600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c7523700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5577f0fb4850 0x5577f1039600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c7523700 1 -- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 msgr2=0x5577f0f6bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c7523700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 0x5577f0f6bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c7523700 1 -- 172.21.15.29:0/3343956207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c0006bd0 con 0x5577f103d4e0 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c6521700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577f0fb8c70 0x5577f0f6bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c7523700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f103d4e0 0x5577f1031440 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800d290 tx=0x7fc1b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1bf7fe700 1 -- 172.21.15.29:0/3343956207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80030d0 con 0x5577f103d4e0 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1bf7fe700 1 -- 172.21.15.29:0/3343956207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b8003230 con 0x5577f103d4e0 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5577f0eba770 con 0x5577f103d4e0 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1bf7fe700 1 -- 172.21.15.29:0/3343956207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8001630 con 0x5577f103d4e0 2023-10-06T05:26:53.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.584+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5577f0eba1d0 con 0x5577f103d4e0 2023-10-06T05:26:53.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1bf7fe700 1 -- 172.21.15.29:0/3343956207 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc1b80019e0 con 0x5577f103d4e0 2023-10-06T05:26:53.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1bf7fe700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1a805eeb0 0x7fc1a8061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1bf7fe700 1 -- 172.21.15.29:0/3343956207 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc1b807afe0 con 0x5577f103d4e0 2023-10-06T05:26:53.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5577f0f6c180 0x5577f0fb2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c6d22700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1a805eeb0 0x7fc1a8061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x5577f10330a0 con 0x5577f0f6c180 2023-10-06T05:26:53.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c6521700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5577f0f6c180 0x5577f0fb2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c6d22700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1a805eeb0 0x7fc1a8061360 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc1c00063a0 tx=0x7fc1c0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c6521700 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5577f0f6c180 0x5577f0fb2340 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c6521700 1 -- 172.21.15.29:0/3343956207 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fc1b00079f0 con 0x5577f0f6c180 2023-10-06T05:26:53.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5577f0f6c180 msgr2=0x5577f0fb2340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5577f0f6c180 0x5577f0fb2340 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1a805eeb0 msgr2=0x7fc1a8061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1a805eeb0 0x7fc1a8061360 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc1c00063a0 tx=0x7fc1c0017000 comp rx=0 tx=0).stop 2023-10-06T05:26:53.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f103d4e0 msgr2=0x5577f1031440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 --2- 172.21.15.29:0/3343956207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5577f103d4e0 0x5577f1031440 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800d290 tx=0x7fc1b8008040 comp rx=0 tx=0).stop 2023-10-06T05:26:53.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c7523700 1 -- 172.21.15.29:0/3343956207 reap_dead start 2023-10-06T05:26:53.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 shutdown_connections 2023-10-06T05:26:53.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 >> 172.21.15.29:0/3343956207 conn(0x5577f0f6dca0 msgr2=0x5577f0fb4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 shutdown_connections 2023-10-06T05:26:53.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.588+0000 7fc1c91ebe80 1 -- 172.21.15.29:0/3343956207 wait complete. 2023-10-06T05:26:53.599 INFO:teuthology.orchestra.run.smithi029.stdout:mytag 2023-10-06T05:26:53.599 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-10-06T05:26:53.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 Processor -- start 2023-10-06T05:26:53.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 -- start start 2023-10-06T05:26:53.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 0x557a7fae20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7fae7900 0x557a7fa5c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7faed830 0x557a7fa486f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7f9bc220 con 0x557a7faed830 2023-10-06T05:26:53.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7f960840 con 0x557a7fae7900 2023-10-06T05:26:53.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a7f9604e0 con 0x557a7fa5ed80 2023-10-06T05:26:53.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaaa456700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7faed830 0x557a7fa486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaaa456700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7faed830 0x557a7fa486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38850/0 (socket says 172.21.15.29:38850) 2023-10-06T05:26:53.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaaa456700 1 -- 172.21.15.29:0/1453690781 learned_addr learned my addr 172.21.15.29:0/1453690781 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaa9454700 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7fae7900 0x557a7fa5c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaa9c55700 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 0x557a7fae20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaaa456700 1 -- 172.21.15.29:0/1453690781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 msgr2=0x557a7fae20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaaa456700 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 0x557a7fae20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaaa456700 1 -- 172.21.15.29:0/1453690781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7fae7900 msgr2=0x557a7fa5c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaaa456700 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7fae7900 0x557a7fa5c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaaa456700 1 -- 172.21.15.29:0/1453690781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9400a0e0 con 0x557a7faed830 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaa9c55700 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 0x557a7fae20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaaa456700 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7faed830 0x557a7fa486f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001d60 tx=0x7fbaa40017d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f3e48b12769b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaa3fff700 1 -- 172.21.15.29:0/1453690781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4014070 con 0x557a7faed830 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaa3fff700 1 -- 172.21.15.29:0/1453690781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa4008030 con 0x557a7faed830 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaa3fff700 1 -- 172.21.15.29:0/1453690781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa400bd20 con 0x557a7faed830 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1453690781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7faed830 msgr2=0x557a7fa486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.628+0000 7fbaac11ee80 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7faed830 0x557a7fa486f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001d60 tx=0x7fbaa40017d0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1453690781 shutdown_connections 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7faed830 0x557a7fa486f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7fae7900 0x557a7fa5c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 --2- 172.21.15.29:0/1453690781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 0x557a7fae20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1453690781 >> 172.21.15.29:0/1453690781 conn(0x557a7fa64cd0 msgr2=0x557a7fa5dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1453690781 shutdown_connections 2023-10-06T05:26:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1453690781 wait complete. 2023-10-06T05:26:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 Processor -- start 2023-10-06T05:26:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- start start 2023-10-06T05:26:53.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 0x557a7fa486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7fae7900 0x557a7fae5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7faed830 0x557a7fae0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7f957270 con 0x557a7fae7900 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7fa5da20 con 0x557a7faed830 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a7fafe250 con 0x557a7fa5ed80 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaa9454700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7fae7900 0x557a7fae5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaaa456700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7faed830 0x557a7fae0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaa9c55700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 0x557a7fa486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaaa456700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7faed830 0x557a7fae0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45620/0 (socket says 172.21.15.29:45620) 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaaa456700 1 -- 172.21.15.29:0/1818074657 learned_addr learned my addr 172.21.15.29:0/1818074657 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaa9454700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7fae7900 0x557a7fae5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38856/0 (socket says 172.21.15.29:38856) 2023-10-06T05:26:53.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaaa456700 1 -- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 msgr2=0x557a7fa486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaaa456700 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x557a7fa5ed80 0x557a7fa486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaaa456700 1 -- 172.21.15.29:0/1818074657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7fae7900 msgr2=0x557a7fae5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaaa456700 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a7fae7900 0x557a7fae5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaaa456700 1 -- 172.21.15.29:0/1818074657 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa400a040 con 0x557a7faed830 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaaa456700 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7faed830 0x557a7fae0b20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001810 tx=0x7fbaa4016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaa27fc700 1 -- 172.21.15.29:0/1818074657 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4001470 con 0x557a7faed830 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaa27fc700 1 -- 172.21.15.29:0/1818074657 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa4021070 con 0x557a7faed830 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a7f962770 con 0x557a7faed830 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaa27fc700 1 -- 172.21.15.29:0/1818074657 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40018f0 con 0x557a7faed830 2023-10-06T05:26:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.632+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a7f9621d0 con 0x557a7faed830 2023-10-06T05:26:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.636+0000 7fbaa27fc700 1 -- 172.21.15.29:0/1818074657 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbaa401a8a0 con 0x557a7faed830 2023-10-06T05:26:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.636+0000 7fbaa27fc700 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba9005eeb0 0x7fba90061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.636+0000 7fbaa27fc700 1 -- 172.21.15.29:0/1818074657 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbaa407cf50 con 0x557a7faed830 2023-10-06T05:26:53.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.636+0000 7fbaac11ee80 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x557a7fae1060 0x557a7fae4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.636+0000 7fbaa9c55700 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba9005eeb0 0x7fba90061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.636+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) v8 -- 0x557a7fa5c520 con 0x557a7fae1060 2023-10-06T05:26:53.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.636+0000 7fbaa9454700 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x557a7fae1060 0x557a7fae4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaa9c55700 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba9005eeb0 0x7fba90061360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba9c000c00 tx=0x7fba9c0018b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaa9454700 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x557a7fae1060 0x557a7fae4a30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaa9454700 1 -- 172.21.15.29:0/1818074657 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fba94023040 con 0x557a7fae1060 2023-10-06T05:26:53.646 INFO:teuthology.orchestra.run.smithi029.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2023-10-06T05:26:53.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x557a7fae1060 msgr2=0x557a7fae4a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x557a7fae1060 0x557a7fae4a30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba9005eeb0 msgr2=0x7fba90061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba9005eeb0 0x7fba90061360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba9c000c00 tx=0x7fba9c0018b0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7faed830 msgr2=0x557a7fae0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 --2- 172.21.15.29:0/1818074657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a7faed830 0x557a7fae0b20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001810 tx=0x7fbaa4016000 comp rx=0 tx=0).stop 2023-10-06T05:26:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaaa456700 1 -- 172.21.15.29:0/1818074657 reap_dead start 2023-10-06T05:26:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 shutdown_connections 2023-10-06T05:26:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 >> 172.21.15.29:0/1818074657 conn(0x557a7fa64cd0 msgr2=0x557a7faecfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 shutdown_connections 2023-10-06T05:26:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.640+0000 7fbaac11ee80 1 -- 172.21.15.29:0/1818074657 wait complete. 2023-10-06T05:26:53.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:26:53.649 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T05:26:53.649 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:26:53.711 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:26:53.733 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T05:26:53.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:26:53.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:53.733 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:26:53.740 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T05:26:53.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:26:53.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:26:53.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:53.741 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T05:26:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T05:26:53.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:26:53.784 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:26:53.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:53.784 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T05:26:53.791 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T05:26:53.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:26:53.792 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:26:53.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:26:53.792 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T05:26:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T05:26:53.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:26:53.799 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.944+0000 7faf74a5f700 1 Processor -- start 2023-10-06T05:26:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.944+0000 7faf74a5f700 1 -- start start 2023-10-06T05:26:53.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.944+0000 7faf74a5f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7faf700ab220 0x7faf70156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.944+0000 7faf74a5f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7006a5b0 con 0x7faf701569f0 2023-10-06T05:26:53.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.944+0000 7faf74a5f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7015b0a0 con 0x7faf700c68b0 2023-10-06T05:26:53.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.944+0000 7faf74a5f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7015b380 con 0x7faf700ab220 2023-10-06T05:26:53.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.944+0000 7faf6ed9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faf701569f0 0x7faf7015a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57818/0 (socket says 172.21.15.29:57818) 2023-10-06T05:26:53.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6ed9d700 1 -- 172.21.15.29:0/3220769849 learned_addr learned my addr 172.21.15.29:0/3220769849 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:53.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6e59c700 1 --2- 172.21.15.29:0/3220769849 >> v2:172.21.15.173:3300/0 conn(0x7faf700ab220 0x7faf70156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6dd9b700 1 -- 172.21.15.29:0/3220769849 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034179839 0 0) 0x7faf7006a5b0 con 0x7faf701569f0 2023-10-06T05:26:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6dd9b700 1 -- 172.21.15.29:0/3220769849 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf5c003570 con 0x7faf701569f0 2023-10-06T05:26:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6e59c700 1 -- 172.21.15.29:0/3220769849 >> v1:172.21.15.173:6789/0 conn(0x7faf700c68b0 legacy=0x7faf7006aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6e59c700 1 -- 172.21.15.29:0/3220769849 >> v1:172.21.15.29:6789/0 conn(0x7faf701569f0 legacy=0x7faf7015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6e59c700 1 -- 172.21.15.29:0/3220769849 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7015b660 con 0x7faf700ab220 2023-10-06T05:26:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6e59c700 1 --2- 172.21.15.29:0/3220769849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf700ab220 0x7faf70156dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf580098e0 tx=0x7faf580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2180ffa2b254651 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6dd9b700 1 -- 172.21.15.29:0/3220769849 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800b640 con 0x7faf700ab220 2023-10-06T05:26:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6dd9b700 1 -- 172.21.15.29:0/3220769849 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5800b7a0 con 0x7faf700ab220 2023-10-06T05:26:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf6dd9b700 1 -- 172.21.15.29:0/3220769849 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800bb20 con 0x7faf700ab220 2023-10-06T05:26:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf74a5f700 1 -- 172.21.15.29:0/3220769849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf700ab220 msgr2=0x7faf70156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf74a5f700 1 --2- 172.21.15.29:0/3220769849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf700ab220 0x7faf70156dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf580098e0 tx=0x7faf580091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf74a5f700 1 -- 172.21.15.29:0/3220769849 shutdown_connections 2023-10-06T05:26:53.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf74a5f700 1 --2- 172.21.15.29:0/3220769849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf700ab220 0x7faf70156dc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf74a5f700 1 -- 172.21.15.29:0/3220769849 >> 172.21.15.29:0/3220769849 conn(0x7faf700670a0 msgr2=0x7faf700674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:53.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf74a5f700 1 -- 172.21.15.29:0/3220769849 shutdown_connections 2023-10-06T05:26:53.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf74a5f700 1 -- 172.21.15.29:0/3220769849 wait complete. 2023-10-06T05:26:53.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf74a5f700 1 Processor -- start 2023-10-06T05:26:53.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.948+0000 7faf74a5f700 1 -- start start 2023-10-06T05:26:53.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf74a5f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf700ab220 0x7faf70150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf74a5f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf700c68b0 0x7faf700c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf74a5f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf701569f0 0x7faf7015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf74a5f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015a100 con 0x7faf700c68b0 2023-10-06T05:26:53.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf74a5f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf701594f0 con 0x7faf700ab220 2023-10-06T05:26:53.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf74a5f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf701597d0 con 0x7faf701569f0 2023-10-06T05:26:53.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf700c68b0 0x7faf700c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf700c68b0 0x7faf700c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38858/0 (socket says 172.21.15.29:38858) 2023-10-06T05:26:53.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6e59c700 1 -- 172.21.15.29:0/575232733 learned_addr learned my addr 172.21.15.29:0/575232733 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:53.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6ed9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf700ab220 0x7faf70150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6f59e700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf701569f0 0x7faf7015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6f59e700 1 -- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf700ab220 msgr2=0x7faf70150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6f59e700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf700ab220 0x7faf70150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6f59e700 1 -- 172.21.15.29:0/575232733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf700c68b0 msgr2=0x7faf700c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:53.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6f59e700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf700c68b0 0x7faf700c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:53.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6f59e700 1 -- 172.21.15.29:0/575232733 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58009420 con 0x7faf701569f0 2023-10-06T05:26:53.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6e59c700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf700c68b0 0x7faf700c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:53.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf6f59e700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf701569f0 0x7faf7015e9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c830 tx=0x7faf68001690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf66ffd700 1 -- 172.21.15.29:0/575232733 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68012630 con 0x7faf701569f0 2023-10-06T05:26:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf66ffd700 1 -- 172.21.15.29:0/575232733 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf68012790 con 0x7faf701569f0 2023-10-06T05:26:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf70159ab0 con 0x7faf701569f0 2023-10-06T05:26:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf66ffd700 1 -- 172.21.15.29:0/575232733 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68012b50 con 0x7faf701569f0 2023-10-06T05:26:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.952+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf700c42c0 con 0x7faf701569f0 2023-10-06T05:26:53.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.956+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7015bf10 con 0x7faf701569f0 2023-10-06T05:26:53.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.956+0000 7faf66ffd700 1 -- 172.21.15.29:0/575232733 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faf68011380 con 0x7faf701569f0 2023-10-06T05:26:53.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.956+0000 7faf66ffd700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf50060620 0x7faf50062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:53.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.956+0000 7faf66ffd700 1 -- 172.21.15.29:0/575232733 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faf6807ca50 con 0x7faf701569f0 2023-10-06T05:26:53.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.956+0000 7faf6ed9d700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf50060620 0x7faf50062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:53.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.960+0000 7faf6ed9d700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf50060620 0x7faf50062ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faf60007fd0 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:53.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:53.968+0000 7faf66ffd700 1 -- 172.21.15.29:0/575232733 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faf6804cf00 con 0x7faf701569f0 2023-10-06T05:26:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.164+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf70159910 con 0x7faf701569f0 2023-10-06T05:26:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf66ffd700 1 -- 172.21.15.29:0/575232733 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4597 (secure 0 0 0) 0x7faf70159910 con 0x7faf701569f0 2023-10-06T05:26:54.172 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:54.172 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3342279357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3342279357},{"type":"v1","addr":"172.21.15.173:6835","nonce":3342279357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2659141401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2659141401},{"type":"v1","addr":"172.21.15.173:6837","nonce":2659141401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/648720882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":648720882},{"type":"v1","addr":"172.21.15.29:6833","nonce":648720882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:26:26.407210+0000","modified":"2023-10-06T05:26:29.412409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/244763098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":244763098},{"type":"v1","addr":"172.21.15.29:6835","nonce":244763098}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T05:26:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf50060620 msgr2=0x7faf50062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf50060620 0x7faf50062ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faf60007fd0 tx=0x7faf60009040 comp rx=0 tx=0).stop 2023-10-06T05:26:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf701569f0 msgr2=0x7faf7015e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf701569f0 0x7faf7015e9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c830 tx=0x7faf68001690 comp rx=0 tx=0).stop 2023-10-06T05:26:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 shutdown_connections 2023-10-06T05:26:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf701569f0 0x7faf7015e9e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf700c68b0 0x7faf700c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7faf50060620 0x7faf50062ad0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 --2- 172.21.15.29:0/575232733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf700ab220 0x7faf70150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 >> 172.21.15.29:0/575232733 conn(0x7faf700670a0 msgr2=0x7faf701522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:54.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 shutdown_connections 2023-10-06T05:26:54.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.168+0000 7faf74a5f700 1 -- 172.21.15.29:0/575232733 wait complete. 2023-10-06T05:26:54.176 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-10-06T05:26:54.186 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a229f8700 1 Processor -- start 2023-10-06T05:26:54.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a229f8700 1 -- start start 2023-10-06T05:26:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a229f8700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1a1c1531a0 0x7f1a1c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a229f8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c0af430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a229f8700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c06e060 con 0x7f1a1c152dd0 2023-10-06T05:26:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a229f8700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c0acbb0 con 0x7f1a1c1531a0 2023-10-06T05:26:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a229f8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0ac030 con 0x7f1a1c06dc10 2023-10-06T05:26:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a20f95700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c0af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a1b7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1a1c1531a0 0x7f1a1c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a20f95700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c0af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:37980/0 (socket says 172.21.15.29:37980) 2023-10-06T05:26:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a20f95700 1 -- 172.21.15.29:0/3103558081 learned_addr learned my addr 172.21.15.29:0/3103558081 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:54.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a1bfff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f1a1c152dd0 0x7f1a1c1563b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:33376/0 (socket says 172.21.15.29:33376) 2023-10-06T05:26:54.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a1affd700 1 -- 172.21.15.29:0/3103558081 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917551572 0 0) 0x7f1a1c06e060 con 0x7f1a1c152dd0 2023-10-06T05:26:54.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a1affd700 1 -- 172.21.15.29:0/3103558081 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a08003570 con 0x7f1a1c152dd0 2023-10-06T05:26:54.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a20f95700 1 -- 172.21.15.29:0/3103558081 >> v2:172.21.15.173:3300/0 conn(0x7f1a1c1531a0 msgr2=0x7f1a1c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:54.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a20f95700 1 --2- 172.21.15.29:0/3103558081 >> v2:172.21.15.173:3300/0 conn(0x7f1a1c1531a0 0x7f1a1c06d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a20f95700 1 -- 172.21.15.29:0/3103558081 >> v1:172.21.15.173:6789/0 conn(0x7f1a1c152dd0 legacy=0x7f1a1c1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.284+0000 7f1a20f95700 1 -- 172.21.15.29:0/3103558081 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c0ac310 con 0x7f1a1c06dc10 2023-10-06T05:26:54.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a20f95700 1 --2- 172.21.15.29:0/3103558081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c0af430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009f20 tx=0x7f1a14009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d070b8b5ef4986 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:54.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a1affd700 1 -- 172.21.15.29:0/3103558081 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400e070 con 0x7f1a1c06dc10 2023-10-06T05:26:54.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a1affd700 1 -- 172.21.15.29:0/3103558081 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1400ba00 con 0x7f1a1c06dc10 2023-10-06T05:26:54.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a1affd700 1 -- 172.21.15.29:0/3103558081 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a140092e0 con 0x7f1a1c06dc10 2023-10-06T05:26:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 -- 172.21.15.29:0/3103558081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 msgr2=0x7f1a1c0af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 --2- 172.21.15.29:0/3103558081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c0af430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009f20 tx=0x7f1a14009840 comp rx=0 tx=0).stop 2023-10-06T05:26:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 -- 172.21.15.29:0/3103558081 shutdown_connections 2023-10-06T05:26:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 --2- 172.21.15.29:0/3103558081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c0af430 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 --2- 172.21.15.29:0/3103558081 >> v2:172.21.15.173:3300/0 conn(0x7f1a1c1531a0 0x7f1a1c06d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 -- 172.21.15.29:0/3103558081 >> 172.21.15.29:0/3103558081 conn(0x7f1a1c06b7b0 msgr2=0x7f1a1c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 -- 172.21.15.29:0/3103558081 shutdown_connections 2023-10-06T05:26:54.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 -- 172.21.15.29:0/3103558081 wait complete. 2023-10-06T05:26:54.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 Processor -- start 2023-10-06T05:26:54.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.288+0000 7f1a229f8700 1 -- start start 2023-10-06T05:26:54.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a229f8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c13de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a229f8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a1c152dd0 0x7f1a1c0670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a229f8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a1c0675e0 0x7f1a1c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a229f8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c067a80 con 0x7f1a1c152dd0 2023-10-06T05:26:54.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a229f8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c16a9f0 con 0x7f1a1c0675e0 2023-10-06T05:26:54.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a229f8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c16a0c0 con 0x7f1a1c06dc10 2023-10-06T05:26:54.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a1c152dd0 0x7f1a1c0670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a1c152dd0 0x7f1a1c0670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38866/0 (socket says 172.21.15.29:38866) 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1b7fe700 1 -- 172.21.15.29:0/1455435920 learned_addr learned my addr 172.21.15.29:0/1455435920 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a20f95700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a1c0675e0 0x7f1a1c1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1bfff700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c13de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1b7fe700 1 -- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 msgr2=0x7f1a1c13de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1b7fe700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c13de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1b7fe700 1 -- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a1c0675e0 msgr2=0x7f1a1c1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1b7fe700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a1c0675e0 0x7f1a1c1509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1b7fe700 1 -- 172.21.15.29:0/1455435920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14009ae0 con 0x7f1a1c152dd0 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1bfff700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c13de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a1b7fe700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a1c152dd0 0x7f1a1c0670a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00e900 tx=0x7f1a0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:54.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a13fff700 1 -- 172.21.15.29:0/1455435920 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c013680 con 0x7f1a1c152dd0 2023-10-06T05:26:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a13fff700 1 -- 172.21.15.29:0/1455435920 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c0137e0 con 0x7f1a1c152dd0 2023-10-06T05:26:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c16a3a0 con 0x7f1a1c152dd0 2023-10-06T05:26:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a13fff700 1 -- 172.21.15.29:0/1455435920 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c013ba0 con 0x7f1a1c152dd0 2023-10-06T05:26:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c13e360 con 0x7f1a1c152dd0 2023-10-06T05:26:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c04be00 con 0x7f1a1c152dd0 2023-10-06T05:26:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.292+0000 7f1a13fff700 1 -- 172.21.15.29:0/1455435920 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1a0c00c460 con 0x7f1a1c152dd0 2023-10-06T05:26:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.296+0000 7f1a13fff700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19fc060550 0x7f19fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.296+0000 7f1a13fff700 1 -- 172.21.15.29:0/1455435920 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1a0c07cad0 con 0x7f1a1c152dd0 2023-10-06T05:26:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.296+0000 7f1a1bfff700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19fc060550 0x7f19fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.296+0000 7f1a1bfff700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19fc060550 0x7f19fc062a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c152450 tx=0x7f1a04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:54.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.304+0000 7f1a13fff700 1 -- 172.21.15.29:0/1455435920 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1a0c04cec0 con 0x7f1a1c152dd0 2023-10-06T05:26:54.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.464+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a1c16ab30 con 0x7f1a1c152dd0 2023-10-06T05:26:54.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a13fff700 1 -- 172.21.15.29:0/1455435920 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f1a0c0504e0 con 0x7f1a1c152dd0 2023-10-06T05:26:54.473 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:54.473 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":36,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:26:28.049454+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:26:24.748472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T05:26:25.410229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19fc060550 msgr2=0x7f19fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19fc060550 0x7f19fc062a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c152450 tx=0x7f1a04009040 comp rx=0 tx=0).stop 2023-10-06T05:26:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a1c152dd0 msgr2=0x7f1a1c0670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a1c152dd0 0x7f1a1c0670a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00e900 tx=0x7f1a0c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 shutdown_connections 2023-10-06T05:26:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19fc060550 0x7f19fc062a00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a1c0675e0 0x7f1a1c1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a1c152dd0 0x7f1a1c0670a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 --2- 172.21.15.29:0/1455435920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1a1c06dc10 0x7f1a1c13de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 >> 172.21.15.29:0/1455435920 conn(0x7f1a1c06b7b0 msgr2=0x7f1a1c0aaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 shutdown_connections 2023-10-06T05:26:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.468+0000 7f1a229f8700 1 -- 172.21.15.29:0/1455435920 wait complete. 2023-10-06T05:26:54.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:26:24.748472+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:26:25.410229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:26:54.488 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:26:54.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.596+0000 7f427dabe700 1 Processor -- start 2023-10-06T05:26:54.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.596+0000 7f427dabe700 1 -- start start 2023-10-06T05:26:54.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.596+0000 7f427dabe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278158e30 0x7f4278068260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.596+0000 7f427dabe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f42780687a0 0x7f42780676f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.596+0000 7f427dabe700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427806bf90 con 0x7f4278159200 2023-10-06T05:26:54.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.596+0000 7f427dabe700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427806b6f0 con 0x7f42780687a0 2023-10-06T05:26:54.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.596+0000 7f427dabe700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427806b9d0 con 0x7f4278158e30 2023-10-06T05:26:54.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.596+0000 7f427cabc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278158e30 0x7f4278068260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.596+0000 7f427d2bd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f42780687a0 0x7f42780676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427d2bd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f42780687a0 0x7f42780676f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:39304/0 (socket says 172.21.15.29:39304) 2023-10-06T05:26:54.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427d2bd700 1 -- 172.21.15.29:0/3327292941 learned_addr learned my addr 172.21.15.29:0/3327292941 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:54.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f4277fff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4278159200 0x7f42780c6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:49276/0 (socket says 172.21.15.29:49276) 2023-10-06T05:26:54.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427d2bd700 1 -- 172.21.15.29:0/3327292941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278158e30 msgr2=0x7f4278068260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:54.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427d2bd700 1 --2- 172.21.15.29:0/3327292941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278158e30 0x7f4278068260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427d2bd700 1 -- 172.21.15.29:0/3327292941 >> v1:172.21.15.173:6789/0 conn(0x7f4278159200 legacy=0x7f42780c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427d2bd700 1 -- 172.21.15.29:0/3327292941 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427806bcb0 con 0x7f42780687a0 2023-10-06T05:26:54.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427d2bd700 1 --2- 172.21.15.29:0/3327292941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42780687a0 0x7f42780676f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4270009f20 tx=0x7f4270009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca815b76bb3573f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:54.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f42777fe700 1 -- 172.21.15.29:0/3327292941 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000e070 con 0x7f42780687a0 2023-10-06T05:26:54.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f42777fe700 1 -- 172.21.15.29:0/3327292941 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000b9d0 con 0x7f42780687a0 2023-10-06T05:26:54.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f42777fe700 1 -- 172.21.15.29:0/3327292941 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700092e0 con 0x7f42780687a0 2023-10-06T05:26:54.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427dabe700 1 -- 172.21.15.29:0/3327292941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42780687a0 msgr2=0x7f42780676f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427dabe700 1 --2- 172.21.15.29:0/3327292941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42780687a0 0x7f42780676f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4270009f20 tx=0x7f4270009840 comp rx=0 tx=0).stop 2023-10-06T05:26:54.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427dabe700 1 -- 172.21.15.29:0/3327292941 shutdown_connections 2023-10-06T05:26:54.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427dabe700 1 --2- 172.21.15.29:0/3327292941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42780687a0 0x7f42780676f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427dabe700 1 --2- 172.21.15.29:0/3327292941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278158e30 0x7f4278068260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427dabe700 1 -- 172.21.15.29:0/3327292941 >> 172.21.15.29:0/3327292941 conn(0x7f42780c9830 msgr2=0x7f427806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:54.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427dabe700 1 -- 172.21.15.29:0/3327292941 shutdown_connections 2023-10-06T05:26:54.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.600+0000 7f427dabe700 1 -- 172.21.15.29:0/3327292941 wait complete. 2023-10-06T05:26:54.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 Processor -- start 2023-10-06T05:26:54.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 -- start start 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42780687a0 0x7f42780ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4278158e30 0x7f4278155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4278159200 0x7f427815b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780aa920 con 0x7f4278159200 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780aa490 con 0x7f4278158e30 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780a9880 con 0x7f42780687a0 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427d2bd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4278159200 0x7f427815b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427d2bd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4278159200 0x7f427815b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48780/0 (socket says 172.21.15.29:48780) 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427d2bd700 1 -- 172.21.15.29:0/976565440 learned_addr learned my addr 172.21.15.29:0/976565440 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:54.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f4277fff700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4278158e30 0x7f4278155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427cabc700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42780687a0 0x7f42780ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427d2bd700 1 -- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42780687a0 msgr2=0x7f42780ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427d2bd700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42780687a0 0x7f42780ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427d2bd700 1 -- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4278158e30 msgr2=0x7f4278155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427d2bd700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4278158e30 0x7f4278155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427d2bd700 1 -- 172.21.15.29:0/976565440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270009ae0 con 0x7f4278159200 2023-10-06T05:26:54.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f4277fff700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4278158e30 0x7f4278155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:54.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427d2bd700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4278159200 0x7f427815b750 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f427000b610 tx=0x7f4270018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f4274ff9700 1 -- 172.21.15.29:0/976565440 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270008c30 con 0x7f4278159200 2023-10-06T05:26:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f4274ff9700 1 -- 172.21.15.29:0/976565440 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4270008d90 con 0x7f4278159200 2023-10-06T05:26:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42780a9b60 con 0x7f4278159200 2023-10-06T05:26:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f4274ff9700 1 -- 172.21.15.29:0/976565440 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270025690 con 0x7f4278159200 2023-10-06T05:26:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.604+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42780aa120 con 0x7f4278159200 2023-10-06T05:26:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.608+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42780aa620 con 0x7f4278159200 2023-10-06T05:26:54.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.608+0000 7f4274ff9700 1 -- 172.21.15.29:0/976565440 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4270003040 con 0x7f4278159200 2023-10-06T05:26:54.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.608+0000 7f4274ff9700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4264060550 0x7f4264062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.608+0000 7f4274ff9700 1 -- 172.21.15.29:0/976565440 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f427007e010 con 0x7f4278159200 2023-10-06T05:26:54.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.608+0000 7f427cabc700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4264060550 0x7f4264062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.608+0000 7f427cabc700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4264060550 0x7f4264062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f426c009ca0 tx=0x7f426c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:54.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.620+0000 7f4274ff9700 1 -- 172.21.15.29:0/976565440 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f427004e520 con 0x7f4278159200 2023-10-06T05:26:54.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f427804be00 con 0x7f4278159200 2023-10-06T05:26:54.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f4274ff9700 1 -- 172.21.15.29:0/976565440 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4270051b40 con 0x7f4278159200 2023-10-06T05:26:54.789 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:26:54.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4264060550 msgr2=0x7f4264062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4264060550 0x7f4264062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f426c009ca0 tx=0x7f426c008040 comp rx=0 tx=0).stop 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4278159200 msgr2=0x7f427815b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4278159200 0x7f427815b750 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f427000b610 tx=0x7f4270018000 comp rx=0 tx=0).stop 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 shutdown_connections 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4278159200 0x7f427815b750 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4264060550 0x7f4264062a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4278158e30 0x7f4278155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 --2- 172.21.15.29:0/976565440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42780687a0 0x7f42780ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.784+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 >> 172.21.15.29:0/976565440 conn(0x7f42780c9830 msgr2=0x7f42780c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.788+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 shutdown_connections 2023-10-06T05:26:54.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.788+0000 7f427dabe700 1 -- 172.21.15.29:0/976565440 wait complete. 2023-10-06T05:26:54.803 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:26:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.912+0000 7f2292d5e700 1 Processor -- start 2023-10-06T05:26:54.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.912+0000 7f2292d5e700 1 -- start start 2023-10-06T05:26:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f2292d5e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f228c156c70 0x7f228c0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f2292d5e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f228c06d6d0 0x7f228c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f2292d5e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228c0c6b40 con 0x7f228c157040 2023-10-06T05:26:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f2292d5e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228c06e050 con 0x7f228c06d6d0 2023-10-06T05:26:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f2292d5e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228c06bdd0 con 0x7f228c156c70 2023-10-06T05:26:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f229255d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f228c06d6d0 0x7f228c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f229255d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f228c06d6d0 0x7f228c06db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48792/0 (socket says 172.21.15.29:48792) 2023-10-06T05:26:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f229255d700 1 -- 172.21.15.29:0/2776796338 learned_addr learned my addr 172.21.15.29:0/2776796338 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f2291d5c700 1 --2- 172.21.15.29:0/2776796338 >> v2:172.21.15.173:3300/0 conn(0x7f228c156c70 0x7f228c0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f229255d700 1 -- 172.21.15.29:0/2776796338 >> v2:172.21.15.173:3300/0 conn(0x7f228c156c70 msgr2=0x7f228c0c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f229255d700 1 --2- 172.21.15.29:0/2776796338 >> v2:172.21.15.173:3300/0 conn(0x7f228c156c70 0x7f228c0c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f229255d700 1 -- 172.21.15.29:0/2776796338 >> v1:172.21.15.173:6789/0 conn(0x7f228c157040 legacy=0x7f228c06b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f229255d700 1 -- 172.21.15.29:0/2776796338 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c0c6d90 con 0x7f228c06d6d0 2023-10-06T05:26:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f229255d700 1 --2- 172.21.15.29:0/2776796338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 0x7f228c06db10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f228c069d70 tx=0x7f2284009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3615b3ce3d495ff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f2290d5a700 1 -- 172.21.15.29:0/2776796338 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400e070 con 0x7f228c06d6d0 2023-10-06T05:26:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f2290d5a700 1 -- 172.21.15.29:0/2776796338 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228400ba20 con 0x7f228c06d6d0 2023-10-06T05:26:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.916+0000 7f2290d5a700 1 -- 172.21.15.29:0/2776796338 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840092e0 con 0x7f228c06d6d0 2023-10-06T05:26:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 -- 172.21.15.29:0/2776796338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 msgr2=0x7f228c06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 --2- 172.21.15.29:0/2776796338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 0x7f228c06db10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f228c069d70 tx=0x7f2284009840 comp rx=0 tx=0).stop 2023-10-06T05:26:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 -- 172.21.15.29:0/2776796338 shutdown_connections 2023-10-06T05:26:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 --2- 172.21.15.29:0/2776796338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 0x7f228c06db10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 --2- 172.21.15.29:0/2776796338 >> v2:172.21.15.173:3300/0 conn(0x7f228c156c70 0x7f228c0c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 -- 172.21.15.29:0/2776796338 >> 172.21.15.29:0/2776796338 conn(0x7f228c0c9830 msgr2=0x7f228c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 -- 172.21.15.29:0/2776796338 shutdown_connections 2023-10-06T05:26:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 -- 172.21.15.29:0/2776796338 wait complete. 2023-10-06T05:26:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 Processor -- start 2023-10-06T05:26:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.920+0000 7f2292d5e700 1 -- start start 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2292d5e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 0x7f228c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2292d5e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c156c70 0x7f228c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2292d5e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c157040 0x7f228c0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2292d5e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c0b02f0 con 0x7f228c06d6d0 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2292d5e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c155430 con 0x7f228c157040 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2292d5e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228c0c5820 con 0x7f228c156c70 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2291d5c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 0x7f228c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2291d5c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 0x7f228c0af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48798/0 (socket says 172.21.15.29:48798) 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2291d5c700 1 -- 172.21.15.29:0/2862208832 learned_addr learned my addr 172.21.15.29:0/2862208832 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f229255d700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c157040 0x7f228c0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f229155b700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c156c70 0x7f228c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2291d5c700 1 -- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c156c70 msgr2=0x7f228c154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2291d5c700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c156c70 0x7f228c154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2291d5c700 1 -- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c157040 msgr2=0x7f228c0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2291d5c700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c157040 0x7f228c0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2291d5c700 1 -- 172.21.15.29:0/2862208832 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2284009ae0 con 0x7f228c06d6d0 2023-10-06T05:26:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f229255d700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c157040 0x7f228c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2291d5c700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 0x7f228c0af090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f228800ecb0 tx=0x7f22880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:54.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2281ffb700 1 -- 172.21.15.29:0/2862208832 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228800c850 con 0x7f228c06d6d0 2023-10-06T05:26:54.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2281ffb700 1 -- 172.21.15.29:0/2862208832 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228800c9b0 con 0x7f228c06d6d0 2023-10-06T05:26:54.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c0af6e0 con 0x7f228c06d6d0 2023-10-06T05:26:54.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2281ffb700 1 -- 172.21.15.29:0/2862208832 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228800cd50 con 0x7f228c06d6d0 2023-10-06T05:26:54.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c0afca0 con 0x7f228c06d6d0 2023-10-06T05:26:54.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c04be00 con 0x7f228c06d6d0 2023-10-06T05:26:54.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.924+0000 7f2281ffb700 1 -- 172.21.15.29:0/2862208832 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2288013680 con 0x7f228c06d6d0 2023-10-06T05:26:54.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.928+0000 7f2281ffb700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2270060580 0x7f2270062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:54.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.928+0000 7f2281ffb700 1 -- 172.21.15.29:0/2862208832 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f228807cae0 con 0x7f228c06d6d0 2023-10-06T05:26:54.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.928+0000 7f229155b700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2270060580 0x7f2270062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.928+0000 7f229155b700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2270060580 0x7f2270062a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f228c16c7b0 tx=0x7f227c007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:54.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:54.932+0000 7f2281ffb700 1 -- 172.21.15.29:0/2862208832 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f228804cf70 con 0x7f228c06d6d0 2023-10-06T05:26:55.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.096+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f228c0c72b0 con 0x7f228c06d6d0 2023-10-06T05:26:55.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2281ffb700 1 -- 172.21.15.29:0/2862208832 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2288050590 con 0x7f228c06d6d0 2023-10-06T05:26:55.104 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:26:55.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2270060580 msgr2=0x7f2270062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2270060580 0x7f2270062a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f228c16c7b0 tx=0x7f227c007ec0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 msgr2=0x7f228c0af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 0x7f228c0af090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f228800ecb0 tx=0x7f22880091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 shutdown_connections 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2270060580 0x7f2270062a30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f228c157040 0x7f228c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f228c156c70 0x7f228c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 --2- 172.21.15.29:0/2862208832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f228c06d6d0 0x7f228c0af090 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 >> 172.21.15.29:0/2862208832 conn(0x7f228c0c9830 msgr2=0x7f228c0ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 shutdown_connections 2023-10-06T05:26:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.100+0000 7f2292d5e700 1 -- 172.21.15.29:0/2862208832 wait complete. 2023-10-06T05:26:55.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:26:55.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff214d50700 1 Processor -- start 2023-10-06T05:26:55.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff214d50700 1 -- start start 2023-10-06T05:26:55.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff214d50700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 0x7ff2100b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff214d50700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff2100cdcb0 0x7ff2100cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff214d50700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100c8e70 con 0x7ff2100cb3a0 2023-10-06T05:26:55.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff214d50700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100ce220 con 0x7ff2100cdcb0 2023-10-06T05:26:55.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff214d50700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100ce500 con 0x7ff210156d70 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff20dd9b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff2100cdcb0 0x7ff2100cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff20e59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 0x7ff2100b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff20ed9d700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff2100cb3a0 0x7ff2100afbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:49288/0 (socket says 172.21.15.29:49288) 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.224+0000 7ff20ed9d700 1 -- 172.21.15.29:0/1577879839 learned_addr learned my addr 172.21.15.29:0/1577879839 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20d59a700 1 -- 172.21.15.29:0/1577879839 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825542270 0 0) 0x7ff2100c8e70 con 0x7ff2100cb3a0 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20d59a700 1 -- 172.21.15.29:0/1577879839 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f8003570 con 0x7ff2100cb3a0 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20dd9b700 1 -- 172.21.15.29:0/1577879839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 msgr2=0x7ff2100b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20dd9b700 1 --2- 172.21.15.29:0/1577879839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 0x7ff2100b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20dd9b700 1 -- 172.21.15.29:0/1577879839 >> v1:172.21.15.173:6789/0 conn(0x7ff2100cb3a0 legacy=0x7ff2100afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20dd9b700 1 -- 172.21.15.29:0/1577879839 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100c8b00 con 0x7ff2100cdcb0 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20e59c700 1 --2- 172.21.15.29:0/1577879839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 0x7ff2100b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:55.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20dd9b700 1 --2- 172.21.15.29:0/1577879839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2100cdcb0 0x7ff2100cae60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff2040098e0 tx=0x7ff2040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc039f13d376998a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:55.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20d59a700 1 -- 172.21.15.29:0/1577879839 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204011630 con 0x7ff2100cdcb0 2023-10-06T05:26:55.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20d59a700 1 -- 172.21.15.29:0/1577879839 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204011790 con 0x7ff2100cdcb0 2023-10-06T05:26:55.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff20d59a700 1 -- 172.21.15.29:0/1577879839 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204011b30 con 0x7ff2100cdcb0 2023-10-06T05:26:55.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff214d50700 1 -- 172.21.15.29:0/1577879839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2100cdcb0 msgr2=0x7ff2100cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff214d50700 1 --2- 172.21.15.29:0/1577879839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2100cdcb0 0x7ff2100cae60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff2040098e0 tx=0x7ff2040091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff214d50700 1 -- 172.21.15.29:0/1577879839 shutdown_connections 2023-10-06T05:26:55.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff214d50700 1 --2- 172.21.15.29:0/1577879839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2100cdcb0 0x7ff2100cae60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff214d50700 1 --2- 172.21.15.29:0/1577879839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 0x7ff2100b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff214d50700 1 -- 172.21.15.29:0/1577879839 >> 172.21.15.29:0/1577879839 conn(0x7ff2100692b0 msgr2=0x7ff210069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:55.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff214d50700 1 -- 172.21.15.29:0/1577879839 shutdown_connections 2023-10-06T05:26:55.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.228+0000 7ff214d50700 1 -- 172.21.15.29:0/1577879839 wait complete. 2023-10-06T05:26:55.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 Processor -- start 2023-10-06T05:26:55.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 -- start start 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2100cb3a0 0x7ff210157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2100cdcb0 0x7ff2101667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 0x7ff210166d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210157c00 con 0x7ff2100cb3a0 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210157ee0 con 0x7ff2100cdcb0 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2101581c0 con 0x7ff210156d70 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2100cb3a0 0x7ff210157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2100cb3a0 0x7ff210157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48800/0 (socket says 172.21.15.29:48800) 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20e59c700 1 -- 172.21.15.29:0/3910532533 learned_addr learned my addr 172.21.15.29:0/3910532533 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20dd9b700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2100cdcb0 0x7ff2101667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20ed9d700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 0x7ff210166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20e59c700 1 -- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 msgr2=0x7ff210166d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20e59c700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 0x7ff210166d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20e59c700 1 -- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2100cdcb0 msgr2=0x7ff2101667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20e59c700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2100cdcb0 0x7ff2101667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20e59c700 1 -- 172.21.15.29:0/3910532533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200009420 con 0x7ff2100cb3a0 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff20e59c700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2100cb3a0 0x7ff210157140 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff20000ec80 tx=0x7ff2000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff1fe7fc700 1 -- 172.21.15.29:0/3910532533 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20000c850 con 0x7ff2100cb3a0 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff204009420 con 0x7ff2100cb3a0 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff1fe7fc700 1 -- 172.21.15.29:0/3910532533 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20000c9b0 con 0x7ff2100cb3a0 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff1fe7fc700 1 -- 172.21.15.29:0/3910532533 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20000cd30 con 0x7ff2100cb3a0 2023-10-06T05:26:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.232+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21015a9d0 con 0x7ff2100cb3a0 2023-10-06T05:26:55.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.236+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff210159260 con 0x7ff2100cb3a0 2023-10-06T05:26:55.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.236+0000 7ff1fe7fc700 1 -- 172.21.15.29:0/3910532533 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff200013680 con 0x7ff2100cb3a0 2023-10-06T05:26:55.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.236+0000 7ff1fe7fc700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff1f0060580 0x7ff1f0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.236+0000 7ff1fe7fc700 1 -- 172.21.15.29:0/3910532533 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff20007d1d0 con 0x7ff2100cb3a0 2023-10-06T05:26:55.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.236+0000 7ff20dd9b700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff1f0060580 0x7ff1f0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.240+0000 7ff20dd9b700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff1f0060580 0x7ff1f0062a30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff2040091e0 tx=0x7ff204017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:55.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.244+0000 7ff1fe7fc700 1 -- 172.21.15.29:0/3910532533 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff20004d5c0 con 0x7ff2100cb3a0 2023-10-06T05:26:55.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.404+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff210159260 con 0x7ff2100cb3a0 2023-10-06T05:26:55.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.404+0000 7ff1fe7fc700 1 -- 172.21.15.29:0/3910532533 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff210159260 con 0x7ff2100cb3a0 2023-10-06T05:26:55.411 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:26:55.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff1f0060580 msgr2=0x7ff1f0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff1f0060580 0x7ff1f0062a30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff2040091e0 tx=0x7ff204017000 comp rx=0 tx=0).stop 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2100cb3a0 msgr2=0x7ff210157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2100cb3a0 0x7ff210157140 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff20000ec80 tx=0x7ff2000091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 shutdown_connections 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff210156d70 0x7ff210166d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff1f0060580 0x7ff1f0062a30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2100cdcb0 0x7ff2101667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 --2- 172.21.15.29:0/3910532533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2100cb3a0 0x7ff210157140 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 >> 172.21.15.29:0/3910532533 conn(0x7ff2100692b0 msgr2=0x7ff2100b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 shutdown_connections 2023-10-06T05:26:55.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.408+0000 7ff214d50700 1 -- 172.21.15.29:0/3910532533 wait complete. 2023-10-06T05:26:55.425 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:26:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.536+0000 7fada2b37700 1 Processor -- start 2023-10-06T05:26:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.536+0000 7fada2b37700 1 -- start start 2023-10-06T05:26:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fad9c155ac0 0x7fad9c0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad9c0cb8c0 0x7fad9c0c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c0c9ed0 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9c0c8ce0 con 0x7fad9c0cb8c0 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9c0c8060 con 0x7fad9c155ac0 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada1334700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad9c0cb8c0 0x7fad9c0c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada1334700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad9c0cb8c0 0x7fad9c0c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48816/0 (socket says 172.21.15.29:48816) 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada1334700 1 -- 172.21.15.29:0/1921784620 learned_addr learned my addr 172.21.15.29:0/1921784620 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada1b35700 1 --2- 172.21.15.29:0/1921784620 >> v2:172.21.15.173:3300/0 conn(0x7fad9c155ac0 0x7fad9c0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada1334700 1 -- 172.21.15.29:0/1921784620 >> v2:172.21.15.173:3300/0 conn(0x7fad9c155ac0 msgr2=0x7fad9c0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:55.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada1334700 1 --2- 172.21.15.29:0/1921784620 >> v2:172.21.15.173:3300/0 conn(0x7fad9c155ac0 0x7fad9c0c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada1334700 1 -- 172.21.15.29:0/1921784620 >> v1:172.21.15.173:6789/0 conn(0x7fad9c0c9ab0 legacy=0x7fad9c159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:55.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada1334700 1 -- 172.21.15.29:0/1921784620 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0c8340 con 0x7fad9c0cb8c0 2023-10-06T05:26:55.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada1334700 1 --2- 172.21.15.29:0/1921784620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0cb8c0 0x7fad9c0c9570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fad9c06af00 tx=0x7fad8c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d2c374fef3503 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:55.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada0b33700 1 -- 172.21.15.29:0/1921784620 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00dc10 con 0x7fad9c0cb8c0 2023-10-06T05:26:55.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada0b33700 1 -- 172.21.15.29:0/1921784620 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c00dd70 con 0x7fad9c0cb8c0 2023-10-06T05:26:55.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada0b33700 1 -- 172.21.15.29:0/1921784620 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0106c0 con 0x7fad9c0cb8c0 2023-10-06T05:26:55.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 -- 172.21.15.29:0/1921784620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0cb8c0 msgr2=0x7fad9c0c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 --2- 172.21.15.29:0/1921784620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0cb8c0 0x7fad9c0c9570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fad9c06af00 tx=0x7fad8c00b4f0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 -- 172.21.15.29:0/1921784620 shutdown_connections 2023-10-06T05:26:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 --2- 172.21.15.29:0/1921784620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0cb8c0 0x7fad9c0c9570 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 --2- 172.21.15.29:0/1921784620 >> v2:172.21.15.173:3300/0 conn(0x7fad9c155ac0 0x7fad9c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 -- 172.21.15.29:0/1921784620 >> 172.21.15.29:0/1921784620 conn(0x7fad9c06ba30 msgr2=0x7fad9c095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 -- 172.21.15.29:0/1921784620 shutdown_connections 2023-10-06T05:26:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.540+0000 7fada2b37700 1 -- 172.21.15.29:0/1921784620 wait complete. 2023-10-06T05:26:55.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada2b37700 1 Processor -- start 2023-10-06T05:26:55.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada2b37700 1 -- start start 2023-10-06T05:26:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada2b37700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0c9ab0 0x7fad9c0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada2b37700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad9c0cb8c0 0x7fad9c149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada2b37700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad9c155ac0 0x7fad9c14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada2b37700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0c4c20 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada2b37700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0c5760 con 0x7fad9c0cb8c0 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada2b37700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0c4e30 con 0x7fad9c155ac0 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada1b35700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0c9ab0 0x7fad9c0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada1b35700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0c9ab0 0x7fad9c0b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48824/0 (socket says 172.21.15.29:48824) 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada1b35700 1 -- 172.21.15.29:0/644875812 learned_addr learned my addr 172.21.15.29:0/644875812 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada1334700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad9c0cb8c0 0x7fad9c149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.544+0000 7fada2336700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad9c155ac0 0x7fad9c14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fada1b35700 1 -- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad9c155ac0 msgr2=0x7fad9c14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fada1b35700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad9c155ac0 0x7fad9c14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fada1b35700 1 -- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad9c0cb8c0 msgr2=0x7fad9c149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fada1b35700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad9c0cb8c0 0x7fad9c149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fada1b35700 1 -- 172.21.15.29:0/644875812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c00b790 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fada1b35700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0c9ab0 0x7fad9c0b0b70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fad9800d890 tx=0x7fad98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:55.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fad91ffb700 1 -- 172.21.15.29:0/644875812 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98018070 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fad91ffb700 1 -- 172.21.15.29:0/644875812 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad98005a00 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c0c5110 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fad91ffb700 1 -- 172.21.15.29:0/644875812 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98005da0 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c0b28a0 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c04be00 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fad91ffb700 1 -- 172.21.15.29:0/644875812 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fad98012800 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fad91ffb700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fad80060550 0x7fad80062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.548+0000 7fad91ffb700 1 -- 172.21.15.29:0/644875812 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad9807ca60 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.552+0000 7fada1334700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fad80060550 0x7fad80062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.552+0000 7fada1334700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fad80060550 0x7fad80062a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad9c06af00 tx=0x7fad8c01a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:55.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.556+0000 7fad91ffb700 1 -- 172.21.15.29:0/644875812 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fad98050980 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.712+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad9c0c8620 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fad91ffb700 1 -- 172.21.15.29:0/644875812 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad98050510 con 0x7fad9c0c9ab0 2023-10-06T05:26:55.720 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:26:55.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fad80060550 msgr2=0x7fad80062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fad80060550 0x7fad80062a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad9c06af00 tx=0x7fad8c01a000 comp rx=0 tx=0).stop 2023-10-06T05:26:55.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0c9ab0 msgr2=0x7fad9c0b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0c9ab0 0x7fad9c0b0b70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fad9800d890 tx=0x7fad98008040 comp rx=0 tx=0).stop 2023-10-06T05:26:55.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 shutdown_connections 2023-10-06T05:26:55.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad9c155ac0 0x7fad9c14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fad80060550 0x7fad80062a00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad9c0cb8c0 0x7fad9c149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 --2- 172.21.15.29:0/644875812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0c9ab0 0x7fad9c0b0b70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 >> 172.21.15.29:0/644875812 conn(0x7fad9c06ba30 msgr2=0x7fad9c14dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:55.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 shutdown_connections 2023-10-06T05:26:55.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.716+0000 7fada2b37700 1 -- 172.21.15.29:0/644875812 wait complete. 2023-10-06T05:26:55.735 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:55.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.836+0000 7f8d60f4f700 1 Processor -- start 2023-10-06T05:26:55.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.836+0000 7f8d60f4f700 1 -- start start 2023-10-06T05:26:55.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b11b0 0x7f8d5c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c06a970 con 0x7f8d5c0cc460 2023-10-06T05:26:55.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c06f120 con 0x7f8d5c0b0de0 2023-10-06T05:26:55.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c06f6e0 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d5ad9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8d5c0cc460 0x7f8d5c06ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39576/0 (socket says 172.21.15.29:39576) 2023-10-06T05:26:55.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d5ad9d700 1 -- 172.21.15.29:0/1896992784 learned_addr learned my addr 172.21.15.29:0/1896992784 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:55.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d59d9b700 1 --2- 172.21.15.29:0/1896992784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b11b0 0x7f8d5c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d5959a700 1 -- 172.21.15.29:0/1896992784 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999846948 0 0) 0x7f8d5c06a970 con 0x7f8d5c0cc460 2023-10-06T05:26:55.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d5959a700 1 -- 172.21.15.29:0/1896992784 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d48003570 con 0x7f8d5c0cc460 2023-10-06T05:26:55.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d5959a700 1 -- 172.21.15.29:0/1896992784 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266089970 0 0) 0x7f8d5c06f120 con 0x7f8d5c0b0de0 2023-10-06T05:26:55.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d5959a700 1 -- 172.21.15.29:0/1896992784 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d5c06a970 con 0x7f8d5c0b0de0 2023-10-06T05:26:55.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d59d9b700 1 -- 172.21.15.29:0/1896992784 >> v1:172.21.15.173:6789/0 conn(0x7f8d5c0b0de0 legacy=0x7f8d5c0ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d59d9b700 1 -- 172.21.15.29:0/1896992784 >> v1:172.21.15.29:6789/0 conn(0x7f8d5c0cc460 legacy=0x7f8d5c06ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d59d9b700 1 -- 172.21.15.29:0/1896992784 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c06f400 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d59d9b700 1 --2- 172.21.15.29:0/1896992784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b11b0 0x7f8d5c06e9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009e90 tx=0x7f8d44009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=368dcc0254654a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:55.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d5959a700 1 -- 172.21.15.29:0/1896992784 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400e070 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d5959a700 1 -- 172.21.15.29:0/1896992784 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4400bb80 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d5959a700 1 -- 172.21.15.29:0/1896992784 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44012430 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 -- 172.21.15.29:0/1896992784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b11b0 msgr2=0x7f8d5c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 --2- 172.21.15.29:0/1896992784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b11b0 0x7f8d5c06e9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009e90 tx=0x7f8d44009780 comp rx=0 tx=0).stop 2023-10-06T05:26:55.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 -- 172.21.15.29:0/1896992784 shutdown_connections 2023-10-06T05:26:55.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 --2- 172.21.15.29:0/1896992784 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b11b0 0x7f8d5c06e9f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 -- 172.21.15.29:0/1896992784 >> 172.21.15.29:0/1896992784 conn(0x7f8d5c067b70 msgr2=0x7f8d5c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:55.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 -- 172.21.15.29:0/1896992784 shutdown_connections 2023-10-06T05:26:55.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.840+0000 7f8d60f4f700 1 -- 172.21.15.29:0/1896992784 wait complete. 2023-10-06T05:26:55.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.844+0000 7f8d60f4f700 1 Processor -- start 2023-10-06T05:26:55.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.844+0000 7f8d60f4f700 1 -- start start 2023-10-06T05:26:55.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d60f4f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b0de0 0x7f8d5c16d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d60f4f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d5c0b11b0 0x7f8d5c153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d60f4f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d5c0cc460 0x7f8d5c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d60f4f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c16a5b0 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d60f4f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0af460 con 0x7f8d5c0cc460 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d60f4f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0af740 con 0x7f8d5c0b0de0 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d59d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d5c0b11b0 0x7f8d5c153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d59d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d5c0b11b0 0x7f8d5c153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48836/0 (socket says 172.21.15.29:48836) 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d59d9b700 1 -- 172.21.15.29:0/2280756990 learned_addr learned my addr 172.21.15.29:0/2280756990 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d5a59c700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b0de0 0x7f8d5c16d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d5ad9d700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d5c0cc460 0x7f8d5c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d59d9b700 1 -- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b0de0 msgr2=0x7f8d5c16d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d59d9b700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b0de0 0x7f8d5c16d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d59d9b700 1 -- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d5c0cc460 msgr2=0x7f8d5c15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:55.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d59d9b700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d5c0cc460 0x7f8d5c15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:55.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d59d9b700 1 -- 172.21.15.29:0/2280756990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44009a20 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d5ad9d700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d5c0cc460 0x7f8d5c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:26:55.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d59d9b700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d5c0b11b0 0x7f8d5c153ce0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8d440097c0 tx=0x7f8d44019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d527fc700 1 -- 172.21.15.29:0/2280756990 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400be40 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d527fc700 1 -- 172.21.15.29:0/2280756990 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d44012e00 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5c0afa20 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d527fc700 1 -- 172.21.15.29:0/2280756990 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4401b850 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5c154220 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c0af2c0 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.848+0000 7f8d527fc700 1 -- 172.21.15.29:0/2280756990 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8d4401bc40 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.852+0000 7f8d527fc700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d3c060550 0x7f8d3c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:55.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.852+0000 7f8d527fc700 1 -- 172.21.15.29:0/2280756990 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d4407e530 con 0x7f8d5c0b11b0 2023-10-06T05:26:55.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.852+0000 7f8d5a59c700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d3c060550 0x7f8d3c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:55.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.852+0000 7f8d5a59c700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d3c060550 0x7f8d3c062a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c1526c0 tx=0x7f8d4c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:55.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:55.856+0000 7f8d527fc700 1 -- 172.21.15.29:0/2280756990 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8d5c0af2c0 con 0x7f8d5c0b11b0 2023-10-06T05:26:56.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.048+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d5c0af2c0 con 0x7f8d5c0b11b0 2023-10-06T05:26:56.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.048+0000 7f8d527fc700 1 -- 172.21.15.29:0/2280756990 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f8d5c0af2c0 con 0x7f8d5c0b11b0 2023-10-06T05:26:56.055 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:56.055 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3342279357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3342279357},{"type":"v1","addr":"172.21.15.173:6835","nonce":3342279357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2659141401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2659141401},{"type":"v1","addr":"172.21.15.173:6837","nonce":2659141401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/648720882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":648720882},{"type":"v1","addr":"172.21.15.29:6833","nonce":648720882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:26:26.407210+0000","modified":"2023-10-06T05:26:29.412409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/244763098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":244763098},{"type":"v1","addr":"172.21.15.29:6835","nonce":244763098}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T05:26:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d3c060550 msgr2=0x7f8d3c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d3c060550 0x7f8d3c062a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c1526c0 tx=0x7f8d4c009040 comp rx=0 tx=0).stop 2023-10-06T05:26:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d5c0b11b0 msgr2=0x7f8d5c153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d5c0b11b0 0x7f8d5c153ce0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8d440097c0 tx=0x7f8d44019000 comp rx=0 tx=0).stop 2023-10-06T05:26:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 shutdown_connections 2023-10-06T05:26:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d3c060550 0x7f8d3c062a00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d5c0cc460 0x7f8d5c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d5c0b11b0 0x7f8d5c153ce0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 --2- 172.21.15.29:0/2280756990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d5c0b0de0 0x7f8d5c16d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 >> 172.21.15.29:0/2280756990 conn(0x7f8d5c067b70 msgr2=0x7f8d5c146f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 shutdown_connections 2023-10-06T05:26:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.052+0000 7f8d60f4f700 1 -- 172.21.15.29:0/2280756990 wait complete. 2023-10-06T05:26:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-10-06T05:26:56.069 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:56.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4421243700 1 Processor -- start 2023-10-06T05:26:56.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4421243700 1 -- start start 2023-10-06T05:26:56.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4421243700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f441c06e960 0x7f441c06ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4421243700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f441c15a080 0x7f441c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4421243700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c159bf0 con 0x7f441c0c8100 2023-10-06T05:26:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4421243700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c156930 con 0x7f441c15a080 2023-10-06T05:26:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4421243700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c1598c0 con 0x7f441c06e960 2023-10-06T05:26:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f441a59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f441c0c8100 0x7f441c156220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39584/0 (socket says 172.21.15.29:39584) 2023-10-06T05:26:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f441a59c700 1 -- 172.21.15.29:0/1369068539 learned_addr learned my addr 172.21.15.29:0/1369068539 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f441b59e700 1 --2- 172.21.15.29:0/1369068539 >> v2:172.21.15.173:3300/0 conn(0x7f441c15a080 0x7f441c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f441ad9d700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f441c06e960 0x7f441c06ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369532952 0 0) 0x7f441c159bf0 con 0x7f441c0c8100 2023-10-06T05:26:56.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4404003570 con 0x7f441c0c8100 2023-10-06T05:26:56.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1717313310 0 0) 0x7f4404003570 con 0x7f441c0c8100 2023-10-06T05:26:56.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f441c06e960 msgr2=0x7f441c06ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f441c06e960 0x7f441c06ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 >> v2:172.21.15.173:3300/0 conn(0x7f441c15a080 msgr2=0x7f441c14fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 --2- 172.21.15.29:0/1369068539 >> v2:172.21.15.173:3300/0 conn(0x7f441c15a080 0x7f441c14fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c156b90 con 0x7f441c0c8100 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f4410001470 con 0x7f441c0c8100 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f441b59e700 1 --2- 172.21.15.29:0/1369068539 >> v2:172.21.15.173:3300/0 conn(0x7f441c15a080 0x7f441c14fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 >> v1:172.21.15.29:6789/0 conn(0x7f441c0c8100 legacy=0x7f441c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f441c06e960 0x7f4404003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4404003fe0 0x7f4404004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4404004d50 0x7f44040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c156930 con 0x7f4404003fe0 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c1598c0 con 0x7f4404004d50 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440400ba90 con 0x7f441c06e960 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.168+0000 7f441a59c700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4404003fe0 0x7f4404004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f441ad9d700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f441c06e960 0x7f4404003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f441b59e700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4404004d50 0x7f44040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f441a59c700 1 -- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f441c06e960 msgr2=0x7f4404003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f441a59c700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f441c06e960 0x7f4404003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f441a59c700 1 -- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4404004d50 msgr2=0x7f44040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f441a59c700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4404004d50 0x7f44040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f441a59c700 1 -- 172.21.15.29:0/1369068539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4404003570 con 0x7f4404003fe0 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f441a59c700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4404003fe0 0x7f4404004810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f441000c3c0 tx=0x7f4410001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d003e980256c46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441000cc30 con 0x7f4404003fe0 2023-10-06T05:26:56.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441000cd90 con 0x7f4404003fe0 2023-10-06T05:26:56.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4419d9b700 1 -- 172.21.15.29:0/1369068539 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410005b70 con 0x7f4404003fe0 2023-10-06T05:26:56.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4421243700 1 -- 172.21.15.29:0/1369068539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4404003fe0 msgr2=0x7f4404004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4421243700 1 --2- 172.21.15.29:0/1369068539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4404003fe0 0x7f4404004810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f441000c3c0 tx=0x7f4410001e90 comp rx=0 tx=0).stop 2023-10-06T05:26:56.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f441b59e700 1 -- 172.21.15.29:0/1369068539 reap_dead start 2023-10-06T05:26:56.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4421243700 1 -- 172.21.15.29:0/1369068539 shutdown_connections 2023-10-06T05:26:56.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4421243700 1 -- 172.21.15.29:0/1369068539 >> 172.21.15.29:0/1369068539 conn(0x7f441c067b70 msgr2=0x7f441c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:56.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4421243700 1 -- 172.21.15.29:0/1369068539 shutdown_connections 2023-10-06T05:26:56.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4421243700 1 -- 172.21.15.29:0/1369068539 wait complete. 2023-10-06T05:26:56.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4421243700 1 Processor -- start 2023-10-06T05:26:56.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.172+0000 7f4421243700 1 -- start start 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4421243700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4404003fe0 0x7f441c14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4421243700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f441c1583c0 0x7f441c158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4421243700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f441c1658b0 0x7f441c165d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4421243700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c158d70 con 0x7f441c1583c0 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4421243700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c14e2b0 con 0x7f441c1658b0 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4421243700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c14e590 con 0x7f4404003fe0 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f441c1583c0 0x7f441c158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f441c1583c0 0x7f441c158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48856/0 (socket says 172.21.15.29:48856) 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441a59c700 1 -- 172.21.15.29:0/2197460501 learned_addr learned my addr 172.21.15.29:0/2197460501 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441ad9d700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4404003fe0 0x7f441c14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441b59e700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f441c1658b0 0x7f441c165d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441a59c700 1 -- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4404003fe0 msgr2=0x7f441c14ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441a59c700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4404003fe0 0x7f441c14ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441a59c700 1 -- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f441c1658b0 msgr2=0x7f441c165d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441a59c700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f441c1658b0 0x7f441c165d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441a59c700 1 -- 172.21.15.29:0/2197460501 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c14cf60 con 0x7f441c1583c0 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f441a59c700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f441c1583c0 0x7f441c158830 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4404004730 tx=0x7f4410015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4402ffd700 1 -- 172.21.15.29:0/2197460501 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441000cc30 con 0x7f441c1583c0 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4402ffd700 1 -- 172.21.15.29:0/2197460501 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44100072e0 con 0x7f441c1583c0 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c166650 con 0x7f441c1583c0 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4402ffd700 1 -- 172.21.15.29:0/2197460501 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410007680 con 0x7f441c1583c0 2023-10-06T05:26:56.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c166c10 con 0x7f441c1583c0 2023-10-06T05:26:56.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.176+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c166e30 con 0x7f441c1583c0 2023-10-06T05:26:56.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.180+0000 7f4402ffd700 1 -- 172.21.15.29:0/2197460501 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4410019070 con 0x7f441c1583c0 2023-10-06T05:26:56.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.180+0000 7f4402ffd700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4408060580 0x7f4408062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.180+0000 7f4402ffd700 1 -- 172.21.15.29:0/2197460501 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f441007dd60 con 0x7f441c1583c0 2023-10-06T05:26:56.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.180+0000 7f441ad9d700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4408060580 0x7f4408062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.180+0000 7f441ad9d700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4408060580 0x7f4408062a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f440c009e00 tx=0x7f440c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:56.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.188+0000 7f4402ffd700 1 -- 172.21.15.29:0/2197460501 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f441004e150 con 0x7f441c1583c0 2023-10-06T05:26:56.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.352+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f441c158d70 con 0x7f441c1583c0 2023-10-06T05:26:56.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.352+0000 7f4402ffd700 1 -- 172.21.15.29:0/2197460501 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f4410051770 con 0x7f441c1583c0 2023-10-06T05:26:56.360 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:56.360 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":36,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:26:28.049454+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:26:24.748472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T05:26:25.410229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:56.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4408060580 msgr2=0x7f4408062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4408060580 0x7f4408062a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f440c009e00 tx=0x7f440c008040 comp rx=0 tx=0).stop 2023-10-06T05:26:56.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f441c1583c0 msgr2=0x7f441c158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f441c1583c0 0x7f441c158830 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4404004730 tx=0x7f4410015000 comp rx=0 tx=0).stop 2023-10-06T05:26:56.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 shutdown_connections 2023-10-06T05:26:56.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4408060580 0x7f4408062a30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f441c1658b0 0x7f441c165d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f441c1583c0 0x7f441c158830 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 --2- 172.21.15.29:0/2197460501 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4404003fe0 0x7f441c14ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 >> 172.21.15.29:0/2197460501 conn(0x7f441c067b70 msgr2=0x7f441c0ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:56.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 shutdown_connections 2023-10-06T05:26:56.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.356+0000 7f4421243700 1 -- 172.21.15.29:0/2197460501 wait complete. 2023-10-06T05:26:56.375 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T05:26:56.375 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:56.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa627fff700 1 Processor -- start 2023-10-06T05:26:56.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa627fff700 1 -- start start 2023-10-06T05:26:56.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa627fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa62806c8f0 0x7fa62806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa627fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6280c9e80 0x7fa62806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa627fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6281555a0 0x7fa628155a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa627fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280cb7e0 con 0x7fa6280c9e80 2023-10-06T05:26:56.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa627fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62806b9e0 con 0x7fa6281555a0 2023-10-06T05:26:56.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa627fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa628155f60 con 0x7fa62806c8f0 2023-10-06T05:26:56.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa61ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6280c9e80 0x7fa62806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa626ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa62806c8f0 0x7fa62806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa61ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6280c9e80 0x7fa62806b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48866/0 (socket says 172.21.15.29:48866) 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa61ffff700 1 -- 172.21.15.29:0/2721269830 learned_addr learned my addr 172.21.15.29:0/2721269830 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.480+0000 7fa6277fe700 1 --2- 172.21.15.29:0/2721269830 >> v2:172.21.15.173:3300/0 conn(0x7fa6281555a0 0x7fa628155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa61ffff700 1 -- 172.21.15.29:0/2721269830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa62806c8f0 msgr2=0x7fa62806ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa61ffff700 1 --2- 172.21.15.29:0/2721269830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa62806c8f0 0x7fa62806ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa61ffff700 1 -- 172.21.15.29:0/2721269830 >> v2:172.21.15.173:3300/0 conn(0x7fa6281555a0 msgr2=0x7fa628155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa61ffff700 1 --2- 172.21.15.29:0/2721269830 >> v2:172.21.15.173:3300/0 conn(0x7fa6281555a0 0x7fa628155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa61ffff700 1 -- 172.21.15.29:0/2721269830 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6280caf80 con 0x7fa6280c9e80 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa6277fe700 1 --2- 172.21.15.29:0/2721269830 >> v2:172.21.15.173:3300/0 conn(0x7fa6281555a0 0x7fa628155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa61ffff700 1 --2- 172.21.15.29:0/2721269830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6280c9e80 0x7fa62806b4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa6280c93b0 tx=0x7fa610009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb38c64f6c1b818 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa6267fc700 1 -- 172.21.15.29:0/2721269830 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000b640 con 0x7fa6280c9e80 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa6267fc700 1 -- 172.21.15.29:0/2721269830 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61000b7a0 con 0x7fa6280c9e80 2023-10-06T05:26:56.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa6267fc700 1 -- 172.21.15.29:0/2721269830 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000bb60 con 0x7fa6280c9e80 2023-10-06T05:26:56.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 -- 172.21.15.29:0/2721269830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6280c9e80 msgr2=0x7fa62806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 --2- 172.21.15.29:0/2721269830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6280c9e80 0x7fa62806b4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa6280c93b0 tx=0x7fa610009250 comp rx=0 tx=0).stop 2023-10-06T05:26:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 -- 172.21.15.29:0/2721269830 shutdown_connections 2023-10-06T05:26:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 --2- 172.21.15.29:0/2721269830 >> v2:172.21.15.173:3300/0 conn(0x7fa6281555a0 0x7fa628155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 --2- 172.21.15.29:0/2721269830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6280c9e80 0x7fa62806b4a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 --2- 172.21.15.29:0/2721269830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa62806c8f0 0x7fa62806ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 -- 172.21.15.29:0/2721269830 >> 172.21.15.29:0/2721269830 conn(0x7fa6280670a0 msgr2=0x7fa6280674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 -- 172.21.15.29:0/2721269830 shutdown_connections 2023-10-06T05:26:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 -- 172.21.15.29:0/2721269830 wait complete. 2023-10-06T05:26:56.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.484+0000 7fa627fff700 1 Processor -- start 2023-10-06T05:26:56.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa627fff700 1 -- start start 2023-10-06T05:26:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa627fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa62806c8f0 0x7fa6280c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa627fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6280c9e80 0x7fa628143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa627fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6281555a0 0x7fa6281495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa627fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c5a60 con 0x7fa62806c8f0 2023-10-06T05:26:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa627fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c2f50 con 0x7fa6280c9e80 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa627fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa628141480 con 0x7fa6281555a0 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa626ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa62806c8f0 0x7fa6280c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa626ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa62806c8f0 0x7fa6280c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48870/0 (socket says 172.21.15.29:48870) 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa626ffd700 1 -- 172.21.15.29:0/2979710967 learned_addr learned my addr 172.21.15.29:0/2979710967 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa61ffff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6280c9e80 0x7fa628143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa6277fe700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6281555a0 0x7fa6281495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa626ffd700 1 -- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6281555a0 msgr2=0x7fa6281495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa626ffd700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6281555a0 0x7fa6281495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa626ffd700 1 -- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6280c9e80 msgr2=0x7fa628143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa626ffd700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6280c9e80 0x7fa628143240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa626ffd700 1 -- 172.21.15.29:0/2979710967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620009a20 con 0x7fa62806c8f0 2023-10-06T05:26:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa61ffff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6280c9e80 0x7fa628143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:56.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa626ffd700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa62806c8f0 0x7fa6280c2a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa61800ecb0 tx=0x7fa6180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:56.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa61effd700 1 -- 172.21.15.29:0/2979710967 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800c970 con 0x7fa62806c8f0 2023-10-06T05:26:56.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa61effd700 1 -- 172.21.15.29:0/2979710967 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61800cad0 con 0x7fa62806c8f0 2023-10-06T05:26:56.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6100094f0 con 0x7fa62806c8f0 2023-10-06T05:26:56.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa61effd700 1 -- 172.21.15.29:0/2979710967 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800ce70 con 0x7fa62806c8f0 2023-10-06T05:26:56.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.488+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6280c5780 con 0x7fa62806c8f0 2023-10-06T05:26:56.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.492+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62804be00 con 0x7fa62806c8f0 2023-10-06T05:26:56.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.492+0000 7fa61effd700 1 -- 172.21.15.29:0/2979710967 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa618013680 con 0x7fa62806c8f0 2023-10-06T05:26:56.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.492+0000 7fa61effd700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa608060550 0x7fa608062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.492+0000 7fa61effd700 1 -- 172.21.15.29:0/2979710967 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa61807d060 con 0x7fa62806c8f0 2023-10-06T05:26:56.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.492+0000 7fa61ffff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa608060550 0x7fa608062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.492+0000 7fa61ffff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa608060550 0x7fa608062a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa6280c93b0 tx=0x7fa610017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:56.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.500+0000 7fa61effd700 1 -- 172.21.15.29:0/2979710967 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa61804d4f0 con 0x7fa62806c8f0 2023-10-06T05:26:56.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.700+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa62806dbb0 con 0x7fa62806c8f0 2023-10-06T05:26:56.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.700+0000 7fa61effd700 1 -- 172.21.15.29:0/2979710967 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fa618050b10 con 0x7fa62806c8f0 2023-10-06T05:26:56.705 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:56.706 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3342279357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3342279357},{"type":"v1","addr":"172.21.15.173:6835","nonce":3342279357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2659141401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2659141401},{"type":"v1","addr":"172.21.15.173:6837","nonce":2659141401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/648720882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":648720882},{"type":"v1","addr":"172.21.15.29:6833","nonce":648720882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:26:26.407210+0000","modified":"2023-10-06T05:26:29.412409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/244763098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":244763098},{"type":"v1","addr":"172.21.15.29:6835","nonce":244763098}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T05:26:56.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa608060550 msgr2=0x7fa608062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa608060550 0x7fa608062a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa6280c93b0 tx=0x7fa610017000 comp rx=0 tx=0).stop 2023-10-06T05:26:56.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa62806c8f0 msgr2=0x7fa6280c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa62806c8f0 0x7fa6280c2a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa61800ecb0 tx=0x7fa6180091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 shutdown_connections 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6281555a0 0x7fa6281495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa608060550 0x7fa608062a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6280c9e80 0x7fa628143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 --2- 172.21.15.29:0/2979710967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa62806c8f0 0x7fa6280c2a10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 >> 172.21.15.29:0/2979710967 conn(0x7fa6280670a0 msgr2=0x7fa6280c0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 shutdown_connections 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.704+0000 7fa627fff700 1 -- 172.21.15.29:0/2979710967 wait complete. 2023-10-06T05:26:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-10-06T05:26:56.723 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:26:56.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f9791c46700 1 Processor -- start 2023-10-06T05:26:56.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f9791c46700 1 -- start start 2023-10-06T05:26:56.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f9791c46700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c06ed30 0x7f978c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f9791c46700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c159bf0 con 0x7f978c0c8100 2023-10-06T05:26:56.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f9791c46700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c156930 con 0x7f978c06e960 2023-10-06T05:26:56.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f9791c46700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c15a790 con 0x7f978c06ed30 2023-10-06T05:26:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978affd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f978c0c8100 0x7f978c15a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39592/0 (socket says 172.21.15.29:39592) 2023-10-06T05:26:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978affd700 1 -- 172.21.15.29:0/3455144728 learned_addr learned my addr 172.21.15.29:0/3455144728 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978bfff700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c06ed30 0x7f978c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890909636 0 0) 0x7f978c159bf0 con 0x7f978c0c8100 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9774003570 con 0x7f978c0c8100 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2101975279 0 0) 0x7f9774003570 con 0x7f978c0c8100 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c06ed30 msgr2=0x7f978c14fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978a7fc700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c06ed30 0x7f978c14fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 >> v1:172.21.15.173:6789/0 conn(0x7f978c06e960 legacy=0x7f978c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c1598c0 con 0x7f978c0c8100 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.824+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f97800017f0 con 0x7f978c0c8100 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 >> v1:172.21.15.29:6789/0 conn(0x7f978c0c8100 legacy=0x7f978c15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c06ed30 0x7f9774003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f9774004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9774004d50 0x7f97740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c15a790 con 0x7f9774003fd0 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977400bb40 con 0x7f9774004d50 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977400bd00 con 0x7f978c06ed30 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978affd700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f9774004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978b7fe700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c06ed30 0x7f9774003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978affd700 1 -- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c06ed30 msgr2=0x7f9774003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978affd700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c06ed30 0x7f9774003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978affd700 1 -- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9774004d50 msgr2=0x7f97740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978affd700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9774004d50 0x7f97740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978affd700 1 -- 172.21.15.29:0/3455144728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774003570 con 0x7f9774003fd0 2023-10-06T05:26:56.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978affd700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f9774004810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f978c0c8540 tx=0x7f978c159b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbce6f32ec9bafe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:56.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97800070d0 con 0x7f9774003fd0 2023-10-06T05:26:56.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780007230 con 0x7f9774003fd0 2023-10-06T05:26:56.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978a7fc700 1 -- 172.21.15.29:0/3455144728 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97800075f0 con 0x7f9774003fd0 2023-10-06T05:26:56.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f9791c46700 1 -- 172.21.15.29:0/3455144728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 msgr2=0x7f9774004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f9791c46700 1 --2- 172.21.15.29:0/3455144728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f9774004810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f978c0c8540 tx=0x7f978c159b60 comp rx=0 tx=0).stop 2023-10-06T05:26:56.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f978bfff700 1 -- 172.21.15.29:0/3455144728 reap_dead start 2023-10-06T05:26:56.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f9791c46700 1 -- 172.21.15.29:0/3455144728 shutdown_connections 2023-10-06T05:26:56.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f9791c46700 1 -- 172.21.15.29:0/3455144728 >> 172.21.15.29:0/3455144728 conn(0x7f978c067b70 msgr2=0x7f978c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:56.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f9791c46700 1 -- 172.21.15.29:0/3455144728 shutdown_connections 2023-10-06T05:26:56.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.828+0000 7f9791c46700 1 -- 172.21.15.29:0/3455144728 wait complete. 2023-10-06T05:26:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f9791c46700 1 Processor -- start 2023-10-06T05:26:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f9791c46700 1 -- start start 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f9791c46700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f978c14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f9791c46700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c1540b0 0x7f978c154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f9791c46700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f978c0a5650 0x7f978c0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f9791c46700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c154a60 con 0x7f9774003fd0 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f9791c46700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0a51e0 con 0x7f978c0a5650 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f9791c46700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0a45d0 con 0x7f978c1540b0 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f978b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f978c14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f978b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f978c14ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48896/0 (socket says 172.21.15.29:48896) 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.832+0000 7f978b7fe700 1 -- 172.21.15.29:0/352390207 learned_addr learned my addr 172.21.15.29:0/352390207 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978affd700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c1540b0 0x7f978c154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978bfff700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f978c0a5650 0x7f978c0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978b7fe700 1 -- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c1540b0 msgr2=0x7f978c154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978b7fe700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c1540b0 0x7f978c154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978b7fe700 1 -- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f978c0a5650 msgr2=0x7f978c0a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978b7fe700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f978c0a5650 0x7f978c0a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978b7fe700 1 -- 172.21.15.29:0/352390207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0a48b0 con 0x7f9774003fd0 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978bfff700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f978c0a5650 0x7f978c0a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978affd700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c1540b0 0x7f978c154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978b7fe700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f978c14ffa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f977c010aa0 tx=0x7f977c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f97737fe700 1 -- 172.21.15.29:0/352390207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00e9f0 con 0x7f9774003fd0 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f97737fe700 1 -- 172.21.15.29:0/352390207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c00eb70 con 0x7f9774003fd0 2023-10-06T05:26:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c0a4b90 con 0x7f9774003fd0 2023-10-06T05:26:56.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f97737fe700 1 -- 172.21.15.29:0/352390207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c012450 con 0x7f9774003fd0 2023-10-06T05:26:56.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c1504e0 con 0x7f9774003fd0 2023-10-06T05:26:56.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f97737fe700 1 -- 172.21.15.29:0/352390207 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f977c0127c0 con 0x7f9774003fd0 2023-10-06T05:26:56.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c06b5b0 con 0x7f9774003fd0 2023-10-06T05:26:56.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f97737fe700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9778060580 0x7f9778062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:56.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f97737fe700 1 -- 172.21.15.29:0/352390207 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f977c07f5c0 con 0x7f9774003fd0 2023-10-06T05:26:56.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.836+0000 7f978affd700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9778060580 0x7f9778062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:56.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.840+0000 7f978affd700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9778060580 0x7f9778062a30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f978000a430 tx=0x7f9780016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:56.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:56.848+0000 7f97737fe700 1 -- 172.21.15.29:0/352390207 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f978c06b5b0 con 0x7f9774003fd0 2023-10-06T05:26:57.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.048+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f978c06b5b0 con 0x7f9774003fd0 2023-10-06T05:26:57.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.048+0000 7f97737fe700 1 -- 172.21.15.29:0/352390207 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f978c06b5b0 con 0x7f9774003fd0 2023-10-06T05:26:57.055 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:57.055 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3342279357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3342279357},{"type":"v1","addr":"172.21.15.173:6835","nonce":3342279357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2659141401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2659141401},{"type":"v1","addr":"172.21.15.173:6837","nonce":2659141401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/648720882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":648720882},{"type":"v1","addr":"172.21.15.29:6833","nonce":648720882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:26:26.407210+0000","modified":"2023-10-06T05:26:29.412409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/244763098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":244763098},{"type":"v1","addr":"172.21.15.29:6835","nonce":244763098}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T05:26:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9778060580 msgr2=0x7f9778062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9778060580 0x7f9778062a30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f978000a430 tx=0x7f9780016000 comp rx=0 tx=0).stop 2023-10-06T05:26:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 msgr2=0x7f978c14ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f978c14ffa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f977c010aa0 tx=0x7f977c009040 comp rx=0 tx=0).stop 2023-10-06T05:26:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 shutdown_connections 2023-10-06T05:26:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9778060580 0x7f9778062a30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f978c0a5650 0x7f978c0a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f978c1540b0 0x7f978c154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 --2- 172.21.15.29:0/352390207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9774003fd0 0x7f978c14ffa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 >> 172.21.15.29:0/352390207 conn(0x7f978c067b70 msgr2=0x7f978c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 shutdown_connections 2023-10-06T05:26:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.052+0000 7f9791c46700 1 -- 172.21.15.29:0/352390207 wait complete. 2023-10-06T05:26:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-10-06T05:26:57.069 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:26:57.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3926c0c700 1 Processor -- start 2023-10-06T05:26:57.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3926c0c700 1 -- start start 2023-10-06T05:26:57.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3926c0c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f39201569f0 0x7f39200ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3926c0c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392006a5b0 con 0x7f3920156dc0 2023-10-06T05:26:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3926c0c700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392015b0a0 con 0x7f39200c68b0 2023-10-06T05:26:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3926c0c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392015b380 con 0x7f39201569f0 2023-10-06T05:26:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925409700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3920156dc0 0x7f392015a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39598/0 (socket says 172.21.15.29:39598) 2023-10-06T05:26:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925409700 1 -- 172.21.15.29:0/2695652243 learned_addr learned my addr 172.21.15.29:0/2695652243 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:57.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925c0a700 1 --2- 172.21.15.29:0/2695652243 >> v2:172.21.15.173:3300/0 conn(0x7f39201569f0 0x7f39200ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641097656 0 0) 0x7f392006a5b0 con 0x7f3920156dc0 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f390c003570 con 0x7f3920156dc0 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857861935 0 0) 0x7f392015b0a0 con 0x7f39200c68b0 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f392006a5b0 con 0x7f39200c68b0 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1111088009 0 0) 0x7f390c003570 con 0x7f3920156dc0 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 >> v2:172.21.15.173:3300/0 conn(0x7f39201569f0 msgr2=0x7f39200ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 --2- 172.21.15.29:0/2695652243 >> v2:172.21.15.173:3300/0 conn(0x7f39201569f0 0x7f39200ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 >> v1:172.21.15.173:6789/0 conn(0x7f39200c68b0 legacy=0x7f392006aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392015b660 con 0x7f3920156dc0 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f3910001470 con 0x7f3920156dc0 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 >> v1:172.21.15.29:6789/0 conn(0x7f3920156dc0 legacy=0x7f392015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f390c003c40 0x7f390c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c004810 0x7f390c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f390c005210 0x7f390c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392015b380 con 0x7f390c003c40 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c00c130 con 0x7f390c004810 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c00c2c0 con 0x7f390c005210 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925c0a700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f390c003c40 0x7f390c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925409700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c004810 0x7f390c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f392640b700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f390c005210 0x7f390c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925c0a700 1 -- 172.21.15.29:0/2695652243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f390c005210 msgr2=0x7f390c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925c0a700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f390c005210 0x7f390c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925c0a700 1 -- 172.21.15.29:0/2695652243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c004810 msgr2=0x7f390c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925c0a700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c004810 0x7f390c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925c0a700 1 -- 172.21.15.29:0/2695652243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c003570 con 0x7f390c003c40 2023-10-06T05:26:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f392640b700 1 -- 172.21.15.29:0/2695652243 reap_dead start 2023-10-06T05:26:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.168+0000 7f3925c0a700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f390c003c40 0x7f390c004030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f391c009c30 tx=0x7f391c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21edbfbdf7d80b60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00e6e0 con 0x7f390c003c40 2023-10-06T05:26:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00e840 con 0x7f390c003c40 2023-10-06T05:26:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3924c08700 1 -- 172.21.15.29:0/2695652243 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00ec00 con 0x7f390c003c40 2023-10-06T05:26:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3926c0c700 1 -- 172.21.15.29:0/2695652243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f390c003c40 msgr2=0x7f390c004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3926c0c700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f390c003c40 0x7f390c004030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f391c009c30 tx=0x7f391c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3926c0c700 1 -- 172.21.15.29:0/2695652243 shutdown_connections 2023-10-06T05:26:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3926c0c700 1 --2- 172.21.15.29:0/2695652243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f390c003c40 0x7f390c004030 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3926c0c700 1 -- 172.21.15.29:0/2695652243 >> 172.21.15.29:0/2695652243 conn(0x7f39200670a0 msgr2=0x7f39200674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3926c0c700 1 -- 172.21.15.29:0/2695652243 shutdown_connections 2023-10-06T05:26:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3926c0c700 1 -- 172.21.15.29:0/2695652243 wait complete. 2023-10-06T05:26:57.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3926c0c700 1 Processor -- start 2023-10-06T05:26:57.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.172+0000 7f3926c0c700 1 -- start start 2023-10-06T05:26:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3926c0c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c003c40 0x7f392014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3926c0c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3920158830 0x7f3920158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3926c0c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39200aa380 0x7f39200aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3926c0c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39201591e0 con 0x7f3920158830 2023-10-06T05:26:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3926c0c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39200ca0b0 con 0x7f390c003c40 2023-10-06T05:26:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3926c0c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39200c94a0 con 0x7f39200aa380 2023-10-06T05:26:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925409700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3920158830 0x7f3920158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925409700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3920158830 0x7f3920158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48912/0 (socket says 172.21.15.29:48912) 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925409700 1 -- 172.21.15.29:0/3286756233 learned_addr learned my addr 172.21.15.29:0/3286756233 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f392640b700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39200aa380 0x7f39200aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925c0a700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c003c40 0x7f392014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925409700 1 -- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39200aa380 msgr2=0x7f39200aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925409700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39200aa380 0x7f39200aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925409700 1 -- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c003c40 msgr2=0x7f392014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925409700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c003c40 0x7f392014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925409700 1 -- 172.21.15.29:0/3286756233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39200c9780 con 0x7f3920158830 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925c0a700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c003c40 0x7f392014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3925409700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3920158830 0x7f3920158ca0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3910001120 tx=0x7f3910001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3915ffb700 1 -- 172.21.15.29:0/3286756233 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100077d0 con 0x7f3920158830 2023-10-06T05:26:57.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3915ffb700 1 -- 172.21.15.29:0/3286756233 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391000f840 con 0x7f3920158830 2023-10-06T05:26:57.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39200c9a60 con 0x7f3920158830 2023-10-06T05:26:57.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3915ffb700 1 -- 172.21.15.29:0/3286756233 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391000fbc0 con 0x7f3920158830 2023-10-06T05:26:57.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.176+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392014fa00 con 0x7f3920158830 2023-10-06T05:26:57.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.180+0000 7f3915ffb700 1 -- 172.21.15.29:0/3286756233 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f391001d460 con 0x7f3920158830 2023-10-06T05:26:57.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.180+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39200c9ee0 con 0x7f3920158830 2023-10-06T05:26:57.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.180+0000 7f3915ffb700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3904060550 0x7f3904062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.180+0000 7f3915ffb700 1 -- 172.21.15.29:0/3286756233 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f391007ca00 con 0x7f3920158830 2023-10-06T05:26:57.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.180+0000 7f3925c0a700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3904060550 0x7f3904062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.180+0000 7f3925c0a700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3904060550 0x7f3904062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f391c0091e0 tx=0x7f391c01a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:57.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.188+0000 7f3915ffb700 1 -- 172.21.15.29:0/3286756233 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f391004cf50 con 0x7f3920158830 2023-10-06T05:26:57.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.344+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f392004be00 con 0x7f3920158830 2023-10-06T05:26:57.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3915ffb700 1 -- 172.21.15.29:0/3286756233 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f3910050570 con 0x7f3920158830 2023-10-06T05:26:57.352 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:26:57.352 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":36,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:26:28.049454+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:26:24.748472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T05:26:25.410229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:26:57.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3904060550 msgr2=0x7f3904062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3904060550 0x7f3904062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f391c0091e0 tx=0x7f391c01a000 comp rx=0 tx=0).stop 2023-10-06T05:26:57.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3920158830 msgr2=0x7f3920158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3920158830 0x7f3920158ca0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3910001120 tx=0x7f3910001d20 comp rx=0 tx=0).stop 2023-10-06T05:26:57.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 shutdown_connections 2023-10-06T05:26:57.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39200aa380 0x7f39200aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3920158830 0x7f3920158ca0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3904060550 0x7f3904062a00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 --2- 172.21.15.29:0/3286756233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f390c003c40 0x7f392014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 >> 172.21.15.29:0/3286756233 conn(0x7f39200670a0 msgr2=0x7f39201517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:57.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 shutdown_connections 2023-10-06T05:26:57.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.348+0000 7f3926c0c700 1 -- 172.21.15.29:0/3286756233 wait complete. 2023-10-06T05:26:57.366 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T05:26:57.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9aea5a3700 1 Processor -- start 2023-10-06T05:26:57.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9aea5a3700 1 -- start start 2023-10-06T05:26:57.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9aea5a3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ae4158b50 0x7f9ae4158f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9aea5a3700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9ae406b620 0x7f9ae40ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9aea5a3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae406b190 con 0x7f9ae40ce790 2023-10-06T05:26:57.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9aea5a3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae40cec10 con 0x7f9ae4158b50 2023-10-06T05:26:57.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9aea5a3700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae406a580 con 0x7f9ae406b620 2023-10-06T05:26:57.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9ae9da2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9ae40ce790 0x7f9ae40cc810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39612/0 (socket says 172.21.15.29:39612) 2023-10-06T05:26:57.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9ae9da2700 1 -- 172.21.15.29:0/2900918628 learned_addr learned my addr 172.21.15.29:0/2900918628 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:57.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9ae95a1700 1 --2- 172.21.15.29:0/2900918628 >> v2:172.21.15.29:3300/0 conn(0x7f9ae4158b50 0x7f9ae4158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9ae8da0700 1 --2- 172.21.15.29:0/2900918628 >> v2:172.21.15.173:3300/0 conn(0x7f9ae406b620 0x7f9ae40ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9ae95a1700 1 -- 172.21.15.29:0/2900918628 >> v2:172.21.15.173:3300/0 conn(0x7f9ae406b620 msgr2=0x7f9ae40ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:57.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9ae95a1700 1 --2- 172.21.15.29:0/2900918628 >> v2:172.21.15.173:3300/0 conn(0x7f9ae406b620 0x7f9ae40ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9ae95a1700 1 -- 172.21.15.29:0/2900918628 >> v1:172.21.15.29:6789/0 conn(0x7f9ae40ce790 legacy=0x7f9ae40cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.476+0000 7f9ae95a1700 1 -- 172.21.15.29:0/2900918628 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae406a860 con 0x7f9ae4158b50 2023-10-06T05:26:57.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9ae95a1700 1 --2- 172.21.15.29:0/2900918628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae4158b50 0x7f9ae4158f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40ca3e0 tx=0x7f9ae00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c56a7cd890d659 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:57.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9adbfff700 1 -- 172.21.15.29:0/2900918628 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0011630 con 0x7f9ae4158b50 2023-10-06T05:26:57.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9adbfff700 1 -- 172.21.15.29:0/2900918628 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae0011790 con 0x7f9ae4158b50 2023-10-06T05:26:57.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9adbfff700 1 -- 172.21.15.29:0/2900918628 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0011b30 con 0x7f9ae4158b50 2023-10-06T05:26:57.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9aea5a3700 1 -- 172.21.15.29:0/2900918628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae4158b50 msgr2=0x7f9ae4158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9aea5a3700 1 --2- 172.21.15.29:0/2900918628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae4158b50 0x7f9ae4158f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40ca3e0 tx=0x7f9ae00091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9aea5a3700 1 -- 172.21.15.29:0/2900918628 shutdown_connections 2023-10-06T05:26:57.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9aea5a3700 1 --2- 172.21.15.29:0/2900918628 >> v2:172.21.15.173:3300/0 conn(0x7f9ae406b620 0x7f9ae40ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9aea5a3700 1 --2- 172.21.15.29:0/2900918628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae4158b50 0x7f9ae4158f20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9aea5a3700 1 -- 172.21.15.29:0/2900918628 >> 172.21.15.29:0/2900918628 conn(0x7f9ae406c6c0 msgr2=0x7f9ae406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:57.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9aea5a3700 1 -- 172.21.15.29:0/2900918628 shutdown_connections 2023-10-06T05:26:57.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.480+0000 7f9aea5a3700 1 -- 172.21.15.29:0/2900918628 wait complete. 2023-10-06T05:26:57.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9aea5a3700 1 Processor -- start 2023-10-06T05:26:57.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9aea5a3700 1 -- start start 2023-10-06T05:26:57.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9aea5a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae406b620 0x7f9ae4153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9aea5a3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae40ce790 0x7f9ae4150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9aea5a3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ae4158b50 0x7f9ae4150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9aea5a3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae4159c50 con 0x7f9ae406b620 2023-10-06T05:26:57.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9aea5a3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae4159f30 con 0x7f9ae4158b50 2023-10-06T05:26:57.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9aea5a3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae415a210 con 0x7f9ae40ce790 2023-10-06T05:26:57.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae95a1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae406b620 0x7f9ae4153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae95a1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae406b620 0x7f9ae4153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48938/0 (socket says 172.21.15.29:48938) 2023-10-06T05:26:57.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae95a1700 1 -- 172.21.15.29:0/33201207 learned_addr learned my addr 172.21.15.29:0/33201207 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:57.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae9da2700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ae4158b50 0x7f9ae4150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae8da0700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae40ce790 0x7f9ae4150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae95a1700 1 -- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae40ce790 msgr2=0x7f9ae4150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae95a1700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae40ce790 0x7f9ae4150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae95a1700 1 -- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ae4158b50 msgr2=0x7f9ae4150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae95a1700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ae4158b50 0x7f9ae4150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae95a1700 1 -- 172.21.15.29:0/33201207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae0009420 con 0x7f9ae406b620 2023-10-06T05:26:57.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ae95a1700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae406b620 0x7f9ae4153b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40681f0 tx=0x7f9ae0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:57.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ad97fa700 1 -- 172.21.15.29:0/33201207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0011b10 con 0x7f9ae406b620 2023-10-06T05:26:57.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ad97fa700 1 -- 172.21.15.29:0/33201207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae00253f0 con 0x7f9ae406b620 2023-10-06T05:26:57.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae415a4f0 con 0x7f9ae406b620 2023-10-06T05:26:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.484+0000 7f9ad97fa700 1 -- 172.21.15.29:0/33201207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0025790 con 0x7f9ae406b620 2023-10-06T05:26:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.488+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae4154050 con 0x7f9ae406b620 2023-10-06T05:26:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.488+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae41542a0 con 0x7f9ae406b620 2023-10-06T05:26:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.488+0000 7f9ad97fa700 1 -- 172.21.15.29:0/33201207 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9ae0025b80 con 0x7f9ae406b620 2023-10-06T05:26:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.488+0000 7f9ad97fa700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9ac8060550 0x7f9ac8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.488+0000 7f9ad97fa700 1 -- 172.21.15.29:0/33201207 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ae007e200 con 0x7f9ae406b620 2023-10-06T05:26:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.488+0000 7f9ae8da0700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9ac8060550 0x7f9ac8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.488+0000 7f9ae8da0700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9ac8060550 0x7f9ac8062a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40c5c80 tx=0x7f9ad4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:57.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.496+0000 7f9ad97fa700 1 -- 172.21.15.29:0/33201207 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ae004e5f0 con 0x7f9ae406b620 2023-10-06T05:26:57.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.696+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9ae404be00 con 0x7f9ae406b620 2023-10-06T05:26:57.702 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-06T05:26:57.696+0000 7fe44aab2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T05:26:57.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.704+0000 7f9ad97fa700 1 -- 172.21.15.29:0/33201207 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9ae0051c10 con 0x7f9ae406b620 2023-10-06T05:26:57.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9ac8060550 msgr2=0x7f9ac8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9ac8060550 0x7f9ac8062a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40c5c80 tx=0x7f9ad4008040 comp rx=0 tx=0).stop 2023-10-06T05:26:57.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae406b620 msgr2=0x7f9ae4153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae406b620 0x7f9ae4153b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40681f0 tx=0x7f9ae0017000 comp rx=0 tx=0).stop 2023-10-06T05:26:57.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 shutdown_connections 2023-10-06T05:26:57.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9ac8060550 0x7f9ac8062a00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ae4158b50 0x7f9ae4150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ae40ce790 0x7f9ae4150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 --2- 172.21.15.29:0/33201207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae406b620 0x7f9ae4153b10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 >> 172.21.15.29:0/33201207 conn(0x7f9ae406c6c0 msgr2=0x7f9ae40c61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:57.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 shutdown_connections 2023-10-06T05:26:57.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.708+0000 7f9aea5a3700 1 -- 172.21.15.29:0/33201207 wait complete. 2023-10-06T05:26:57.714 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T05:26:57.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T05:26:57.748 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-06T05:26:57.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18afcd8700 1 Processor -- start 2023-10-06T05:26:57.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18afcd8700 1 -- start start 2023-10-06T05:26:57.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18afcd8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8156db0 0x7f18a80cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18afcd8700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a806b200 con 0x7f18a81569e0 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18afcd8700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a806a5f0 con 0x7f18a80cc030 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18afcd8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80cc4b0 con 0x7f18a8156db0 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18ada74700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f18a81569e0 0x7f18a80c6ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39626/0 (socket says 172.21.15.29:39626) 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18ada74700 1 -- 172.21.15.29:0/4274552322 learned_addr learned my addr 172.21.15.29:0/4274552322 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18ad273700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8156db0 0x7f18a80cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885072009 0 0) 0x7f18a806b200 con 0x7f18a81569e0 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1894003570 con 0x7f18a81569e0 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217561643 0 0) 0x7f18a806a5f0 con 0x7f18a80cc030 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a806b200 con 0x7f18a80cc030 2023-10-06T05:26:57.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1033115389 0 0) 0x7f1894003570 con 0x7f18a81569e0 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8156db0 msgr2=0x7f18a80cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8156db0 0x7f18a80cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 >> v1:172.21.15.173:6789/0 conn(0x7f18a80cc030 legacy=0x7f18a80ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a806a8d0 con 0x7f18a81569e0 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f18a00017f0 con 0x7f18a81569e0 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 >> v1:172.21.15.29:6789/0 conn(0x7f18a81569e0 legacy=0x7f18a80c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894003c20 0x7f1894004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1894004810 0x7f1894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8156db0 0x7f18940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80cc4b0 con 0x7f1894003c20 2023-10-06T05:26:57.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189400bb40 con 0x7f1894004810 2023-10-06T05:26:57.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189400bd00 con 0x7f18a8156db0 2023-10-06T05:26:57.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18ada74700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894003c20 0x7f1894004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18ad273700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1894004810 0x7f1894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.816+0000 7f18ae275700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8156db0 0x7f18940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18ad273700 1 -- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8156db0 msgr2=0x7f18940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:57.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18ad273700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8156db0 0x7f18940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18ad273700 1 -- 172.21.15.29:0/4274552322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894003c20 msgr2=0x7f1894004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:26:57.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18ad273700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894003c20 0x7f1894004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18ad273700 1 -- 172.21.15.29:0/4274552322 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894003570 con 0x7f1894004810 2023-10-06T05:26:57.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18ada74700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894003c20 0x7f1894004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:26:57.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18ad273700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1894004810 0x7f1894004c80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1898009c00 tx=0x7f18980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cfd842cbbecb267 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800e710 con 0x7f1894004810 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800e870 con 0x7f1894004810 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18aca72700 1 -- 172.21.15.29:0/4274552322 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800ec30 con 0x7f1894004810 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18afcd8700 1 -- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1894004810 msgr2=0x7f1894004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18afcd8700 1 --2- 172.21.15.29:0/4274552322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1894004810 0x7f1894004c80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1898009c00 tx=0x7f18980091a0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18ae275700 1 -- 172.21.15.29:0/4274552322 reap_dead start 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18afcd8700 1 -- 172.21.15.29:0/4274552322 shutdown_connections 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18afcd8700 1 -- 172.21.15.29:0/4274552322 >> 172.21.15.29:0/4274552322 conn(0x7f18a80670a0 msgr2=0x7f18a80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18afcd8700 1 -- 172.21.15.29:0/4274552322 shutdown_connections 2023-10-06T05:26:57.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.820+0000 7f18afcd8700 1 -- 172.21.15.29:0/4274552322 wait complete. 2023-10-06T05:26:57.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18afcd8700 1 Processor -- start 2023-10-06T05:26:57.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18afcd8700 1 -- start start 2023-10-06T05:26:57.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18afcd8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894004810 0x7f18a80af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18afcd8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18a80b0420 0x7f18a813e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18afcd8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8151890 0x7f18a8151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18afcd8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a8152240 con 0x7f1894004810 2023-10-06T05:26:57.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18afcd8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a8152fd0 con 0x7f18a80b0420 2023-10-06T05:26:57.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18afcd8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80b0c70 con 0x7f18a8151890 2023-10-06T05:26:57.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18ada74700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894004810 0x7f18a80af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18ada74700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894004810 0x7f18a80af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48962/0 (socket says 172.21.15.29:48962) 2023-10-06T05:26:57.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18ada74700 1 -- 172.21.15.29:0/365625385 learned_addr learned my addr 172.21.15.29:0/365625385 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:57.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18ae275700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8151890 0x7f18a8151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.824+0000 7f18ad273700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18a80b0420 0x7f18a813e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f18ada74700 1 -- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8151890 msgr2=0x7f18a8151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f18ada74700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8151890 0x7f18a8151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f18ada74700 1 -- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18a80b0420 msgr2=0x7f18a813e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f18ada74700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18a80b0420 0x7f18a813e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f18ada74700 1 -- 172.21.15.29:0/365625385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80b0f50 con 0x7f1894004810 2023-10-06T05:26:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f18ada74700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894004810 0x7f18a80af540 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f18a000afd0 tx=0x7f18a0002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f189dffb700 1 -- 172.21.15.29:0/365625385 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a00133f0 con 0x7f1894004810 2023-10-06T05:26:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f189dffb700 1 -- 172.21.15.29:0/365625385 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a0013550 con 0x7f1894004810 2023-10-06T05:26:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a80b1230 con 0x7f1894004810 2023-10-06T05:26:57.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f189dffb700 1 -- 172.21.15.29:0/365625385 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a00138d0 con 0x7f1894004810 2023-10-06T05:26:57.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a80b0890 con 0x7f1894004810 2023-10-06T05:26:57.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a8071120 con 0x7f1894004810 2023-10-06T05:26:57.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.828+0000 7f189dffb700 1 -- 172.21.15.29:0/365625385 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f18a0013c40 con 0x7f1894004810 2023-10-06T05:26:57.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.832+0000 7f189dffb700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f188c060550 0x7f188c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:57.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.832+0000 7f189dffb700 1 -- 172.21.15.29:0/365625385 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f18a007d8c0 con 0x7f1894004810 2023-10-06T05:26:57.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.832+0000 7f18ad273700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f188c060550 0x7f188c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:57.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.832+0000 7f18ad273700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f188c060550 0x7f188c062a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f18a8152bf0 tx=0x7f189801a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:57.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:57.840+0000 7f189dffb700 1 -- 172.21.15.29:0/365625385 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f18a004dd00 con 0x7f1894004810 2023-10-06T05:26:58.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.028+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f18a8152dc0 con 0x7f1894004810 2023-10-06T05:26:58.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.708+0000 7f189dffb700 1 -- 172.21.15.29:0/365625385 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f18a0051320 con 0x7f1894004810 2023-10-06T05:26:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f188c060550 msgr2=0x7f188c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f188c060550 0x7f188c062a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f18a8152bf0 tx=0x7f189801a000 comp rx=0 tx=0).stop 2023-10-06T05:26:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894004810 msgr2=0x7f18a80af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894004810 0x7f18a80af540 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f18a000afd0 tx=0x7f18a0002190 comp rx=0 tx=0).stop 2023-10-06T05:26:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 shutdown_connections 2023-10-06T05:26:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18a8151890 0x7f18a8151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f188c060550 0x7f188c062a00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:58.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18a80b0420 0x7f18a813e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:58.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 --2- 172.21.15.29:0/365625385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1894004810 0x7f18a80af540 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:58.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 >> 172.21.15.29:0/365625385 conn(0x7f18a80670a0 msgr2=0x7f18a80ac730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:58.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 shutdown_connections 2023-10-06T05:26:58.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.712+0000 7f18afcd8700 1 -- 172.21.15.29:0/365625385 wait complete. 2023-10-06T05:26:58.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T05:26:58.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.892+0000 7fb761b1c700 1 Processor -- start 2023-10-06T05:26:58.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.892+0000 7fb761b1c700 1 -- start start 2023-10-06T05:26:58.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb75c157040 0x7fb75c0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:58.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0c6b40 con 0x7fb75c156c70 2023-10-06T05:26:58.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c06bdd0 con 0x7fb75c06d6d0 2023-10-06T05:26:58.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c0c6d90 con 0x7fb75c157040 2023-10-06T05:26:58.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb760b1a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb75c156c70 0x7fb75c06b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39642/0 (socket says 172.21.15.29:39642) 2023-10-06T05:26:58.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb760b1a700 1 -- 172.21.15.29:0/3918746298 learned_addr learned my addr 172.21.15.29:0/3918746298 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:58.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75bfff700 1 --2- 172.21.15.29:0/3918746298 >> v2:172.21.15.29:3300/0 conn(0x7fb75c157040 0x7fb75c0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:58.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75b7fe700 1 -- 172.21.15.29:0/3918746298 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168942047 0 0) 0x7fb75c0c6b40 con 0x7fb75c156c70 2023-10-06T05:26:58.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75b7fe700 1 -- 172.21.15.29:0/3918746298 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb748003570 con 0x7fb75c156c70 2023-10-06T05:26:58.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75bfff700 1 -- 172.21.15.29:0/3918746298 >> v1:172.21.15.173:6789/0 conn(0x7fb75c06d6d0 legacy=0x7fb75c0ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:58.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75b7fe700 1 -- 172.21.15.29:0/3918746298 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204430434 0 0) 0x7fb75c06bdd0 con 0x7fb75c06d6d0 2023-10-06T05:26:58.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75bfff700 1 -- 172.21.15.29:0/3918746298 >> v1:172.21.15.29:6789/0 conn(0x7fb75c156c70 legacy=0x7fb75c06b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:58.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75bfff700 1 -- 172.21.15.29:0/3918746298 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0c7070 con 0x7fb75c157040 2023-10-06T05:26:58.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75bfff700 1 --2- 172.21.15.29:0/3918746298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c157040 0x7fb75c0c7870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb744009e60 tx=0x7fb744009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9beb29bde858b666 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:58.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75b7fe700 1 -- 172.21.15.29:0/3918746298 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74400e070 con 0x7fb75c157040 2023-10-06T05:26:58.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75b7fe700 1 -- 172.21.15.29:0/3918746298 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74400bb60 con 0x7fb75c157040 2023-10-06T05:26:58.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb75b7fe700 1 -- 172.21.15.29:0/3918746298 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744012430 con 0x7fb75c157040 2023-10-06T05:26:58.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 -- 172.21.15.29:0/3918746298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c157040 msgr2=0x7fb75c0c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:58.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 --2- 172.21.15.29:0/3918746298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c157040 0x7fb75c0c7870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb744009e60 tx=0x7fb744009780 comp rx=0 tx=0).stop 2023-10-06T05:26:58.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 -- 172.21.15.29:0/3918746298 shutdown_connections 2023-10-06T05:26:58.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 --2- 172.21.15.29:0/3918746298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c157040 0x7fb75c0c7870 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:58.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 -- 172.21.15.29:0/3918746298 >> 172.21.15.29:0/3918746298 conn(0x7fb75c0c9830 msgr2=0x7fb75c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:58.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.896+0000 7fb761b1c700 1 -- 172.21.15.29:0/3918746298 shutdown_connections 2023-10-06T05:26:58.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb761b1c700 1 -- 172.21.15.29:0/3918746298 wait complete. 2023-10-06T05:26:58.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb761b1c700 1 Processor -- start 2023-10-06T05:26:58.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb761b1c700 1 -- start start 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb761b1c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c06d6d0 0x7fb75c0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb761b1c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb75c156c70 0x7fb75c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb761b1c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb75c157040 0x7fb75c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb761b1c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c15a300 con 0x7fb75c06d6d0 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb761b1c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c14f9d0 con 0x7fb75c156c70 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb761b1c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c153610 con 0x7fb75c157040 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb760b1a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c06d6d0 0x7fb75c0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb760b1a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c06d6d0 0x7fb75c0b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48978/0 (socket says 172.21.15.29:48978) 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.900+0000 7fb760b1a700 1 -- 172.21.15.29:0/1170014534 learned_addr learned my addr 172.21.15.29:0/1170014534 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb75bfff700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb75c156c70 0x7fb75c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb76131b700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb75c157040 0x7fb75c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb760b1a700 1 -- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb75c157040 msgr2=0x7fb75c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb760b1a700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb75c157040 0x7fb75c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb760b1a700 1 -- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb75c156c70 msgr2=0x7fb75c0af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb760b1a700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb75c156c70 0x7fb75c0af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb760b1a700 1 -- 172.21.15.29:0/1170014534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744009a20 con 0x7fb75c06d6d0 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb76131b700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb75c157040 0x7fb75c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb75bfff700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb75c156c70 0x7fb75c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb760b1a700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c06d6d0 0x7fb75c0b18a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00c790 tx=0x7fb74c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb758ff9700 1 -- 172.21.15.29:0/1170014534 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c005b30 con 0x7fb75c06d6d0 2023-10-06T05:26:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb758ff9700 1 -- 172.21.15.29:0/1170014534 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c005c90 con 0x7fb75c06d6d0 2023-10-06T05:26:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c0c59e0 con 0x7fb75c06d6d0 2023-10-06T05:26:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb758ff9700 1 -- 172.21.15.29:0/1170014534 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c007300 con 0x7fb75c06d6d0 2023-10-06T05:26:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c0c5420 con 0x7fb75c06d6d0 2023-10-06T05:26:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.904+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c04be00 con 0x7fb75c06d6d0 2023-10-06T05:26:58.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.908+0000 7fb758ff9700 1 -- 172.21.15.29:0/1170014534 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb74c007670 con 0x7fb75c06d6d0 2023-10-06T05:26:58.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.908+0000 7fb758ff9700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb73c060550 0x7fb73c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:58.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.908+0000 7fb758ff9700 1 -- 172.21.15.29:0/1170014534 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb74c07bf80 con 0x7fb75c06d6d0 2023-10-06T05:26:58.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.908+0000 7fb75bfff700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb73c060550 0x7fb73c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:58.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.908+0000 7fb75bfff700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb73c060550 0x7fb73c062a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb75c1574c0 tx=0x7fb744019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:58.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:58.912+0000 7fb758ff9700 1 -- 172.21.15.29:0/1170014534 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb74c04c340 con 0x7fb75c06d6d0 2023-10-06T05:26:59.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.076+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb75c062e70 con 0x7fb75c06d6d0 2023-10-06T05:26:59.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.712+0000 7fb758ff9700 1 -- 172.21.15.29:0/1170014534 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb74c0170d0 con 0x7fb75c06d6d0 2023-10-06T05:26:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb73c060550 msgr2=0x7fb73c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb73c060550 0x7fb73c062a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb75c1574c0 tx=0x7fb744019000 comp rx=0 tx=0).stop 2023-10-06T05:26:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c06d6d0 msgr2=0x7fb75c0b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c06d6d0 0x7fb75c0b18a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00c790 tx=0x7fb74c007df0 comp rx=0 tx=0).stop 2023-10-06T05:26:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 shutdown_connections 2023-10-06T05:26:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb75c157040 0x7fb75c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb73c060550 0x7fb73c062a00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb75c156c70 0x7fb75c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:59.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 --2- 172.21.15.29:0/1170014534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb75c06d6d0 0x7fb75c0b18a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 >> 172.21.15.29:0/1170014534 conn(0x7fb75c0c9830 msgr2=0x7fb75c0c27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 shutdown_connections 2023-10-06T05:26:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.716+0000 7fb761b1c700 1 -- 172.21.15.29:0/1170014534 wait complete. 2023-10-06T05:26:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2023-10-06T05:26:59.737 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T05:26:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.856+0000 7fc1d499c700 1 Processor -- start 2023-10-06T05:26:59.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.856+0000 7fc1d499c700 1 -- start start 2023-10-06T05:26:59.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1d499c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc1d00ca250 0x7fc1d0156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:59.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1d499c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d01569d0 con 0x7fc1d00cd530 2023-10-06T05:26:59.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1d499c700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00c93e0 con 0x7fc1d0156f20 2023-10-06T05:26:59.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1d499c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d00c96c0 con 0x7fc1d00ca250 2023-10-06T05:26:59.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1c7fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc1d00cd530 0x7fc1d0159d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39646/0 (socket says 172.21.15.29:39646) 2023-10-06T05:26:59.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1c7fff700 1 -- 172.21.15.29:0/622432440 learned_addr learned my addr 172.21.15.29:0/622432440 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:26:59.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1ced9d700 1 --2- 172.21.15.29:0/622432440 >> v2:172.21.15.173:3300/0 conn(0x7fc1d00ca250 0x7fc1d0156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:59.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1cdd9b700 1 -- 172.21.15.29:0/622432440 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256733699 0 0) 0x7fc1d01569d0 con 0x7fc1d00cd530 2023-10-06T05:26:59.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1cdd9b700 1 -- 172.21.15.29:0/622432440 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1bc003570 con 0x7fc1d00cd530 2023-10-06T05:26:59.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1cdd9b700 1 -- 172.21.15.29:0/622432440 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269060397 0 0) 0x7fc1d00c93e0 con 0x7fc1d0156f20 2023-10-06T05:26:59.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1cdd9b700 1 -- 172.21.15.29:0/622432440 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d01569d0 con 0x7fc1d0156f20 2023-10-06T05:26:59.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1ced9d700 1 -- 172.21.15.29:0/622432440 >> v1:172.21.15.173:6789/0 conn(0x7fc1d0156f20 legacy=0x7fc1d00cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:59.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1ced9d700 1 -- 172.21.15.29:0/622432440 >> v1:172.21.15.29:6789/0 conn(0x7fc1d00cd530 legacy=0x7fc1d0159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:59.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1ced9d700 1 -- 172.21.15.29:0/622432440 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00c87f0 con 0x7fc1d00ca250 2023-10-06T05:26:59.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1ced9d700 1 --2- 172.21.15.29:0/622432440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d00ca250 0x7fc1d0156490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009e60 tx=0x7fc1c8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad9016cde754c0c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:59.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1cdd9b700 1 -- 172.21.15.29:0/622432440 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800e070 con 0x7fc1d00ca250 2023-10-06T05:26:59.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1cdd9b700 1 -- 172.21.15.29:0/622432440 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c800bab0 con 0x7fc1d00ca250 2023-10-06T05:26:59.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.860+0000 7fc1cdd9b700 1 -- 172.21.15.29:0/622432440 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800be70 con 0x7fc1d00ca250 2023-10-06T05:26:59.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.864+0000 7fc1d499c700 1 -- 172.21.15.29:0/622432440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d00ca250 msgr2=0x7fc1d0156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:59.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.864+0000 7fc1d499c700 1 --2- 172.21.15.29:0/622432440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d00ca250 0x7fc1d0156490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009e60 tx=0x7fc1c8009780 comp rx=0 tx=0).stop 2023-10-06T05:26:59.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.864+0000 7fc1d499c700 1 -- 172.21.15.29:0/622432440 shutdown_connections 2023-10-06T05:26:59.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.864+0000 7fc1d499c700 1 --2- 172.21.15.29:0/622432440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d00ca250 0x7fc1d0156490 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:59.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.864+0000 7fc1d499c700 1 -- 172.21.15.29:0/622432440 >> 172.21.15.29:0/622432440 conn(0x7fc1d006b820 msgr2=0x7fc1d006bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:26:59.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.864+0000 7fc1d499c700 1 -- 172.21.15.29:0/622432440 shutdown_connections 2023-10-06T05:26:59.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.864+0000 7fc1d499c700 1 -- 172.21.15.29:0/622432440 wait complete. 2023-10-06T05:26:59.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.864+0000 7fc1d499c700 1 Processor -- start 2023-10-06T05:26:59.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.864+0000 7fc1d499c700 1 -- start start 2023-10-06T05:26:59.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1d499c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1d00ca250 0x7fc1d014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:59.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1d499c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d00cd530 0x7fc1d00b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:59.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1d499c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1d0156f20 0x7fc1d0155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:59.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1d499c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d014bad0 con 0x7fc1d00ca250 2023-10-06T05:26:59.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1d499c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d00b0b90 con 0x7fc1d00cd530 2023-10-06T05:26:59.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1d499c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d00b13a0 con 0x7fc1d0156f20 2023-10-06T05:26:59.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ce59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1d00ca250 0x7fc1d014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:59.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ced9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1d0156f20 0x7fc1d0155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:59.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ce59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1d00ca250 0x7fc1d014b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48990/0 (socket says 172.21.15.29:48990) 2023-10-06T05:26:59.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ce59c700 1 -- 172.21.15.29:0/1701593422 learned_addr learned my addr 172.21.15.29:0/1701593422 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:26:59.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1c7fff700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d00cd530 0x7fc1d00b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:59.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ce59c700 1 -- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1d0156f20 msgr2=0x7fc1d0155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:59.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ce59c700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1d0156f20 0x7fc1d0155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:59.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ce59c700 1 -- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d00cd530 msgr2=0x7fc1d00b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:26:59.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ce59c700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d00cd530 0x7fc1d00b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:26:59.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ce59c700 1 -- 172.21.15.29:0/1701593422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c8009a20 con 0x7fc1d00ca250 2023-10-06T05:26:59.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1ce59c700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1d00ca250 0x7fc1d014b590 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000c790 tx=0x7fc1c0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:59.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1c67fc700 1 -- 172.21.15.29:0/1701593422 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0010510 con 0x7fc1d00ca250 2023-10-06T05:26:59.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1c67fc700 1 -- 172.21.15.29:0/1701593422 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0010670 con 0x7fc1d00ca250 2023-10-06T05:26:59.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1c67fc700 1 -- 172.21.15.29:0/1701593422 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0010a10 con 0x7fc1d00ca250 2023-10-06T05:26:59.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d00b1680 con 0x7fc1d00ca250 2023-10-06T05:26:59.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.868+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d00b1c40 con 0x7fc1d00ca250 2023-10-06T05:26:59.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.872+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d0156c80 con 0x7fc1d00ca250 2023-10-06T05:26:59.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.872+0000 7fc1c67fc700 1 -- 172.21.15.29:0/1701593422 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc1c001b3b0 con 0x7fc1d00ca250 2023-10-06T05:26:59.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.872+0000 7fc1c67fc700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1b0060550 0x7fc1b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:26:59.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.872+0000 7fc1c67fc700 1 -- 172.21.15.29:0/1701593422 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fc1c007c110 con 0x7fc1d00ca250 2023-10-06T05:26:59.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.872+0000 7fc1c7fff700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1b0060550 0x7fc1b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:26:59.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.872+0000 7fc1c7fff700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1b0060550 0x7fc1b0062a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc1d014cb00 tx=0x7fc1b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:26:59.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:26:59.880+0000 7fc1c67fc700 1 -- 172.21.15.29:0/1701593422 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc1d0156c80 con 0x7fc1d00ca250 2023-10-06T05:27:00.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.060+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1d0156c80 con 0x7fc1d00ca250 2023-10-06T05:27:00.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.716+0000 7fc1c67fc700 1 -- 172.21.15.29:0/1701593422 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc1d0156c80 con 0x7fc1d00ca250 2023-10-06T05:27:00.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.720+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1b0060550 msgr2=0x7fc1b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:00.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.720+0000 7fc1d499c700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1b0060550 0x7fc1b0062a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc1d014cb00 tx=0x7fc1b8009040 comp rx=0 tx=0).stop 2023-10-06T05:27:00.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.720+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1d00ca250 msgr2=0x7fc1d014b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:00.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.720+0000 7fc1d499c700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1d00ca250 0x7fc1d014b590 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000c790 tx=0x7fc1c0007e10 comp rx=0 tx=0).stop 2023-10-06T05:27:00.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.720+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 shutdown_connections 2023-10-06T05:27:00.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.720+0000 7fc1d499c700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1d0156f20 0x7fc1d0155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:00.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.724+0000 7fc1d499c700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc1b0060550 0x7fc1b0062a00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:00.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.724+0000 7fc1d499c700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1d00cd530 0x7fc1d00b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:00.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.724+0000 7fc1d499c700 1 --2- 172.21.15.29:0/1701593422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1d00ca250 0x7fc1d014b590 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:00.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.724+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 >> 172.21.15.29:0/1701593422 conn(0x7fc1d006b820 msgr2=0x7fc1d0159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:00.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.724+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 shutdown_connections 2023-10-06T05:27:00.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.724+0000 7fc1d499c700 1 -- 172.21.15.29:0/1701593422 wait complete. 2023-10-06T05:27:00.730 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2023-10-06T05:27:00.747 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T05:27:00.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f4270f700 1 Processor -- start 2023-10-06T05:27:00.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f4270f700 1 -- start start 2023-10-06T05:27:00.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f4270f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f3c0c8bc0 0x7f5f3c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:00.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f4270f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c15e8b0 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f4270f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c161920 con 0x7f5f3c0c87f0 2023-10-06T05:27:00.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f4270f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c160ff0 con 0x7f5f3c0c8bc0 2023-10-06T05:27:00.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f40cac700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f3c0c8bc0 0x7f5f3c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:00.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f3b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5f3c0ca6b0 0x7f5f3c15cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39662/0 (socket says 172.21.15.29:39662) 2023-10-06T05:27:00.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f3b7fe700 1 -- 172.21.15.29:0/3153863292 learned_addr learned my addr 172.21.15.29:0/3153863292 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:00.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f3affd700 1 -- 172.21.15.29:0/3153863292 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386451296 0 0) 0x7f5f3c15e8b0 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f3affd700 1 -- 172.21.15.29:0/3153863292 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f24003570 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f3affd700 1 -- 172.21.15.29:0/3153863292 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728366605 0 0) 0x7f5f3c161920 con 0x7f5f3c0c87f0 2023-10-06T05:27:00.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f3affd700 1 -- 172.21.15.29:0/3153863292 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f3c15e8b0 con 0x7f5f3c0c87f0 2023-10-06T05:27:00.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f40cac700 1 -- 172.21.15.29:0/3153863292 >> v1:172.21.15.173:6789/0 conn(0x7f5f3c0c87f0 legacy=0x7f5f3c0c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:00.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f40cac700 1 -- 172.21.15.29:0/3153863292 >> v1:172.21.15.29:6789/0 conn(0x7f5f3c0ca6b0 legacy=0x7f5f3c15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:00.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f40cac700 1 -- 172.21.15.29:0/3153863292 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c1612d0 con 0x7f5f3c0c8bc0 2023-10-06T05:27:00.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.848+0000 7f5f40cac700 1 --2- 172.21.15.29:0/3153863292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0c8bc0 0x7f5f3c15d370 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009e90 tx=0x7f5f34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d854cccaed528212 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:00.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f3affd700 1 -- 172.21.15.29:0/3153863292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400e070 con 0x7f5f3c0c8bc0 2023-10-06T05:27:00.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f3affd700 1 -- 172.21.15.29:0/3153863292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400bb90 con 0x7f5f3c0c8bc0 2023-10-06T05:27:00.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f3affd700 1 -- 172.21.15.29:0/3153863292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34012430 con 0x7f5f3c0c8bc0 2023-10-06T05:27:00.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 -- 172.21.15.29:0/3153863292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0c8bc0 msgr2=0x7f5f3c15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:00.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 --2- 172.21.15.29:0/3153863292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0c8bc0 0x7f5f3c15d370 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009e90 tx=0x7f5f34009780 comp rx=0 tx=0).stop 2023-10-06T05:27:00.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 -- 172.21.15.29:0/3153863292 shutdown_connections 2023-10-06T05:27:00.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 --2- 172.21.15.29:0/3153863292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0c8bc0 0x7f5f3c15d370 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:00.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 -- 172.21.15.29:0/3153863292 >> 172.21.15.29:0/3153863292 conn(0x7f5f3c0670a0 msgr2=0x7f5f3c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:00.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 -- 172.21.15.29:0/3153863292 shutdown_connections 2023-10-06T05:27:00.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 -- 172.21.15.29:0/3153863292 wait complete. 2023-10-06T05:27:00.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 Processor -- start 2023-10-06T05:27:00.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 -- start start 2023-10-06T05:27:00.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f3c0c87f0 0x7f5f3c0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:00.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f3c0c8bc0 0x7f5f3c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:00.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0ca6b0 0x7f5f3c0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:00.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b01b0 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b0490 con 0x7f5f3c0c8bc0 2023-10-06T05:27:00.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f4270f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b0770 con 0x7f5f3c0c87f0 2023-10-06T05:27:00.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f40cac700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0ca6b0 0x7f5f3c0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:00.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f40cac700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0ca6b0 0x7f5f3c0b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49010/0 (socket says 172.21.15.29:49010) 2023-10-06T05:27:00.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f40cac700 1 -- 172.21.15.29:0/713552241 learned_addr learned my addr 172.21.15.29:0/713552241 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:00.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f3b7fe700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f3c0c8bc0 0x7f5f3c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:00.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.852+0000 7f5f3bfff700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f3c0c87f0 0x7f5f3c0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:00.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f40cac700 1 -- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f3c0c87f0 msgr2=0x7f5f3c0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:00.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f40cac700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f3c0c87f0 0x7f5f3c0c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f40cac700 1 -- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f3c0c8bc0 msgr2=0x7f5f3c14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f40cac700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f3c0c8bc0 0x7f5f3c14dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f40cac700 1 -- 172.21.15.29:0/713552241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34009a20 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f3b7fe700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f3c0c8bc0 0x7f5f3c14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f40cac700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0ca6b0 0x7f5f3c0b1250 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400b950 tx=0x7f5f34019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f23fff700 1 -- 172.21.15.29:0/713552241 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34027470 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f23fff700 1 -- 172.21.15.29:0/713552241 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f340275d0 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c0b0a50 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f23fff700 1 -- 172.21.15.29:0/713552241 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34027990 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c0c5de0 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c0b0f50 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.856+0000 7f5f23fff700 1 -- 172.21.15.29:0/713552241 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5f34024070 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.860+0000 7f5f23fff700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5f28060550 0x7f5f28062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:00.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.860+0000 7f5f23fff700 1 -- 172.21.15.29:0/713552241 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5f3407eff0 con 0x7f5f3c0ca6b0 2023-10-06T05:27:00.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.860+0000 7f5f3bfff700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5f28060550 0x7f5f28062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:00.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.860+0000 7f5f3bfff700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5f28060550 0x7f5f28062a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c001010 tx=0x7f5f2c007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:00.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:00.864+0000 7f5f23fff700 1 -- 172.21.15.29:0/713552241 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5f3404f780 con 0x7f5f3c0ca6b0 2023-10-06T05:27:01.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.024+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5f3c071120 con 0x7f5f3c0ca6b0 2023-10-06T05:27:01.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f23fff700 1 -- 172.21.15.29:0/713552241 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5f34052da0 con 0x7f5f3c0ca6b0 2023-10-06T05:27:01.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5f28060550 msgr2=0x7f5f28062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5f28060550 0x7f5f28062a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c001010 tx=0x7f5f2c007de0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0ca6b0 msgr2=0x7f5f3c0b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0ca6b0 0x7f5f3c0b1250 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400b950 tx=0x7f5f34019000 comp rx=0 tx=0).stop 2023-10-06T05:27:01.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 shutdown_connections 2023-10-06T05:27:01.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c0ca6b0 0x7f5f3c0b1250 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5f28060550 0x7f5f28062a00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f3c0c8bc0 0x7f5f3c14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 --2- 172.21.15.29:0/713552241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f3c0c87f0 0x7f5f3c0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 >> 172.21.15.29:0/713552241 conn(0x7f5f3c0670a0 msgr2=0x7f5f3c0c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:01.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 shutdown_connections 2023-10-06T05:27:01.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.032+0000 7f5f4270f700 1 -- 172.21.15.29:0/713552241 wait complete. 2023-10-06T05:27:01.050 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-10-06T05:27:01.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.152+0000 7f8de919e700 1 Processor -- start 2023-10-06T05:27:01.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.152+0000 7f8de919e700 1 -- start start 2023-10-06T05:27:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8de4159fe0 0x7f8de406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de40cfb60 0x7f8de40cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de40cee50 con 0x7f8de4158c00 2023-10-06T05:27:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de406b250 con 0x7f8de4159fe0 2023-10-06T05:27:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de406a640 con 0x7f8de40cfb60 2023-10-06T05:27:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de899d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de40cfb60 0x7f8de40cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de37fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8de4159fe0 0x7f8de406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de899d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de40cfb60 0x7f8de40cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:42508/0 (socket says 172.21.15.29:42508) 2023-10-06T05:27:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de37fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8de4159fe0 0x7f8de406b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:39528/0 (socket says 172.21.15.29:39528) 2023-10-06T05:27:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de899d700 1 -- 172.21.15.29:0/1667858262 learned_addr learned my addr 172.21.15.29:0/1667858262 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de3fff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f8de4158c00 0x7f8de40ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:49370/0 (socket says 172.21.15.29:49370) 2023-10-06T05:27:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de899d700 1 -- 172.21.15.29:0/1667858262 >> v2:172.21.15.173:3300/0 conn(0x7f8de4159fe0 msgr2=0x7f8de406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de899d700 1 --2- 172.21.15.29:0/1667858262 >> v2:172.21.15.173:3300/0 conn(0x7f8de4159fe0 0x7f8de406b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de899d700 1 -- 172.21.15.29:0/1667858262 >> v1:172.21.15.173:6789/0 conn(0x7f8de4158c00 legacy=0x7f8de40ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de899d700 1 -- 172.21.15.29:0/1667858262 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de406a920 con 0x7f8de40cfb60 2023-10-06T05:27:01.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de899d700 1 --2- 172.21.15.29:0/1667858262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de40cfb60 0x7f8de40cffe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009f20 tx=0x7f8ddc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c61c9ddfe9129e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:01.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de2ffd700 1 -- 172.21.15.29:0/1667858262 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc00e070 con 0x7f8de40cfb60 2023-10-06T05:27:01.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de2ffd700 1 -- 172.21.15.29:0/1667858262 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc00b9d0 con 0x7f8de40cfb60 2023-10-06T05:27:01.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de2ffd700 1 -- 172.21.15.29:0/1667858262 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0092e0 con 0x7f8de40cfb60 2023-10-06T05:27:01.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 -- 172.21.15.29:0/1667858262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de40cfb60 msgr2=0x7f8de40cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 --2- 172.21.15.29:0/1667858262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de40cfb60 0x7f8de40cffe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009f20 tx=0x7f8ddc009840 comp rx=0 tx=0).stop 2023-10-06T05:27:01.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 -- 172.21.15.29:0/1667858262 shutdown_connections 2023-10-06T05:27:01.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 --2- 172.21.15.29:0/1667858262 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de40cfb60 0x7f8de40cffe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 --2- 172.21.15.29:0/1667858262 >> v2:172.21.15.173:3300/0 conn(0x7f8de4159fe0 0x7f8de406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 -- 172.21.15.29:0/1667858262 >> 172.21.15.29:0/1667858262 conn(0x7f8de40670a0 msgr2=0x7f8de4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:01.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 -- 172.21.15.29:0/1667858262 shutdown_connections 2023-10-06T05:27:01.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.156+0000 7f8de919e700 1 -- 172.21.15.29:0/1667858262 wait complete. 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 Processor -- start 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 -- start start 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de40cfb60 0x7f8de41415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de4158c00 0x7f8de40c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8de4159fe0 0x7f8de4154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40b2fd0 con 0x7f8de40cfb60 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40b32b0 con 0x7f8de4159fe0 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40b3590 con 0x7f8de4158c00 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de40cfb60 0x7f8de41415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de40cfb60 0x7f8de41415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49026/0 (socket says 172.21.15.29:49026) 2023-10-06T05:27:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de3fff700 1 -- 172.21.15.29:0/263065895 learned_addr learned my addr 172.21.15.29:0/263065895 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de37fe700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de4158c00 0x7f8de40c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de899d700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8de4159fe0 0x7f8de4154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de3fff700 1 -- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de4158c00 msgr2=0x7f8de40c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de3fff700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de4158c00 0x7f8de40c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de3fff700 1 -- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8de4159fe0 msgr2=0x7f8de4154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de3fff700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8de4159fe0 0x7f8de4154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de3fff700 1 -- 172.21.15.29:0/263065895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc009ae0 con 0x7f8de40cfb60 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de37fe700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de4158c00 0x7f8de40c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de899d700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8de4159fe0 0x7f8de4154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de3fff700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de40cfb60 0x7f8de41415f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400c560 tx=0x7f8dd4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8ddbfff700 1 -- 172.21.15.29:0/263065895 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4005a70 con 0x7f8de40cfb60 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8ddbfff700 1 -- 172.21.15.29:0/263065895 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd4005bd0 con 0x7f8de40cfb60 2023-10-06T05:27:01.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de40b3870 con 0x7f8de40cfb60 2023-10-06T05:27:01.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8ddbfff700 1 -- 172.21.15.29:0/263065895 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40070d0 con 0x7f8de40cfb60 2023-10-06T05:27:01.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.160+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de40b2c80 con 0x7f8de40cfb60 2023-10-06T05:27:01.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.164+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de404be00 con 0x7f8de40cfb60 2023-10-06T05:27:01.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.164+0000 7f8ddbfff700 1 -- 172.21.15.29:0/263065895 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8dd4007480 con 0x7f8de40cfb60 2023-10-06T05:27:01.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.164+0000 7f8ddbfff700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8dc4060550 0x7f8dc4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.164+0000 7f8ddbfff700 1 -- 172.21.15.29:0/263065895 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8dd407b8e0 con 0x7f8de40cfb60 2023-10-06T05:27:01.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.164+0000 7f8de37fe700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8dc4060550 0x7f8dc4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.164+0000 7f8de37fe700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8dc4060550 0x7f8dc4062a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8de40cf420 tx=0x7f8dcc0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:01.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.172+0000 7f8ddbfff700 1 -- 172.21.15.29:0/263065895 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8dd404bfd0 con 0x7f8de40cfb60 2023-10-06T05:27:01.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.388+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f8de40cee50 con 0x7f8de40cfb60 2023-10-06T05:27:01.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.716+0000 7f8ddbfff700 1 -- 172.21.15.29:0/263065895 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v91) v1 ==== 142+0+0 (secure 0 0 0) 0x7f8de40cee50 con 0x7f8de40cfb60 2023-10-06T05:27:01.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8dc4060550 msgr2=0x7f8dc4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8dc4060550 0x7f8dc4062a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8de40cf420 tx=0x7f8dcc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de40cfb60 msgr2=0x7f8de41415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de40cfb60 0x7f8de41415f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400c560 tx=0x7f8dd4007f70 comp rx=0 tx=0).stop 2023-10-06T05:27:01.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 shutdown_connections 2023-10-06T05:27:01.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8dc4060550 0x7f8dc4062a00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8de4159fe0 0x7f8de4154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8de4158c00 0x7f8de40c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 --2- 172.21.15.29:0/263065895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de40cfb60 0x7f8de41415f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 >> 172.21.15.29:0/263065895 conn(0x7f8de40670a0 msgr2=0x7f8de40c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:01.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 shutdown_connections 2023-10-06T05:27:01.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.720+0000 7f8de919e700 1 -- 172.21.15.29:0/263065895 wait complete. 2023-10-06T05:27:01.744 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-10-06T05:27:01.744 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2023-10-06T05:27:01.744 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-10-06T05:27:01.744 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-10-06T05:27:01.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f669a2b5700 1 Processor -- start 2023-10-06T05:27:01.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f669a2b5700 1 -- start start 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f669a2b5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152b50 0x7f6694159830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f669a2b5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6694152f20 0x7f669406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f669a2b5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f669406dc10 0x7f66940c6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f669a2b5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669406e090 con 0x7f6694152f20 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f669a2b5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66940c9e00 con 0x7f669406dc10 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f669a2b5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66941567d0 con 0x7f6694152b50 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f6698ab2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6694152f20 0x7f669406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f6698ab2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6694152f20 0x7f669406d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49036/0 (socket says 172.21.15.29:49036) 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f6698ab2700 1 -- 172.21.15.29:0/1978486352 learned_addr learned my addr 172.21.15.29:0/1978486352 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f66992b3700 1 --2- 172.21.15.29:0/1978486352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152b50 0x7f6694159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f6699ab4700 1 --2- 172.21.15.29:0/1978486352 >> v2:172.21.15.173:3300/0 conn(0x7f669406dc10 0x7f66940c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f6698ab2700 1 -- 172.21.15.29:0/1978486352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152b50 msgr2=0x7f6694159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:01.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f6698ab2700 1 --2- 172.21.15.29:0/1978486352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152b50 0x7f6694159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f6698ab2700 1 -- 172.21.15.29:0/1978486352 >> v2:172.21.15.173:3300/0 conn(0x7f669406dc10 msgr2=0x7f66940c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:01.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f6698ab2700 1 --2- 172.21.15.29:0/1978486352 >> v2:172.21.15.173:3300/0 conn(0x7f669406dc10 0x7f66940c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.860+0000 7f6698ab2700 1 -- 172.21.15.29:0/1978486352 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694159d70 con 0x7f6694152f20 2023-10-06T05:27:01.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f6698ab2700 1 --2- 172.21.15.29:0/1978486352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152f20 0x7f669406d6d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f669406b810 tx=0x7f6684009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43520e2672f71648 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:01.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f668bfff700 1 -- 172.21.15.29:0/1978486352 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400b640 con 0x7f6694152f20 2023-10-06T05:27:01.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f668bfff700 1 -- 172.21.15.29:0/1978486352 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668400b7a0 con 0x7f6694152f20 2023-10-06T05:27:01.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f668bfff700 1 -- 172.21.15.29:0/1978486352 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400bb40 con 0x7f6694152f20 2023-10-06T05:27:01.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f669a2b5700 1 -- 172.21.15.29:0/1978486352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152f20 msgr2=0x7f669406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1978486352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152f20 0x7f669406d6d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f669406b810 tx=0x7f6684009250 comp rx=0 tx=0).stop 2023-10-06T05:27:01.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f669a2b5700 1 -- 172.21.15.29:0/1978486352 shutdown_connections 2023-10-06T05:27:01.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1978486352 >> v2:172.21.15.173:3300/0 conn(0x7f669406dc10 0x7f66940c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1978486352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152f20 0x7f669406d6d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1978486352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152b50 0x7f6694159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f669a2b5700 1 -- 172.21.15.29:0/1978486352 >> 172.21.15.29:0/1978486352 conn(0x7f669406aaf0 msgr2=0x7f669406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:01.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f669a2b5700 1 -- 172.21.15.29:0/1978486352 shutdown_connections 2023-10-06T05:27:01.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.864+0000 7f669a2b5700 1 -- 172.21.15.29:0/1978486352 wait complete. 2023-10-06T05:27:01.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f669a2b5700 1 Processor -- start 2023-10-06T05:27:01.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f669a2b5700 1 -- start start 2023-10-06T05:27:01.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f669a2b5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669406dc10 0x7f6694157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f669a2b5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152b50 0x7f66940c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f669a2b5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152f20 0x7f66940c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f669a2b5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694168050 con 0x7f6694152b50 2023-10-06T05:27:01.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f669a2b5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694157ea0 con 0x7f669406dc10 2023-10-06T05:27:01.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f669a2b5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6694167460 con 0x7f6694152f20 2023-10-06T05:27:01.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f6698ab2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152b50 0x7f66940c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f6698ab2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152b50 0x7f66940c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49050/0 (socket says 172.21.15.29:49050) 2023-10-06T05:27:01.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f6698ab2700 1 -- 172.21.15.29:0/1992443896 learned_addr learned my addr 172.21.15.29:0/1992443896 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:01.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f66992b3700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669406dc10 0x7f6694157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.868+0000 7f6699ab4700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152f20 0x7f66940c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f6698ab2700 1 -- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152f20 msgr2=0x7f66940c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f6698ab2700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152f20 0x7f66940c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f6698ab2700 1 -- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669406dc10 msgr2=0x7f6694157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:01.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f6698ab2700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669406dc10 0x7f6694157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:01.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f6698ab2700 1 -- 172.21.15.29:0/1992443896 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840094f0 con 0x7f6694152b50 2023-10-06T05:27:01.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f66992b3700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669406dc10 0x7f6694157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:01.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f6698ab2700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152b50 0x7f66940c54f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f66840099b0 tx=0x7f6684017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:01.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f66897fa700 1 -- 172.21.15.29:0/1992443896 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400bb20 con 0x7f6694152b50 2023-10-06T05:27:01.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f66897fa700 1 -- 172.21.15.29:0/1992443896 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6684000c90 con 0x7f6694152b50 2023-10-06T05:27:01.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6694167720 con 0x7f6694152b50 2023-10-06T05:27:01.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f66897fa700 1 -- 172.21.15.29:0/1992443896 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684011670 con 0x7f6694152b50 2023-10-06T05:27:01.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6694167ce0 con 0x7f6694152b50 2023-10-06T05:27:01.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.872+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6694168200 con 0x7f6694152b50 2023-10-06T05:27:01.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.876+0000 7f66897fa700 1 -- 172.21.15.29:0/1992443896 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6684011a20 con 0x7f6694152b50 2023-10-06T05:27:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.876+0000 7f66897fa700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6678060580 0x7f6678062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.876+0000 7f66897fa700 1 -- 172.21.15.29:0/1992443896 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f668407dc40 con 0x7f6694152b50 2023-10-06T05:27:01.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.876+0000 7f66992b3700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6678060580 0x7f6678062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:01.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.876+0000 7f66992b3700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6678060580 0x7f6678062a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f669406da50 tx=0x7f66900091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:01.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:01.884+0000 7f66897fa700 1 -- 172.21.15.29:0/1992443896 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f668404e3d0 con 0x7f6694152b50 2023-10-06T05:27:02.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.104+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f6694167ea0 con 0x7f6694152b50 2023-10-06T05:27:02.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.724+0000 7f66897fa700 1 -- 172.21.15.29:0/1992443896 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v92) v1 ==== 152+0+0 (secure 0 0 0) 0x7f66840519f0 con 0x7f6694152b50 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.728+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6678060580 msgr2=0x7f6678062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.728+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6678060580 0x7f6678062a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f669406da50 tx=0x7f66900091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.728+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152b50 msgr2=0x7f66940c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.728+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152b50 0x7f66940c54f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f66840099b0 tx=0x7f6684017000 comp rx=0 tx=0).stop 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.732+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 shutdown_connections 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.732+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6694152f20 0x7f66940c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.732+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6694152b50 0x7f66940c54f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.732+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6678060580 0x7f6678062a30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.732+0000 7f669a2b5700 1 --2- 172.21.15.29:0/1992443896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669406dc10 0x7f6694157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.732+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 >> 172.21.15.29:0/1992443896 conn(0x7f669406aaf0 msgr2=0x7f66940cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.732+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 shutdown_connections 2023-10-06T05:27:02.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.732+0000 7f669a2b5700 1 -- 172.21.15.29:0/1992443896 wait complete. 2023-10-06T05:27:02.752 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T05:27:02.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.868+0000 7f7279b5d700 1 Processor -- start 2023-10-06T05:27:02.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.868+0000 7f7279b5d700 1 -- start start 2023-10-06T05:27:02.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7279b5d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7274156e90 0x7f72740cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:02.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7279b5d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f727406cdd0 0x7f72740cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:02.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7279b5d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7274157260 0x7f72740ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:02.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7279b5d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740cd9d0 con 0x7f727406cdd0 2023-10-06T05:27:02.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7279b5d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740cd000 con 0x7f7274156e90 2023-10-06T05:27:02.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7279b5d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72740cc3f0 con 0x7f7274157260 2023-10-06T05:27:02.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f726affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f727406cdd0 0x7f72740cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:02.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f726affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f727406cdd0 0x7f72740cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49056/0 (socket says 172.21.15.29:49056) 2023-10-06T05:27:02.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f726affd700 1 -- 172.21.15.29:0/58818584 learned_addr learned my addr 172.21.15.29:0/58818584 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:02.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7273fff700 1 --2- 172.21.15.29:0/58818584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7274157260 0x7f72740ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:02.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f72737fe700 1 --2- 172.21.15.29:0/58818584 >> v2:172.21.15.173:3300/0 conn(0x7f7274156e90 0x7f72740cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:02.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f726affd700 1 -- 172.21.15.29:0/58818584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7274157260 msgr2=0x7f72740ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:02.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f726affd700 1 --2- 172.21.15.29:0/58818584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7274157260 0x7f72740ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f726affd700 1 -- 172.21.15.29:0/58818584 >> v2:172.21.15.173:3300/0 conn(0x7f7274156e90 msgr2=0x7f72740cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:02.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f726affd700 1 --2- 172.21.15.29:0/58818584 >> v2:172.21.15.173:3300/0 conn(0x7f7274156e90 0x7f72740cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f726affd700 1 -- 172.21.15.29:0/58818584 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740cc6d0 con 0x7f727406cdd0 2023-10-06T05:27:02.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f726affd700 1 --2- 172.21.15.29:0/58818584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f727406cdd0 0x7f72740cbba0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f727406d6a0 tx=0x7f725c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed7e0b5e2668516 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:02.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7272ffd700 1 -- 172.21.15.29:0/58818584 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c00b640 con 0x7f727406cdd0 2023-10-06T05:27:02.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7272ffd700 1 -- 172.21.15.29:0/58818584 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c00b7a0 con 0x7f727406cdd0 2023-10-06T05:27:02.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.872+0000 7f7272ffd700 1 -- 172.21.15.29:0/58818584 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c00bb60 con 0x7f727406cdd0 2023-10-06T05:27:02.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 -- 172.21.15.29:0/58818584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f727406cdd0 msgr2=0x7f72740cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:02.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 --2- 172.21.15.29:0/58818584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f727406cdd0 0x7f72740cbba0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f727406d6a0 tx=0x7f725c009250 comp rx=0 tx=0).stop 2023-10-06T05:27:02.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 -- 172.21.15.29:0/58818584 shutdown_connections 2023-10-06T05:27:02.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 --2- 172.21.15.29:0/58818584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7274157260 0x7f72740ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 --2- 172.21.15.29:0/58818584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f727406cdd0 0x7f72740cbba0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 --2- 172.21.15.29:0/58818584 >> v2:172.21.15.173:3300/0 conn(0x7f7274156e90 0x7f72740cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 -- 172.21.15.29:0/58818584 >> 172.21.15.29:0/58818584 conn(0x7f7274069d30 msgr2=0x7f727406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:02.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 -- 172.21.15.29:0/58818584 shutdown_connections 2023-10-06T05:27:02.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 -- 172.21.15.29:0/58818584 wait complete. 2023-10-06T05:27:02.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 Processor -- start 2023-10-06T05:27:02.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 -- start start 2023-10-06T05:27:02.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f727406cdd0 0x7f727414bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:02.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7274156e90 0x7f72740b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7274157260 0x7f72740b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727414c0f0 con 0x7f7274156e90 2023-10-06T05:27:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740b1a40 con 0x7f7274157260 2023-10-06T05:27:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f7279b5d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72740b1d20 con 0x7f727406cdd0 2023-10-06T05:27:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.876+0000 7f726affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7274156e90 0x7f72740b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7274156e90 0x7f72740b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49070/0 (socket says 172.21.15.29:49070) 2023-10-06T05:27:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726affd700 1 -- 172.21.15.29:0/2869787668 learned_addr learned my addr 172.21.15.29:0/2869787668 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f7273fff700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7274157260 0x7f72740b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:02.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f72737fe700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f727406cdd0 0x7f727414bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726affd700 1 -- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f727406cdd0 msgr2=0x7f727414bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726affd700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f727406cdd0 0x7f727414bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726affd700 1 -- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7274157260 msgr2=0x7f72740b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:02.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726affd700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7274157260 0x7f72740b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726affd700 1 -- 172.21.15.29:0/2869787668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c0094f0 con 0x7f7274156e90 2023-10-06T05:27:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726affd700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7274156e90 0x7f72740b2980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f725c006fd0 tx=0x7f725c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726bfff700 1 -- 172.21.15.29:0/2869787668 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c000bc0 con 0x7f7274156e90 2023-10-06T05:27:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726bfff700 1 -- 172.21.15.29:0/2869787668 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c00b910 con 0x7f7274156e90 2023-10-06T05:27:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72740b2000 con 0x7f7274156e90 2023-10-06T05:27:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f726bfff700 1 -- 172.21.15.29:0/2869787668 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c000d20 con 0x7f7274156e90 2023-10-06T05:27:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72740c5360 con 0x7f7274156e90 2023-10-06T05:27:02.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.880+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72740c5550 con 0x7f7274156e90 2023-10-06T05:27:02.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.884+0000 7f726bfff700 1 -- 172.21.15.29:0/2869787668 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f725c023030 con 0x7f7274156e90 2023-10-06T05:27:02.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.884+0000 7f726bfff700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7258060550 0x7f7258062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:02.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.884+0000 7f726bfff700 1 -- 172.21.15.29:0/2869787668 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f725c07dcd0 con 0x7f7274156e90 2023-10-06T05:27:02.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.884+0000 7f72737fe700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7258060550 0x7f7258062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:02.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.884+0000 7f72737fe700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7258060550 0x7f7258062a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7264009db0 tx=0x7f72640091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:02.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:02.896+0000 7f726bfff700 1 -- 172.21.15.29:0/2869787668 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f725c04e460 con 0x7f7274156e90 2023-10-06T05:27:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.060+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7274071120 con 0x7f7274156e90 2023-10-06T05:27:03.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f726bfff700 1 -- 172.21.15.29:0/2869787668 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f725c051a80 con 0x7f7274156e90 2023-10-06T05:27:03.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7258060550 msgr2=0x7f7258062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7258060550 0x7f7258062a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7264009db0 tx=0x7f72640091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7274156e90 msgr2=0x7f72740b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7274156e90 0x7f72740b2980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f725c006fd0 tx=0x7f725c017000 comp rx=0 tx=0).stop 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 shutdown_connections 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7258060550 0x7f7258062a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7274157260 0x7f72740b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7274156e90 0x7f72740b2980 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 --2- 172.21.15.29:0/2869787668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f727406cdd0 0x7f727414bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.068+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 >> 172.21.15.29:0/2869787668 conn(0x7f7274069d30 msgr2=0x7f7274155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.072+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 shutdown_connections 2023-10-06T05:27:03.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.072+0000 7f7279b5d700 1 -- 172.21.15.29:0/2869787668 wait complete. 2023-10-06T05:27:03.088 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T05:27:03.089 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:27:03.107 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:27:03.127 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T05:27:03.127 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T05:27:03.127 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:27:03.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.236+0000 7fdb2ab23700 1 Processor -- start 2023-10-06T05:27:03.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.236+0000 7fdb2ab23700 1 -- start start 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.236+0000 7fdb2ab23700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdb240c6540 0x7fdb240c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.236+0000 7fdb2ab23700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb240ca1f0 0x7fdb240c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.236+0000 7fdb2ab23700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb240c2980 con 0x7fdb241605e0 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.236+0000 7fdb2ab23700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb240c69c0 con 0x7fdb240ca1f0 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.236+0000 7fdb2ab23700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb240ca630 con 0x7fdb240c6540 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2a322700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb240ca1f0 0x7fdb240c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2a322700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb240ca1f0 0x7fdb240c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49078/0 (socket says 172.21.15.29:49078) 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2a322700 1 -- 172.21.15.29:0/603336890 learned_addr learned my addr 172.21.15.29:0/603336890 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb29320700 1 --2- 172.21.15.29:0/603336890 >> v2:172.21.15.173:3300/0 conn(0x7fdb240c6540 0x7fdb240c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2a322700 1 -- 172.21.15.29:0/603336890 >> v2:172.21.15.173:3300/0 conn(0x7fdb240c6540 msgr2=0x7fdb240c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:03.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2a322700 1 --2- 172.21.15.29:0/603336890 >> v2:172.21.15.173:3300/0 conn(0x7fdb240c6540 0x7fdb240c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2a322700 1 -- 172.21.15.29:0/603336890 >> v1:172.21.15.173:6789/0 conn(0x7fdb241605e0 legacy=0x7fdb2406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:03.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2a322700 1 -- 172.21.15.29:0/603336890 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240c6bb0 con 0x7fdb240ca1f0 2023-10-06T05:27:03.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb29320700 1 --2- 172.21.15.29:0/603336890 >> v2:172.21.15.173:3300/0 conn(0x7fdb240c6540 0x7fdb240c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2a322700 1 --2- 172.21.15.29:0/603336890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 0x7fdb240c7c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb240c5980 tx=0x7fdb1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2372eac38d5a8eac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb28b1f700 1 -- 172.21.15.29:0/603336890 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c00e070 con 0x7fdb240ca1f0 2023-10-06T05:27:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb28b1f700 1 -- 172.21.15.29:0/603336890 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c00ba50 con 0x7fdb240ca1f0 2023-10-06T05:27:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb28b1f700 1 -- 172.21.15.29:0/603336890 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0092e0 con 0x7fdb240ca1f0 2023-10-06T05:27:03.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2ab23700 1 -- 172.21.15.29:0/603336890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 msgr2=0x7fdb240c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2ab23700 1 --2- 172.21.15.29:0/603336890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 0x7fdb240c7c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb240c5980 tx=0x7fdb1c009840 comp rx=0 tx=0).stop 2023-10-06T05:27:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2ab23700 1 -- 172.21.15.29:0/603336890 shutdown_connections 2023-10-06T05:27:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2ab23700 1 --2- 172.21.15.29:0/603336890 >> v2:172.21.15.173:3300/0 conn(0x7fdb240c6540 0x7fdb240c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2ab23700 1 --2- 172.21.15.29:0/603336890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 0x7fdb240c7c50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2ab23700 1 -- 172.21.15.29:0/603336890 >> 172.21.15.29:0/603336890 conn(0x7fdb240670a0 msgr2=0x7fdb240674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2ab23700 1 -- 172.21.15.29:0/603336890 shutdown_connections 2023-10-06T05:27:03.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.240+0000 7fdb2ab23700 1 -- 172.21.15.29:0/603336890 wait complete. 2023-10-06T05:27:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb2ab23700 1 Processor -- start 2023-10-06T05:27:03.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb2ab23700 1 -- start start 2023-10-06T05:27:03.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb2ab23700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb240c6540 0x7fdb24156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb2ab23700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 0x7fdb24141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb2ab23700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb241605e0 0x7fdb240c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb2ab23700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240c4fb0 con 0x7fdb240ca1f0 2023-10-06T05:27:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb2ab23700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240c43a0 con 0x7fdb240c6540 2023-10-06T05:27:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb2ab23700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240c4680 con 0x7fdb241605e0 2023-10-06T05:27:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb29320700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 0x7fdb24141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb29320700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 0x7fdb24141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49080/0 (socket says 172.21.15.29:49080) 2023-10-06T05:27:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb29320700 1 -- 172.21.15.29:0/1407479046 learned_addr learned my addr 172.21.15.29:0/1407479046 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.244+0000 7fdb29b21700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb240c6540 0x7fdb24156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb2a322700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb241605e0 0x7fdb240c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb29320700 1 -- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb241605e0 msgr2=0x7fdb240c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb29320700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb241605e0 0x7fdb240c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb29320700 1 -- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb240c6540 msgr2=0x7fdb24156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb29320700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb240c6540 0x7fdb24156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb29320700 1 -- 172.21.15.29:0/1407479046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c009ae0 con 0x7fdb240ca1f0 2023-10-06T05:27:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb29320700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 0x7fdb24141ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000e8d0 tx=0x7fdb20008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb19ffb700 1 -- 172.21.15.29:0/1407479046 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20013410 con 0x7fdb240ca1f0 2023-10-06T05:27:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb19ffb700 1 -- 172.21.15.29:0/1407479046 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb20013570 con 0x7fdb240ca1f0 2023-10-06T05:27:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb240c4960 con 0x7fdb240ca1f0 2023-10-06T05:27:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb19ffb700 1 -- 172.21.15.29:0/1407479046 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20013910 con 0x7fdb240ca1f0 2023-10-06T05:27:03.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb24156780 con 0x7fdb240ca1f0 2023-10-06T05:27:03.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.248+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb240c5120 con 0x7fdb240ca1f0 2023-10-06T05:27:03.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.252+0000 7fdb19ffb700 1 -- 172.21.15.29:0/1407479046 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdb20013d00 con 0x7fdb240ca1f0 2023-10-06T05:27:03.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.252+0000 7fdb19ffb700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb08060550 0x7fdb08062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.252+0000 7fdb19ffb700 1 -- 172.21.15.29:0/1407479046 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fdb2007c360 con 0x7fdb240ca1f0 2023-10-06T05:27:03.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.252+0000 7fdb29b21700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb08060550 0x7fdb08062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.252+0000 7fdb29b21700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb08060550 0x7fdb08062a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000c00 tx=0x7fdb14007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:03.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.260+0000 7fdb19ffb700 1 -- 172.21.15.29:0/1407479046 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdb2004caf0 con 0x7fdb240ca1f0 2023-10-06T05:27:03.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.456+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb2404be00 con 0x7fdb240ca1f0 2023-10-06T05:27:03.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.456+0000 7fdb19ffb700 1 -- 172.21.15.29:0/1407479046 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fdb20020de0 con 0x7fdb240ca1f0 2023-10-06T05:27:03.463 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:03.463 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3342279357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3342279357},{"type":"v1","addr":"172.21.15.173:6835","nonce":3342279357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2659141401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2659141401},{"type":"v1","addr":"172.21.15.173:6837","nonce":2659141401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/648720882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":648720882},{"type":"v1","addr":"172.21.15.29:6833","nonce":648720882}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3408345876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3408345876},{"type":"v1","addr":"172.21.15.29:6835","nonce":3408345876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[]} 2023-10-06T05:27:03.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb08060550 msgr2=0x7fdb08062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb08060550 0x7fdb08062a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000c00 tx=0x7fdb14007ea0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 msgr2=0x7fdb24141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 0x7fdb24141ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000e8d0 tx=0x7fdb20008040 comp rx=0 tx=0).stop 2023-10-06T05:27:03.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 shutdown_connections 2023-10-06T05:27:03.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb241605e0 0x7fdb240c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb240ca1f0 0x7fdb24141ad0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb08060550 0x7fdb08062a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 --2- 172.21.15.29:0/1407479046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb240c6540 0x7fdb24156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 >> 172.21.15.29:0/1407479046 conn(0x7fdb240670a0 msgr2=0x7fdb240c8870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 shutdown_connections 2023-10-06T05:27:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.460+0000 7fdb2ab23700 1 -- 172.21.15.29:0/1407479046 wait complete. 2023-10-06T05:27:03.466 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 15 2023-10-06T05:27:03.478 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T05:27:03.478 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T05:27:03.478 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T05:27:03.478 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:27:03.479 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T05:27:03.479 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T05:27:03.479 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T05:27:03.479 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:27:03.480 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T05:27:03.480 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T05:27:03.480 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T05:27:03.480 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:27:03.480 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T05:27:03.480 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T05:27:03.481 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T05:27:03.481 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:27:03.496 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T05:27:03.497 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T05:27:03.497 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T05:27:03.498 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T05:27:03.499 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T05:27:03.499 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T05:27:03.500 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T05:27:03.500 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T05:27:03.501 INFO:tasks.ceph.mds.d:Started 2023-10-06T05:27:03.501 DEBUG:teuthology.parallel:result is None 2023-10-06T05:27:03.502 INFO:tasks.ceph.mds.b:Started 2023-10-06T05:27:03.503 DEBUG:teuthology.parallel:result is None 2023-10-06T05:27:03.541 INFO:tasks.ceph.mds.a:Started 2023-10-06T05:27:03.541 DEBUG:teuthology.parallel:result is None 2023-10-06T05:27:03.542 INFO:tasks.ceph.mds.c:Started 2023-10-06T05:27:03.542 DEBUG:teuthology.parallel:result is None 2023-10-06T05:27:03.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T05:27:03.579 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-10-06T05:27:03.588 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-10-06T05:27:03.613 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-06T05:27:03.618 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:27:03.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74759e700 1 Processor -- start 2023-10-06T05:27:03.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74759e700 1 -- start start 2023-10-06T05:27:03.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd74806d110 0x7fd74806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd74806d4e0 0x7fd748157c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74815b730 con 0x7fd7480b1350 2023-10-06T05:27:03.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7481581b0 con 0x7fd74806d110 2023-10-06T05:27:03.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74815a840 con 0x7fd74806d4e0 2023-10-06T05:27:03.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd74806d110 0x7fd74806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd74806d110 0x7fd74806c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49122/0 (socket says 172.21.15.29:49122) 2023-10-06T05:27:03.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74659c700 1 -- 172.21.15.29:0/3660581801 learned_addr learned my addr 172.21.15.29:0/3660581801 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:03.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd745d9b700 1 --2- 172.21.15.29:0/3660581801 >> v2:172.21.15.173:3300/0 conn(0x7fd74806d4e0 0x7fd748157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74659c700 1 -- 172.21.15.29:0/3660581801 >> v2:172.21.15.173:3300/0 conn(0x7fd74806d4e0 msgr2=0x7fd748157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:03.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74659c700 1 --2- 172.21.15.29:0/3660581801 >> v2:172.21.15.173:3300/0 conn(0x7fd74806d4e0 0x7fd748157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74659c700 1 -- 172.21.15.29:0/3660581801 >> v1:172.21.15.173:6789/0 conn(0x7fd7480b1350 legacy=0x7fd7480b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74659c700 1 -- 172.21.15.29:0/3660581801 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74815ab20 con 0x7fd74806d110 2023-10-06T05:27:03.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74659c700 1 --2- 172.21.15.29:0/3660581801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74806d110 0x7fd74806c6c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd74806e730 tx=0x7fd73c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f440aaa1b2060582 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:03.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74559a700 1 -- 172.21.15.29:0/3660581801 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c009e70 con 0x7fd74806d110 2023-10-06T05:27:03.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74559a700 1 -- 172.21.15.29:0/3660581801 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c00b860 con 0x7fd74806d110 2023-10-06T05:27:03.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.648+0000 7fd74559a700 1 -- 172.21.15.29:0/3660581801 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c00bc00 con 0x7fd74806d110 2023-10-06T05:27:03.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 -- 172.21.15.29:0/3660581801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74806d110 msgr2=0x7fd74806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 --2- 172.21.15.29:0/3660581801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74806d110 0x7fd74806c6c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd74806e730 tx=0x7fd73c009250 comp rx=0 tx=0).stop 2023-10-06T05:27:03.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 -- 172.21.15.29:0/3660581801 shutdown_connections 2023-10-06T05:27:03.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 --2- 172.21.15.29:0/3660581801 >> v2:172.21.15.173:3300/0 conn(0x7fd74806d4e0 0x7fd748157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 --2- 172.21.15.29:0/3660581801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74806d110 0x7fd74806c6c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 -- 172.21.15.29:0/3660581801 >> 172.21.15.29:0/3660581801 conn(0x7fd74806abc0 msgr2=0x7fd7480adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:03.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 -- 172.21.15.29:0/3660581801 shutdown_connections 2023-10-06T05:27:03.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 -- 172.21.15.29:0/3660581801 wait complete. 2023-10-06T05:27:03.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 Processor -- start 2023-10-06T05:27:03.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 -- start start 2023-10-06T05:27:03.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd74806d4e0 0x7fd748145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7480b1350 0x7fd74814c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814c9f0 0x7fd74814e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74816a840 con 0x7fd7480b1350 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74816b0e0 con 0x7fd74806d4e0 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74814ceb0 con 0x7fd74814c9f0 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd745d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7480b1350 0x7fd74814c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd745d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7480b1350 0x7fd74814c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49138/0 (socket says 172.21.15.29:49138) 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd745d9b700 1 -- 172.21.15.29:0/3884032516 learned_addr learned my addr 172.21.15.29:0/3884032516 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd746d9d700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814c9f0 0x7fd74814e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.652+0000 7fd74659c700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd74806d4e0 0x7fd748145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd745d9b700 1 -- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814c9f0 msgr2=0x7fd74814e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd745d9b700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814c9f0 0x7fd74814e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd745d9b700 1 -- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd74806d4e0 msgr2=0x7fd748145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:03.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd745d9b700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd74806d4e0 0x7fd748145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:03.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd745d9b700 1 -- 172.21.15.29:0/3884032516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c0094f0 con 0x7fd7480b1350 2023-10-06T05:27:03.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd745d9b700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7480b1350 0x7fd74814c4b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd738009f20 tx=0x7fd73800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:03.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd7367fc700 1 -- 172.21.15.29:0/3884032516 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73800cb70 con 0x7fd7480b1350 2023-10-06T05:27:03.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd7367fc700 1 -- 172.21.15.29:0/3884032516 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73800f040 con 0x7fd7480b1350 2023-10-06T05:27:03.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74816aa90 con 0x7fd7480b1350 2023-10-06T05:27:03.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd7367fc700 1 -- 172.21.15.29:0/3884032516 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738014480 con 0x7fd7480b1350 2023-10-06T05:27:03.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd748146400 con 0x7fd7480b1350 2023-10-06T05:27:03.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74816af10 con 0x7fd7480b1350 2023-10-06T05:27:03.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd7367fc700 1 -- 172.21.15.29:0/3884032516 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd7380147f0 con 0x7fd7480b1350 2023-10-06T05:27:03.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd7367fc700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd728060550 0x7fd728062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:03.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd7367fc700 1 -- 172.21.15.29:0/3884032516 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd73807cf50 con 0x7fd7480b1350 2023-10-06T05:27:03.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.656+0000 7fd74659c700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd728060550 0x7fd728062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:03.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.660+0000 7fd74659c700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd728060550 0x7fd728062a00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd74806e730 tx=0x7fd73c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:03.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.664+0000 7fd7367fc700 1 -- 172.21.15.29:0/3884032516 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd73804d6e0 con 0x7fd7480b1350 2023-10-06T05:27:03.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:03.844+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd74804be00 con 0x7fd7480b1350 2023-10-06T05:27:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.756+0000 7fd7367fc700 1 -- 172.21.15.29:0/3884032516 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd738050d00 con 0x7fd7480b1350 2023-10-06T05:27:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd728060550 msgr2=0x7fd728062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd728060550 0x7fd728062a00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd74806e730 tx=0x7fd73c017000 comp rx=0 tx=0).stop 2023-10-06T05:27:04.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7480b1350 msgr2=0x7fd74814c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7480b1350 0x7fd74814c4b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd738009f20 tx=0x7fd73800b040 comp rx=0 tx=0).stop 2023-10-06T05:27:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 shutdown_connections 2023-10-06T05:27:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd74814c9f0 0x7fd74814e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7480b1350 0x7fd74814c4b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd728060550 0x7fd728062a00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 --2- 172.21.15.29:0/3884032516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd74806d4e0 0x7fd748145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 >> 172.21.15.29:0/3884032516 conn(0x7fd74806abc0 msgr2=0x7fd7480ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 shutdown_connections 2023-10-06T05:27:04.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.760+0000 7fd74759e700 1 -- 172.21.15.29:0/3884032516 wait complete. 2023-10-06T05:27:04.766 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2023-10-06T05:27:04.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T05:27:04.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64896a700 1 Processor -- start 2023-10-06T05:27:04.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64896a700 1 -- start start 2023-10-06T05:27:04.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64896a700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6440af5c0 0x7fb6440af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:04.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64896a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 0x7fb64415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:04.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64896a700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6441614c0 con 0x7fb644161950 2023-10-06T05:27:04.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64896a700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb644160f40 con 0x7fb6440af5c0 2023-10-06T05:27:04.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64896a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64406d420 con 0x7fb64415cd80 2023-10-06T05:27:04.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64259c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6440af5c0 0x7fb6440af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:04.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb642d9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 0x7fb64415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:04.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64259c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb6440af5c0 0x7fb6440af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:35738/0 (socket says 172.21.15.29:35738) 2023-10-06T05:27:04.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64259c700 1 -- 172.21.15.29:0/2395967628 learned_addr learned my addr 172.21.15.29:0/2395967628 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:04.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb641d9b700 1 --1- 172.21.15.29:0/2395967628 >> v1:172.21.15.173:6789/0 conn(0x7fb644161950 0x7fb64406a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:59180/0 (socket says 172.21.15.29:59180) 2023-10-06T05:27:04.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64259c700 1 -- 172.21.15.29:0/2395967628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 msgr2=0x7fb64415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:04.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64259c700 1 --2- 172.21.15.29:0/2395967628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 0x7fb64415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:04.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64259c700 1 -- 172.21.15.29:0/2395967628 >> v1:172.21.15.173:6789/0 conn(0x7fb644161950 legacy=0x7fb64406a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:04.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64259c700 1 -- 172.21.15.29:0/2395967628 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64406af20 con 0x7fb6440af5c0 2023-10-06T05:27:04.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64259c700 1 --2- 172.21.15.29:0/2395967628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6440af5c0 0x7fb6440af990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0099b0 tx=0x7fb62c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44156aa623c5126b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:04.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64159a700 1 -- 172.21.15.29:0/2395967628 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c009ea0 con 0x7fb6440af5c0 2023-10-06T05:27:04.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.892+0000 7fb64159a700 1 -- 172.21.15.29:0/2395967628 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c00b860 con 0x7fb6440af5c0 2023-10-06T05:27:04.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64159a700 1 -- 172.21.15.29:0/2395967628 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00bc00 con 0x7fb6440af5c0 2023-10-06T05:27:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 -- 172.21.15.29:0/2395967628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6440af5c0 msgr2=0x7fb6440af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 --2- 172.21.15.29:0/2395967628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6440af5c0 0x7fb6440af990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0099b0 tx=0x7fb62c009250 comp rx=0 tx=0).stop 2023-10-06T05:27:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 -- 172.21.15.29:0/2395967628 shutdown_connections 2023-10-06T05:27:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 --2- 172.21.15.29:0/2395967628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 0x7fb64415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 --2- 172.21.15.29:0/2395967628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6440af5c0 0x7fb6440af990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 -- 172.21.15.29:0/2395967628 >> 172.21.15.29:0/2395967628 conn(0x7fb644067b70 msgr2=0x7fb64406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 -- 172.21.15.29:0/2395967628 shutdown_connections 2023-10-06T05:27:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 -- 172.21.15.29:0/2395967628 wait complete. 2023-10-06T05:27:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 Processor -- start 2023-10-06T05:27:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 -- start start 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6440af5c0 0x7fb644158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 0x7fb64415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.896+0000 7fb64896a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb644161950 0x7fb64415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64896a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440a5630 con 0x7fb6440af5c0 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64896a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440a5910 con 0x7fb644161950 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64896a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440a5bf0 con 0x7fb64415cd80 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6440af5c0 0x7fb644158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6440af5c0 0x7fb644158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35724/0 (socket says 172.21.15.29:35724) 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64259c700 1 -- 172.21.15.29:0/2699373103 learned_addr learned my addr 172.21.15.29:0/2699373103 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb641d9b700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 0x7fb64415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb642d9d700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb644161950 0x7fb64415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:04.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64259c700 1 -- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 msgr2=0x7fb64415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:04.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64259c700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 0x7fb64415bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:04.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64259c700 1 -- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb644161950 msgr2=0x7fb64415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:04.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64259c700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb644161950 0x7fb64415c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:04.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64259c700 1 -- 172.21.15.29:0/2699373103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0094f0 con 0x7fb6440af5c0 2023-10-06T05:27:04.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64259c700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6440af5c0 0x7fb644158eb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb6440696f0 tx=0x7fb62c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:04.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb63a7fc700 1 -- 172.21.15.29:0/2699373103 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c000d10 con 0x7fb6440af5c0 2023-10-06T05:27:04.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb63a7fc700 1 -- 172.21.15.29:0/2699373103 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c00bbe0 con 0x7fb6440af5c0 2023-10-06T05:27:04.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb63a7fc700 1 -- 172.21.15.29:0/2699373103 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c011670 con 0x7fb6440af5c0 2023-10-06T05:27:04.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6440a5ed0 con 0x7fb6440af5c0 2023-10-06T05:27:04.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6441593f0 con 0x7fb6440af5c0 2023-10-06T05:27:04.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.900+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6440a6110 con 0x7fb6440af5c0 2023-10-06T05:27:04.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.904+0000 7fb63a7fc700 1 -- 172.21.15.29:0/2699373103 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb62c011aa0 con 0x7fb6440af5c0 2023-10-06T05:27:04.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.904+0000 7fb63a7fc700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb624060550 0x7fb624062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:04.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.904+0000 7fb63a7fc700 1 -- 172.21.15.29:0/2699373103 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb62c07de50 con 0x7fb6440af5c0 2023-10-06T05:27:04.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.904+0000 7fb641d9b700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb624060550 0x7fb624062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:04.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.904+0000 7fb641d9b700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb624060550 0x7fb624062a00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb64416b810 tx=0x7fb634001a30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:04.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:04.912+0000 7fb63a7fc700 1 -- 172.21.15.29:0/2699373103 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb6440a6110 con 0x7fb6440af5c0 2023-10-06T05:27:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb6440a5770 con 0x7fb6440af5c0 2023-10-06T05:27:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb63a7fc700 1 -- 172.21.15.29:0/2699373103 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb6440a5770 con 0x7fb6440af5c0 2023-10-06T05:27:05.133 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:05.133 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:27:05.133 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2023-10-06T05:27:05.133 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.133 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2023-10-06T05:27:05.133 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lmmo6OBAAQpP+gZa78MNtTT1c5tK+vw==", 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lOCLABhAA38TEJqLAC+ccT54rGKcRHQ==", 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.134 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lLN0yABAAa4pRtt5i1VwRUls37iQ6Ng==", 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:27:05.135 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9l/IkZChAAA0KqF/fQdw+Lvfgt3G7D1Q==", 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9liLI7OhAA2q9u7NoYTihYVqDD6feWqg==", 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAdmh9lVgGUABAAT+KgCiblIExCBVOWaW1KTQ==", 2023-10-06T05:27:05.137 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAgmh9lTun5BhAAhxhwULNJol5kiIMd6cr4EQ==", 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:27:05.138 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAjmh9lJRz4DBAAPs7JW7cj58uGIh0CXjTPOA==", 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.139 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAomh9lF4v2MRAA6d30MwZe8jaJE2/KZ2v2fg==", 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAsmh9lLsIbCRAAW0z6kOmd/cRdSMyGXB43cA==", 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:27:05.140 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAvmh9lBdCTDhAACXtGHMjlSZ4mDObzP73SCw==", 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.141 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAymh9lpfyEExAAKfZ7994WtblLHuzw9X2CjA==", 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9l/dfwDBAAyd4qv0io8GSbP8ukYr6WaQ==", 2023-10-06T05:27:05.142 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow r", 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lhSm7EhAA//AImYYn3pBpCmwsOv9X8g==", 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:27:05.143 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.2", 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lLAPFDxAA0M9C3WbeOYjQvGGIqPRrSw==", 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.144 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.3", 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lYEpMFRAAgFoS4+VPWcjT0TgyNTDFFA==", 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2023-10-06T05:27:05.145 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lrcA0KxAAl4GK+rF0VWq9nkzu1RXN1A==", 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9l0ABYNRAAjZ6Ji5Q1o0HKn3oDYZaZ+w==", 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:27:05.146 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lCDNrMhAA/2ymYL+jXTRPLjyoHbWzPg==", 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-06T05:27:05.148 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb624060550 msgr2=0x7fb624062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb624060550 0x7fb624062a00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb64416b810 tx=0x7fb634001a30 comp rx=0 tx=0).stop 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6440af5c0 msgr2=0x7fb644158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6440af5c0 0x7fb644158eb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb6440696f0 tx=0x7fb62c017000 comp rx=0 tx=0).stop 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 shutdown_connections 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb624060550 0x7fb624062a00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb644161950 0x7fb64415c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb64415cd80 0x7fb64415bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 --2- 172.21.15.29:0/2699373103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6440af5c0 0x7fb644158eb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 >> 172.21.15.29:0/2699373103 conn(0x7fb644067b70 msgr2=0x7fb64415d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:05.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 shutdown_connections 2023-10-06T05:27:05.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.128+0000 7fb64896a700 1 -- 172.21.15.29:0/2699373103 wait complete. 2023-10-06T05:27:05.154 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:27:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90bfff700 1 Processor -- start 2023-10-06T05:27:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90bfff700 1 -- start start 2023-10-06T05:27:05.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90bfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa90c158bd0 0x7fa90c158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa90c06b720 0x7fa90c0c9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90bfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c0c7090 con 0x7fa90c06b2a0 2023-10-06T05:27:05.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c06bc80 con 0x7fa90c06b720 2023-10-06T05:27:05.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90bfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c06bf60 con 0x7fa90c158bd0 2023-10-06T05:27:05.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa90c06b720 0x7fa90c0c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa90c06b720 0x7fa90c0c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35738/0 (socket says 172.21.15.29:35738) 2023-10-06T05:27:05.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.256+0000 7fa90b7fe700 1 -- 172.21.15.29:0/2272624929 learned_addr learned my addr 172.21.15.29:0/2272624929 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:05.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90affd700 1 --2- 172.21.15.29:0/2272624929 >> v2:172.21.15.173:3300/0 conn(0x7fa90c158bd0 0x7fa90c158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90b7fe700 1 -- 172.21.15.29:0/2272624929 >> v2:172.21.15.173:3300/0 conn(0x7fa90c158bd0 msgr2=0x7fa90c158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:05.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90b7fe700 1 --2- 172.21.15.29:0/2272624929 >> v2:172.21.15.173:3300/0 conn(0x7fa90c158bd0 0x7fa90c158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90b7fe700 1 -- 172.21.15.29:0/2272624929 >> v1:172.21.15.173:6789/0 conn(0x7fa90c06b2a0 legacy=0x7fa90c0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90b7fe700 1 -- 172.21.15.29:0/2272624929 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0c7300 con 0x7fa90c06b720 2023-10-06T05:27:05.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90b7fe700 1 --2- 172.21.15.29:0/2272624929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 0x7fa90c0c9220 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa90c06b1a0 tx=0x7fa904009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947014d5c311ebaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa909ffb700 1 -- 172.21.15.29:0/2272624929 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400e070 con 0x7fa90c06b720 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa909ffb700 1 -- 172.21.15.29:0/2272624929 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90400ba50 con 0x7fa90c06b720 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa909ffb700 1 -- 172.21.15.29:0/2272624929 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9040092e0 con 0x7fa90c06b720 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90bfff700 1 -- 172.21.15.29:0/2272624929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 msgr2=0x7fa90c0c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90bfff700 1 --2- 172.21.15.29:0/2272624929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 0x7fa90c0c9220 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa90c06b1a0 tx=0x7fa904009840 comp rx=0 tx=0).stop 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90bfff700 1 -- 172.21.15.29:0/2272624929 shutdown_connections 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90bfff700 1 --2- 172.21.15.29:0/2272624929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 0x7fa90c0c9220 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90bfff700 1 --2- 172.21.15.29:0/2272624929 >> v2:172.21.15.173:3300/0 conn(0x7fa90c158bd0 0x7fa90c158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90bfff700 1 -- 172.21.15.29:0/2272624929 >> 172.21.15.29:0/2272624929 conn(0x7fa90c06d7d0 msgr2=0x7fa90c06dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90bfff700 1 -- 172.21.15.29:0/2272624929 shutdown_connections 2023-10-06T05:27:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.260+0000 7fa90bfff700 1 -- 172.21.15.29:0/2272624929 wait complete. 2023-10-06T05:27:05.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 Processor -- start 2023-10-06T05:27:05.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 -- start start 2023-10-06T05:27:05.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa90c06b2a0 0x7fa90c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 0x7fa90c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa90c158bd0 0x7fa90c15bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0b1d70 con 0x7fa90c06b720 2023-10-06T05:27:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0b0ec0 con 0x7fa90c06b2a0 2023-10-06T05:27:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0b1160 con 0x7fa90c158bd0 2023-10-06T05:27:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 0x7fa90c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90b7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa90c158bd0 0x7fa90c15bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 0x7fa90c0b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35752/0 (socket says 172.21.15.29:35752) 2023-10-06T05:27:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90a7fc700 1 -- 172.21.15.29:0/3800369267 learned_addr learned my addr 172.21.15.29:0/3800369267 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90affd700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa90c06b2a0 0x7fa90c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90a7fc700 1 -- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa90c158bd0 msgr2=0x7fa90c15bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90a7fc700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa90c158bd0 0x7fa90c15bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90a7fc700 1 -- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa90c06b2a0 msgr2=0x7fa90c146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90a7fc700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa90c06b2a0 0x7fa90c146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90a7fc700 1 -- 172.21.15.29:0/3800369267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904009ae0 con 0x7fa90c06b720 2023-10-06T05:27:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90b7fe700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa90c158bd0 0x7fa90c15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90a7fc700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 0x7fa90c0b2200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400c4e0 tx=0x7fa8f400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa902ffd700 1 -- 172.21.15.29:0/3800369267 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4011590 con 0x7fa90c06b720 2023-10-06T05:27:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa902ffd700 1 -- 172.21.15.29:0/3800369267 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4011710 con 0x7fa90c06b720 2023-10-06T05:27:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c0b1440 con 0x7fa90c06b720 2023-10-06T05:27:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa902ffd700 1 -- 172.21.15.29:0/3800369267 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4011ad0 con 0x7fa90c06b720 2023-10-06T05:27:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.264+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c0b1a00 con 0x7fa90c06b720 2023-10-06T05:27:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.268+0000 7fa902ffd700 1 -- 172.21.15.29:0/3800369267 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa8f401b3b0 con 0x7fa90c06b720 2023-10-06T05:27:05.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.268+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c0b1ee0 con 0x7fa90c06b720 2023-10-06T05:27:05.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.268+0000 7fa902ffd700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa8ec060580 0x7fa8ec062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.268+0000 7fa902ffd700 1 -- 172.21.15.29:0/3800369267 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa8f407b940 con 0x7fa90c06b720 2023-10-06T05:27:05.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.268+0000 7fa90affd700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa8ec060580 0x7fa8ec062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.272+0000 7fa90affd700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa8ec060580 0x7fa8ec062a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc006fd0 tx=0x7fa8fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:05.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.276+0000 7fa902ffd700 1 -- 172.21.15.29:0/3800369267 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa8f404c120 con 0x7fa90c06b720 2023-10-06T05:27:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.432+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa90c04be00 con 0x7fa90c06b720 2023-10-06T05:27:05.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.436+0000 7fa902ffd700 1 -- 172.21.15.29:0/3800369267 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13650 (secure 0 0 0) 0x7fa8f404f740 con 0x7fa90c06b720 2023-10-06T05:27:05.441 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:05.441 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":44,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:27:04.751750+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:27:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.436+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa8ec060580 msgr2=0x7fa8ec062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.436+0000 7fa90bfff700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa8ec060580 0x7fa8ec062a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc006fd0 tx=0x7fa8fc008040 comp rx=0 tx=0).stop 2023-10-06T05:27:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.436+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 msgr2=0x7fa90c0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.436+0000 7fa90bfff700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 0x7fa90c0b2200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400c4e0 tx=0x7fa8f400c7f0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.440+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 shutdown_connections 2023-10-06T05:27:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.440+0000 7fa90bfff700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa90c158bd0 0x7fa90c15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.440+0000 7fa90bfff700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90c06b720 0x7fa90c0b2200 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.440+0000 7fa90bfff700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa8ec060580 0x7fa8ec062a30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.440+0000 7fa90bfff700 1 --2- 172.21.15.29:0/3800369267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa90c06b2a0 0x7fa90c146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.440+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 >> 172.21.15.29:0/3800369267 conn(0x7fa90c06d7d0 msgr2=0x7fa90c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.440+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 shutdown_connections 2023-10-06T05:27:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.440+0000 7fa90bfff700 1 -- 172.21.15.29:0/3800369267 wait complete. 2023-10-06T05:27:05.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T05:27:05.456 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:27:05.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.568+0000 7fdbd7fff700 1 Processor -- start 2023-10-06T05:27:05.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.568+0000 7fdbd7fff700 1 -- start start 2023-10-06T05:27:05.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80b0110 0x7fdbd80c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd80c9120 con 0x7fdbd80c3950 2023-10-06T05:27:05.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd80c9f60 con 0x7fdbd80c8cd0 2023-10-06T05:27:05.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80c9350 con 0x7fdbd80b0110 2023-10-06T05:27:05.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd77fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdbd80c3950 0x7fdbd80670a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39510/0 (socket says 172.21.15.29:39510) 2023-10-06T05:27:05.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd77fe700 1 -- 172.21.15.29:0/985693687 learned_addr learned my addr 172.21.15.29:0/985693687 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd6ffd700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80b0110 0x7fdbd80c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627678224 0 0) 0x7fdbd80c9120 con 0x7fdbd80c3950 2023-10-06T05:27:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb8003570 con 0x7fdbd80c3950 2023-10-06T05:27:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631985099 0 0) 0x7fdbd80c9f60 con 0x7fdbd80c8cd0 2023-10-06T05:27:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd80c9120 con 0x7fdbd80c8cd0 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1665075430 0 0) 0x7fdbb8003570 con 0x7fdbd80c3950 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80b0110 msgr2=0x7fdbd80c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80b0110 0x7fdbd80c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 >> v1:172.21.15.173:6789/0 conn(0x7fdbd80c8cd0 legacy=0x7fdbd80c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80c9630 con 0x7fdbd80c3950 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fdbd00017f0 con 0x7fdbd80c3950 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 >> v1:172.21.15.29:6789/0 conn(0x7fdbd80c3950 legacy=0x7fdbd80670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80b0110 0x7fdbb8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbb80041d0 0x7fdbb8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbb8004d50 0x7fdbb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80c9350 con 0x7fdbb80041d0 2023-10-06T05:27:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb800bbf0 con 0x7fdbb8004d50 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb800bdb0 con 0x7fdbd80b0110 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbce7fc700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbb80041d0 0x7fdbb8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd6ffd700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80b0110 0x7fdbb8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd77fe700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbb8004d50 0x7fdbb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbce7fc700 1 -- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80b0110 msgr2=0x7fdbb8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbce7fc700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80b0110 0x7fdbb8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbce7fc700 1 -- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbb8004d50 msgr2=0x7fdbb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbce7fc700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbb8004d50 0x7fdbb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbce7fc700 1 -- 172.21.15.29:0/985693687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8003570 con 0x7fdbb80041d0 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbce7fc700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbb80041d0 0x7fdbb8004810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0001a10 tx=0x7fdbc0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9975416b5c93146 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000c5d0 con 0x7fdbb80041d0 2023-10-06T05:27:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000c730 con 0x7fdbb80041d0 2023-10-06T05:27:05.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd67fc700 1 -- 172.21.15.29:0/985693687 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000cad0 con 0x7fdbb80041d0 2023-10-06T05:27:05.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 -- 172.21.15.29:0/985693687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbb80041d0 msgr2=0x7fdbb8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 --2- 172.21.15.29:0/985693687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbb80041d0 0x7fdbb8004810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0001a10 tx=0x7fdbc0007d30 comp rx=0 tx=0).stop 2023-10-06T05:27:05.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd77fe700 1 -- 172.21.15.29:0/985693687 reap_dead start 2023-10-06T05:27:05.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 -- 172.21.15.29:0/985693687 shutdown_connections 2023-10-06T05:27:05.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 -- 172.21.15.29:0/985693687 >> 172.21.15.29:0/985693687 conn(0x7fdbd8069d50 msgr2=0x7fdbd806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:05.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 -- 172.21.15.29:0/985693687 shutdown_connections 2023-10-06T05:27:05.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.572+0000 7fdbd7fff700 1 -- 172.21.15.29:0/985693687 wait complete. 2023-10-06T05:27:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 Processor -- start 2023-10-06T05:27:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 -- start start 2023-10-06T05:27:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbb80041d0 0x7fdbd81578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80c55f0 0x7fdbd80b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd80b3490 0x7fdbd8159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd8156530 con 0x7fdbd80b3490 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd8156810 con 0x7fdbb80041d0 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd8156af0 con 0x7fdbd80c55f0 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd80b3490 0x7fdbd8159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd80b3490 0x7fdbd8159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35772/0 (socket says 172.21.15.29:35772) 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd77fe700 1 -- 172.21.15.29:0/2641261105 learned_addr learned my addr 172.21.15.29:0/2641261105 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd6ffd700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbb80041d0 0x7fdbd81578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbce7fc700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80c55f0 0x7fdbd80b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd77fe700 1 -- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80c55f0 msgr2=0x7fdbd80b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd77fe700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80c55f0 0x7fdbd80b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd77fe700 1 -- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbb80041d0 msgr2=0x7fdbd81578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd77fe700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbb80041d0 0x7fdbd81578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd77fe700 1 -- 172.21.15.29:0/2641261105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8156dd0 con 0x7fdbd80b3490 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd77fe700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd80b3490 0x7fdbd8159590 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdbd806c3c0 tx=0x7fdbd00013b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbcf7fe700 1 -- 172.21.15.29:0/2641261105 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000e960 con 0x7fdbd80b3490 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbcf7fe700 1 -- 172.21.15.29:0/2641261105 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd000eac0 con 0x7fdbd80b3490 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd81570b0 con 0x7fdbd80b3490 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbcf7fe700 1 -- 172.21.15.29:0/2641261105 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000ee80 con 0x7fdbd80b3490 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.576+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd8157df0 con 0x7fdbd80b3490 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.580+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd80c4450 con 0x7fdbd80b3490 2023-10-06T05:27:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.580+0000 7fdbcf7fe700 1 -- 172.21.15.29:0/2641261105 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdbd0013630 con 0x7fdbd80b3490 2023-10-06T05:27:05.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.580+0000 7fdbcf7fe700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdbbc060550 0x7fdbbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.580+0000 7fdbcf7fe700 1 -- 172.21.15.29:0/2641261105 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdbd007ca90 con 0x7fdbd80b3490 2023-10-06T05:27:05.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.580+0000 7fdbd6ffd700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdbbc060550 0x7fdbbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.580+0000 7fdbd6ffd700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdbbc060550 0x7fdbbc062a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009e00 tx=0x7fdbc8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:05.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.588+0000 7fdbcf7fe700 1 -- 172.21.15.29:0/2641261105 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdbd80c4450 con 0x7fdbd80b3490 2023-10-06T05:27:05.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.748+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdbd80c4450 con 0x7fdbd80b3490 2023-10-06T05:27:05.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.748+0000 7fdbcf7fe700 1 -- 172.21.15.29:0/2641261105 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdbd80c4450 con 0x7fdbd80b3490 2023-10-06T05:27:05.754 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:27:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdbbc060550 msgr2=0x7fdbbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdbbc060550 0x7fdbbc062a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009e00 tx=0x7fdbc8008040 comp rx=0 tx=0).stop 2023-10-06T05:27:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd80b3490 msgr2=0x7fdbd8159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd80b3490 0x7fdbd8159590 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdbd806c3c0 tx=0x7fdbd00013b0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 shutdown_connections 2023-10-06T05:27:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbd80b3490 0x7fdbd8159590 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbd80c55f0 0x7fdbd80b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdbbc060550 0x7fdbbc062a00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 --2- 172.21.15.29:0/2641261105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbb80041d0 0x7fdbd81578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 >> 172.21.15.29:0/2641261105 conn(0x7fdbd8069d50 msgr2=0x7fdbd80cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 shutdown_connections 2023-10-06T05:27:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.752+0000 7fdbd7fff700 1 -- 172.21.15.29:0/2641261105 wait complete. 2023-10-06T05:27:05.776 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:27:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.884+0000 7f92da039700 1 Processor -- start 2023-10-06T05:27:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.884+0000 7f92da039700 1 -- start start 2023-10-06T05:27:05.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.884+0000 7f92da039700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 0x7f92d415b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.884+0000 7f92da039700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f92d406a370 0x7f92d40c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.884+0000 7f92da039700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92d4156c40 0x7f92d40c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.884+0000 7f92da039700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d406b540 con 0x7f92d4156c40 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.884+0000 7f92da039700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d415b650 con 0x7f92d406a370 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.884+0000 7f92da039700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d406a930 con 0x7f92d4156870 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.884+0000 7f92d9838700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92d4156c40 0x7f92d40c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d9838700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92d4156c40 0x7f92d40c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35780/0 (socket says 172.21.15.29:35780) 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d9838700 1 -- 172.21.15.29:0/2080534292 learned_addr learned my addr 172.21.15.29:0/2080534292 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d8836700 1 --2- 172.21.15.29:0/2080534292 >> v2:172.21.15.173:3300/0 conn(0x7f92d406a370 0x7f92d40c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d9037700 1 --2- 172.21.15.29:0/2080534292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 0x7f92d415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d9838700 1 -- 172.21.15.29:0/2080534292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 msgr2=0x7f92d415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d9838700 1 --2- 172.21.15.29:0/2080534292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 0x7f92d415b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d9838700 1 -- 172.21.15.29:0/2080534292 >> v2:172.21.15.173:3300/0 conn(0x7f92d406a370 msgr2=0x7f92d40c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d9838700 1 --2- 172.21.15.29:0/2080534292 >> v2:172.21.15.173:3300/0 conn(0x7f92d406a370 0x7f92d40c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d9838700 1 -- 172.21.15.29:0/2080534292 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d406ac10 con 0x7f92d4156c40 2023-10-06T05:27:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92d9838700 1 --2- 172.21.15.29:0/2080534292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d4156c40 0x7f92d40c8920 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f92d4069d80 tx=0x7f92cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af0174a0552ecdb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92cbfff700 1 -- 172.21.15.29:0/2080534292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00e070 con 0x7f92d4156c40 2023-10-06T05:27:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92cbfff700 1 -- 172.21.15.29:0/2080534292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc00b970 con 0x7f92d4156c40 2023-10-06T05:27:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92cbfff700 1 -- 172.21.15.29:0/2080534292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0092e0 con 0x7f92d4156c40 2023-10-06T05:27:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92da039700 1 -- 172.21.15.29:0/2080534292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d4156c40 msgr2=0x7f92d40c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92da039700 1 --2- 172.21.15.29:0/2080534292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d4156c40 0x7f92d40c8920 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f92d4069d80 tx=0x7f92cc009840 comp rx=0 tx=0).stop 2023-10-06T05:27:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92da039700 1 -- 172.21.15.29:0/2080534292 shutdown_connections 2023-10-06T05:27:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92da039700 1 --2- 172.21.15.29:0/2080534292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d4156c40 0x7f92d40c8920 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92da039700 1 --2- 172.21.15.29:0/2080534292 >> v2:172.21.15.173:3300/0 conn(0x7f92d406a370 0x7f92d40c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92da039700 1 --2- 172.21.15.29:0/2080534292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 0x7f92d415b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92da039700 1 -- 172.21.15.29:0/2080534292 >> 172.21.15.29:0/2080534292 conn(0x7f92d406c6c0 msgr2=0x7f92d406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92da039700 1 -- 172.21.15.29:0/2080534292 shutdown_connections 2023-10-06T05:27:05.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.888+0000 7f92da039700 1 -- 172.21.15.29:0/2080534292 wait complete. 2023-10-06T05:27:05.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 Processor -- start 2023-10-06T05:27:05.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 -- start start 2023-10-06T05:27:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d406a370 0x7f92d414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 0x7f92d4150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d4156c40 0x7f92d4150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d414d260 con 0x7f92d406a370 2023-10-06T05:27:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d414d530 con 0x7f92d4156c40 2023-10-06T05:27:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d414d810 con 0x7f92d4156870 2023-10-06T05:27:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9037700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d406a370 0x7f92d414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9037700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d406a370 0x7f92d414cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35786/0 (socket says 172.21.15.29:35786) 2023-10-06T05:27:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9838700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d4156c40 0x7f92d4150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9037700 1 -- 172.21.15.29:0/3673046399 learned_addr learned my addr 172.21.15.29:0/3673046399 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:05.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d8836700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 0x7f92d4150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9037700 1 -- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 msgr2=0x7f92d4150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9037700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 0x7f92d4150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9037700 1 -- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d4156c40 msgr2=0x7f92d4150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9037700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d4156c40 0x7f92d4150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9037700 1 -- 172.21.15.29:0/3673046399 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc009ae0 con 0x7f92d406a370 2023-10-06T05:27:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9838700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d4156c40 0x7f92d4150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92d9037700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d406a370 0x7f92d414cd20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f92d000ec80 tx=0x7f92d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:05.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92c97fa700 1 -- 172.21.15.29:0/3673046399 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d000c850 con 0x7f92d406a370 2023-10-06T05:27:05.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92c97fa700 1 -- 172.21.15.29:0/3673046399 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d000c9b0 con 0x7f92d406a370 2023-10-06T05:27:05.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d414daf0 con 0x7f92d406a370 2023-10-06T05:27:05.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92c97fa700 1 -- 172.21.15.29:0/3673046399 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d000cd50 con 0x7f92d406a370 2023-10-06T05:27:05.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.892+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d40aeae0 con 0x7f92d406a370 2023-10-06T05:27:05.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.896+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d404be00 con 0x7f92d406a370 2023-10-06T05:27:05.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.896+0000 7f92c97fa700 1 -- 172.21.15.29:0/3673046399 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f92d0013680 con 0x7f92d406a370 2023-10-06T05:27:05.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.896+0000 7f92c97fa700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f92b8060620 0x7f92b8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:05.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.896+0000 7f92c97fa700 1 -- 172.21.15.29:0/3673046399 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f92d007c820 con 0x7f92d406a370 2023-10-06T05:27:05.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.896+0000 7f92d8836700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f92b8060620 0x7f92b8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:05.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.900+0000 7f92d8836700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f92b8060620 0x7f92b8062ad0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f92d414de00 tx=0x7f92c40091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:05.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:05.904+0000 7f92c97fa700 1 -- 172.21.15.29:0/3673046399 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f92d004cfe0 con 0x7f92d406a370 2023-10-06T05:27:06.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.064+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92d406aef0 con 0x7f92d406a370 2023-10-06T05:27:06.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.064+0000 7f92c97fa700 1 -- 172.21.15.29:0/3673046399 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92d0050600 con 0x7f92d406a370 2023-10-06T05:27:06.070 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:27:06.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f92b8060620 msgr2=0x7f92b8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f92b8060620 0x7f92b8062ad0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f92d414de00 tx=0x7f92c40091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d406a370 msgr2=0x7f92d414cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d406a370 0x7f92d414cd20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f92d000ec80 tx=0x7f92d00091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 shutdown_connections 2023-10-06T05:27:06.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f92b8060620 0x7f92b8062ad0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d4156c40 0x7f92d4150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92d4156870 0x7f92d4150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 --2- 172.21.15.29:0/3673046399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92d406a370 0x7f92d414cd20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 >> 172.21.15.29:0/3673046399 conn(0x7f92d406c6c0 msgr2=0x7f92d4151530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:06.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 shutdown_connections 2023-10-06T05:27:06.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.068+0000 7f92da039700 1 -- 172.21.15.29:0/3673046399 wait complete. 2023-10-06T05:27:06.086 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T05:27:06.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.192+0000 7f41d359e700 1 Processor -- start 2023-10-06T05:27:06.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.192+0000 7f41d359e700 1 -- start start 2023-10-06T05:27:06.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f41d40ab220 0x7f41d4156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40c68b0 0x7f41d40c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d406a5b0 con 0x7f41d41569f0 2023-10-06T05:27:06.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d40c7290 con 0x7f41d40ab220 2023-10-06T05:27:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d415b0a0 con 0x7f41d40c68b0 2023-10-06T05:27:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d259c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f41d41569f0 0x7f41d415a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39524/0 (socket says 172.21.15.29:39524) 2023-10-06T05:27:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d259c700 1 -- 172.21.15.29:0/3692723229 learned_addr learned my addr 172.21.15.29:0/3692723229 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d1d9b700 1 --2- 172.21.15.29:0/3692723229 >> v2:172.21.15.173:3300/0 conn(0x7f41d40ab220 0x7f41d4156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d2d9d700 1 --2- 172.21.15.29:0/3692723229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40c68b0 0x7f41d40c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d1d9b700 1 -- 172.21.15.29:0/3692723229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40c68b0 msgr2=0x7f41d40c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d1d9b700 1 --2- 172.21.15.29:0/3692723229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40c68b0 0x7f41d40c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d1d9b700 1 -- 172.21.15.29:0/3692723229 >> v1:172.21.15.29:6789/0 conn(0x7f41d41569f0 legacy=0x7f41d415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d1d9b700 1 -- 172.21.15.29:0/3692723229 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d415b380 con 0x7f41d40ab220 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d159a700 1 -- 172.21.15.29:0/3692723229 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660733474 0 0) 0x7f41d406a5b0 con 0x7f41d41569f0 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d1d9b700 1 --2- 172.21.15.29:0/3692723229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40ab220 0x7f41d4156dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f41c80098e0 tx=0x7f41c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d979b69a25b913e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d159a700 1 -- 172.21.15.29:0/3692723229 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c800b640 con 0x7f41d40ab220 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d159a700 1 -- 172.21.15.29:0/3692723229 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c800b7a0 con 0x7f41d40ab220 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d159a700 1 -- 172.21.15.29:0/3692723229 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c800bb40 con 0x7f41d40ab220 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 -- 172.21.15.29:0/3692723229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40ab220 msgr2=0x7f41d4156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 --2- 172.21.15.29:0/3692723229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40ab220 0x7f41d4156dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f41c80098e0 tx=0x7f41c80091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 -- 172.21.15.29:0/3692723229 shutdown_connections 2023-10-06T05:27:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 --2- 172.21.15.29:0/3692723229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40c68b0 0x7f41d40c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 --2- 172.21.15.29:0/3692723229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40ab220 0x7f41d4156dc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 -- 172.21.15.29:0/3692723229 >> 172.21.15.29:0/3692723229 conn(0x7f41d40670a0 msgr2=0x7f41d40674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 -- 172.21.15.29:0/3692723229 shutdown_connections 2023-10-06T05:27:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.196+0000 7f41d359e700 1 -- 172.21.15.29:0/3692723229 wait complete. 2023-10-06T05:27:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d359e700 1 Processor -- start 2023-10-06T05:27:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d359e700 1 -- start start 2023-10-06T05:27:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d359e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40ab220 0x7f41d414a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d359e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40c68b0 0x7f41d40af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41d41569f0 0x7f41d40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40c2980 con 0x7f41d41569f0 2023-10-06T05:27:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d359e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4157ea0 con 0x7f41d40c68b0 2023-10-06T05:27:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d359e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4158460 con 0x7f41d40ab220 2023-10-06T05:27:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41d41569f0 0x7f41d40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41d41569f0 0x7f41d40c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35798/0 (socket says 172.21.15.29:35798) 2023-10-06T05:27:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d2d9d700 1 -- 172.21.15.29:0/436384097 learned_addr learned my addr 172.21.15.29:0/436384097 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d1d9b700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40c68b0 0x7f41d40af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d259c700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40ab220 0x7f41d414a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d2d9d700 1 -- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40ab220 msgr2=0x7f41d414a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d2d9d700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40ab220 0x7f41d414a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d2d9d700 1 -- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40c68b0 msgr2=0x7f41d40af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d2d9d700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40c68b0 0x7f41d40af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d2d9d700 1 -- 172.21.15.29:0/436384097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8009420 con 0x7f41d41569f0 2023-10-06T05:27:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.200+0000 7f41d2d9d700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41d41569f0 0x7f41d40c8230 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009ec0 tx=0x7f41cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:06.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41c27fc700 1 -- 172.21.15.29:0/436384097 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00cc20 con 0x7f41d41569f0 2023-10-06T05:27:06.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41c27fc700 1 -- 172.21.15.29:0/436384097 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc00f040 con 0x7f41d41569f0 2023-10-06T05:27:06.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d40aa9f0 con 0x7f41d41569f0 2023-10-06T05:27:06.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41c27fc700 1 -- 172.21.15.29:0/436384097 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc014480 con 0x7f41d41569f0 2023-10-06T05:27:06.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d40aeec0 con 0x7f41d41569f0 2023-10-06T05:27:06.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d41585f0 con 0x7f41d41569f0 2023-10-06T05:27:06.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41c27fc700 1 -- 172.21.15.29:0/436384097 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f41cc014830 con 0x7f41d41569f0 2023-10-06T05:27:06.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41c27fc700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41b4060550 0x7f41b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41c27fc700 1 -- 172.21.15.29:0/436384097 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f41cc07cf20 con 0x7f41d41569f0 2023-10-06T05:27:06.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.204+0000 7f41d259c700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41b4060550 0x7f41b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.208+0000 7f41d259c700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41b4060550 0x7f41b4062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f41c400c870 tx=0x7f41c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.212+0000 7f41c27fc700 1 -- 172.21.15.29:0/436384097 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f41cc04d700 con 0x7f41d41569f0 2023-10-06T05:27:06.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.372+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f41d415b660 con 0x7f41d41569f0 2023-10-06T05:27:06.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.372+0000 7f41c27fc700 1 -- 172.21.15.29:0/436384097 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+126 (secure 0 0 0) 0x7f41cc018020 con 0x7f41d41569f0 2023-10-06T05:27:06.379 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:06.379 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-06T05:27:06.379 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:06.379 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-06T05:27:06.379 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-06T05:27:06.379 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:06.379 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:06.380 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 2, 2023-10-06T05:27:06.380 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": "rbd" 2023-10-06T05:27:06.380 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:06.380 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-06T05:27:06.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41b4060550 msgr2=0x7f41b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41b4060550 0x7f41b4062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f41c400c870 tx=0x7f41c4009040 comp rx=0 tx=0).stop 2023-10-06T05:27:06.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41d41569f0 msgr2=0x7f41d40c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41d41569f0 0x7f41d40c8230 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009ec0 tx=0x7f41cc00b040 comp rx=0 tx=0).stop 2023-10-06T05:27:06.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 shutdown_connections 2023-10-06T05:27:06.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41d41569f0 0x7f41d40c8230 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41b4060550 0x7f41b4062a00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d40c68b0 0x7f41d40af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 --2- 172.21.15.29:0/436384097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41d40ab220 0x7f41d414a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 >> 172.21.15.29:0/436384097 conn(0x7f41d40670a0 msgr2=0x7f41d4150750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:06.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 shutdown_connections 2023-10-06T05:27:06.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.376+0000 7f41d359e700 1 -- 172.21.15.29:0/436384097 wait complete. 2023-10-06T05:27:06.393 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T05:27:06.394 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T05:27:06.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.496+0000 7ffa31552700 1 Processor -- start 2023-10-06T05:27:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.496+0000 7ffa31552700 1 -- start start 2023-10-06T05:27:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffa2c158c30 0x7ffa2c159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa2c15d890 0x7ffa2c06b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2c06b380 con 0x7ffa2c0ce910 2023-10-06T05:27:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c06a770 con 0x7ffa2c15d890 2023-10-06T05:27:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c06aa50 con 0x7ffa2c158c30 2023-10-06T05:27:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa2a7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa2c15d890 0x7ffa2c06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa2b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ffa2c0ce910 0x7ffa2c0cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39526/0 (socket says 172.21.15.29:39526) 2023-10-06T05:27:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa2b7fe700 1 -- 172.21.15.29:0/1359110459 learned_addr learned my addr 172.21.15.29:0/1359110459 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa2affd700 1 --2- 172.21.15.29:0/1359110459 >> v2:172.21.15.173:3300/0 conn(0x7ffa2c158c30 0x7ffa2c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa29ffb700 1 -- 172.21.15.29:0/1359110459 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606027406 0 0) 0x7ffa2c06b380 con 0x7ffa2c0ce910 2023-10-06T05:27:06.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa29ffb700 1 -- 172.21.15.29:0/1359110459 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa18003570 con 0x7ffa2c0ce910 2023-10-06T05:27:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa2a7fc700 1 -- 172.21.15.29:0/1359110459 >> v2:172.21.15.173:3300/0 conn(0x7ffa2c158c30 msgr2=0x7ffa2c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa2a7fc700 1 --2- 172.21.15.29:0/1359110459 >> v2:172.21.15.173:3300/0 conn(0x7ffa2c158c30 0x7ffa2c159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa2a7fc700 1 -- 172.21.15.29:0/1359110459 >> v1:172.21.15.29:6789/0 conn(0x7ffa2c0ce910 legacy=0x7ffa2c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa2a7fc700 1 -- 172.21.15.29:0/1359110459 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c06ad30 con 0x7ffa2c15d890 2023-10-06T05:27:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa2a7fc700 1 --2- 172.21.15.29:0/1359110459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c15d890 0x7ffa2c06b810 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c06a250 tx=0x7ffa1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58244ce30dd7c3a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa29ffb700 1 -- 172.21.15.29:0/1359110459 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c011630 con 0x7ffa2c15d890 2023-10-06T05:27:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa29ffb700 1 -- 172.21.15.29:0/1359110459 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c0117b0 con 0x7ffa2c15d890 2023-10-06T05:27:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa29ffb700 1 -- 172.21.15.29:0/1359110459 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c011b70 con 0x7ffa2c15d890 2023-10-06T05:27:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 -- 172.21.15.29:0/1359110459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c15d890 msgr2=0x7ffa2c06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 --2- 172.21.15.29:0/1359110459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c15d890 0x7ffa2c06b810 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c06a250 tx=0x7ffa1c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 -- 172.21.15.29:0/1359110459 shutdown_connections 2023-10-06T05:27:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 --2- 172.21.15.29:0/1359110459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c15d890 0x7ffa2c06b810 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 --2- 172.21.15.29:0/1359110459 >> v2:172.21.15.173:3300/0 conn(0x7ffa2c158c30 0x7ffa2c159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.500+0000 7ffa31552700 1 -- 172.21.15.29:0/1359110459 >> 172.21.15.29:0/1359110459 conn(0x7ffa2c0670a0 msgr2=0x7ffa2c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:06.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 -- 172.21.15.29:0/1359110459 shutdown_connections 2023-10-06T05:27:06.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 -- 172.21.15.29:0/1359110459 wait complete. 2023-10-06T05:27:06.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 Processor -- start 2023-10-06T05:27:06.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 -- start start 2023-10-06T05:27:06.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c0ce910 0x7ffa2c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c158c30 0x7ffa2c15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c15d890 0x7ffa2c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c16a300 con 0x7ffa2c0ce910 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c0b34f0 con 0x7ffa2c15d890 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa31552700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c16a020 con 0x7ffa2c158c30 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa2affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c0ce910 0x7ffa2c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa2affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c0ce910 0x7ffa2c0b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35818/0 (socket says 172.21.15.29:35818) 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.504+0000 7ffa2affd700 1 -- 172.21.15.29:0/1584204198 learned_addr learned my addr 172.21.15.29:0/1584204198 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa2b7fe700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c15d890 0x7ffa2c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa2a7fc700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c158c30 0x7ffa2c15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa2affd700 1 -- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c158c30 msgr2=0x7ffa2c15a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa2affd700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c158c30 0x7ffa2c15a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa2affd700 1 -- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c15d890 msgr2=0x7ffa2c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa2affd700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c15d890 0x7ffa2c0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa2affd700 1 -- 172.21.15.29:0/1584204198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c009420 con 0x7ffa2c0ce910 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa2affd700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c0ce910 0x7ffa2c0b3980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400ec80 tx=0x7ffa140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa22ffd700 1 -- 172.21.15.29:0/1584204198 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400c850 con 0x7ffa2c0ce910 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa22ffd700 1 -- 172.21.15.29:0/1584204198 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1400c9b0 con 0x7ffa2c0ce910 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2c0b2ea0 con 0x7ffa2c0ce910 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa22ffd700 1 -- 172.21.15.29:0/1584204198 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400cd50 con 0x7ffa2c0ce910 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2c15ae30 con 0x7ffa2c0ce910 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2c071120 con 0x7ffa2c0ce910 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.508+0000 7ffa22ffd700 1 -- 172.21.15.29:0/1584204198 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffa14013680 con 0x7ffa2c0ce910 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.512+0000 7ffa22ffd700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa0c060550 0x7ffa0c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.512+0000 7ffa22ffd700 1 -- 172.21.15.29:0/1584204198 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ffa1407c8f0 con 0x7ffa2c0ce910 2023-10-06T05:27:06.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.512+0000 7ffa2a7fc700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa0c060550 0x7ffa0c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:06.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.512+0000 7ffa2a7fc700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa0c060550 0x7ffa0c062a00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c06a250 tx=0x7ffa1c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:06.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.520+0000 7ffa22ffd700 1 -- 172.21.15.29:0/1584204198 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffa1404d0d0 con 0x7ffa2c0ce910 2023-10-06T05:27:06.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:06.684+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ffa2c06b010 con 0x7ffa2c0ce910 2023-10-06T05:27:07.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.424+0000 7ffa22ffd700 1 -- 172.21.15.29:0/1584204198 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffa140506f0 con 0x7ffa2c0ce910 2023-10-06T05:27:07.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa0c060550 msgr2=0x7ffa0c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa0c060550 0x7ffa0c062a00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c06a250 tx=0x7ffa1c017000 comp rx=0 tx=0).stop 2023-10-06T05:27:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c0ce910 msgr2=0x7ffa2c0b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c0ce910 0x7ffa2c0b3980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400ec80 tx=0x7ffa140091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 shutdown_connections 2023-10-06T05:27:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa0c060550 0x7ffa0c062a00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa2c15d890 0x7ffa2c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffa2c158c30 0x7ffa2c15a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 --2- 172.21.15.29:0/1584204198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa2c0ce910 0x7ffa2c0b3980 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 >> 172.21.15.29:0/1584204198 conn(0x7ffa2c0670a0 msgr2=0x7ffa2c0cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:07.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 shutdown_connections 2023-10-06T05:27:07.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.436+0000 7ffa31552700 1 -- 172.21.15.29:0/1584204198 wait complete. 2023-10-06T05:27:07.444 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-06T05:27:07.458 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T05:27:07.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.584+0000 7f516a153700 1 Processor -- start 2023-10-06T05:27:07.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.584+0000 7f516a153700 1 -- start start 2023-10-06T05:27:07.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f516a153700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5164156c70 0x7f51640c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:07.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f516a153700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5164157040 0x7f516406b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:07.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f516a153700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51640c6b40 con 0x7f516406b8c0 2023-10-06T05:27:07.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f516a153700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516406bdd0 con 0x7f5164156c70 2023-10-06T05:27:07.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f516a153700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51640c6d90 con 0x7f5164157040 2023-10-06T05:27:07.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5169151700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5164156c70 0x7f51640c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:07.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5168950700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5164157040 0x7f516406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:07.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5169151700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5164156c70 0x7f51640c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:35864/0 (socket says 172.21.15.29:35864) 2023-10-06T05:27:07.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5168950700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5164157040 0x7f516406b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:46400/0 (socket says 172.21.15.29:46400) 2023-10-06T05:27:07.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5169151700 1 -- 172.21.15.29:0/4036800173 learned_addr learned my addr 172.21.15.29:0/4036800173 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:07.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5169952700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f516406b8c0 0x7f516406d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:59210/0 (socket says 172.21.15.29:59210) 2023-10-06T05:27:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f515bfff700 1 -- 172.21.15.29:0/4036800173 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725573021 0 0) 0x7f51640c6b40 con 0x7f516406b8c0 2023-10-06T05:27:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5168950700 1 -- 172.21.15.29:0/4036800173 >> v2:172.21.15.173:3300/0 conn(0x7f5164156c70 msgr2=0x7f51640c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5168950700 1 --2- 172.21.15.29:0/4036800173 >> v2:172.21.15.173:3300/0 conn(0x7f5164156c70 0x7f51640c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5168950700 1 -- 172.21.15.29:0/4036800173 >> v1:172.21.15.173:6789/0 conn(0x7f516406b8c0 legacy=0x7f516406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5168950700 1 -- 172.21.15.29:0/4036800173 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51640c7070 con 0x7f5164157040 2023-10-06T05:27:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f5168950700 1 --2- 172.21.15.29:0/4036800173 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5164157040 0x7f516406b380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51540098e0 tx=0x7f51540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e5c106163000812 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f515bfff700 1 -- 172.21.15.29:0/4036800173 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400b640 con 0x7f5164157040 2023-10-06T05:27:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f515bfff700 1 -- 172.21.15.29:0/4036800173 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515400b7a0 con 0x7f5164157040 2023-10-06T05:27:07.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.588+0000 7f515bfff700 1 -- 172.21.15.29:0/4036800173 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400bb40 con 0x7f5164157040 2023-10-06T05:27:07.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 -- 172.21.15.29:0/4036800173 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5164157040 msgr2=0x7f516406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:07.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 --2- 172.21.15.29:0/4036800173 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5164157040 0x7f516406b380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51540098e0 tx=0x7f51540091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 -- 172.21.15.29:0/4036800173 shutdown_connections 2023-10-06T05:27:07.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 --2- 172.21.15.29:0/4036800173 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5164157040 0x7f516406b380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 --2- 172.21.15.29:0/4036800173 >> v2:172.21.15.173:3300/0 conn(0x7f5164156c70 0x7f51640c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 -- 172.21.15.29:0/4036800173 >> 172.21.15.29:0/4036800173 conn(0x7f51640c9830 msgr2=0x7f516406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:07.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 -- 172.21.15.29:0/4036800173 shutdown_connections 2023-10-06T05:27:07.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 -- 172.21.15.29:0/4036800173 wait complete. 2023-10-06T05:27:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 Processor -- start 2023-10-06T05:27:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 -- start start 2023-10-06T05:27:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f516406b8c0 0x7f51641537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164156c70 0x7f51640c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164157040 0x7f516416cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5164153d20 con 0x7f5164156c70 2023-10-06T05:27:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51640a9e40 con 0x7f5164157040 2023-10-06T05:27:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f516a153700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51640afa50 con 0x7f516406b8c0 2023-10-06T05:27:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f5168950700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164156c70 0x7f51640c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f5168950700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164156c70 0x7f51640c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35820/0 (socket says 172.21.15.29:35820) 2023-10-06T05:27:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f5168950700 1 -- 172.21.15.29:0/2817043911 learned_addr learned my addr 172.21.15.29:0/2817043911 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f5169151700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f516406b8c0 0x7f51641537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.592+0000 7f5169952700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164157040 0x7f516416cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f5168950700 1 -- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f516406b8c0 msgr2=0x7f51641537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f5168950700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f516406b8c0 0x7f51641537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f5168950700 1 -- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164157040 msgr2=0x7f516416cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f5168950700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164157040 0x7f516416cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f5168950700 1 -- 172.21.15.29:0/2817043911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5154009420 con 0x7f5164156c70 2023-10-06T05:27:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f5168950700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164156c70 0x7f51640c5d00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f51640c6ed0 tx=0x7f5154017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f51597fa700 1 -- 172.21.15.29:0/2817043911 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400bb20 con 0x7f5164156c70 2023-10-06T05:27:07.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f51597fa700 1 -- 172.21.15.29:0/2817043911 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154011420 con 0x7f5164156c70 2023-10-06T05:27:07.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51640c6240 con 0x7f5164156c70 2023-10-06T05:27:07.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f51597fa700 1 -- 172.21.15.29:0/2817043911 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51540117c0 con 0x7f5164156c70 2023-10-06T05:27:07.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51640affd0 con 0x7f5164156c70 2023-10-06T05:27:07.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516404be00 con 0x7f5164156c70 2023-10-06T05:27:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.596+0000 7f51597fa700 1 -- 172.21.15.29:0/2817043911 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5154011bb0 con 0x7f5164156c70 2023-10-06T05:27:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.600+0000 7f51597fa700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5148060550 0x7f5148062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.600+0000 7f51597fa700 1 -- 172.21.15.29:0/2817043911 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f515407dff0 con 0x7f5164156c70 2023-10-06T05:27:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.600+0000 7f5169151700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5148060550 0x7f5148062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.600+0000 7f5169151700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5148060550 0x7f5148062a00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5160006fd0 tx=0x7f5160008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.604+0000 7f51597fa700 1 -- 172.21.15.29:0/2817043911 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f515404e620 con 0x7f5164156c70 2023-10-06T05:27:07.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:07.768+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f516406d000 con 0x7f5164156c70 2023-10-06T05:27:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.440+0000 7f51597fa700 1 -- 172.21.15.29:0/2817043911 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5154011e60 con 0x7f5164156c70 2023-10-06T05:27:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5148060550 msgr2=0x7f5148062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5148060550 0x7f5148062a00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5160006fd0 tx=0x7f5160008040 comp rx=0 tx=0).stop 2023-10-06T05:27:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164156c70 msgr2=0x7f51640c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164156c70 0x7f51640c5d00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f51640c6ed0 tx=0x7f5154017000 comp rx=0 tx=0).stop 2023-10-06T05:27:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 shutdown_connections 2023-10-06T05:27:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5148060550 0x7f5148062a00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5164157040 0x7f516416cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:08.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164156c70 0x7f51640c5d00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 --2- 172.21.15.29:0/2817043911 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f516406b8c0 0x7f51641537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 >> 172.21.15.29:0/2817043911 conn(0x7f51640c9830 msgr2=0x7f516406d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 shutdown_connections 2023-10-06T05:27:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.468+0000 7f516a153700 1 -- 172.21.15.29:0/2817043911 wait complete. 2023-10-06T05:27:08.475 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-06T05:27:08.485 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T05:27:08.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a9047700 1 Processor -- start 2023-10-06T05:27:08.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a9047700 1 -- start start 2023-10-06T05:27:08.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a9047700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0a40cde80 0x7fe0a40ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:08.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a9047700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40685d0 0x7fe0a40ade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:08.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a9047700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a40c95c0 con 0x7fe0a40ada00 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a9047700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a40674e0 con 0x7fe0a40cde80 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a9047700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4067a30 con 0x7fe0a40685d0 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a2d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0a40cde80 0x7fe0a40ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a2d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0a40cde80 0x7fe0a40ce250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35834/0 (socket says 172.21.15.29:35834) 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a2d9d700 1 -- 172.21.15.29:0/1102136948 learned_addr learned my addr 172.21.15.29:0/1102136948 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a259c700 1 --1- 172.21.15.29:0/1102136948 >> v1:172.21.15.29:6789/0 conn(0x7fe0a40ada00 0x7fe0a4067ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39530/0 (socket says 172.21.15.29:39530) 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.584+0000 7fe0a359e700 1 --2- 172.21.15.29:0/1102136948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40685d0 0x7fe0a40ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a2d9d700 1 -- 172.21.15.29:0/1102136948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40685d0 msgr2=0x7fe0a40ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a2d9d700 1 --2- 172.21.15.29:0/1102136948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40685d0 0x7fe0a40ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:08.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a2d9d700 1 -- 172.21.15.29:0/1102136948 >> v1:172.21.15.29:6789/0 conn(0x7fe0a40ada00 legacy=0x7fe0a4067ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:08.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a2d9d700 1 -- 172.21.15.29:0/1102136948 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40c9000 con 0x7fe0a40cde80 2023-10-06T05:27:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a2d9d700 1 --2- 172.21.15.29:0/1102136948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40cde80 0x7fe0a40ce250 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe094009f20 tx=0x7fe094009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e1a10e08a68665 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a1d9b700 1 -- 172.21.15.29:0/1102136948 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400e070 con 0x7fe0a40cde80 2023-10-06T05:27:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a1d9b700 1 -- 172.21.15.29:0/1102136948 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09400ba80 con 0x7fe0a40cde80 2023-10-06T05:27:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a1d9b700 1 -- 172.21.15.29:0/1102136948 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940092e0 con 0x7fe0a40cde80 2023-10-06T05:27:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 -- 172.21.15.29:0/1102136948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40cde80 msgr2=0x7fe0a40ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 --2- 172.21.15.29:0/1102136948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40cde80 0x7fe0a40ce250 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe094009f20 tx=0x7fe094009840 comp rx=0 tx=0).stop 2023-10-06T05:27:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 -- 172.21.15.29:0/1102136948 shutdown_connections 2023-10-06T05:27:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 --2- 172.21.15.29:0/1102136948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40685d0 0x7fe0a40ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:08.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 --2- 172.21.15.29:0/1102136948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40cde80 0x7fe0a40ce250 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:08.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 -- 172.21.15.29:0/1102136948 >> 172.21.15.29:0/1102136948 conn(0x7fe0a40692b0 msgr2=0x7fe0a4069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:08.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 -- 172.21.15.29:0/1102136948 shutdown_connections 2023-10-06T05:27:08.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 -- 172.21.15.29:0/1102136948 wait complete. 2023-10-06T05:27:08.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 Processor -- start 2023-10-06T05:27:08.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.588+0000 7fe0a9047700 1 -- start start 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a9047700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40685d0 0x7fe0a40c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a9047700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a40ada00 0x7fe0a40b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a9047700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40cde80 0x7fe0a40b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a9047700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c2360 con 0x7fe0a40685d0 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a9047700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40b1540 con 0x7fe0a40ada00 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a9047700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a415e480 con 0x7fe0a40cde80 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40685d0 0x7fe0a40c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40685d0 0x7fe0a40c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35846/0 (socket says 172.21.15.29:35846) 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a2d9d700 1 -- 172.21.15.29:0/3623707795 learned_addr learned my addr 172.21.15.29:0/3623707795 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a259c700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a40ada00 0x7fe0a40b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a359e700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40cde80 0x7fe0a40b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:08.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a2d9d700 1 -- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40cde80 msgr2=0x7fe0a40b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:08.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a2d9d700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40cde80 0x7fe0a40b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:08.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a2d9d700 1 -- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a40ada00 msgr2=0x7fe0a40b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:08.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a2d9d700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a40ada00 0x7fe0a40b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:08.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a2d9d700 1 -- 172.21.15.29:0/3623707795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094009ae0 con 0x7fe0a40685d0 2023-10-06T05:27:08.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a2d9d700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40685d0 0x7fe0a40c1e20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe09400bf20 tx=0x7fe094018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:08.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe08affd700 1 -- 172.21.15.29:0/3623707795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094007190 con 0x7fe0a40685d0 2023-10-06T05:27:08.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe08affd700 1 -- 172.21.15.29:0/3623707795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094007a80 con 0x7fe0a40685d0 2023-10-06T05:27:08.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a40b0c10 con 0x7fe0a40685d0 2023-10-06T05:27:08.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe08affd700 1 -- 172.21.15.29:0/3623707795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094007e40 con 0x7fe0a40685d0 2023-10-06T05:27:08.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a40b11d0 con 0x7fe0a40685d0 2023-10-06T05:27:08.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.592+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a4071120 con 0x7fe0a40685d0 2023-10-06T05:27:08.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.596+0000 7fe08affd700 1 -- 172.21.15.29:0/3623707795 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe09401c410 con 0x7fe0a40685d0 2023-10-06T05:27:08.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.596+0000 7fe08affd700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe090060550 0x7fe090062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:08.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.596+0000 7fe08affd700 1 -- 172.21.15.29:0/3623707795 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fe09407e3c0 con 0x7fe0a40685d0 2023-10-06T05:27:08.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.596+0000 7fe0a259c700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe090060550 0x7fe090062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:08.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.596+0000 7fe0a259c700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe090060550 0x7fe090062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe098007fd0 tx=0x7fe098007d70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:08.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.604+0000 7fe08affd700 1 -- 172.21.15.29:0/3623707795 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe09404e810 con 0x7fe0a40685d0 2023-10-06T05:27:08.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:08.800+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe0a40c92e0 con 0x7fe0a40685d0 2023-10-06T05:27:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.472+0000 7fe08affd700 1 -- 172.21.15.29:0/3623707795 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v17) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe094051e30 con 0x7fe0a40685d0 2023-10-06T05:27:09.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe090060550 msgr2=0x7fe090062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe090060550 0x7fe090062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe098007fd0 tx=0x7fe098007d70 comp rx=0 tx=0).stop 2023-10-06T05:27:09.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40685d0 msgr2=0x7fe0a40c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40685d0 0x7fe0a40c1e20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe09400bf20 tx=0x7fe094018000 comp rx=0 tx=0).stop 2023-10-06T05:27:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 shutdown_connections 2023-10-06T05:27:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a40cde80 0x7fe0a40b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe090060550 0x7fe090062a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a40ada00 0x7fe0a40b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 --2- 172.21.15.29:0/3623707795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a40685d0 0x7fe0a40c1e20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 >> 172.21.15.29:0/3623707795 conn(0x7fe0a40692b0 msgr2=0x7fe0a4155340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 shutdown_connections 2023-10-06T05:27:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.480+0000 7fe0a9047700 1 -- 172.21.15.29:0/3623707795 wait complete. 2023-10-06T05:27:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 7 and data pool 8 2023-10-06T05:27:09.498 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:27:09.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd540d1b700 1 Processor -- start 2023-10-06T05:27:09.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd540d1b700 1 -- start start 2023-10-06T05:27:09.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd540d1b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd53c158bd0 0x7fd53c158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd540d1b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd53c06b2a0 0x7fd53c0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd540d1b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c0c7090 con 0x7fd53c06b720 2023-10-06T05:27:09.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd540d1b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c06bc80 con 0x7fd53c06b2a0 2023-10-06T05:27:09.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd540d1b700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c06bf60 con 0x7fd53c158bd0 2023-10-06T05:27:09.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd53affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd53c06b2a0 0x7fd53c0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd53bfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd53c06b720 0x7fd53c0c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39536/0 (socket says 172.21.15.29:39536) 2023-10-06T05:27:09.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.592+0000 7fd53bfff700 1 -- 172.21.15.29:0/207752598 learned_addr learned my addr 172.21.15.29:0/207752598 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53b7fe700 1 --2- 172.21.15.29:0/207752598 >> v2:172.21.15.173:3300/0 conn(0x7fd53c158bd0 0x7fd53c158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53a7fc700 1 -- 172.21.15.29:0/207752598 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997101577 0 0) 0x7fd53c0c7090 con 0x7fd53c06b720 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53a7fc700 1 -- 172.21.15.29:0/207752598 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd524003570 con 0x7fd53c06b720 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53affd700 1 -- 172.21.15.29:0/207752598 >> v2:172.21.15.173:3300/0 conn(0x7fd53c158bd0 msgr2=0x7fd53c158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53affd700 1 --2- 172.21.15.29:0/207752598 >> v2:172.21.15.173:3300/0 conn(0x7fd53c158bd0 0x7fd53c158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53affd700 1 -- 172.21.15.29:0/207752598 >> v1:172.21.15.29:6789/0 conn(0x7fd53c06b720 legacy=0x7fd53c0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53affd700 1 -- 172.21.15.29:0/207752598 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0c7300 con 0x7fd53c06b2a0 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53b7fe700 1 --2- 172.21.15.29:0/207752598 >> v2:172.21.15.173:3300/0 conn(0x7fd53c158bd0 0x7fd53c158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53affd700 1 --2- 172.21.15.29:0/207752598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b2a0 0x7fd53c0ac700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd53c06b1a0 tx=0x7fd5300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea4439aaa149f5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53a7fc700 1 -- 172.21.15.29:0/207752598 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530011630 con 0x7fd53c06b2a0 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53a7fc700 1 -- 172.21.15.29:0/207752598 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd530011790 con 0x7fd53c06b2a0 2023-10-06T05:27:09.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd53a7fc700 1 -- 172.21.15.29:0/207752598 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530011b30 con 0x7fd53c06b2a0 2023-10-06T05:27:09.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 -- 172.21.15.29:0/207752598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b2a0 msgr2=0x7fd53c0ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 --2- 172.21.15.29:0/207752598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b2a0 0x7fd53c0ac700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd53c06b1a0 tx=0x7fd5300091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 -- 172.21.15.29:0/207752598 shutdown_connections 2023-10-06T05:27:09.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 --2- 172.21.15.29:0/207752598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b2a0 0x7fd53c0ac700 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 --2- 172.21.15.29:0/207752598 >> v2:172.21.15.173:3300/0 conn(0x7fd53c158bd0 0x7fd53c158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 -- 172.21.15.29:0/207752598 >> 172.21.15.29:0/207752598 conn(0x7fd53c06d7d0 msgr2=0x7fd53c06dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:09.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 -- 172.21.15.29:0/207752598 shutdown_connections 2023-10-06T05:27:09.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 -- 172.21.15.29:0/207752598 wait complete. 2023-10-06T05:27:09.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 Processor -- start 2023-10-06T05:27:09.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.596+0000 7fd540d1b700 1 -- start start 2023-10-06T05:27:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd540d1b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd53c06b2a0 0x7fd53c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd540d1b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b720 0x7fd53c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd540d1b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd53c158bd0 0x7fd53c0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd540d1b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0b1220 con 0x7fd53c06b720 2023-10-06T05:27:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd540d1b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0b0750 con 0x7fd53c06b2a0 2023-10-06T05:27:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd540d1b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c15a560 con 0x7fd53c158bd0 2023-10-06T05:27:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b720 0x7fd53c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b720 0x7fd53c156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35868/0 (socket says 172.21.15.29:35868) 2023-10-06T05:27:09.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53affd700 1 -- 172.21.15.29:0/461737514 learned_addr learned my addr 172.21.15.29:0/461737514 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53b7fe700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd53c06b2a0 0x7fd53c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53bfff700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd53c158bd0 0x7fd53c0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53affd700 1 -- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd53c158bd0 msgr2=0x7fd53c0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53affd700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd53c158bd0 0x7fd53c0b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53affd700 1 -- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd53c06b2a0 msgr2=0x7fd53c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53affd700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd53c06b2a0 0x7fd53c0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53affd700 1 -- 172.21.15.29:0/461737514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530009420 con 0x7fd53c06b720 2023-10-06T05:27:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53b7fe700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd53c06b2a0 0x7fd53c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:09.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd53affd700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b720 0x7fd53c156060 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd530009f50 tx=0x7fd530017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:09.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd5237fe700 1 -- 172.21.15.29:0/461737514 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530011b10 con 0x7fd53c06b720 2023-10-06T05:27:09.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd5237fe700 1 -- 172.21.15.29:0/461737514 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5300233f0 con 0x7fd53c06b720 2023-10-06T05:27:09.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c15a230 con 0x7fd53c06b720 2023-10-06T05:27:09.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd5237fe700 1 -- 172.21.15.29:0/461737514 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530023790 con 0x7fd53c06b720 2023-10-06T05:27:09.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.600+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c0b0c60 con 0x7fd53c06b720 2023-10-06T05:27:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.604+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c15a710 con 0x7fd53c06b720 2023-10-06T05:27:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.604+0000 7fd5237fe700 1 -- 172.21.15.29:0/461737514 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd5300193b0 con 0x7fd53c06b720 2023-10-06T05:27:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.604+0000 7fd5237fe700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd528060550 0x7fd528062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.604+0000 7fd5237fe700 1 -- 172.21.15.29:0/461737514 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd53007de00 con 0x7fd53c06b720 2023-10-06T05:27:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.604+0000 7fd53b7fe700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd528060550 0x7fd528062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.604+0000 7fd53b7fe700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd528060550 0x7fd528062a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd5340076e0 tx=0x7fd5340098f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.612+0000 7fd5237fe700 1 -- 172.21.15.29:0/461737514 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd53c15a710 con 0x7fd53c06b720 2023-10-06T05:27:09.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.780+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd53c15a6d0 con 0x7fd53c06b720 2023-10-06T05:27:09.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.780+0000 7fd5237fe700 1 -- 172.21.15.29:0/461737514 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fd53004e1f0 con 0x7fd53c06b720 2023-10-06T05:27:09.789 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:09.789 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":47,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:27:08.807422+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:27:06.728148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T05:27:07.815762+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:27:09.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd528060550 msgr2=0x7fd528062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd528060550 0x7fd528062a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd5340076e0 tx=0x7fd5340098f0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b720 msgr2=0x7fd53c156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b720 0x7fd53c156060 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd530009f50 tx=0x7fd530017000 comp rx=0 tx=0).stop 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 shutdown_connections 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd53c158bd0 0x7fd53c0b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd53c06b720 0x7fd53c156060 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd528060550 0x7fd528062a00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 --2- 172.21.15.29:0/461737514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd53c06b2a0 0x7fd53c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 >> 172.21.15.29:0/461737514 conn(0x7fd53c06d7d0 msgr2=0x7fd53c157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 shutdown_connections 2023-10-06T05:27:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.784+0000 7fd540d1b700 1 -- 172.21.15.29:0/461737514 wait complete. 2023-10-06T05:27:09.802 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:27:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.904+0000 7ffb85440700 1 Processor -- start 2023-10-06T05:27:09.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.904+0000 7ffb85440700 1 -- start start 2023-10-06T05:27:09.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb801569f0 0x7ffb800ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffb80156dc0 0x7ffb8015a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8006a5b0 con 0x7ffb800c68b0 2023-10-06T05:27:09.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8015b0a0 con 0x7ffb80156dc0 2023-10-06T05:27:09.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8015b380 con 0x7ffb801569f0 2023-10-06T05:27:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7f7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffb80156dc0 0x7ffb8015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7f7fe700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffb80156dc0 0x7ffb8015a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:35906/0 (socket says 172.21.15.29:35906) 2023-10-06T05:27:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7f7fe700 1 -- 172.21.15.29:0/3961712834 learned_addr learned my addr 172.21.15.29:0/3961712834 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7ffff700 1 --2- 172.21.15.29:0/3961712834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb801569f0 0x7ffb800ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7f7fe700 1 -- 172.21.15.29:0/3961712834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb801569f0 msgr2=0x7ffb800ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7f7fe700 1 --2- 172.21.15.29:0/3961712834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb801569f0 0x7ffb800ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7f7fe700 1 -- 172.21.15.29:0/3961712834 >> v1:172.21.15.173:6789/0 conn(0x7ffb800c68b0 legacy=0x7ffb8006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7f7fe700 1 -- 172.21.15.29:0/3961712834 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8015b660 con 0x7ffb80156dc0 2023-10-06T05:27:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7f7fe700 1 --2- 172.21.15.29:0/3961712834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb80156dc0 0x7ffb8015a870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb680099b0 tx=0x7ffb68009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=966a2cf7cfb64d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:09.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7effd700 1 -- 172.21.15.29:0/3961712834 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68009ea0 con 0x7ffb80156dc0 2023-10-06T05:27:09.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7effd700 1 -- 172.21.15.29:0/3961712834 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800b860 con 0x7ffb80156dc0 2023-10-06T05:27:09.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb7effd700 1 -- 172.21.15.29:0/3961712834 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800bc00 con 0x7ffb80156dc0 2023-10-06T05:27:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 -- 172.21.15.29:0/3961712834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb80156dc0 msgr2=0x7ffb8015a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 --2- 172.21.15.29:0/3961712834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb80156dc0 0x7ffb8015a870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb680099b0 tx=0x7ffb68009250 comp rx=0 tx=0).stop 2023-10-06T05:27:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 -- 172.21.15.29:0/3961712834 shutdown_connections 2023-10-06T05:27:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 --2- 172.21.15.29:0/3961712834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb80156dc0 0x7ffb8015a870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 --2- 172.21.15.29:0/3961712834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb801569f0 0x7ffb800ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 -- 172.21.15.29:0/3961712834 >> 172.21.15.29:0/3961712834 conn(0x7ffb800670a0 msgr2=0x7ffb800674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 -- 172.21.15.29:0/3961712834 shutdown_connections 2023-10-06T05:27:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.908+0000 7ffb85440700 1 -- 172.21.15.29:0/3961712834 wait complete. 2023-10-06T05:27:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.912+0000 7ffb85440700 1 Processor -- start 2023-10-06T05:27:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.912+0000 7ffb85440700 1 -- start start 2023-10-06T05:27:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb85440700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb800c68b0 0x7ffb80145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb85440700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb801569f0 0x7ffb80152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb85440700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb80156dc0 0x7ffb80145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb85440700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80157d10 con 0x7ffb801569f0 2023-10-06T05:27:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb85440700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb801536b0 con 0x7ffb800c68b0 2023-10-06T05:27:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb85440700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb801573e0 con 0x7ffb80156dc0 2023-10-06T05:27:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb801569f0 0x7ffb80152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb801569f0 0x7ffb80152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35870/0 (socket says 172.21.15.29:35870) 2023-10-06T05:27:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7f7fe700 1 -- 172.21.15.29:0/2426820032 learned_addr learned my addr 172.21.15.29:0/2426820032 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb800c68b0 0x7ffb80145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb84c3f700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb80156dc0 0x7ffb80145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7f7fe700 1 -- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb80156dc0 msgr2=0x7ffb80145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7f7fe700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb80156dc0 0x7ffb80145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7f7fe700 1 -- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb800c68b0 msgr2=0x7ffb80145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7f7fe700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb800c68b0 0x7ffb80145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7f7fe700 1 -- 172.21.15.29:0/2426820032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb680094f0 con 0x7ffb801569f0 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb84c3f700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb80156dc0 0x7ffb80145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb7f7fe700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb801569f0 0x7ffb80152e60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffb8006df30 tx=0x7ffb68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb77fff700 1 -- 172.21.15.29:0/2426820032 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68000d10 con 0x7ffb801569f0 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb77fff700 1 -- 172.21.15.29:0/2426820032 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800bbe0 con 0x7ffb801569f0 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb77fff700 1 -- 172.21.15.29:0/2426820032 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68011670 con 0x7ffb801569f0 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb801576c0 con 0x7ffb801569f0 2023-10-06T05:27:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb801533a0 con 0x7ffb801569f0 2023-10-06T05:27:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.916+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb80157e80 con 0x7ffb801569f0 2023-10-06T05:27:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.920+0000 7ffb77fff700 1 -- 172.21.15.29:0/2426820032 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffb68011aa0 con 0x7ffb801569f0 2023-10-06T05:27:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.920+0000 7ffb77fff700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffb60060550 0x7ffb60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.920+0000 7ffb77fff700 1 -- 172.21.15.29:0/2426820032 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffb6807e1f0 con 0x7ffb801569f0 2023-10-06T05:27:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.920+0000 7ffb7ffff700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffb60060550 0x7ffb60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:09.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.920+0000 7ffb7ffff700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffb60060550 0x7ffb60062a00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009db0 tx=0x7ffb700091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:09.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:09.928+0000 7ffb77fff700 1 -- 172.21.15.29:0/2426820032 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffb6804e680 con 0x7ffb801569f0 2023-10-06T05:27:10.041 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:27:10.043 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:27:10.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.088+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb8004be00 con 0x7ffb801569f0 2023-10-06T05:27:10.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.088+0000 7ffb77fff700 1 -- 172.21.15.29:0/2426820032 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16879 (secure 0 0 0) 0x7ffb68051ca0 con 0x7ffb801569f0 2023-10-06T05:27:10.095 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:10.095 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":47,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:27:08.807422+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:27:06.728148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T05:27:07.815762+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:27:10.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffb60060550 msgr2=0x7ffb60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:10.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffb60060550 0x7ffb60062a00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009db0 tx=0x7ffb700091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb801569f0 msgr2=0x7ffb80152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:10.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb801569f0 0x7ffb80152e60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffb8006df30 tx=0x7ffb68017000 comp rx=0 tx=0).stop 2023-10-06T05:27:10.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 shutdown_connections 2023-10-06T05:27:10.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb80156dc0 0x7ffb80145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb801569f0 0x7ffb80152e60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffb60060550 0x7ffb60062a00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 --2- 172.21.15.29:0/2426820032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb800c68b0 0x7ffb80145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 >> 172.21.15.29:0/2426820032 conn(0x7ffb800670a0 msgr2=0x7ffb80146ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:10.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 shutdown_connections 2023-10-06T05:27:10.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.092+0000 7ffb85440700 1 -- 172.21.15.29:0/2426820032 wait complete. 2023-10-06T05:27:10.109 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T05:27:10.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.264+0000 7f1aecd35700 1 Processor -- start 2023-10-06T05:27:10.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.264+0000 7f1aecd35700 1 -- start start 2023-10-06T05:27:10.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.264+0000 7f1aecd35700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae8158f10 0x7f1ae80ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:10.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1ae815d730 0x7f1ae806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:10.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ae806cc00 0x7f1ae80cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:10.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae806a600 con 0x7f1ae806cc00 2023-10-06T05:27:10.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae806d080 con 0x7f1ae815d730 2023-10-06T05:27:10.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae80cacd0 con 0x7f1ae8158f10 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ae806cc00 0x7f1ae80cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ae806cc00 0x7f1ae80cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35878/0 (socket says 172.21.15.29:35878) 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae7fff700 1 -- 172.21.15.29:0/981107171 learned_addr learned my addr 172.21.15.29:0/981107171 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1adeffd700 1 --2- 172.21.15.29:0/981107171 >> v2:172.21.15.173:3300/0 conn(0x7f1ae815d730 0x7f1ae806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae7fff700 1 -- 172.21.15.29:0/981107171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae8158f10 msgr2=0x7f1ae80ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae77fe700 1 --2- 172.21.15.29:0/981107171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae8158f10 0x7f1ae80ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae7fff700 1 --2- 172.21.15.29:0/981107171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae8158f10 0x7f1ae80ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae7fff700 1 -- 172.21.15.29:0/981107171 >> v2:172.21.15.173:3300/0 conn(0x7f1ae815d730 msgr2=0x7f1ae806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae7fff700 1 --2- 172.21.15.29:0/981107171 >> v2:172.21.15.173:3300/0 conn(0x7f1ae815d730 0x7f1ae806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae7fff700 1 -- 172.21.15.29:0/981107171 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80cafb0 con 0x7f1ae806cc00 2023-10-06T05:27:10.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1adeffd700 1 --2- 172.21.15.29:0/981107171 >> v2:172.21.15.173:3300/0 conn(0x7f1ae815d730 0x7f1ae806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:10.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae77fe700 1 --2- 172.21.15.29:0/981107171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae8158f10 0x7f1ae80ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:10.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae7fff700 1 --2- 172.21.15.29:0/981107171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae806cc00 0x7f1ae80cfdf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8069a70 tx=0x7f1ae0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9c25f5a292a8be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:10.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae6ffd700 1 -- 172.21.15.29:0/981107171 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000e070 con 0x7f1ae806cc00 2023-10-06T05:27:10.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae6ffd700 1 -- 172.21.15.29:0/981107171 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae000ba40 con 0x7f1ae806cc00 2023-10-06T05:27:10.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1ae6ffd700 1 -- 172.21.15.29:0/981107171 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00092e0 con 0x7f1ae806cc00 2023-10-06T05:27:10.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 -- 172.21.15.29:0/981107171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae806cc00 msgr2=0x7f1ae80cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:10.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 --2- 172.21.15.29:0/981107171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae806cc00 0x7f1ae80cfdf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8069a70 tx=0x7f1ae0009840 comp rx=0 tx=0).stop 2023-10-06T05:27:10.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 -- 172.21.15.29:0/981107171 shutdown_connections 2023-10-06T05:27:10.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 --2- 172.21.15.29:0/981107171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae806cc00 0x7f1ae80cfdf0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 --2- 172.21.15.29:0/981107171 >> v2:172.21.15.173:3300/0 conn(0x7f1ae815d730 0x7f1ae806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 --2- 172.21.15.29:0/981107171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae8158f10 0x7f1ae80ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 -- 172.21.15.29:0/981107171 >> 172.21.15.29:0/981107171 conn(0x7f1ae8062b60 msgr2=0x7f1ae8062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:10.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 -- 172.21.15.29:0/981107171 shutdown_connections 2023-10-06T05:27:10.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.268+0000 7f1aecd35700 1 -- 172.21.15.29:0/981107171 wait complete. 2023-10-06T05:27:10.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1aecd35700 1 Processor -- start 2023-10-06T05:27:10.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1aecd35700 1 -- start start 2023-10-06T05:27:10.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1aecd35700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ae806cc00 0x7f1ae81574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:10.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1aecd35700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8158f10 0x7f1ae80c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:10.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1aecd35700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae815d730 0x7f1ae815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:10.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1aecd35700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae80c3cb0 con 0x7f1ae8158f10 2023-10-06T05:27:10.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1aecd35700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae80c3f90 con 0x7f1ae806cc00 2023-10-06T05:27:10.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1aecd35700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae80c4270 con 0x7f1ae815d730 2023-10-06T05:27:10.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8158f10 0x7f1ae80c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:10.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8158f10 0x7f1ae80c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35890/0 (socket says 172.21.15.29:35890) 2023-10-06T05:27:10.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adeffd700 1 -- 172.21.15.29:0/3211044990 learned_addr learned my addr 172.21.15.29:0/3211044990 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:10.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1ae7fff700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae815d730 0x7f1ae815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:10.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1ae77fe700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ae806cc00 0x7f1ae81574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:10.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adeffd700 1 -- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae815d730 msgr2=0x7f1ae815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:10.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adeffd700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae815d730 0x7f1ae815a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adeffd700 1 -- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ae806cc00 msgr2=0x7f1ae81574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:10.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adeffd700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ae806cc00 0x7f1ae81574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:10.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adeffd700 1 -- 172.21.15.29:0/3211044990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0009ae0 con 0x7f1ae8158f10 2023-10-06T05:27:10.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1ae77fe700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ae806cc00 0x7f1ae81574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:10.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adeffd700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8158f10 0x7f1ae80c4d50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000c850 tx=0x7f1ad0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:10.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adffff700 1 -- 172.21.15.29:0/3211044990 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0011600 con 0x7f1ae8158f10 2023-10-06T05:27:10.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adffff700 1 -- 172.21.15.29:0/3211044990 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad0011760 con 0x7f1ae8158f10 2023-10-06T05:27:10.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae80c4550 con 0x7f1ae8158f10 2023-10-06T05:27:10.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.272+0000 7f1adffff700 1 -- 172.21.15.29:0/3211044990 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0011b00 con 0x7f1ae8158f10 2023-10-06T05:27:10.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.276+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae8157a30 con 0x7f1ae8158f10 2023-10-06T05:27:10.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.276+0000 7f1adffff700 1 -- 172.21.15.29:0/3211044990 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1ad00073b0 con 0x7f1ae8158f10 2023-10-06T05:27:10.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.276+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae804be00 con 0x7f1ae8158f10 2023-10-06T05:27:10.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.276+0000 7f1adffff700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1acc060550 0x7f1acc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:10.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.276+0000 7f1adffff700 1 -- 172.21.15.29:0/3211044990 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ad007c8a0 con 0x7f1ae8158f10 2023-10-06T05:27:10.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.276+0000 7f1ae77fe700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1acc060550 0x7f1acc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:10.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.280+0000 7f1ae77fe700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1acc060550 0x7f1acc062a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8008a80 tx=0x7f1ad8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:10.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.284+0000 7f1adffff700 1 -- 172.21.15.29:0/3211044990 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ad00507c0 con 0x7f1ae8158f10 2023-10-06T05:27:10.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:10.480+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1ae80af630 con 0x7f1ae8158f10 2023-10-06T05:27:11.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.492+0000 7f1adffff700 1 -- 172.21.15.29:0/3211044990 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1ad001e0b0 con 0x7f1ae8158f10 2023-10-06T05:27:11.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1acc060550 msgr2=0x7f1acc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:11.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1acc060550 0x7f1acc062a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8008a80 tx=0x7f1ad8008040 comp rx=0 tx=0).stop 2023-10-06T05:27:11.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8158f10 msgr2=0x7f1ae80c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:11.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8158f10 0x7f1ae80c4d50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000c850 tx=0x7f1ad0008040 comp rx=0 tx=0).stop 2023-10-06T05:27:11.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 shutdown_connections 2023-10-06T05:27:11.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ae815d730 0x7f1ae815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:11.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8158f10 0x7f1ae80c4d50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:11.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1acc060550 0x7f1acc062a00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:11.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 --2- 172.21.15.29:0/3211044990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ae806cc00 0x7f1ae81574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:11.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 >> 172.21.15.29:0/3211044990 conn(0x7f1ae8062b60 msgr2=0x7f1ae80ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:11.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 shutdown_connections 2023-10-06T05:27:11.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.496+0000 7f1aecd35700 1 -- 172.21.15.29:0/3211044990 wait complete. 2023-10-06T05:27:11.517 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T05:27:11.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e5cfa5700 1 Processor -- start 2023-10-06T05:27:11.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e5cfa5700 1 -- start start 2023-10-06T05:27:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e5cfa5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e58155b60 0x7f5e580686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e5cfa5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5e58155f30 0x7f5e5815a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e5cfa5700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5806bbd0 con 0x7f5e5806b380 2023-10-06T05:27:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e5cfa5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e58159ff0 con 0x7f5e58155b60 2023-10-06T05:27:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e5cfa5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5806beb0 con 0x7f5e58155f30 2023-10-06T05:27:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e577fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e58155b60 0x7f5e580686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e577fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e58155b60 0x7f5e580686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35902/0 (socket says 172.21.15.29:35902) 2023-10-06T05:27:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.632+0000 7f5e577fe700 1 -- 172.21.15.29:0/2297320146 learned_addr learned my addr 172.21.15.29:0/2297320146 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:11.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e56ffd700 1 --2- 172.21.15.29:0/2297320146 >> v2:172.21.15.173:3300/0 conn(0x7f5e58155f30 0x7f5e5815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:11.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e577fe700 1 -- 172.21.15.29:0/2297320146 >> v2:172.21.15.173:3300/0 conn(0x7f5e58155f30 msgr2=0x7f5e5815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:11.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e577fe700 1 --2- 172.21.15.29:0/2297320146 >> v2:172.21.15.173:3300/0 conn(0x7f5e58155f30 0x7f5e5815a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:11.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e577fe700 1 -- 172.21.15.29:0/2297320146 >> v1:172.21.15.173:6789/0 conn(0x7f5e5806b380 legacy=0x7f5e5806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:11.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e577fe700 1 -- 172.21.15.29:0/2297320146 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58159930 con 0x7f5e58155b60 2023-10-06T05:27:11.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e56ffd700 1 --2- 172.21.15.29:0/2297320146 >> v2:172.21.15.173:3300/0 conn(0x7f5e58155f30 0x7f5e5815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:11.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e577fe700 1 --2- 172.21.15.29:0/2297320146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 0x7f5e580686a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5e5806c110 tx=0x7f5e50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b1f0a51b94acc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e567fc700 1 -- 172.21.15.29:0/2297320146 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5000b8f0 con 0x7f5e58155b60 2023-10-06T05:27:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e567fc700 1 -- 172.21.15.29:0/2297320146 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5000ba50 con 0x7f5e58155b60 2023-10-06T05:27:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e567fc700 1 -- 172.21.15.29:0/2297320146 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5000bdf0 con 0x7f5e58155b60 2023-10-06T05:27:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/2297320146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 msgr2=0x7f5e580686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e5cfa5700 1 --2- 172.21.15.29:0/2297320146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 0x7f5e580686a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5e5806c110 tx=0x7f5e50009250 comp rx=0 tx=0).stop 2023-10-06T05:27:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/2297320146 shutdown_connections 2023-10-06T05:27:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e5cfa5700 1 --2- 172.21.15.29:0/2297320146 >> v2:172.21.15.173:3300/0 conn(0x7f5e58155f30 0x7f5e5815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e5cfa5700 1 --2- 172.21.15.29:0/2297320146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 0x7f5e580686a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/2297320146 >> 172.21.15.29:0/2297320146 conn(0x7f5e580c9830 msgr2=0x7f5e5806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/2297320146 shutdown_connections 2023-10-06T05:27:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.636+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/2297320146 wait complete. 2023-10-06T05:27:11.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e5cfa5700 1 Processor -- start 2023-10-06T05:27:11.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e5cfa5700 1 -- start start 2023-10-06T05:27:11.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e5cfa5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e5806b380 0x7f5e58147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:11.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e5cfa5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 0x7f5e58156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:11.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e5cfa5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e58155f30 0x7f5e581582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:11.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e5cfa5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e581698f0 con 0x7f5e58155b60 2023-10-06T05:27:11.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e5cfa5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e58169bd0 con 0x7f5e58155f30 2023-10-06T05:27:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e5cfa5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e58169eb0 con 0x7f5e5806b380 2023-10-06T05:27:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 0x7f5e58156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 0x7f5e58156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35906/0 (socket says 172.21.15.29:35906) 2023-10-06T05:27:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e56ffd700 1 -- 172.21.15.29:0/1700403830 learned_addr learned my addr 172.21.15.29:0/1700403830 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e577fe700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e5806b380 0x7f5e58147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e57fff700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e58155f30 0x7f5e581582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:11.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e56ffd700 1 -- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e5806b380 msgr2=0x7f5e58147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:11.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e56ffd700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e5806b380 0x7f5e58147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:11.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e56ffd700 1 -- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e58155f30 msgr2=0x7f5e581582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:11.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e56ffd700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e58155f30 0x7f5e581582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:11.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e56ffd700 1 -- 172.21.15.29:0/1700403830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e500094f0 con 0x7f5e58155b60 2023-10-06T05:27:11.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e56ffd700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 0x7f5e58156380 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000d890 tx=0x7f5e40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:11.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e4f7fe700 1 -- 172.21.15.29:0/1700403830 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e400125f0 con 0x7f5e58155b60 2023-10-06T05:27:11.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e4f7fe700 1 -- 172.21.15.29:0/1700403830 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40012750 con 0x7f5e58155b60 2023-10-06T05:27:11.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5816a190 con 0x7f5e58155b60 2023-10-06T05:27:11.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.640+0000 7f5e4f7fe700 1 -- 172.21.15.29:0/1700403830 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40012b10 con 0x7f5e58155b60 2023-10-06T05:27:11.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.644+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e581568c0 con 0x7f5e58155b60 2023-10-06T05:27:11.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.644+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5804be00 con 0x7f5e58155b60 2023-10-06T05:27:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.644+0000 7f5e4f7fe700 1 -- 172.21.15.29:0/1700403830 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5e40014430 con 0x7f5e58155b60 2023-10-06T05:27:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.644+0000 7f5e4f7fe700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e3c060550 0x7f5e3c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.644+0000 7f5e4f7fe700 1 -- 172.21.15.29:0/1700403830 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5e4007cc80 con 0x7f5e58155b60 2023-10-06T05:27:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.644+0000 7f5e577fe700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e3c060550 0x7f5e3c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.648+0000 7f5e577fe700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e3c060550 0x7f5e3c062a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e5806c110 tx=0x7f5e50017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:11.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.652+0000 7f5e4f7fe700 1 -- 172.21.15.29:0/1700403830 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e40050ba0 con 0x7f5e58155b60 2023-10-06T05:27:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:11.852+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5e58062f90 con 0x7f5e58155b60 2023-10-06T05:27:12.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.496+0000 7f5e4f7fe700 1 -- 172.21.15.29:0/1700403830 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5e40050730 con 0x7f5e58155b60 2023-10-06T05:27:12.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e3c060550 msgr2=0x7f5e3c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e3c060550 0x7f5e3c062a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e5806c110 tx=0x7f5e50017000 comp rx=0 tx=0).stop 2023-10-06T05:27:12.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 msgr2=0x7f5e58156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 0x7f5e58156380 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000d890 tx=0x7f5e40008040 comp rx=0 tx=0).stop 2023-10-06T05:27:12.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 shutdown_connections 2023-10-06T05:27:12.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e3c060550 0x7f5e3c062a00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e58155f30 0x7f5e581582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58155b60 0x7f5e58156380 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 --2- 172.21.15.29:0/1700403830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e5806b380 0x7f5e58147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 >> 172.21.15.29:0/1700403830 conn(0x7f5e580c9830 msgr2=0x7f5e580b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:12.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 shutdown_connections 2023-10-06T05:27:12.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.500+0000 7f5e5cfa5700 1 -- 172.21.15.29:0/1700403830 wait complete. 2023-10-06T05:27:12.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:27:12.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fcef49e5700 1 Processor -- start 2023-10-06T05:27:12.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fcef49e5700 1 -- start start 2023-10-06T05:27:12.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fcef49e5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcef00ce740 0x7fcef00ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fcef49e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00cc830 0x7fcef0158a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fcef49e5700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef00cb390 con 0x7fcef00d0850 2023-10-06T05:27:12.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fcef49e5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef00cad80 con 0x7fcef00ce740 2023-10-06T05:27:12.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fcef49e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef006b900 con 0x7fcef00cc830 2023-10-06T05:27:12.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceee59c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcef00ce740 0x7fcef00ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceee59c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcef00ce740 0x7fcef00ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:35964/0 (socket says 172.21.15.29:35964) 2023-10-06T05:27:12.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceee59c700 1 -- 172.21.15.29:0/4253479592 learned_addr learned my addr 172.21.15.29:0/4253479592 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:12.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceedd9b700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fcef00d0850 0x7fcef006b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:59238/0 (socket says 172.21.15.29:59238) 2023-10-06T05:27:12.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceeed9d700 1 --2- 172.21.15.29:0/4253479592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00cc830 0x7fcef0158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceee59c700 1 -- 172.21.15.29:0/4253479592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00cc830 msgr2=0x7fcef0158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:12.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceee59c700 1 --2- 172.21.15.29:0/4253479592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00cc830 0x7fcef0158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceee59c700 1 -- 172.21.15.29:0/4253479592 >> v1:172.21.15.173:6789/0 conn(0x7fcef00d0850 legacy=0x7fcef006b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceee59c700 1 -- 172.21.15.29:0/4253479592 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef00cb020 con 0x7fcef00ce740 2023-10-06T05:27:12.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceed59a700 1 -- 172.21.15.29:0/4253479592 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183750434 0 0) 0x7fcef00cb390 con 0x7fcef00d0850 2023-10-06T05:27:12.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceee59c700 1 --2- 172.21.15.29:0/4253479592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef00ce740 0x7fcef00ceb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcee00099b0 tx=0x7fcee0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b0299b9a36afb20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:12.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.624+0000 7fceed59a700 1 -- 172.21.15.29:0/4253479592 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0009ea0 con 0x7fcef00ce740 2023-10-06T05:27:12.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fceed59a700 1 -- 172.21.15.29:0/4253479592 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee000b860 con 0x7fcef00ce740 2023-10-06T05:27:12.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fceed59a700 1 -- 172.21.15.29:0/4253479592 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee000bc00 con 0x7fcef00ce740 2023-10-06T05:27:12.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 -- 172.21.15.29:0/4253479592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef00ce740 msgr2=0x7fcef00ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 --2- 172.21.15.29:0/4253479592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef00ce740 0x7fcef00ceb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcee00099b0 tx=0x7fcee0009250 comp rx=0 tx=0).stop 2023-10-06T05:27:12.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 -- 172.21.15.29:0/4253479592 shutdown_connections 2023-10-06T05:27:12.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 --2- 172.21.15.29:0/4253479592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00cc830 0x7fcef0158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 --2- 172.21.15.29:0/4253479592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef00ce740 0x7fcef00ceb10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 -- 172.21.15.29:0/4253479592 >> 172.21.15.29:0/4253479592 conn(0x7fcef00670a0 msgr2=0x7fcef0067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:12.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 -- 172.21.15.29:0/4253479592 shutdown_connections 2023-10-06T05:27:12.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 -- 172.21.15.29:0/4253479592 wait complete. 2023-10-06T05:27:12.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 Processor -- start 2023-10-06T05:27:12.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 -- start start 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.628+0000 7fcef49e5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef00cc830 0x7fcef016c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcef49e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00ce740 0x7fcef01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcef49e5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcef00d0850 0x7fcef00c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcef49e5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef0158800 con 0x7fcef00d0850 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcef49e5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef016d210 con 0x7fcef00cc830 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcef49e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef016d4f0 con 0x7fcef00ce740 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceeed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcef00d0850 0x7fcef00c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceeed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcef00d0850 0x7fcef00c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35920/0 (socket says 172.21.15.29:35920) 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceedd9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00ce740 0x7fcef01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceeed9d700 1 -- 172.21.15.29:0/1161224277 learned_addr learned my addr 172.21.15.29:0/1161224277 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:12.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceee59c700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef00cc830 0x7fcef016c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceeed9d700 1 -- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00ce740 msgr2=0x7fcef01562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceeed9d700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00ce740 0x7fcef01562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceeed9d700 1 -- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef00cc830 msgr2=0x7fcef016c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceeed9d700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef00cc830 0x7fcef016c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceeed9d700 1 -- 172.21.15.29:0/1161224277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00094f0 con 0x7fcef00d0850 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fceeed9d700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcef00d0850 0x7fcef00c9130 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009e90 tx=0x7fcee800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcee67fc700 1 -- 172.21.15.29:0/1161224277 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee800cb70 con 0x7fcef00d0850 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcee67fc700 1 -- 172.21.15.29:0/1161224277 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee800f040 con 0x7fcef00d0850 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef016d7d0 con 0x7fcef00d0850 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcee67fc700 1 -- 172.21.15.29:0/1161224277 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8014480 con 0x7fcef00d0850 2023-10-06T05:27:12.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef016cf20 con 0x7fcef00d0850 2023-10-06T05:27:12.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.632+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef0158c70 con 0x7fcef00d0850 2023-10-06T05:27:12.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.636+0000 7fcee67fc700 1 -- 172.21.15.29:0/1161224277 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcee8014830 con 0x7fcef00d0850 2023-10-06T05:27:12.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.636+0000 7fcee67fc700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fced4060550 0x7fced4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.636+0000 7fcee67fc700 1 -- 172.21.15.29:0/1161224277 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcee807d660 con 0x7fcef00d0850 2023-10-06T05:27:12.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.636+0000 7fceee59c700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fced4060550 0x7fced4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.636+0000 7fceee59c700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fced4060550 0x7fced4062a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcee00099b0 tx=0x7fcee0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:12.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.644+0000 7fcee67fc700 1 -- 172.21.15.29:0/1161224277 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcee804da50 con 0x7fcef00d0850 2023-10-06T05:27:12.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.840+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcef004be00 con 0x7fcef00d0850 2023-10-06T05:27:12.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.840+0000 7fcee67fc700 1 -- 172.21.15.29:0/1161224277 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fcee8051070 con 0x7fcef00d0850 2023-10-06T05:27:12.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:12.847 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3538089078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3538089078},{"type":"v1","addr":"172.21.15.173:6835","nonce":3538089078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3499370562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3499370562},{"type":"v1","addr":"172.21.15.173:6837","nonce":3499370562}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3369448997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3369448997},{"type":"v1","addr":"172.21.15.29:6833","nonce":3369448997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:27:08.808178+0000","modified":"2023-10-06T05:27:12.494062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5460":{"gid":5460,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2111647358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2111647358},{"type":"v1","addr":"172.21.15.29:6835","nonce":2111647358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T05:27:12.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fced4060550 msgr2=0x7fced4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fced4060550 0x7fced4062a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcee00099b0 tx=0x7fcee0017000 comp rx=0 tx=0).stop 2023-10-06T05:27:12.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcef00d0850 msgr2=0x7fcef00c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcef00d0850 0x7fcef00c9130 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009e90 tx=0x7fcee800b040 comp rx=0 tx=0).stop 2023-10-06T05:27:12.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 shutdown_connections 2023-10-06T05:27:12.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcef00d0850 0x7fcef00c9130 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcef00ce740 0x7fcef01562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fced4060550 0x7fced4062a00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 --2- 172.21.15.29:0/1161224277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcef00cc830 0x7fcef016c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 >> 172.21.15.29:0/1161224277 conn(0x7fcef00670a0 msgr2=0x7fcef00b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:12.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 shutdown_connections 2023-10-06T05:27:12.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.844+0000 7fcef49e5700 1 -- 172.21.15.29:0/1161224277 wait complete. 2023-10-06T05:27:12.850 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 21 2023-10-06T05:27:12.861 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:27:12.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652759e700 1 Processor -- start 2023-10-06T05:27:12.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652759e700 1 -- start start 2023-10-06T05:27:12.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6528158ac0 0x7f6528158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65280cc8d0 con 0x7f652815d700 2023-10-06T05:27:12.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65280c8950 con 0x7f65280c9710 2023-10-06T05:27:12.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65280c8c30 con 0x7f6528158ac0 2023-10-06T05:27:12.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f6525d9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f652815d700 0x7f65280cc1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39552/0 (socket says 172.21.15.29:39552) 2023-10-06T05:27:12.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f6525d9b700 1 -- 172.21.15.29:0/4108672970 learned_addr learned my addr 172.21.15.29:0/4108672970 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:12.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652659c700 1 --2- 172.21.15.29:0/4108672970 >> v2:172.21.15.173:3300/0 conn(0x7f6528158ac0 0x7f6528158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146875143 0 0) 0x7f65280cc8d0 con 0x7f652815d700 2023-10-06T05:27:12.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6514003570 con 0x7f652815d700 2023-10-06T05:27:12.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133769590 0 0) 0x7f6514003570 con 0x7f652815d700 2023-10-06T05:27:12.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 >> v2:172.21.15.173:3300/0 conn(0x7f6528158ac0 msgr2=0x7f6528158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:12.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 --2- 172.21.15.29:0/4108672970 >> v2:172.21.15.173:3300/0 conn(0x7f6528158ac0 0x7f6528158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 >> v1:172.21.15.173:6789/0 conn(0x7f65280c9710 legacy=0x7f652815c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65280c8f10 con 0x7f652815d700 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f65100017f0 con 0x7f652815d700 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 >> v1:172.21.15.29:6789/0 conn(0x7f652815d700 legacy=0x7f65280cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6514003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6514004810 0x7f6514004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65140051c0 0x7f651400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65280c8c30 con 0x7f6514003a60 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651400c160 con 0x7f65140051c0 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.964+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651400c320 con 0x7f6514004810 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652659c700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6514003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f6525d9b700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6514004810 0x7f6514004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f6526d9d700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65140051c0 0x7f651400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652659c700 1 -- 172.21.15.29:0/4108672970 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6514004810 msgr2=0x7f6514004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:12.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652659c700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6514004810 0x7f6514004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652659c700 1 -- 172.21.15.29:0/4108672970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65140051c0 msgr2=0x7f651400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:12.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652659c700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65140051c0 0x7f651400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f6526d9d700 1 -- 172.21.15.29:0/4108672970 reap_dead start 2023-10-06T05:27:12.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652659c700 1 -- 172.21.15.29:0/4108672970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6514003570 con 0x7f6514003a60 2023-10-06T05:27:12.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652659c700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6514003e70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6518009c00 tx=0x7f65180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115641f926b1d069 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:12.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800e710 con 0x7f6514003a60 2023-10-06T05:27:12.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651800e870 con 0x7f6514003a60 2023-10-06T05:27:12.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652559a700 1 -- 172.21.15.29:0/4108672970 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800ec30 con 0x7f6514003a60 2023-10-06T05:27:12.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652759e700 1 -- 172.21.15.29:0/4108672970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 msgr2=0x7f6514003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652759e700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6514003e70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6518009c00 tx=0x7f65180091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652759e700 1 -- 172.21.15.29:0/4108672970 shutdown_connections 2023-10-06T05:27:12.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652759e700 1 --2- 172.21.15.29:0/4108672970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6514003e70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652759e700 1 -- 172.21.15.29:0/4108672970 >> 172.21.15.29:0/4108672970 conn(0x7f6528069d80 msgr2=0x7f652806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:12.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652759e700 1 -- 172.21.15.29:0/4108672970 shutdown_connections 2023-10-06T05:27:12.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652759e700 1 -- 172.21.15.29:0/4108672970 wait complete. 2023-10-06T05:27:12.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652759e700 1 Processor -- start 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.968+0000 7f652759e700 1 -- start start 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6528158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f652815c9f0 0x7f65280c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65280c6ac0 0x7f6528153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65281593d0 con 0x7f6514003a60 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652815b950 con 0x7f652815c9f0 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652815bc30 con 0x7f65280c6ac0 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6528158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6528158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35952/0 (socket says 172.21.15.29:35952) 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652659c700 1 -- 172.21.15.29:0/2723981647 learned_addr learned my addr 172.21.15.29:0/2723981647 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f6525d9b700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f652815c9f0 0x7f65280c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f6526d9d700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65280c6ac0 0x7f6528153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652659c700 1 -- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65280c6ac0 msgr2=0x7f6528153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652659c700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65280c6ac0 0x7f6528153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652659c700 1 -- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f652815c9f0 msgr2=0x7f65280c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652659c700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f652815c9f0 0x7f65280c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652659c700 1 -- 172.21.15.29:0/2723981647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652815bf10 con 0x7f6514003a60 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f6525d9b700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f652815c9f0 0x7f65280c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f6526d9d700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65280c6ac0 0x7f6528153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652659c700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6528158e90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f651400c130 tx=0x7f651801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f651e7fc700 1 -- 172.21.15.29:0/2723981647 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518022070 con 0x7f6514003a60 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f651e7fc700 1 -- 172.21.15.29:0/2723981647 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651800e9e0 con 0x7f6514003a60 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652815c1f0 con 0x7f6514003a60 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f651e7fc700 1 -- 172.21.15.29:0/2723981647 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651801c450 con 0x7f6514003a60 2023-10-06T05:27:12.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65280b0090 con 0x7f6514003a60 2023-10-06T05:27:12.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.972+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65280c86a0 con 0x7f6514003a60 2023-10-06T05:27:12.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.976+0000 7f651e7fc700 1 -- 172.21.15.29:0/2723981647 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f651801c840 con 0x7f6514003a60 2023-10-06T05:27:12.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.976+0000 7f651e7fc700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6508060580 0x7f6508062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:12.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.976+0000 7f651e7fc700 1 -- 172.21.15.29:0/2723981647 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f651807e000 con 0x7f6514003a60 2023-10-06T05:27:12.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.976+0000 7f6525d9b700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6508060580 0x7f6508062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:12.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.976+0000 7f6525d9b700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6508060580 0x7f6508062a30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6510002060 tx=0x7f6510006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:12.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:12.980+0000 7f651e7fc700 1 -- 172.21.15.29:0/2723981647 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f65280c86a0 con 0x7f6514003a60 2023-10-06T05:27:13.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.144+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65280c86a0 con 0x7f6514003a60 2023-10-06T05:27:13.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.144+0000 7f651e7fc700 1 -- 172.21.15.29:0/2723981647 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f65280c86a0 con 0x7f6514003a60 2023-10-06T05:27:13.152 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:13.152 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":48,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:27:10.439943+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:27:06.728148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T05:27:07.815762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:27:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6508060580 msgr2=0x7f6508062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6508060580 0x7f6508062a30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6510002060 tx=0x7f6510006040 comp rx=0 tx=0).stop 2023-10-06T05:27:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 msgr2=0x7f6528158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6528158e90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f651400c130 tx=0x7f651801a000 comp rx=0 tx=0).stop 2023-10-06T05:27:13.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 shutdown_connections 2023-10-06T05:27:13.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65280c6ac0 0x7f6528153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6508060580 0x7f6508062a30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f652815c9f0 0x7f65280c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 --2- 172.21.15.29:0/2723981647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6514003a60 0x7f6528158e90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 >> 172.21.15.29:0/2723981647 conn(0x7f6528069d80 msgr2=0x7f6528157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 shutdown_connections 2023-10-06T05:27:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.148+0000 7f652759e700 1 -- 172.21.15.29:0/2723981647 wait complete. 2023-10-06T05:27:13.165 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T05:27:13.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:27:13.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.268+0000 7f9ed6f72700 1 Processor -- start 2023-10-06T05:27:13.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.268+0000 7f9ed6f72700 1 -- start start 2023-10-06T05:27:13.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ed006b380 0x7f9ed006ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9ed0159750 0x7f9ed00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed006aef0 con 0x7f9ed006c8f0 2023-10-06T05:27:13.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00c8080 con 0x7f9ed006b380 2023-10-06T05:27:13.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed006a2e0 con 0x7f9ed0159750 2023-10-06T05:27:13.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed576f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ed006b380 0x7f9ed006ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed576f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ed006b380 0x7f9ed006ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35960/0 (socket says 172.21.15.29:35960) 2023-10-06T05:27:13.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed576f700 1 -- 172.21.15.29:0/818889681 learned_addr learned my addr 172.21.15.29:0/818889681 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:13.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed576f700 1 -- 172.21.15.29:0/818889681 >> v2:172.21.15.173:3300/0 conn(0x7f9ed0159750 msgr2=0x7f9ed00c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:13.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6771700 1 --2- 172.21.15.29:0/818889681 >> v2:172.21.15.173:3300/0 conn(0x7f9ed0159750 0x7f9ed00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed576f700 1 --2- 172.21.15.29:0/818889681 >> v2:172.21.15.173:3300/0 conn(0x7f9ed0159750 0x7f9ed00c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed576f700 1 -- 172.21.15.29:0/818889681 >> v1:172.21.15.29:6789/0 conn(0x7f9ed006c8f0 legacy=0x7f9ed00c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed576f700 1 -- 172.21.15.29:0/818889681 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed006a5c0 con 0x7f9ed006b380 2023-10-06T05:27:13.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6771700 1 --2- 172.21.15.29:0/818889681 >> v2:172.21.15.173:3300/0 conn(0x7f9ed0159750 0x7f9ed00c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:13.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed576f700 1 --2- 172.21.15.29:0/818889681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 0x7f9ed006ccc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9ed006e530 tx=0x7f9ec4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72b7498cf3d1a5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:13.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed4f6e700 1 -- 172.21.15.29:0/818889681 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400b860 con 0x7f9ed006b380 2023-10-06T05:27:13.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed4f6e700 1 -- 172.21.15.29:0/818889681 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec400b9c0 con 0x7f9ed006b380 2023-10-06T05:27:13.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed4f6e700 1 -- 172.21.15.29:0/818889681 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400bd60 con 0x7f9ed006b380 2023-10-06T05:27:13.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 -- 172.21.15.29:0/818889681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 msgr2=0x7f9ed006ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 --2- 172.21.15.29:0/818889681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 0x7f9ed006ccc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9ed006e530 tx=0x7f9ec4009250 comp rx=0 tx=0).stop 2023-10-06T05:27:13.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 -- 172.21.15.29:0/818889681 shutdown_connections 2023-10-06T05:27:13.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 --2- 172.21.15.29:0/818889681 >> v2:172.21.15.173:3300/0 conn(0x7f9ed0159750 0x7f9ed00c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 --2- 172.21.15.29:0/818889681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 0x7f9ed006ccc0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 -- 172.21.15.29:0/818889681 >> 172.21.15.29:0/818889681 conn(0x7f9ed00670a0 msgr2=0x7f9ed00674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:13.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 -- 172.21.15.29:0/818889681 shutdown_connections 2023-10-06T05:27:13.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.272+0000 7f9ed6f72700 1 -- 172.21.15.29:0/818889681 wait complete. 2023-10-06T05:27:13.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6f72700 1 Processor -- start 2023-10-06T05:27:13.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6f72700 1 -- start start 2023-10-06T05:27:13.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6f72700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 0x7f9ed00c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6f72700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ed006c8f0 0x7f9ed00c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6f72700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ed0159750 0x7f9ed00b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6f72700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0155eb0 con 0x7f9ed006b380 2023-10-06T05:27:13.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6f72700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01552e0 con 0x7f9ed0159750 2023-10-06T05:27:13.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6f72700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0155580 con 0x7f9ed006c8f0 2023-10-06T05:27:13.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed5f70700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 0x7f9ed00c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed5f70700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 0x7f9ed00c2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35970/0 (socket says 172.21.15.29:35970) 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed5f70700 1 -- 172.21.15.29:0/2024077288 learned_addr learned my addr 172.21.15.29:0/2024077288 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed576f700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ed006c8f0 0x7f9ed00c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6771700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ed0159750 0x7f9ed00b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed5f70700 1 -- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ed006c8f0 msgr2=0x7f9ed00c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed5f70700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ed006c8f0 0x7f9ed00c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed5f70700 1 -- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ed0159750 msgr2=0x7f9ed00b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed5f70700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ed0159750 0x7f9ed00b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed5f70700 1 -- 172.21.15.29:0/2024077288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec40094f0 con 0x7f9ed006b380 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed6771700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ed0159750 0x7f9ed00b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.276+0000 7f9ed576f700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ed006c8f0 0x7f9ed00c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:13.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ed5f70700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 0x7f9ed00c2980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00c590 tx=0x7f9ecc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:13.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ec1ffb700 1 -- 172.21.15.29:0/2024077288 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0106b0 con 0x7f9ed006b380 2023-10-06T05:27:13.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ec1ffb700 1 -- 172.21.15.29:0/2024077288 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc010810 con 0x7f9ed006b380 2023-10-06T05:27:13.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed0155860 con 0x7f9ed006b380 2023-10-06T05:27:13.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ec1ffb700 1 -- 172.21.15.29:0/2024077288 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0109c0 con 0x7f9ed006b380 2023-10-06T05:27:13.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed01579d0 con 0x7f9ed006b380 2023-10-06T05:27:13.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed004be00 con 0x7f9ed006b380 2023-10-06T05:27:13.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ec1ffb700 1 -- 172.21.15.29:0/2024077288 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9ecc011470 con 0x7f9ed006b380 2023-10-06T05:27:13.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ec1ffb700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9eb4060550 0x7f9eb4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ec1ffb700 1 -- 172.21.15.29:0/2024077288 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ecc015020 con 0x7f9ed006b380 2023-10-06T05:27:13.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.280+0000 7f9ed576f700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9eb4060550 0x7f9eb4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.284+0000 7f9ed576f700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9eb4060550 0x7f9eb4062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9ed006e530 tx=0x7f9ec4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:13.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.292+0000 7f9ec1ffb700 1 -- 172.21.15.29:0/2024077288 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ecc04ecf0 con 0x7f9ed006b380 2023-10-06T05:27:13.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.452+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ed0155ff0 con 0x7f9eb4060550 2023-10-06T05:27:13.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.468+0000 7f9ec1ffb700 1 -- 172.21.15.29:0/2024077288 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299362 (secure 0 0 0) 0x7f9ec400bc00 con 0x7f9eb4060550 2023-10-06T05:27:13.479 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:13.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9eb4060550 msgr2=0x7f9eb4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9eb4060550 0x7f9eb4062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9ed006e530 tx=0x7f9ec4017000 comp rx=0 tx=0).stop 2023-10-06T05:27:13.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 msgr2=0x7f9ed00c2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 0x7f9ed00c2980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00c590 tx=0x7f9ecc00c950 comp rx=0 tx=0).stop 2023-10-06T05:27:13.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 shutdown_connections 2023-10-06T05:27:13.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9eb4060550 0x7f9eb4062a00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ed0159750 0x7f9ed00b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ed006c8f0 0x7f9ed00c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 --2- 172.21.15.29:0/2024077288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ed006b380 0x7f9ed00c2980 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 >> 172.21.15.29:0/2024077288 conn(0x7f9ed00670a0 msgr2=0x7f9ed00ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:13.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 shutdown_connections 2023-10-06T05:27:13.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.476+0000 7f9ed6f72700 1 -- 172.21.15.29:0/2024077288 wait complete. 2023-10-06T05:27:13.483 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:27:13.496 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-06T05:27:12.680923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399940,"kb_used_data":5252,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752574780,"statfs":{"total":773094113280,"available":770636574720,"internally_reserved":0,"allocated":5378048,"data_stored":2912814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.254174"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433048+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:03.506626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.437547+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433913+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:02.725673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430566+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.437457+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:55.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436409+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.429891+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:02.364537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435004+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:26.359449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434420+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436398+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435687+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:40.288578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433408+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:58.325205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436825+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:07.241389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430234+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:09.791455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434448+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434076+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.437212+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:40.288578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430244+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:02.364537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430578+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:31.707373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.429958+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:20.653667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433854+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:26.359449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435068+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:13.240736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435973+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430197+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:57:56.122222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436058+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.764366+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:27:04.764366+0000","last_peered":"2023-10-06T05:27:04.764366+0000","last_clean":"2023-10-06T05:27:04.764366+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:27:04.764366+0000","last_undegraded":"2023-10-06T05:27:04.764366+0000","last_fullsized":"2023-10-06T05:27:04.764366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.761748+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:27:04.761748+0000","last_peered":"2023-10-06T05:27:04.761748+0000","last_clean":"2023-10-06T05:27:04.761748+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:27:04.761748+0000","last_undegraded":"2023-10-06T05:27:04.761748+0000","last_fullsized":"2023-10-06T05:27:04.761748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434909+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:46.413295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.764366+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:27:04.764366+0000","last_peered":"2023-10-06T05:27:04.764366+0000","last_clean":"2023-10-06T05:27:04.764366+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:27:04.764366+0000","last_undegraded":"2023-10-06T05:27:04.764366+0000","last_fullsized":"2023-10-06T05:27:04.764366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435101+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:02.725673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.805223+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:27:04.805223+0000","last_peered":"2023-10-06T05:27:04.805223+0000","last_clean":"2023-10-06T05:27:04.805223+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:27:04.805223+0000","last_undegraded":"2023-10-06T05:27:04.805223+0000","last_fullsized":"2023-10-06T05:27:04.805223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.429917+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:00.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.761748+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:27:04.761748+0000","last_peered":"2023-10-06T05:27:04.761748+0000","last_clean":"2023-10-06T05:27:04.761748+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:27:04.761748+0000","last_undegraded":"2023-10-06T05:27:04.761748+0000","last_fullsized":"2023-10-06T05:27:04.761748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436625+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:05.665253+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:27:05.665253+0000","last_peered":"2023-10-06T05:27:05.665253+0000","last_clean":"2023-10-06T05:27:05.665253+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:27:05.665253+0000","last_undegraded":"2023-10-06T05:27:05.665253+0000","last_fullsized":"2023-10-06T05:27:05.665253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.431460+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.764256+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:27:04.764256+0000","last_peered":"2023-10-06T05:27:04.764256+0000","last_clean":"2023-10-06T05:27:04.764256+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:27:04.764256+0000","last_undegraded":"2023-10-06T05:27:04.764256+0000","last_fullsized":"2023-10-06T05:27:04.764256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434344+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:05.665249+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:27:05.665249+0000","last_peered":"2023-10-06T05:27:05.665249+0000","last_clean":"2023-10-06T05:27:05.665249+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:27:05.665249+0000","last_undegraded":"2023-10-06T05:27:05.665249+0000","last_fullsized":"2023-10-06T05:27:05.665249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433431+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:05.666030+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:27:05.666030+0000","last_peered":"2023-10-06T05:27:05.666030+0000","last_clean":"2023-10-06T05:27:05.666030+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:27:05.666030+0000","last_undegraded":"2023-10-06T05:27:05.666030+0000","last_fullsized":"2023-10-06T05:27:05.666030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298372,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073468,"statfs":{"total":96636764160,"available":96331231232,"internally_reserved":0,"allocated":1110016,"data_stored":803029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.2749999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.94699999999999995}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.355}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.2989999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.107}]},{"osd":3,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.98099999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.87},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.042}]},{"osd":7,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.0760000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.871},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.04}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.745}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.48}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.2370000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.397},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.593}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":212661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0860000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.423},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.054}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.0049999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.3280000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.266}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.496},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.871}]},{"osd":2,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.3149999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.034}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.367}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.175}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2070000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301888,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069952,"statfs":{"total":96636764160,"available":96327630848,"internally_reserved":0,"allocated":516096,"data_stored":212661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.383},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.1080000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6020000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.006},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.714}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.786},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.518}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.845},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.887}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.1359999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.0009999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.111},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.2609999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.157}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302480,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069360,"statfs":{"total":96636764160,"available":96327024640,"internally_reserved":0,"allocated":1122304,"data_stored":809187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88}]},{"osd":2,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.173}]},{"osd":3,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.93400000000000005}]},{"osd":4,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0820000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.157},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.1419999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:27:13.503 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:27:13.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 Processor -- start 2023-10-06T05:27:13.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 -- start start 2023-10-06T05:27:13.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa390158ee0 0x7fa39015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3900c5a10 con 0x7fa39006a500 2023-10-06T05:27:13.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39006a990 con 0x7fa39006cdd0 2023-10-06T05:27:13.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39006ac70 con 0x7fa390158ee0 2023-10-06T05:27:13.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa394a40700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa390158ee0 0x7fa39015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa394a40700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa390158ee0 0x7fa39015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35976/0 (socket says 172.21.15.29:35976) 2023-10-06T05:27:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa394a40700 1 -- 172.21.15.29:0/1666438013 learned_addr learned my addr 172.21.15.29:0/1666438013 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa38ffff700 1 --1- 172.21.15.29:0/1666438013 >> v1:172.21.15.29:6789/0 conn(0x7fa39006a500 0x7fa39006c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39574/0 (socket says 172.21.15.29:39574) 2023-10-06T05:27:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa394a40700 1 -- 172.21.15.29:0/1666438013 >> v1:172.21.15.173:6789/0 conn(0x7fa39006cdd0 legacy=0x7fa3900cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa394a40700 1 -- 172.21.15.29:0/1666438013 >> v1:172.21.15.29:6789/0 conn(0x7fa39006a500 legacy=0x7fa39006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa394a40700 1 -- 172.21.15.29:0/1666438013 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39006af50 con 0x7fa390158ee0 2023-10-06T05:27:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa394a40700 1 --2- 172.21.15.29:0/1666438013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa390158ee0 0x7fa39015d630 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa388009f20 tx=0x7fa388009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1b49cab4a906e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa38f7fe700 1 -- 172.21.15.29:0/1666438013 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38800e070 con 0x7fa390158ee0 2023-10-06T05:27:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa38f7fe700 1 -- 172.21.15.29:0/1666438013 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38800ba40 con 0x7fa390158ee0 2023-10-06T05:27:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa38f7fe700 1 -- 172.21.15.29:0/1666438013 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880092e0 con 0x7fa390158ee0 2023-10-06T05:27:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 -- 172.21.15.29:0/1666438013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa390158ee0 msgr2=0x7fa39015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 --2- 172.21.15.29:0/1666438013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa390158ee0 0x7fa39015d630 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa388009f20 tx=0x7fa388009840 comp rx=0 tx=0).stop 2023-10-06T05:27:13.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 -- 172.21.15.29:0/1666438013 shutdown_connections 2023-10-06T05:27:13.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 --2- 172.21.15.29:0/1666438013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa390158ee0 0x7fa39015d630 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.604+0000 7fa396ca4700 1 -- 172.21.15.29:0/1666438013 >> 172.21.15.29:0/1666438013 conn(0x7fa390062b60 msgr2=0x7fa390062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:13.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.608+0000 7fa396ca4700 1 -- 172.21.15.29:0/1666438013 shutdown_connections 2023-10-06T05:27:13.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.608+0000 7fa396ca4700 1 -- 172.21.15.29:0/1666438013 wait complete. 2023-10-06T05:27:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.608+0000 7fa396ca4700 1 Processor -- start 2023-10-06T05:27:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.608+0000 7fa396ca4700 1 -- start start 2023-10-06T05:27:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa396ca4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa39006a500 0x7fa390156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa396ca4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa39006cdd0 0x7fa3900c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa396ca4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa390158ee0 0x7fa3900c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa396ca4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900c7620 con 0x7fa39006a500 2023-10-06T05:27:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa396ca4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900c94e0 con 0x7fa390158ee0 2023-10-06T05:27:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa396ca4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900c9e30 con 0x7fa39006cdd0 2023-10-06T05:27:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa394a40700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa39006a500 0x7fa390156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa394a40700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa39006a500 0x7fa390156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35982/0 (socket says 172.21.15.29:35982) 2023-10-06T05:27:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa394a40700 1 -- 172.21.15.29:0/3144130816 learned_addr learned my addr 172.21.15.29:0/3144130816 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa395241700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa390158ee0 0x7fa3900c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa38ffff700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa39006cdd0 0x7fa3900c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa394a40700 1 -- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa39006cdd0 msgr2=0x7fa3900c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa394a40700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa39006cdd0 0x7fa3900c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa394a40700 1 -- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa390158ee0 msgr2=0x7fa3900c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa394a40700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa390158ee0 0x7fa3900c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa394a40700 1 -- 172.21.15.29:0/3144130816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa388009ae0 con 0x7fa39006a500 2023-10-06T05:27:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa395241700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa390158ee0 0x7fa3900c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa38ffff700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa39006cdd0 0x7fa3900c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa394a40700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa39006a500 0x7fa390156ce0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa390069df0 tx=0x7fa388017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa38cff9700 1 -- 172.21.15.29:0/3144130816 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388012aa0 con 0x7fa39006a500 2023-10-06T05:27:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa38cff9700 1 -- 172.21.15.29:0/3144130816 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa388012c00 con 0x7fa39006a500 2023-10-06T05:27:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3900c7060 con 0x7fa39006a500 2023-10-06T05:27:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa38cff9700 1 -- 172.21.15.29:0/3144130816 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38801e430 con 0x7fa39006a500 2023-10-06T05:27:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3900c9170 con 0x7fa39006a500 2023-10-06T05:27:13.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa38cff9700 1 -- 172.21.15.29:0/3144130816 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa38801e860 con 0x7fa39006a500 2023-10-06T05:27:13.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.612+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39004be00 con 0x7fa39006a500 2023-10-06T05:27:13.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.616+0000 7fa38cff9700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa370060550 0x7fa370062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:13.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.616+0000 7fa38cff9700 1 -- 172.21.15.29:0/3144130816 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa38807e3f0 con 0x7fa39006a500 2023-10-06T05:27:13.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.616+0000 7fa38ffff700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa370060550 0x7fa370062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:13.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.616+0000 7fa38ffff700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa370060550 0x7fa370062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa390156ad0 tx=0x7fa378009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:13.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.620+0000 7fa38cff9700 1 -- 172.21.15.29:0/3144130816 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa38804e860 con 0x7fa39006a500 2023-10-06T05:27:13.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.780+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3900c9620 con 0x7fa370060550 2023-10-06T05:27:13.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.796+0000 7fa38cff9700 1 -- 172.21.15.29:0/3144130816 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299362 (secure 0 0 0) 0x7fa3780070d0 con 0x7fa370060550 2023-10-06T05:27:13.806 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:13.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa370060550 msgr2=0x7fa370062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa370060550 0x7fa370062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa390156ad0 tx=0x7fa378009040 comp rx=0 tx=0).stop 2023-10-06T05:27:13.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa39006a500 msgr2=0x7fa390156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:13.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa39006a500 0x7fa390156ce0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa390069df0 tx=0x7fa388017000 comp rx=0 tx=0).stop 2023-10-06T05:27:13.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 shutdown_connections 2023-10-06T05:27:13.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa370060550 0x7fa370062a00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa390158ee0 0x7fa3900c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa39006cdd0 0x7fa3900c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 --2- 172.21.15.29:0/3144130816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa39006a500 0x7fa390156ce0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:13.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 >> 172.21.15.29:0/3144130816 conn(0x7fa390062b60 msgr2=0x7fa39006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:13.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 shutdown_connections 2023-10-06T05:27:13.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.800+0000 7fa396ca4700 1 -- 172.21.15.29:0/3144130816 wait complete. 2023-10-06T05:27:13.809 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:27:13.823 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-06T05:27:12.680923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399940,"kb_used_data":5252,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752574780,"statfs":{"total":773094113280,"available":770636574720,"internally_reserved":0,"allocated":5378048,"data_stored":2912814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.254174"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433048+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:03.506626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.437547+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433913+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:02.725673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430566+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.437457+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:55.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436409+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.429891+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:02.364537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435004+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:26.359449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434420+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436398+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435687+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:40.288578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433408+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:58.325205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436825+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:07.241389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430234+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:09.791455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434448+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434076+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.437212+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:40.288578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430244+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:02.364537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430578+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:31.707373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.429958+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:20.653667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433854+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:26.359449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435068+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:13.240736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435973+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430197+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:57:56.122222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436058+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.764366+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:27:04.764366+0000","last_peered":"2023-10-06T05:27:04.764366+0000","last_clean":"2023-10-06T05:27:04.764366+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:27:04.764366+0000","last_undegraded":"2023-10-06T05:27:04.764366+0000","last_fullsized":"2023-10-06T05:27:04.764366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.761748+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:27:04.761748+0000","last_peered":"2023-10-06T05:27:04.761748+0000","last_clean":"2023-10-06T05:27:04.761748+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:27:04.761748+0000","last_undegraded":"2023-10-06T05:27:04.761748+0000","last_fullsized":"2023-10-06T05:27:04.761748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434909+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:46.413295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.764366+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:27:04.764366+0000","last_peered":"2023-10-06T05:27:04.764366+0000","last_clean":"2023-10-06T05:27:04.764366+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:27:04.764366+0000","last_undegraded":"2023-10-06T05:27:04.764366+0000","last_fullsized":"2023-10-06T05:27:04.764366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435101+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:02.725673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.805223+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:27:04.805223+0000","last_peered":"2023-10-06T05:27:04.805223+0000","last_clean":"2023-10-06T05:27:04.805223+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:27:04.805223+0000","last_undegraded":"2023-10-06T05:27:04.805223+0000","last_fullsized":"2023-10-06T05:27:04.805223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.429917+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:00.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.761748+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:27:04.761748+0000","last_peered":"2023-10-06T05:27:04.761748+0000","last_clean":"2023-10-06T05:27:04.761748+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:27:04.761748+0000","last_undegraded":"2023-10-06T05:27:04.761748+0000","last_fullsized":"2023-10-06T05:27:04.761748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436625+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:05.665253+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:27:05.665253+0000","last_peered":"2023-10-06T05:27:05.665253+0000","last_clean":"2023-10-06T05:27:05.665253+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:27:05.665253+0000","last_undegraded":"2023-10-06T05:27:05.665253+0000","last_fullsized":"2023-10-06T05:27:05.665253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.431460+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.764256+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:27:04.764256+0000","last_peered":"2023-10-06T05:27:04.764256+0000","last_clean":"2023-10-06T05:27:04.764256+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:27:04.764256+0000","last_undegraded":"2023-10-06T05:27:04.764256+0000","last_fullsized":"2023-10-06T05:27:04.764256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434344+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:05.665249+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:27:05.665249+0000","last_peered":"2023-10-06T05:27:05.665249+0000","last_clean":"2023-10-06T05:27:05.665249+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:27:05.665249+0000","last_undegraded":"2023-10-06T05:27:05.665249+0000","last_fullsized":"2023-10-06T05:27:05.665249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433431+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:05.666030+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:27:05.666030+0000","last_peered":"2023-10-06T05:27:05.666030+0000","last_clean":"2023-10-06T05:27:05.666030+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:27:05.666030+0000","last_undegraded":"2023-10-06T05:27:05.666030+0000","last_fullsized":"2023-10-06T05:27:05.666030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298372,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073468,"statfs":{"total":96636764160,"available":96331231232,"internally_reserved":0,"allocated":1110016,"data_stored":803029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.2749999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.94699999999999995}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.355}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.2989999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.107}]},{"osd":3,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.98099999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.87},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.042}]},{"osd":7,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.0760000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.871},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.04}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.745}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.48}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.2370000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.397},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.593}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":212661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0860000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.423},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.054}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.0049999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.3280000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.266}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.496},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.871}]},{"osd":2,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.3149999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.034}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.367}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.175}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2070000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301888,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069952,"statfs":{"total":96636764160,"available":96327630848,"internally_reserved":0,"allocated":516096,"data_stored":212661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.383},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.1080000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6020000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.006},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.714}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.786},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.518}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.845},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.887}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.1359999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.0009999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.111},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.2609999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.157}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302480,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069360,"statfs":{"total":96636764160,"available":96327024640,"internally_reserved":0,"allocated":1122304,"data_stored":809187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88}]},{"osd":2,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.173}]},{"osd":3,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.93400000000000005}]},{"osd":4,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0820000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.157},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.1419999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:27:13.829 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:27:13.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 Processor -- start 2023-10-06T05:27:14.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 -- start start 2023-10-06T05:27:14.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f700c0b11b0 0x7f700c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:14.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700c06a970 con 0x7f700c0b0de0 2023-10-06T05:27:14.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700c06f120 con 0x7f700c0cc460 2023-10-06T05:27:14.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700c06f6e0 con 0x7f700c0b11b0 2023-10-06T05:27:14.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70027fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f700c0b11b0 0x7f700c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:14.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70027fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f700c0b11b0 0x7f700c06e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35986/0 (socket says 172.21.15.29:35986) 2023-10-06T05:27:14.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70027fc700 1 -- 172.21.15.29:0/1750833711 learned_addr learned my addr 172.21.15.29:0/1750833711 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:14.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f700affd700 1 --1- 172.21.15.29:0/1750833711 >> v1:172.21.15.29:6789/0 conn(0x7f700c0b0de0 0x7f700c0ca070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39586/0 (socket says 172.21.15.29:39586) 2023-10-06T05:27:14.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70027fc700 1 -- 172.21.15.29:0/1750833711 >> v1:172.21.15.173:6789/0 conn(0x7f700c0cc460 legacy=0x7f700c06ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:14.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70027fc700 1 -- 172.21.15.29:0/1750833711 >> v1:172.21.15.29:6789/0 conn(0x7f700c0b0de0 legacy=0x7f700c0ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:14.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f700a7fc700 1 -- 172.21.15.29:0/1750833711 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292174484 0 0) 0x7f700c06a970 con 0x7f700c0b0de0 2023-10-06T05:27:14.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70027fc700 1 -- 172.21.15.29:0/1750833711 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c06f400 con 0x7f700c0b11b0 2023-10-06T05:27:14.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70027fc700 1 --2- 172.21.15.29:0/1750833711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 0x7f700c06e9f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6ff40099b0 tx=0x7f6ff4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6088f8b67edef385 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:14.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f700a7fc700 1 -- 172.21.15.29:0/1750833711 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400b860 con 0x7f700c0b11b0 2023-10-06T05:27:14.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f700a7fc700 1 -- 172.21.15.29:0/1750833711 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff400b9c0 con 0x7f700c0b11b0 2023-10-06T05:27:14.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f700a7fc700 1 -- 172.21.15.29:0/1750833711 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400bd60 con 0x7f700c0b11b0 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 -- 172.21.15.29:0/1750833711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 msgr2=0x7f700c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 --2- 172.21.15.29:0/1750833711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 0x7f700c06e9f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6ff40099b0 tx=0x7f6ff4009250 comp rx=0 tx=0).stop 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 -- 172.21.15.29:0/1750833711 shutdown_connections 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 --2- 172.21.15.29:0/1750833711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 0x7f700c06e9f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 -- 172.21.15.29:0/1750833711 >> 172.21.15.29:0/1750833711 conn(0x7f700c067b70 msgr2=0x7f700c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 -- 172.21.15.29:0/1750833711 shutdown_connections 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.936+0000 7f70114e7700 1 -- 172.21.15.29:0/1750833711 wait complete. 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 Processor -- start 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 -- start start 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f700c0b0de0 0x7f700c1423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 0x7f700c0ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:14.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f700c0cc460 0x7f700c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:14.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c0a5600 con 0x7f700c0b11b0 2023-10-06T05:27:14.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c0a4560 con 0x7f700c0b0de0 2023-10-06T05:27:14.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c0a4840 con 0x7f700c0cc460 2023-10-06T05:27:14.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70027fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 0x7f700c0ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:14.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70027fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 0x7f700c0ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35994/0 (socket says 172.21.15.29:35994) 2023-10-06T05:27:14.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70027fc700 1 -- 172.21.15.29:0/107146342 learned_addr learned my addr 172.21.15.29:0/107146342 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:14.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f700affd700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f700c0b0de0 0x7f700c1423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:14.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f700b7fe700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f700c0cc460 0x7f700c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:14.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70027fc700 1 -- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f700c0cc460 msgr2=0x7f700c0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:14.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70027fc700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f700c0cc460 0x7f700c0aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:14.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70027fc700 1 -- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f700c0b0de0 msgr2=0x7f700c1423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:14.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70027fc700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f700c0b0de0 0x7f700c1423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:14.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70027fc700 1 -- 172.21.15.29:0/107146342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40094f0 con 0x7f700c0b11b0 2023-10-06T05:27:14.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f700b7fe700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f700c0cc460 0x7f700c0aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:14.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70027fc700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 0x7f700c0ae9a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4006f50 tx=0x7f6ff4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:14.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70037fe700 1 -- 172.21.15.29:0/107146342 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff401f070 con 0x7f700c0b11b0 2023-10-06T05:27:14.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70037fe700 1 -- 172.21.15.29:0/107146342 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff4011d10 con 0x7f700c0b11b0 2023-10-06T05:27:14.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700c0a4b20 con 0x7f700c0b11b0 2023-10-06T05:27:14.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70037fe700 1 -- 172.21.15.29:0/107146342 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4025670 con 0x7f700c0b11b0 2023-10-06T05:27:14.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.940+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c0a50e0 con 0x7f700c0b11b0 2023-10-06T05:27:14.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.944+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700c04be00 con 0x7f700c0b11b0 2023-10-06T05:27:14.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.944+0000 7f70037fe700 1 -- 172.21.15.29:0/107146342 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6ff4023070 con 0x7f700c0b11b0 2023-10-06T05:27:14.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.944+0000 7f70037fe700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6fec060550 0x7f6fec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:14.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.944+0000 7f70037fe700 1 -- 172.21.15.29:0/107146342 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ff407e050 con 0x7f700c0b11b0 2023-10-06T05:27:14.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.944+0000 7f700affd700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6fec060550 0x7f6fec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:14.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.948+0000 7f700affd700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6fec060550 0x7f6fec062a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc007fd0 tx=0x7f6ffc007db0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:14.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:13.948+0000 7f70037fe700 1 -- 172.21.15.29:0/107146342 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ff40adbe0 con 0x7f700c0b11b0 2023-10-06T05:27:14.226 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:27:14.080+0000 7f1371a92700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:27:14.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.104+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f700c06d070 con 0x7f6fec060550 2023-10-06T05:27:14.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.124+0000 7f70037fe700 1 -- 172.21.15.29:0/107146342 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299362 (secure 0 0 0) 0x7f700c06d070 con 0x7f6fec060550 2023-10-06T05:27:14.230 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:14.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6fec060550 msgr2=0x7f6fec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6fec060550 0x7f6fec062a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc007fd0 tx=0x7f6ffc007db0 comp rx=0 tx=0).stop 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 msgr2=0x7f700c0ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 0x7f700c0ae9a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4006f50 tx=0x7f6ff4017000 comp rx=0 tx=0).stop 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 shutdown_connections 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f700c0cc460 0x7f700c0aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c0b11b0 0x7f700c0ae9a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6fec060550 0x7f6fec062a00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 --2- 172.21.15.29:0/107146342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f700c0b0de0 0x7f700c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 >> 172.21.15.29:0/107146342 conn(0x7f700c067b70 msgr2=0x7f700c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 shutdown_connections 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:14.128+0000 7f70114e7700 1 -- 172.21.15.29:0/107146342 wait complete. 2023-10-06T05:27:14.233 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:27:14.234 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-06T05:27:12.680923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399940,"kb_used_data":5252,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752574780,"statfs":{"total":773094113280,"available":770636574720,"internally_reserved":0,"allocated":5378048,"data_stored":2912814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.254174"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433048+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:03.506626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.437547+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433913+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:02.725673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430566+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.437457+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:55.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436409+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.429891+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:02.364537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435004+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:26.359449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434420+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436398+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435687+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:40.288578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433408+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:58.325205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436825+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:07.241389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430234+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:09.791455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434448+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434076+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.437212+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:40.288578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430244+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:02.364537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430578+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:31.707373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.429958+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:20.653667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433854+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:26.359449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435068+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:13.240736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435973+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.430197+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:57:56.122222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436058+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.764366+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:27:04.764366+0000","last_peered":"2023-10-06T05:27:04.764366+0000","last_clean":"2023-10-06T05:27:04.764366+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:27:04.764366+0000","last_undegraded":"2023-10-06T05:27:04.764366+0000","last_fullsized":"2023-10-06T05:27:04.764366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.761748+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:27:04.761748+0000","last_peered":"2023-10-06T05:27:04.761748+0000","last_clean":"2023-10-06T05:27:04.761748+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:27:04.761748+0000","last_undegraded":"2023-10-06T05:27:04.761748+0000","last_fullsized":"2023-10-06T05:27:04.761748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434909+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:46.413295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.764366+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:27:04.764366+0000","last_peered":"2023-10-06T05:27:04.764366+0000","last_clean":"2023-10-06T05:27:04.764366+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:27:04.764366+0000","last_undegraded":"2023-10-06T05:27:04.764366+0000","last_fullsized":"2023-10-06T05:27:04.764366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.435101+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:18:02.725673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.805223+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:27:04.805223+0000","last_peered":"2023-10-06T05:27:04.805223+0000","last_clean":"2023-10-06T05:27:04.805223+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:27:04.805223+0000","last_undegraded":"2023-10-06T05:27:04.805223+0000","last_fullsized":"2023-10-06T05:27:04.805223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.429917+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:00.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.761748+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:27:04.761748+0000","last_peered":"2023-10-06T05:27:04.761748+0000","last_clean":"2023-10-06T05:27:04.761748+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:27:04.761748+0000","last_undegraded":"2023-10-06T05:27:04.761748+0000","last_fullsized":"2023-10-06T05:27:04.761748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.436625+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:05.665253+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:27:05.665253+0000","last_peered":"2023-10-06T05:27:05.665253+0000","last_clean":"2023-10-06T05:27:05.665253+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:27:05.665253+0000","last_undegraded":"2023-10-06T05:27:05.665253+0000","last_fullsized":"2023-10-06T05:27:05.665253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.431460+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:04.764256+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:27:04.764256+0000","last_peered":"2023-10-06T05:27:04.764256+0000","last_clean":"2023-10-06T05:27:04.764256+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:27:04.764256+0000","last_undegraded":"2023-10-06T05:27:04.764256+0000","last_fullsized":"2023-10-06T05:27:04.764256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.434344+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:05.665249+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:27:05.665249+0000","last_peered":"2023-10-06T05:27:05.665249+0000","last_clean":"2023-10-06T05:27:05.665249+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:27:05.665249+0000","last_undegraded":"2023-10-06T05:27:05.665249+0000","last_fullsized":"2023-10-06T05:27:05.665249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:27:08.424631+0000","last_change":"2023-10-06T05:27:08.424631+0000","last_active":"2023-10-06T05:27:08.424631+0000","last_peered":"2023-10-06T05:27:08.424631+0000","last_clean":"2023-10-06T05:27:08.424631+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:08.424631+0000","last_undegraded":"2023-10-06T05:27:08.424631+0000","last_fullsized":"2023-10-06T05:27:08.424631+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:27:07.412229+0000","last_change":"2023-10-06T05:27:07.433431+0000","last_active":"2023-10-06T05:27:07.412229+0000","last_peered":"2023-10-06T05:27:07.412229+0000","last_clean":"2023-10-06T05:27:07.412229+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:27:07.412229+0000","last_undegraded":"2023-10-06T05:27:07.412229+0000","last_fullsized":"2023-10-06T05:27:07.412229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T05:27:05.666030+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:27:05.666030+0000","last_peered":"2023-10-06T05:27:05.666030+0000","last_clean":"2023-10-06T05:27:05.666030+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:27:05.666030+0000","last_undegraded":"2023-10-06T05:27:05.666030+0000","last_fullsized":"2023-10-06T05:27:05.666030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298372,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073468,"statfs":{"total":96636764160,"available":96331231232,"internally_reserved":0,"allocated":1110016,"data_stored":803029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.2749999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.94699999999999995}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.355}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.2989999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.107}]},{"osd":3,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.98099999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.87},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.042}]},{"osd":7,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.0760000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.871},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.04}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.745}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.48}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.2370000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.397},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.593}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":212661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0860000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.423},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.054}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.0049999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.3280000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.266}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.496},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.871}]},{"osd":2,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.3149999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.034}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.367}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.175}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2070000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301888,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069952,"statfs":{"total":96636764160,"available":96327630848,"internally_reserved":0,"allocated":516096,"data_stored":212661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.383},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.1080000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.6020000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.006},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.714}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.786},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.518}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.845},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.887}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":218819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.1359999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.0009999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.111},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.2609999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.157}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302480,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069360,"statfs":{"total":96636764160,"available":96327024640,"internally_reserved":0,"allocated":1122304,"data_stored":809187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88}]},{"osd":2,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.173}]},{"osd":3,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.93400000000000005}]},{"osd":4,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0820000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.157},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.1419999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:27:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-10-06T05:27:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-10-06T05:27:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-10-06T05:27:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-10-06T05:27:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-10-06T05:27:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-10-06T05:27:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-10-06T05:27:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-10-06T05:27:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-10-06T05:27:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-10-06T05:27:15.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-10-06T05:27:15.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-10-06T05:27:15.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-10-06T05:27:15.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-10-06T05:27:15.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-10-06T05:27:15.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-10-06T05:27:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-10-06T05:27:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-10-06T05:27:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-10-06T05:27:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-10-06T05:27:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-10-06T05:27:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-10-06T05:27:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-10-06T05:27:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-10-06T05:27:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-10-06T05:27:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-10-06T05:27:16.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-10-06T05:27:16.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-10-06T05:27:16.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-10-06T05:27:16.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.433048+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:35:03.506626+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:27:16.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-10-06T05:27:16.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-10-06T05:27:16.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.437547+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T05:27:16.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-06T05:27:16.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-10-06T05:27:16.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.433913+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:18:02.725673+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T05:27:16.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-10-06T05:27:16.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-10-06T05:27:16.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.430566+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:27:16.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-06T05:27:16.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-10-06T05:27:16.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.437457+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:13:55.092140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:27:16.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-10-06T05:27:16.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-10-06T05:27:16.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.436409+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T05:27:16.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-10-06T05:27:16.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-10-06T05:27:16.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.429891+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:01:02.364537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:27:16.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-10-06T05:27:16.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-10-06T05:27:16.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.435004+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:37:26.359449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:27:16.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-06T05:27:16.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-10-06T05:27:16.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.434420+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:27:16.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-10-06T05:27:16.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-10-06T05:27:16.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.436398+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T05:27:16.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-10-06T05:27:16.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-10-06T05:27:16.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.435687+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:13:40.288578+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:27:16.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-06T05:27:16.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-10-06T05:27:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.433408+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:09:58.325205+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:27:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-10-06T05:27:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-10-06T05:27:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.436825+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:19:07.241389+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:27:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-10-06T05:27:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-10-06T05:27:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.430234+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:34:09.791455+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:27:16.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-10-06T05:27:16.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-10-06T05:27:16.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.434448+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:27:16.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-10-06T05:27:16.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-10-06T05:27:16.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.434076+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:27:16.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-10-06T05:27:16.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-10-06T05:27:16.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.437212+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:13:40.288578+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:27:16.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-10-06T05:27:16.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-10-06T05:27:16.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.430244+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:01:02.364537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T05:27:16.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-06T05:27:16.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-10-06T05:27:16.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.430578+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:55:31.707373+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:27:16.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-10-06T05:27:16.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-10-06T05:27:16.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.429958+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:59:20.653667+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:27:16.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-10-06T05:27:16.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-10-06T05:27:16.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.433854+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:37:26.359449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T05:27:16.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-06T05:27:16.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-10-06T05:27:16.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.435068+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:39:13.240736+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:27:16.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-10-06T05:27:16.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-10-06T05:27:16.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.435973+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:50:45.041006+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:27:16.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-10-06T05:27:16.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-10-06T05:27:16.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.430197+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:57:56.122222+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T05:27:16.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-06T05:27:16.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-10-06T05:27:16.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.436058+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:27:16.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-10-06T05:27:16.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-10-06T05:27:16.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.434909+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:46:46.413295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:27:16.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-10-06T05:27:16.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-10-06T05:27:16.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.435101+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:18:02.725673+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:27:16.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-10-06T05:27:16.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-10-06T05:27:16.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.429917+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:25:00.221925+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:27:16.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-10-06T05:27:16.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-10-06T05:27:16.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.436625+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T05:27:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-10-06T05:27:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-10-06T05:27:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.431460+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:17:15.234602+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:27:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-10-06T05:27:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-10-06T05:27:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.434344+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:27:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-10-06T05:27:16.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:27:08.424631+0000', 'last_change': '2023-10-06T05:27:08.424631+0000', 'last_active': '2023-10-06T05:27:08.424631+0000', 'last_peered': '2023-10-06T05:27:08.424631+0000', 'last_clean': '2023-10-06T05:27:08.424631+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:08.424631+0000', 'last_undegraded': '2023-10-06T05:27:08.424631+0000', 'last_fullsized': '2023-10-06T05:27:08.424631+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:08.424631+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:27:16.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-10-06T05:27:16.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:27:07.412229+0000', 'last_change': '2023-10-06T05:27:07.433431+0000', 'last_active': '2023-10-06T05:27:07.412229+0000', 'last_peered': '2023-10-06T05:27:07.412229+0000', 'last_clean': '2023-10-06T05:27:07.412229+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:27:07.412229+0000', 'last_undegraded': '2023-10-06T05:27:07.412229+0000', 'last_fullsized': '2023-10-06T05:27:07.412229+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'last_clean_scrub_stamp': '2023-10-06T05:27:07.412229+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:41:20.431041+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:27:16.366 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T05:27:16.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.468+0000 7fb715554700 1 Processor -- start 2023-10-06T05:27:16.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.468+0000 7fb715554700 1 -- start start 2023-10-06T05:27:16.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.468+0000 7fb715554700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb710152fc0 0x7fb7101601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.468+0000 7fb715554700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb710159cf0 con 0x7fb71006dcd0 2023-10-06T05:27:16.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.468+0000 7fb715554700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb710158e00 con 0x7fb71006d900 2023-10-06T05:27:16.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.468+0000 7fb715554700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7101590e0 con 0x7fb710152fc0 2023-10-06T05:27:16.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb70f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb71006dcd0 0x7fb7101528b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35704/0 (socket says 172.21.15.29:35704) 2023-10-06T05:27:16.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb70f7fe700 1 -- 172.21.15.29:0/1104200572 learned_addr learned my addr 172.21.15.29:0/1104200572 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:16.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb714d53700 1 --2- 172.21.15.29:0/1104200572 >> v2:172.21.15.29:3300/0 conn(0x7fb710152fc0 0x7fb7101601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb70effd700 1 -- 172.21.15.29:0/1104200572 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681662420 0 0) 0x7fb710159cf0 con 0x7fb71006dcd0 2023-10-06T05:27:16.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb70effd700 1 -- 172.21.15.29:0/1104200572 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f8003570 con 0x7fb71006dcd0 2023-10-06T05:27:16.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb714d53700 1 -- 172.21.15.29:0/1104200572 >> v1:172.21.15.173:6789/0 conn(0x7fb71006d900 legacy=0x7fb710156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb714d53700 1 -- 172.21.15.29:0/1104200572 >> v1:172.21.15.29:6789/0 conn(0x7fb71006dcd0 legacy=0x7fb7101528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb714d53700 1 -- 172.21.15.29:0/1104200572 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7101593c0 con 0x7fb710152fc0 2023-10-06T05:27:16.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb714d53700 1 --2- 172.21.15.29:0/1104200572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb710152fc0 0x7fb7101601a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb708009e60 tx=0x7fb708009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98900dd9d0f5a36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:16.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb70effd700 1 -- 172.21.15.29:0/1104200572 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800e070 con 0x7fb710152fc0 2023-10-06T05:27:16.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb70effd700 1 -- 172.21.15.29:0/1104200572 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70800bb60 con 0x7fb710152fc0 2023-10-06T05:27:16.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb70effd700 1 -- 172.21.15.29:0/1104200572 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708012430 con 0x7fb710152fc0 2023-10-06T05:27:16.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb715554700 1 -- 172.21.15.29:0/1104200572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb710152fc0 msgr2=0x7fb7101601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb715554700 1 --2- 172.21.15.29:0/1104200572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb710152fc0 0x7fb7101601a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb708009e60 tx=0x7fb708009780 comp rx=0 tx=0).stop 2023-10-06T05:27:16.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb715554700 1 -- 172.21.15.29:0/1104200572 shutdown_connections 2023-10-06T05:27:16.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb715554700 1 --2- 172.21.15.29:0/1104200572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb710152fc0 0x7fb7101601a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb715554700 1 -- 172.21.15.29:0/1104200572 >> 172.21.15.29:0/1104200572 conn(0x7fb71006aaf0 msgr2=0x7fb71006aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:16.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb715554700 1 -- 172.21.15.29:0/1104200572 shutdown_connections 2023-10-06T05:27:16.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.472+0000 7fb715554700 1 -- 172.21.15.29:0/1104200572 wait complete. 2023-10-06T05:27:16.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb715554700 1 Processor -- start 2023-10-06T05:27:16.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb715554700 1 -- start start 2023-10-06T05:27:16.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb715554700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb71006d900 0x7fb710143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb715554700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71006dcd0 0x7fb7100b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb715554700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb710152fc0 0x7fb710144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb715554700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71014a080 con 0x7fb71006dcd0 2023-10-06T05:27:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb715554700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71014a360 con 0x7fb71006d900 2023-10-06T05:27:16.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb715554700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71014a640 con 0x7fb710152fc0 2023-10-06T05:27:16.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71006dcd0 0x7fb7100b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71006dcd0 0x7fb7100b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55014/0 (socket says 172.21.15.29:55014) 2023-10-06T05:27:16.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb70f7fe700 1 -- 172.21.15.29:0/3521701724 learned_addr learned my addr 172.21.15.29:0/3521701724 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:16.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb70ffff700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb71006d900 0x7fb710143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb714d53700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb710152fc0 0x7fb710144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.476+0000 7fb70f7fe700 1 -- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb710152fc0 msgr2=0x7fb710144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb70f7fe700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb710152fc0 0x7fb710144b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb70f7fe700 1 -- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb71006d900 msgr2=0x7fb710143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb70f7fe700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb71006d900 0x7fb710143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb70f7fe700 1 -- 172.21.15.29:0/3521701724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708009a20 con 0x7fb71006dcd0 2023-10-06T05:27:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb70f7fe700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71006dcd0 0x7fb7100b01c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb70400c7c0 tx=0x7fb704007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb6f7fff700 1 -- 172.21.15.29:0/3521701724 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704005cd0 con 0x7fb71006dcd0 2023-10-06T05:27:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb6f7fff700 1 -- 172.21.15.29:0/3521701724 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb704005e30 con 0x7fb71006dcd0 2023-10-06T05:27:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71014a920 con 0x7fb71006dcd0 2023-10-06T05:27:16.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb6f7fff700 1 -- 172.21.15.29:0/3521701724 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704007320 con 0x7fb71006dcd0 2023-10-06T05:27:16.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7101441f0 con 0x7fb71006dcd0 2023-10-06T05:27:16.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71004be00 con 0x7fb71006dcd0 2023-10-06T05:27:16.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb6f7fff700 1 -- 172.21.15.29:0/3521701724 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb704007690 con 0x7fb71006dcd0 2023-10-06T05:27:16.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.480+0000 7fb6f7fff700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6fc060580 0x7fb6fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.484+0000 7fb6f7fff700 1 -- 172.21.15.29:0/3521701724 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb70407c400 con 0x7fb71006dcd0 2023-10-06T05:27:16.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.484+0000 7fb70ffff700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6fc060580 0x7fb6fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.484+0000 7fb70ffff700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6fc060580 0x7fb6fc062a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb700003a80 tx=0x7fb700007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:16.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.484+0000 7fb6f7fff700 1 -- 172.21.15.29:0/3521701724 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb70404c890 con 0x7fb71006dcd0 2023-10-06T05:27:16.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.704+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb7101596a0 con 0x7fb71006dcd0 2023-10-06T05:27:16.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb6f7fff700 1 -- 172.21.15.29:0/3521701724 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1436 (secure 0 0 0) 0x7fb7040175b0 con 0x7fb71006dcd0 2023-10-06T05:27:16.832 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:16.833 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":120,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1696569927,"num_in_osds":8,"osd_in_since":1696569918,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592674,"bytes_used":2462130176,"bytes_avail":770631983104,"bytes_total":773094113280,"write_bytes_sec":2132,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":21,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5460}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-06T05:26:58.676818+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T05:27:16.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6fc060580 msgr2=0x7fb6fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6fc060580 0x7fb6fc062a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb700003a80 tx=0x7fb700007ec0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71006dcd0 msgr2=0x7fb7100b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71006dcd0 0x7fb7100b01c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb70400c7c0 tx=0x7fb704007e00 comp rx=0 tx=0).stop 2023-10-06T05:27:16.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 shutdown_connections 2023-10-06T05:27:16.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb710152fc0 0x7fb710144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71006dcd0 0x7fb7100b01c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6fc060580 0x7fb6fc062a30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 --2- 172.21.15.29:0/3521701724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb71006d900 0x7fb710143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 >> 172.21.15.29:0/3521701724 conn(0x7fb71006aaf0 msgr2=0x7fb7100c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 shutdown_connections 2023-10-06T05:27:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.708+0000 7fb715554700 1 -- 172.21.15.29:0/3521701724 wait complete. 2023-10-06T05:27:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T05:27:16.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:27:16.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 Processor -- start 2023-10-06T05:27:16.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 -- start start 2023-10-06T05:27:16.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a300af990 0x7f4a3006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4a3006a9a0 0x7f4a3015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a301614c0 con 0x7f4a300af5c0 2023-10-06T05:27:16.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a30160f40 con 0x7f4a300af990 2023-10-06T05:27:16.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3006d420 con 0x7f4a3006a9a0 2023-10-06T05:27:16.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a26ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a300af990 0x7f4a3006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a26ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a300af990 0x7f4a3006a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55030/0 (socket says 172.21.15.29:55030) 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a2f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4a300af5c0 0x7f4a30161950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35708/0 (socket says 172.21.15.29:35708) 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a26ffd700 1 -- 172.21.15.29:0/4200896892 learned_addr learned my addr 172.21.15.29:0/4200896892 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a26ffd700 1 -- 172.21.15.29:0/4200896892 >> v2:172.21.15.173:3300/0 conn(0x7f4a3006a9a0 msgr2=0x7f4a3015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a2ffff700 1 --2- 172.21.15.29:0/4200896892 >> v2:172.21.15.173:3300/0 conn(0x7f4a3006a9a0 0x7f4a3015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a2effd700 1 -- 172.21.15.29:0/4200896892 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054701675 0 0) 0x7f4a301614c0 con 0x7f4a300af5c0 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a26ffd700 1 --2- 172.21.15.29:0/4200896892 >> v2:172.21.15.173:3300/0 conn(0x7f4a3006a9a0 0x7f4a3015cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a26ffd700 1 -- 172.21.15.29:0/4200896892 >> v1:172.21.15.29:6789/0 conn(0x7f4a300af5c0 legacy=0x7f4a30161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a26ffd700 1 -- 172.21.15.29:0/4200896892 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3006af20 con 0x7f4a300af990 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a2ffff700 1 --2- 172.21.15.29:0/4200896892 >> v2:172.21.15.173:3300/0 conn(0x7f4a3006a9a0 0x7f4a3015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a26ffd700 1 --2- 172.21.15.29:0/4200896892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af990 0x7f4a3006a460 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4a30161430 tx=0x7f4a18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b8da8f334a6c38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:16.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a2effd700 1 -- 172.21.15.29:0/4200896892 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800b860 con 0x7f4a300af990 2023-10-06T05:27:16.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a2effd700 1 -- 172.21.15.29:0/4200896892 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1800b9c0 con 0x7f4a300af990 2023-10-06T05:27:16.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a2effd700 1 -- 172.21.15.29:0/4200896892 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800bd60 con 0x7f4a300af990 2023-10-06T05:27:16.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 -- 172.21.15.29:0/4200896892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af990 msgr2=0x7f4a3006a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 --2- 172.21.15.29:0/4200896892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af990 0x7f4a3006a460 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4a30161430 tx=0x7f4a18009250 comp rx=0 tx=0).stop 2023-10-06T05:27:16.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 -- 172.21.15.29:0/4200896892 shutdown_connections 2023-10-06T05:27:16.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 --2- 172.21.15.29:0/4200896892 >> v2:172.21.15.173:3300/0 conn(0x7f4a3006a9a0 0x7f4a3015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 --2- 172.21.15.29:0/4200896892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af990 0x7f4a3006a460 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 -- 172.21.15.29:0/4200896892 >> 172.21.15.29:0/4200896892 conn(0x7f4a30067b70 msgr2=0x7f4a3006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:16.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 -- 172.21.15.29:0/4200896892 shutdown_connections 2023-10-06T05:27:16.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.948+0000 7f4a360a0700 1 -- 172.21.15.29:0/4200896892 wait complete. 2023-10-06T05:27:16.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a360a0700 1 Processor -- start 2023-10-06T05:27:16.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a360a0700 1 -- start start 2023-10-06T05:27:16.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a360a0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a3006a9a0 0x7f4a3015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a360a0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af5c0 0x7f4a30159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a360a0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a300af990 0x7f4a30159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a360a0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300a8f10 con 0x7f4a300af5c0 2023-10-06T05:27:16.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a360a0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300a5230 con 0x7f4a300af990 2023-10-06T05:27:16.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a360a0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300a5510 con 0x7f4a3006a9a0 2023-10-06T05:27:16.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a26ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af5c0 0x7f4a30159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a26ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af5c0 0x7f4a30159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55038/0 (socket says 172.21.15.29:55038) 2023-10-06T05:27:16.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a26ffd700 1 -- 172.21.15.29:0/2836735147 learned_addr learned my addr 172.21.15.29:0/2836735147 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a2f7fe700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a3006a9a0 0x7f4a3015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a2ffff700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a300af990 0x7f4a30159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a26ffd700 1 -- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a3006a9a0 msgr2=0x7f4a3015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a26ffd700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a3006a9a0 0x7f4a3015add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a26ffd700 1 -- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a300af990 msgr2=0x7f4a30159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a26ffd700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a300af990 0x7f4a30159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.952+0000 7f4a26ffd700 1 -- 172.21.15.29:0/2836735147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a180094f0 con 0x7f4a300af5c0 2023-10-06T05:27:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a26ffd700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af5c0 0x7f4a30159aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009290 tx=0x7f4a18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a27fff700 1 -- 172.21.15.29:0/2836735147 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18026450 con 0x7f4a300af5c0 2023-10-06T05:27:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a27fff700 1 -- 172.21.15.29:0/2836735147 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a180265b0 con 0x7f4a300af5c0 2023-10-06T05:27:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300a57f0 con 0x7f4a300af5c0 2023-10-06T05:27:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a27fff700 1 -- 172.21.15.29:0/2836735147 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18026970 con 0x7f4a300af5c0 2023-10-06T05:27:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3015b310 con 0x7f4a300af5c0 2023-10-06T05:27:16.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3015b500 con 0x7f4a300af5c0 2023-10-06T05:27:16.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a27fff700 1 -- 172.21.15.29:0/2836735147 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4a1801a420 con 0x7f4a300af5c0 2023-10-06T05:27:16.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a27fff700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a14060550 0x7f4a14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:16.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a27fff700 1 -- 172.21.15.29:0/2836735147 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a1807e7b0 con 0x7f4a300af5c0 2023-10-06T05:27:16.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.956+0000 7f4a2f7fe700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a14060550 0x7f4a14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:16.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.960+0000 7f4a2f7fe700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a14060550 0x7f4a14062a00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a200011e0 tx=0x7f4a20007bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:16.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:16.964+0000 7f4a27fff700 1 -- 172.21.15.29:0/2836735147 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4a1804ecd0 con 0x7f4a300af5c0 2023-10-06T05:27:17.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.124+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a3004be00 con 0x7f4a14060550 2023-10-06T05:27:17.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.144+0000 7f4a27fff700 1 -- 172.21.15.29:0/2836735147 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310057 (secure 0 0 0) 0x7f4a3004be00 con 0x7f4a14060550 2023-10-06T05:27:17.153 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a14060550 msgr2=0x7f4a14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a14060550 0x7f4a14062a00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a200011e0 tx=0x7f4a20007bf0 comp rx=0 tx=0).stop 2023-10-06T05:27:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af5c0 msgr2=0x7f4a30159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af5c0 0x7f4a30159aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009290 tx=0x7f4a18017000 comp rx=0 tx=0).stop 2023-10-06T05:27:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 shutdown_connections 2023-10-06T05:27:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a14060550 0x7f4a14062a00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a300af990 0x7f4a30159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a300af5c0 0x7f4a30159aa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:17.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 --2- 172.21.15.29:0/2836735147 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a3006a9a0 0x7f4a3015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:17.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 >> 172.21.15.29:0/2836735147 conn(0x7f4a30067b70 msgr2=0x7f4a300cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:17.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 shutdown_connections 2023-10-06T05:27:17.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:17.148+0000 7f4a360a0700 1 -- 172.21.15.29:0/2836735147 wait complete. 2023-10-06T05:27:17.157 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:27:17.168 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-10-06T05:27:16.682506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404424,"kb_used_data":5640,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570296,"statfs":{"total":773094113280,"available":770631983104,"internally_reserved":0,"allocated":5775360,"data_stored":3098884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002829"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473552+0000","last_change":"2023-10-06T05:27:09.467339+0000","last_active":"2023-10-06T05:27:09.473552+0000","last_peered":"2023-10-06T05:27:09.473552+0000","last_clean":"2023-10-06T05:27:09.473552+0000","last_became_active":"2023-10-06T05:27:09.466947+0000","last_became_peered":"2023-10-06T05:27:09.466947+0000","last_unstale":"2023-10-06T05:27:09.473552+0000","last_undegraded":"2023-10-06T05:27:09.473552+0000","last_fullsized":"2023-10-06T05:27:09.473552+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:38.548281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471131+0000","last_change":"2023-10-06T05:27:09.461527+0000","last_active":"2023-10-06T05:27:09.471131+0000","last_peered":"2023-10-06T05:27:09.471131+0000","last_clean":"2023-10-06T05:27:09.471131+0000","last_became_active":"2023-10-06T05:27:09.461213+0000","last_became_peered":"2023-10-06T05:27:09.461213+0000","last_unstale":"2023-10-06T05:27:09.471131+0000","last_undegraded":"2023-10-06T05:27:09.471131+0000","last_fullsized":"2023-10-06T05:27:09.471131+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:38.548281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473913+0000","last_change":"2023-10-06T05:27:09.470141+0000","last_active":"2023-10-06T05:27:09.473913+0000","last_peered":"2023-10-06T05:27:09.473913+0000","last_clean":"2023-10-06T05:27:09.473913+0000","last_became_active":"2023-10-06T05:27:09.466967+0000","last_became_peered":"2023-10-06T05:27:09.466967+0000","last_unstale":"2023-10-06T05:27:09.473913+0000","last_undegraded":"2023-10-06T05:27:09.473913+0000","last_fullsized":"2023-10-06T05:27:09.473913+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:00.610554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471453+0000","last_change":"2023-10-06T05:27:09.468052+0000","last_active":"2023-10-06T05:27:09.471453+0000","last_peered":"2023-10-06T05:27:09.471453+0000","last_clean":"2023-10-06T05:27:09.471453+0000","last_became_active":"2023-10-06T05:27:09.467740+0000","last_became_peered":"2023-10-06T05:27:09.467740+0000","last_unstale":"2023-10-06T05:27:09.471453+0000","last_undegraded":"2023-10-06T05:27:09.471453+0000","last_fullsized":"2023-10-06T05:27:09.471453+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:28.584719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473140+0000","last_change":"2023-10-06T05:27:09.469091+0000","last_active":"2023-10-06T05:27:09.473140+0000","last_peered":"2023-10-06T05:27:09.473140+0000","last_clean":"2023-10-06T05:27:09.473140+0000","last_became_active":"2023-10-06T05:27:09.468775+0000","last_became_peered":"2023-10-06T05:27:09.468775+0000","last_unstale":"2023-10-06T05:27:09.473140+0000","last_undegraded":"2023-10-06T05:27:09.473140+0000","last_fullsized":"2023-10-06T05:27:09.473140+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:15.747971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.478859+0000","last_change":"2023-10-06T05:27:09.469255+0000","last_active":"2023-10-06T05:27:09.478859+0000","last_peered":"2023-10-06T05:27:09.478859+0000","last_clean":"2023-10-06T05:27:09.478859+0000","last_became_active":"2023-10-06T05:27:09.468996+0000","last_became_peered":"2023-10-06T05:27:09.468996+0000","last_unstale":"2023-10-06T05:27:09.478859+0000","last_undegraded":"2023-10-06T05:27:09.478859+0000","last_fullsized":"2023-10-06T05:27:09.478859+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:56.669139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473612+0000","last_change":"2023-10-06T05:27:09.469344+0000","last_active":"2023-10-06T05:27:09.473612+0000","last_peered":"2023-10-06T05:27:09.473612+0000","last_clean":"2023-10-06T05:27:09.473612+0000","last_became_active":"2023-10-06T05:27:09.468839+0000","last_became_peered":"2023-10-06T05:27:09.468839+0000","last_unstale":"2023-10-06T05:27:09.473612+0000","last_undegraded":"2023-10-06T05:27:09.473612+0000","last_fullsized":"2023-10-06T05:27:09.473612+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:58.859726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.483848+0000","last_change":"2023-10-06T05:27:09.475748+0000","last_active":"2023-10-06T05:27:09.483848+0000","last_peered":"2023-10-06T05:27:09.483848+0000","last_clean":"2023-10-06T05:27:09.483848+0000","last_became_active":"2023-10-06T05:27:09.475476+0000","last_became_peered":"2023-10-06T05:27:09.475476+0000","last_unstale":"2023-10-06T05:27:09.483848+0000","last_undegraded":"2023-10-06T05:27:09.483848+0000","last_fullsized":"2023-10-06T05:27:09.483848+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:08.985033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.483347+0000","last_change":"2023-10-06T05:27:09.475174+0000","last_active":"2023-10-06T05:27:09.483347+0000","last_peered":"2023-10-06T05:27:09.483347+0000","last_clean":"2023-10-06T05:27:09.483347+0000","last_became_active":"2023-10-06T05:27:09.474865+0000","last_became_peered":"2023-10-06T05:27:09.474865+0000","last_unstale":"2023-10-06T05:27:09.483347+0000","last_undegraded":"2023-10-06T05:27:09.483347+0000","last_fullsized":"2023-10-06T05:27:09.483347+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:10.229866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473493+0000","last_change":"2023-10-06T05:27:09.465447+0000","last_active":"2023-10-06T05:27:09.473493+0000","last_peered":"2023-10-06T05:27:09.473493+0000","last_clean":"2023-10-06T05:27:09.473493+0000","last_became_active":"2023-10-06T05:27:09.465146+0000","last_became_peered":"2023-10-06T05:27:09.465146+0000","last_unstale":"2023-10-06T05:27:09.473493+0000","last_undegraded":"2023-10-06T05:27:09.473493+0000","last_fullsized":"2023-10-06T05:27:09.473493+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:21.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.476744+0000","last_change":"2023-10-06T05:27:09.464263+0000","last_active":"2023-10-06T05:27:09.476744+0000","last_peered":"2023-10-06T05:27:09.476744+0000","last_clean":"2023-10-06T05:27:09.476744+0000","last_became_active":"2023-10-06T05:27:09.463934+0000","last_became_peered":"2023-10-06T05:27:09.463934+0000","last_unstale":"2023-10-06T05:27:09.476744+0000","last_undegraded":"2023-10-06T05:27:09.476744+0000","last_fullsized":"2023-10-06T05:27:09.476744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:58.461069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.479932+0000","last_change":"2023-10-06T05:27:09.466456+0000","last_active":"2023-10-06T05:27:09.479932+0000","last_peered":"2023-10-06T05:27:09.479932+0000","last_clean":"2023-10-06T05:27:09.479932+0000","last_became_active":"2023-10-06T05:27:09.466012+0000","last_became_peered":"2023-10-06T05:27:09.466012+0000","last_unstale":"2023-10-06T05:27:09.479932+0000","last_undegraded":"2023-10-06T05:27:09.479932+0000","last_fullsized":"2023-10-06T05:27:09.479932+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:50.033168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473436+0000","last_change":"2023-10-06T05:27:09.467052+0000","last_active":"2023-10-06T05:27:09.473436+0000","last_peered":"2023-10-06T05:27:09.473436+0000","last_clean":"2023-10-06T05:27:09.473436+0000","last_became_active":"2023-10-06T05:27:09.465635+0000","last_became_peered":"2023-10-06T05:27:09.465635+0000","last_unstale":"2023-10-06T05:27:09.473436+0000","last_undegraded":"2023-10-06T05:27:09.473436+0000","last_fullsized":"2023-10-06T05:27:09.473436+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:29.488441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473707+0000","last_change":"2023-10-06T05:27:09.469570+0000","last_active":"2023-10-06T05:27:09.473707+0000","last_peered":"2023-10-06T05:27:09.473707+0000","last_clean":"2023-10-06T05:27:09.473707+0000","last_became_active":"2023-10-06T05:27:09.469205+0000","last_became_peered":"2023-10-06T05:27:09.469205+0000","last_unstale":"2023-10-06T05:27:09.473707+0000","last_undegraded":"2023-10-06T05:27:09.473707+0000","last_fullsized":"2023-10-06T05:27:09.473707+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:50.062500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471293+0000","last_change":"2023-10-06T05:27:09.462502+0000","last_active":"2023-10-06T05:27:09.471293+0000","last_peered":"2023-10-06T05:27:09.471293+0000","last_clean":"2023-10-06T05:27:09.471293+0000","last_became_active":"2023-10-06T05:27:09.462149+0000","last_became_peered":"2023-10-06T05:27:09.462149+0000","last_unstale":"2023-10-06T05:27:09.471293+0000","last_undegraded":"2023-10-06T05:27:09.471293+0000","last_fullsized":"2023-10-06T05:27:09.471293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:56.669139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473449+0000","last_change":"2023-10-06T05:27:09.465729+0000","last_active":"2023-10-06T05:27:09.473449+0000","last_peered":"2023-10-06T05:27:09.473449+0000","last_clean":"2023-10-06T05:27:09.473449+0000","last_became_active":"2023-10-06T05:27:09.464939+0000","last_became_peered":"2023-10-06T05:27:09.464939+0000","last_unstale":"2023-10-06T05:27:09.473449+0000","last_undegraded":"2023-10-06T05:27:09.473449+0000","last_fullsized":"2023-10-06T05:27:09.473449+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:14.253137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473208+0000","last_change":"2023-10-06T05:27:09.465490+0000","last_active":"2023-10-06T05:27:09.473208+0000","last_peered":"2023-10-06T05:27:09.473208+0000","last_clean":"2023-10-06T05:27:09.473208+0000","last_became_active":"2023-10-06T05:27:09.464550+0000","last_became_peered":"2023-10-06T05:27:09.464550+0000","last_unstale":"2023-10-06T05:27:09.473208+0000","last_undegraded":"2023-10-06T05:27:09.473208+0000","last_fullsized":"2023-10-06T05:27:09.473208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:58.753411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471154+0000","last_change":"2023-10-06T05:27:09.461722+0000","last_active":"2023-10-06T05:27:09.471154+0000","last_peered":"2023-10-06T05:27:09.471154+0000","last_clean":"2023-10-06T05:27:09.471154+0000","last_became_active":"2023-10-06T05:27:09.461254+0000","last_became_peered":"2023-10-06T05:27:09.461254+0000","last_unstale":"2023-10-06T05:27:09.471154+0000","last_undegraded":"2023-10-06T05:27:09.471154+0000","last_fullsized":"2023-10-06T05:27:09.471154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:29.488441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473132+0000","last_change":"2023-10-06T05:27:09.462771+0000","last_active":"2023-10-06T05:27:09.473132+0000","last_peered":"2023-10-06T05:27:09.473132+0000","last_clean":"2023-10-06T05:27:09.473132+0000","last_became_active":"2023-10-06T05:27:09.462390+0000","last_became_peered":"2023-10-06T05:27:09.462390+0000","last_unstale":"2023-10-06T05:27:09.473132+0000","last_undegraded":"2023-10-06T05:27:09.473132+0000","last_fullsized":"2023-10-06T05:27:09.473132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:50.033168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472101+0000","last_change":"2023-10-06T05:27:09.467005+0000","last_active":"2023-10-06T05:27:09.472101+0000","last_peered":"2023-10-06T05:27:09.472101+0000","last_clean":"2023-10-06T05:27:09.472101+0000","last_became_active":"2023-10-06T05:27:09.466489+0000","last_became_peered":"2023-10-06T05:27:09.466489+0000","last_unstale":"2023-10-06T05:27:09.472101+0000","last_undegraded":"2023-10-06T05:27:09.472101+0000","last_fullsized":"2023-10-06T05:27:09.472101+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:27.636961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472158+0000","last_change":"2023-10-06T05:27:09.469766+0000","last_active":"2023-10-06T05:27:09.472158+0000","last_peered":"2023-10-06T05:27:09.472158+0000","last_clean":"2023-10-06T05:27:09.472158+0000","last_became_active":"2023-10-06T05:27:09.469388+0000","last_became_peered":"2023-10-06T05:27:09.469388+0000","last_unstale":"2023-10-06T05:27:09.472158+0000","last_undegraded":"2023-10-06T05:27:09.472158+0000","last_fullsized":"2023-10-06T05:27:09.472158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:55.047489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.483355+0000","last_change":"2023-10-06T05:27:09.475304+0000","last_active":"2023-10-06T05:27:09.483355+0000","last_peered":"2023-10-06T05:27:09.483355+0000","last_clean":"2023-10-06T05:27:09.483355+0000","last_became_active":"2023-10-06T05:27:09.474989+0000","last_became_peered":"2023-10-06T05:27:09.474989+0000","last_unstale":"2023-10-06T05:27:09.483355+0000","last_undegraded":"2023-10-06T05:27:09.483355+0000","last_fullsized":"2023-10-06T05:27:09.483355+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:03.051979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.476969+0000","last_change":"2023-10-06T05:27:09.463775+0000","last_active":"2023-10-06T05:27:09.476969+0000","last_peered":"2023-10-06T05:27:09.476969+0000","last_clean":"2023-10-06T05:27:09.476969+0000","last_became_active":"2023-10-06T05:27:09.463431+0000","last_became_peered":"2023-10-06T05:27:09.463431+0000","last_unstale":"2023-10-06T05:27:09.476969+0000","last_undegraded":"2023-10-06T05:27:09.476969+0000","last_fullsized":"2023-10-06T05:27:09.476969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:07.045340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.460263+0000","last_change":"2023-10-06T05:27:09.458420+0000","last_active":"2023-10-06T05:27:09.460263+0000","last_peered":"2023-10-06T05:27:09.460263+0000","last_clean":"2023-10-06T05:27:09.460263+0000","last_became_active":"2023-10-06T05:27:09.458103+0000","last_became_peered":"2023-10-06T05:27:09.458103+0000","last_unstale":"2023-10-06T05:27:09.460263+0000","last_undegraded":"2023-10-06T05:27:09.460263+0000","last_fullsized":"2023-10-06T05:27:09.460263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:56.669139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473956+0000","last_change":"2023-10-06T05:27:09.471937+0000","last_active":"2023-10-06T05:27:09.473956+0000","last_peered":"2023-10-06T05:27:09.473956+0000","last_clean":"2023-10-06T05:27:09.473956+0000","last_became_active":"2023-10-06T05:27:09.468813+0000","last_became_peered":"2023-10-06T05:27:09.468813+0000","last_unstale":"2023-10-06T05:27:09.473956+0000","last_undegraded":"2023-10-06T05:27:09.473956+0000","last_fullsized":"2023-10-06T05:27:09.473956+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:11.612360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485271+0000","last_change":"2023-10-06T05:27:09.478612+0000","last_active":"2023-10-06T05:27:09.485271+0000","last_peered":"2023-10-06T05:27:09.485271+0000","last_clean":"2023-10-06T05:27:09.485271+0000","last_became_active":"2023-10-06T05:27:09.478298+0000","last_became_peered":"2023-10-06T05:27:09.478298+0000","last_unstale":"2023-10-06T05:27:09.485271+0000","last_undegraded":"2023-10-06T05:27:09.485271+0000","last_fullsized":"2023-10-06T05:27:09.485271+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:58.753411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473457+0000","last_change":"2023-10-06T05:27:09.464924+0000","last_active":"2023-10-06T05:27:09.473457+0000","last_peered":"2023-10-06T05:27:09.473457+0000","last_clean":"2023-10-06T05:27:09.473457+0000","last_became_active":"2023-10-06T05:27:09.464479+0000","last_became_peered":"2023-10-06T05:27:09.464479+0000","last_unstale":"2023-10-06T05:27:09.473457+0000","last_undegraded":"2023-10-06T05:27:09.473457+0000","last_fullsized":"2023-10-06T05:27:09.473457+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:34.716115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470801+0000","last_change":"2023-10-06T05:27:09.463541+0000","last_active":"2023-10-06T05:27:09.470801+0000","last_peered":"2023-10-06T05:27:09.470801+0000","last_clean":"2023-10-06T05:27:09.470801+0000","last_became_active":"2023-10-06T05:27:09.463277+0000","last_became_peered":"2023-10-06T05:27:09.463277+0000","last_unstale":"2023-10-06T05:27:09.470801+0000","last_undegraded":"2023-10-06T05:27:09.470801+0000","last_fullsized":"2023-10-06T05:27:09.470801+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:40.107384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471647+0000","last_change":"2023-10-06T05:27:09.461750+0000","last_active":"2023-10-06T05:27:09.471647+0000","last_peered":"2023-10-06T05:27:09.471647+0000","last_clean":"2023-10-06T05:27:09.471647+0000","last_became_active":"2023-10-06T05:27:09.461407+0000","last_became_peered":"2023-10-06T05:27:09.461407+0000","last_unstale":"2023-10-06T05:27:09.471647+0000","last_undegraded":"2023-10-06T05:27:09.471647+0000","last_fullsized":"2023-10-06T05:27:09.471647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:00.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471396+0000","last_change":"2023-10-06T05:27:09.466522+0000","last_active":"2023-10-06T05:27:09.471396+0000","last_peered":"2023-10-06T05:27:09.471396+0000","last_clean":"2023-10-06T05:27:09.471396+0000","last_became_active":"2023-10-06T05:27:09.466193+0000","last_became_peered":"2023-10-06T05:27:09.466193+0000","last_unstale":"2023-10-06T05:27:09.471396+0000","last_undegraded":"2023-10-06T05:27:09.471396+0000","last_fullsized":"2023-10-06T05:27:09.471396+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:25.582818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473588+0000","last_change":"2023-10-06T05:27:09.469138+0000","last_active":"2023-10-06T05:27:09.473588+0000","last_peered":"2023-10-06T05:27:09.473588+0000","last_clean":"2023-10-06T05:27:09.473588+0000","last_became_active":"2023-10-06T05:27:09.466465+0000","last_became_peered":"2023-10-06T05:27:09.466465+0000","last_unstale":"2023-10-06T05:27:09.473588+0000","last_undegraded":"2023-10-06T05:27:09.473588+0000","last_fullsized":"2023-10-06T05:27:09.473588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:12.236888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472283+0000","last_change":"2023-10-06T05:27:09.468648+0000","last_active":"2023-10-06T05:27:09.472283+0000","last_peered":"2023-10-06T05:27:09.472283+0000","last_clean":"2023-10-06T05:27:09.472283+0000","last_became_active":"2023-10-06T05:27:09.468174+0000","last_became_peered":"2023-10-06T05:27:09.468174+0000","last_unstale":"2023-10-06T05:27:09.472283+0000","last_undegraded":"2023-10-06T05:27:09.472283+0000","last_fullsized":"2023-10-06T05:27:09.472283+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:39.360520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.468421+0000","last_change":"2023-10-06T05:27:09.460060+0000","last_active":"2023-10-06T05:27:09.468421+0000","last_peered":"2023-10-06T05:27:09.468421+0000","last_clean":"2023-10-06T05:27:09.468421+0000","last_became_active":"2023-10-06T05:27:09.459670+0000","last_became_peered":"2023-10-06T05:27:09.459670+0000","last_unstale":"2023-10-06T05:27:09.468421+0000","last_undegraded":"2023-10-06T05:27:09.468421+0000","last_fullsized":"2023-10-06T05:27:09.468421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:14.253137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.481524+0000","last_change":"2023-10-06T05:27:08.454537+0000","last_active":"2023-10-06T05:27:09.481524+0000","last_peered":"2023-10-06T05:27:09.481524+0000","last_clean":"2023-10-06T05:27:09.481524+0000","last_became_active":"2023-10-06T05:27:08.454244+0000","last_became_peered":"2023-10-06T05:27:08.454244+0000","last_unstale":"2023-10-06T05:27:09.481524+0000","last_undegraded":"2023-10-06T05:27:09.481524+0000","last_fullsized":"2023-10-06T05:27:09.481524+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:10.700348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470979+0000","last_change":"2023-10-06T05:27:09.463837+0000","last_active":"2023-10-06T05:27:09.470979+0000","last_peered":"2023-10-06T05:27:09.470979+0000","last_clean":"2023-10-06T05:27:09.470979+0000","last_became_active":"2023-10-06T05:27:09.463133+0000","last_became_peered":"2023-10-06T05:27:09.463133+0000","last_unstale":"2023-10-06T05:27:09.470979+0000","last_undegraded":"2023-10-06T05:27:09.470979+0000","last_fullsized":"2023-10-06T05:27:09.470979+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:26.248711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485464+0000","last_change":"2023-10-06T05:27:08.469048+0000","last_active":"2023-10-06T05:27:09.485464+0000","last_peered":"2023-10-06T05:27:09.485464+0000","last_clean":"2023-10-06T05:27:09.485464+0000","last_became_active":"2023-10-06T05:27:08.468758+0000","last_became_peered":"2023-10-06T05:27:08.468758+0000","last_unstale":"2023-10-06T05:27:09.485464+0000","last_undegraded":"2023-10-06T05:27:09.485464+0000","last_fullsized":"2023-10-06T05:27:09.485464+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:07.241389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472109+0000","last_change":"2023-10-06T05:27:09.469079+0000","last_active":"2023-10-06T05:27:09.472109+0000","last_peered":"2023-10-06T05:27:09.472109+0000","last_clean":"2023-10-06T05:27:09.472109+0000","last_became_active":"2023-10-06T05:27:09.468799+0000","last_became_peered":"2023-10-06T05:27:09.468799+0000","last_unstale":"2023-10-06T05:27:09.472109+0000","last_undegraded":"2023-10-06T05:27:09.472109+0000","last_fullsized":"2023-10-06T05:27:09.472109+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:29.435631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.482017+0000","last_change":"2023-10-06T05:27:08.459693+0000","last_active":"2023-10-06T05:27:09.482017+0000","last_peered":"2023-10-06T05:27:09.482017+0000","last_clean":"2023-10-06T05:27:09.482017+0000","last_became_active":"2023-10-06T05:27:08.459348+0000","last_became_peered":"2023-10-06T05:27:08.459348+0000","last_unstale":"2023-10-06T05:27:09.482017+0000","last_undegraded":"2023-10-06T05:27:09.482017+0000","last_fullsized":"2023-10-06T05:27:09.482017+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.479897+0000","last_change":"2023-10-06T05:27:09.466076+0000","last_active":"2023-10-06T05:27:09.479897+0000","last_peered":"2023-10-06T05:27:09.479897+0000","last_clean":"2023-10-06T05:27:09.479897+0000","last_became_active":"2023-10-06T05:27:09.465698+0000","last_became_peered":"2023-10-06T05:27:09.465698+0000","last_unstale":"2023-10-06T05:27:09.479897+0000","last_undegraded":"2023-10-06T05:27:09.479897+0000","last_fullsized":"2023-10-06T05:27:09.479897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:43.295093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485738+0000","last_change":"2023-10-06T05:27:08.461036+0000","last_active":"2023-10-06T05:27:09.485738+0000","last_peered":"2023-10-06T05:27:09.485738+0000","last_clean":"2023-10-06T05:27:09.485738+0000","last_became_active":"2023-10-06T05:27:08.460769+0000","last_became_peered":"2023-10-06T05:27:08.460769+0000","last_unstale":"2023-10-06T05:27:09.485738+0000","last_undegraded":"2023-10-06T05:27:09.485738+0000","last_fullsized":"2023-10-06T05:27:09.485738+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.465042+0000","last_change":"2023-10-06T05:27:09.462605+0000","last_active":"2023-10-06T05:27:09.465042+0000","last_peered":"2023-10-06T05:27:09.465042+0000","last_clean":"2023-10-06T05:27:09.465042+0000","last_became_active":"2023-10-06T05:27:09.462335+0000","last_became_peered":"2023-10-06T05:27:09.462335+0000","last_unstale":"2023-10-06T05:27:09.465042+0000","last_undegraded":"2023-10-06T05:27:09.465042+0000","last_fullsized":"2023-10-06T05:27:09.465042+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:23.152618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.484733+0000","last_change":"2023-10-06T05:27:08.465190+0000","last_active":"2023-10-06T05:27:09.484733+0000","last_peered":"2023-10-06T05:27:09.484733+0000","last_clean":"2023-10-06T05:27:09.484733+0000","last_became_active":"2023-10-06T05:27:08.464090+0000","last_became_peered":"2023-10-06T05:27:08.464090+0000","last_unstale":"2023-10-06T05:27:09.484733+0000","last_undegraded":"2023-10-06T05:27:09.484733+0000","last_fullsized":"2023-10-06T05:27:09.484733+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:58.692007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471414+0000","last_change":"2023-10-06T05:27:09.466576+0000","last_active":"2023-10-06T05:27:09.471414+0000","last_peered":"2023-10-06T05:27:09.471414+0000","last_clean":"2023-10-06T05:27:09.471414+0000","last_became_active":"2023-10-06T05:27:09.466231+0000","last_became_peered":"2023-10-06T05:27:09.466231+0000","last_unstale":"2023-10-06T05:27:09.471414+0000","last_undegraded":"2023-10-06T05:27:09.471414+0000","last_fullsized":"2023-10-06T05:27:09.471414+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:55.289829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.481041+0000","last_change":"2023-10-06T05:27:08.456349+0000","last_active":"2023-10-06T05:27:09.481041+0000","last_peered":"2023-10-06T05:27:09.481041+0000","last_clean":"2023-10-06T05:27:09.481041+0000","last_became_active":"2023-10-06T05:27:08.456061+0000","last_became_peered":"2023-10-06T05:27:08.456061+0000","last_unstale":"2023-10-06T05:27:09.481041+0000","last_undegraded":"2023-10-06T05:27:09.481041+0000","last_fullsized":"2023-10-06T05:27:09.481041+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:13.240736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.484789+0000","last_change":"2023-10-06T05:27:09.478058+0000","last_active":"2023-10-06T05:27:09.484789+0000","last_peered":"2023-10-06T05:27:09.484789+0000","last_clean":"2023-10-06T05:27:09.484789+0000","last_became_active":"2023-10-06T05:27:09.477449+0000","last_became_peered":"2023-10-06T05:27:09.477449+0000","last_unstale":"2023-10-06T05:27:09.484789+0000","last_undegraded":"2023-10-06T05:27:09.484789+0000","last_fullsized":"2023-10-06T05:27:09.484789+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:58.859726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.459005+0000","last_change":"2023-10-06T05:27:08.459170+0000","last_active":"2023-10-06T05:27:09.459005+0000","last_peered":"2023-10-06T05:27:09.459005+0000","last_clean":"2023-10-06T05:27:09.459005+0000","last_became_active":"2023-10-06T05:27:08.458864+0000","last_became_peered":"2023-10-06T05:27:08.458864+0000","last_unstale":"2023-10-06T05:27:09.459005+0000","last_undegraded":"2023-10-06T05:27:09.459005+0000","last_fullsized":"2023-10-06T05:27:09.459005+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:06.032939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471239+0000","last_change":"2023-10-06T05:27:09.462866+0000","last_active":"2023-10-06T05:27:09.471239+0000","last_peered":"2023-10-06T05:27:09.471239+0000","last_clean":"2023-10-06T05:27:09.471239+0000","last_became_active":"2023-10-06T05:27:09.462436+0000","last_became_peered":"2023-10-06T05:27:09.462436+0000","last_unstale":"2023-10-06T05:27:09.471239+0000","last_undegraded":"2023-10-06T05:27:09.471239+0000","last_fullsized":"2023-10-06T05:27:09.471239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:34.716115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.451138+0000","last_change":"2023-10-06T05:27:08.467065+0000","last_active":"2023-10-06T05:27:09.451138+0000","last_peered":"2023-10-06T05:27:09.451138+0000","last_clean":"2023-10-06T05:27:09.451138+0000","last_became_active":"2023-10-06T05:27:08.466667+0000","last_became_peered":"2023-10-06T05:27:08.466667+0000","last_unstale":"2023-10-06T05:27:09.451138+0000","last_undegraded":"2023-10-06T05:27:09.451138+0000","last_fullsized":"2023-10-06T05:27:09.451138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:46.413295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473089+0000","last_change":"2023-10-06T05:27:09.468057+0000","last_active":"2023-10-06T05:27:09.473089+0000","last_peered":"2023-10-06T05:27:09.473089+0000","last_clean":"2023-10-06T05:27:09.473089+0000","last_became_active":"2023-10-06T05:27:09.467745+0000","last_became_peered":"2023-10-06T05:27:09.467745+0000","last_unstale":"2023-10-06T05:27:09.473089+0000","last_undegraded":"2023-10-06T05:27:09.473089+0000","last_fullsized":"2023-10-06T05:27:09.473089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:26.248711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449503+0000","last_change":"2023-10-06T05:27:08.457838+0000","last_active":"2023-10-06T05:27:09.449503+0000","last_peered":"2023-10-06T05:27:09.449503+0000","last_clean":"2023-10-06T05:27:09.449503+0000","last_became_active":"2023-10-06T05:27:08.457440+0000","last_became_peered":"2023-10-06T05:27:08.457440+0000","last_unstale":"2023-10-06T05:27:09.449503+0000","last_undegraded":"2023-10-06T05:27:09.449503+0000","last_fullsized":"2023-10-06T05:27:09.449503+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:07.241389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470957+0000","last_change":"2023-10-06T05:27:09.462829+0000","last_active":"2023-10-06T05:27:09.470957+0000","last_peered":"2023-10-06T05:27:09.470957+0000","last_clean":"2023-10-06T05:27:09.470957+0000","last_became_active":"2023-10-06T05:27:09.462571+0000","last_became_peered":"2023-10-06T05:27:09.462571+0000","last_unstale":"2023-10-06T05:27:09.470957+0000","last_undegraded":"2023-10-06T05:27:09.470957+0000","last_fullsized":"2023-10-06T05:27:09.470957+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:15.747971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449876+0000","last_change":"2023-10-06T05:27:08.468417+0000","last_active":"2023-10-06T05:27:09.449876+0000","last_peered":"2023-10-06T05:27:09.449876+0000","last_clean":"2023-10-06T05:27:09.449876+0000","last_became_active":"2023-10-06T05:27:08.468116+0000","last_became_peered":"2023-10-06T05:27:08.468116+0000","last_unstale":"2023-10-06T05:27:09.449876+0000","last_undegraded":"2023-10-06T05:27:09.449876+0000","last_fullsized":"2023-10-06T05:27:09.449876+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:55.656738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473689+0000","last_change":"2023-10-06T05:27:09.468918+0000","last_active":"2023-10-06T05:27:09.473689+0000","last_peered":"2023-10-06T05:27:09.473689+0000","last_clean":"2023-10-06T05:27:09.473689+0000","last_became_active":"2023-10-06T05:27:09.461508+0000","last_became_peered":"2023-10-06T05:27:09.461508+0000","last_unstale":"2023-10-06T05:27:09.473689+0000","last_undegraded":"2023-10-06T05:27:09.473689+0000","last_fullsized":"2023-10-06T05:27:09.473689+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:26.248711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485873+0000","last_change":"2023-10-06T05:27:08.462121+0000","last_active":"2023-10-06T05:27:09.485873+0000","last_peered":"2023-10-06T05:27:09.485873+0000","last_clean":"2023-10-06T05:27:09.485873+0000","last_became_active":"2023-10-06T05:27:08.461840+0000","last_became_peered":"2023-10-06T05:27:08.461840+0000","last_unstale":"2023-10-06T05:27:09.485873+0000","last_undegraded":"2023-10-06T05:27:09.485873+0000","last_fullsized":"2023-10-06T05:27:09.485873+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:54.035088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.465383+0000","last_change":"2023-10-06T05:27:09.462503+0000","last_active":"2023-10-06T05:27:09.465383+0000","last_peered":"2023-10-06T05:27:09.465383+0000","last_clean":"2023-10-06T05:27:09.465383+0000","last_became_active":"2023-10-06T05:27:09.462195+0000","last_became_peered":"2023-10-06T05:27:09.462195+0000","last_unstale":"2023-10-06T05:27:09.465383+0000","last_undegraded":"2023-10-06T05:27:09.465383+0000","last_fullsized":"2023-10-06T05:27:09.465383+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:07.301491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.488956+0000","last_change":"2023-10-06T05:27:08.468574+0000","last_active":"2023-10-06T05:27:09.488956+0000","last_peered":"2023-10-06T05:27:09.488956+0000","last_clean":"2023-10-06T05:27:09.488956+0000","last_became_active":"2023-10-06T05:27:08.468256+0000","last_became_peered":"2023-10-06T05:27:08.468256+0000","last_unstale":"2023-10-06T05:27:09.488956+0000","last_undegraded":"2023-10-06T05:27:09.488956+0000","last_fullsized":"2023-10-06T05:27:09.488956+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:28.476040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471099+0000","last_change":"2023-10-06T05:27:09.465117+0000","last_active":"2023-10-06T05:27:09.471099+0000","last_peered":"2023-10-06T05:27:09.471099+0000","last_clean":"2023-10-06T05:27:09.471099+0000","last_became_active":"2023-10-06T05:27:09.463502+0000","last_became_peered":"2023-10-06T05:27:09.463502+0000","last_unstale":"2023-10-06T05:27:09.471099+0000","last_undegraded":"2023-10-06T05:27:09.471099+0000","last_fullsized":"2023-10-06T05:27:09.471099+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:23.152618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.483384+0000","last_change":"2023-10-06T05:27:08.465731+0000","last_active":"2023-10-06T05:27:09.483384+0000","last_peered":"2023-10-06T05:27:09.483384+0000","last_clean":"2023-10-06T05:27:09.483384+0000","last_became_active":"2023-10-06T05:27:08.465421+0000","last_became_peered":"2023-10-06T05:27:08.465421+0000","last_unstale":"2023-10-06T05:27:09.483384+0000","last_undegraded":"2023-10-06T05:27:09.483384+0000","last_fullsized":"2023-10-06T05:27:09.483384+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:28.423230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473937+0000","last_change":"2023-10-06T05:27:09.470692+0000","last_active":"2023-10-06T05:27:09.473937+0000","last_peered":"2023-10-06T05:27:09.473937+0000","last_clean":"2023-10-06T05:27:09.473937+0000","last_became_active":"2023-10-06T05:27:09.470406+0000","last_became_peered":"2023-10-06T05:27:09.470406+0000","last_unstale":"2023-10-06T05:27:09.473937+0000","last_undegraded":"2023-10-06T05:27:09.473937+0000","last_fullsized":"2023-10-06T05:27:09.473937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:39.360520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.456695+0000","last_change":"2023-10-06T05:27:08.468965+0000","last_active":"2023-10-06T05:27:09.456695+0000","last_peered":"2023-10-06T05:27:09.456695+0000","last_clean":"2023-10-06T05:27:09.456695+0000","last_became_active":"2023-10-06T05:27:08.468665+0000","last_became_peered":"2023-10-06T05:27:08.468665+0000","last_unstale":"2023-10-06T05:27:09.456695+0000","last_undegraded":"2023-10-06T05:27:09.456695+0000","last_fullsized":"2023-10-06T05:27:09.456695+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:16.545506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.480089+0000","last_change":"2023-10-06T05:27:09.471152+0000","last_active":"2023-10-06T05:27:09.480089+0000","last_peered":"2023-10-06T05:27:09.480089+0000","last_clean":"2023-10-06T05:27:09.480089+0000","last_became_active":"2023-10-06T05:27:09.470891+0000","last_became_peered":"2023-10-06T05:27:09.470891+0000","last_unstale":"2023-10-06T05:27:09.480089+0000","last_undegraded":"2023-10-06T05:27:09.480089+0000","last_fullsized":"2023-10-06T05:27:09.480089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:02.407473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449002+0000","last_change":"2023-10-06T05:27:08.454807+0000","last_active":"2023-10-06T05:27:09.449002+0000","last_peered":"2023-10-06T05:27:09.449002+0000","last_clean":"2023-10-06T05:27:09.449002+0000","last_became_active":"2023-10-06T05:27:08.454540+0000","last_became_peered":"2023-10-06T05:27:08.454540+0000","last_unstale":"2023-10-06T05:27:09.449002+0000","last_undegraded":"2023-10-06T05:27:09.449002+0000","last_fullsized":"2023-10-06T05:27:09.449002+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:55.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473321+0000","last_change":"2023-10-06T05:27:09.465676+0000","last_active":"2023-10-06T05:27:09.473321+0000","last_peered":"2023-10-06T05:27:09.473321+0000","last_clean":"2023-10-06T05:27:09.473321+0000","last_became_active":"2023-10-06T05:27:09.464931+0000","last_became_peered":"2023-10-06T05:27:09.464931+0000","last_unstale":"2023-10-06T05:27:09.473321+0000","last_undegraded":"2023-10-06T05:27:09.473321+0000","last_fullsized":"2023-10-06T05:27:09.473321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:18.072057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.487407+0000","last_change":"2023-10-06T05:27:08.462691+0000","last_active":"2023-10-06T05:27:09.487407+0000","last_peered":"2023-10-06T05:27:09.487407+0000","last_clean":"2023-10-06T05:27:09.487407+0000","last_became_active":"2023-10-06T05:27:08.461024+0000","last_became_peered":"2023-10-06T05:27:08.461024+0000","last_unstale":"2023-10-06T05:27:09.487407+0000","last_undegraded":"2023-10-06T05:27:09.487407+0000","last_fullsized":"2023-10-06T05:27:09.487407+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:24.570417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.481882+0000","last_change":"2023-10-06T05:27:09.472524+0000","last_active":"2023-10-06T05:27:09.481882+0000","last_peered":"2023-10-06T05:27:09.481882+0000","last_clean":"2023-10-06T05:27:09.481882+0000","last_became_active":"2023-10-06T05:27:09.472246+0000","last_became_peered":"2023-10-06T05:27:09.472246+0000","last_unstale":"2023-10-06T05:27:09.481882+0000","last_undegraded":"2023-10-06T05:27:09.481882+0000","last_fullsized":"2023-10-06T05:27:09.481882+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:11.612360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485987+0000","last_change":"2023-10-06T05:27:08.468994+0000","last_active":"2023-10-06T05:27:09.485987+0000","last_peered":"2023-10-06T05:27:09.485987+0000","last_clean":"2023-10-06T05:27:09.485987+0000","last_became_active":"2023-10-06T05:27:08.468681+0000","last_became_peered":"2023-10-06T05:27:08.468681+0000","last_unstale":"2023-10-06T05:27:09.485987+0000","last_undegraded":"2023-10-06T05:27:09.485987+0000","last_fullsized":"2023-10-06T05:27:09.485987+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:39.094983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.477153+0000","last_change":"2023-10-06T05:27:09.474104+0000","last_active":"2023-10-06T05:27:09.477153+0000","last_peered":"2023-10-06T05:27:09.477153+0000","last_clean":"2023-10-06T05:27:09.477153+0000","last_became_active":"2023-10-06T05:27:09.473702+0000","last_became_peered":"2023-10-06T05:27:09.473702+0000","last_unstale":"2023-10-06T05:27:09.477153+0000","last_undegraded":"2023-10-06T05:27:09.477153+0000","last_fullsized":"2023-10-06T05:27:09.477153+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:28.584719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.484833+0000","last_change":"2023-10-06T05:27:08.457313+0000","last_active":"2023-10-06T05:27:09.484833+0000","last_peered":"2023-10-06T05:27:09.484833+0000","last_clean":"2023-10-06T05:27:09.484833+0000","last_became_active":"2023-10-06T05:27:08.456931+0000","last_became_peered":"2023-10-06T05:27:08.456931+0000","last_unstale":"2023-10-06T05:27:09.484833+0000","last_undegraded":"2023-10-06T05:27:09.484833+0000","last_fullsized":"2023-10-06T05:27:09.484833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:00.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.479663+0000","last_change":"2023-10-06T05:27:09.475087+0000","last_active":"2023-10-06T05:27:09.479663+0000","last_peered":"2023-10-06T05:27:09.479663+0000","last_clean":"2023-10-06T05:27:09.479663+0000","last_became_active":"2023-10-06T05:27:09.474659+0000","last_became_peered":"2023-10-06T05:27:09.474659+0000","last_unstale":"2023-10-06T05:27:09.479663+0000","last_undegraded":"2023-10-06T05:27:09.479663+0000","last_fullsized":"2023-10-06T05:27:09.479663+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:11.061434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.480826+0000","last_change":"2023-10-06T05:27:08.461975+0000","last_active":"2023-10-06T05:27:09.480826+0000","last_peered":"2023-10-06T05:27:09.480826+0000","last_clean":"2023-10-06T05:27:09.480826+0000","last_became_active":"2023-10-06T05:27:08.461719+0000","last_became_peered":"2023-10-06T05:27:08.461719+0000","last_unstale":"2023-10-06T05:27:09.480826+0000","last_undegraded":"2023-10-06T05:27:09.480826+0000","last_fullsized":"2023-10-06T05:27:09.480826+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:48.444105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.478890+0000","last_change":"2023-10-06T05:27:09.467854+0000","last_active":"2023-10-06T05:27:09.478890+0000","last_peered":"2023-10-06T05:27:09.478890+0000","last_clean":"2023-10-06T05:27:09.478890+0000","last_became_active":"2023-10-06T05:27:09.467479+0000","last_became_peered":"2023-10-06T05:27:09.467479+0000","last_unstale":"2023-10-06T05:27:09.478890+0000","last_undegraded":"2023-10-06T05:27:09.478890+0000","last_fullsized":"2023-10-06T05:27:09.478890+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:25.582818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.460187+0000","last_change":"2023-10-06T05:27:08.469919+0000","last_active":"2023-10-06T05:27:09.460187+0000","last_peered":"2023-10-06T05:27:09.460187+0000","last_clean":"2023-10-06T05:27:09.460187+0000","last_became_active":"2023-10-06T05:27:08.469535+0000","last_became_peered":"2023-10-06T05:27:08.469535+0000","last_unstale":"2023-10-06T05:27:09.460187+0000","last_undegraded":"2023-10-06T05:27:09.460187+0000","last_fullsized":"2023-10-06T05:27:09.460187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:57.448667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470840+0000","last_change":"2023-10-06T05:27:09.462300+0000","last_active":"2023-10-06T05:27:09.470840+0000","last_peered":"2023-10-06T05:27:09.470840+0000","last_clean":"2023-10-06T05:27:09.470840+0000","last_became_active":"2023-10-06T05:27:09.461998+0000","last_became_peered":"2023-10-06T05:27:09.461998+0000","last_unstale":"2023-10-06T05:27:09.470840+0000","last_undegraded":"2023-10-06T05:27:09.470840+0000","last_fullsized":"2023-10-06T05:27:09.470840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:07.301491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485122+0000","last_change":"2023-10-06T05:27:08.461738+0000","last_active":"2023-10-06T05:27:09.485122+0000","last_peered":"2023-10-06T05:27:09.485122+0000","last_clean":"2023-10-06T05:27:09.485122+0000","last_became_active":"2023-10-06T05:27:08.461423+0000","last_became_peered":"2023-10-06T05:27:08.461423+0000","last_unstale":"2023-10-06T05:27:09.485122+0000","last_undegraded":"2023-10-06T05:27:09.485122+0000","last_fullsized":"2023-10-06T05:27:09.485122+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:46.413295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470777+0000","last_change":"2023-10-06T05:27:09.462832+0000","last_active":"2023-10-06T05:27:09.470777+0000","last_peered":"2023-10-06T05:27:09.470777+0000","last_clean":"2023-10-06T05:27:09.470777+0000","last_became_active":"2023-10-06T05:27:09.462552+0000","last_became_peered":"2023-10-06T05:27:09.462552+0000","last_unstale":"2023-10-06T05:27:09.470777+0000","last_undegraded":"2023-10-06T05:27:09.470777+0000","last_fullsized":"2023-10-06T05:27:09.470777+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:56.104542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.455511+0000","last_change":"2023-10-06T05:27:08.458730+0000","last_active":"2023-10-06T05:27:09.455511+0000","last_peered":"2023-10-06T05:27:09.455511+0000","last_clean":"2023-10-06T05:27:09.455511+0000","last_became_active":"2023-10-06T05:27:08.458344+0000","last_became_peered":"2023-10-06T05:27:08.458344+0000","last_unstale":"2023-10-06T05:27:09.455511+0000","last_undegraded":"2023-10-06T05:27:09.455511+0000","last_fullsized":"2023-10-06T05:27:09.455511+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:37.535880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473499+0000","last_change":"2023-10-06T05:27:09.462823+0000","last_active":"2023-10-06T05:27:09.473499+0000","last_peered":"2023-10-06T05:27:09.473499+0000","last_clean":"2023-10-06T05:27:09.473499+0000","last_became_active":"2023-10-06T05:27:09.462469+0000","last_became_peered":"2023-10-06T05:27:09.462469+0000","last_unstale":"2023-10-06T05:27:09.473499+0000","last_undegraded":"2023-10-06T05:27:09.473499+0000","last_fullsized":"2023-10-06T05:27:09.473499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:11.061434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.453375+0000","last_change":"2023-10-06T05:27:08.463721+0000","last_active":"2023-10-06T05:27:09.453375+0000","last_peered":"2023-10-06T05:27:09.453375+0000","last_clean":"2023-10-06T05:27:09.453375+0000","last_became_active":"2023-10-06T05:27:08.463110+0000","last_became_peered":"2023-10-06T05:27:08.463110+0000","last_unstale":"2023-10-06T05:27:09.453375+0000","last_undegraded":"2023-10-06T05:27:09.453375+0000","last_fullsized":"2023-10-06T05:27:09.453375+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:26.624560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.475273+0000","last_change":"2023-10-06T05:27:09.468402+0000","last_active":"2023-10-06T05:27:09.475273+0000","last_peered":"2023-10-06T05:27:09.475273+0000","last_clean":"2023-10-06T05:27:09.475273+0000","last_became_active":"2023-10-06T05:27:09.467709+0000","last_became_peered":"2023-10-06T05:27:09.467709+0000","last_unstale":"2023-10-06T05:27:09.475273+0000","last_undegraded":"2023-10-06T05:27:09.475273+0000","last_fullsized":"2023-10-06T05:27:09.475273+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:55.289829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.451678+0000","last_change":"2023-10-06T05:27:08.458728+0000","last_active":"2023-10-06T05:27:09.451678+0000","last_peered":"2023-10-06T05:27:09.451678+0000","last_clean":"2023-10-06T05:27:09.451678+0000","last_became_active":"2023-10-06T05:27:08.458427+0000","last_became_peered":"2023-10-06T05:27:08.458427+0000","last_unstale":"2023-10-06T05:27:09.451678+0000","last_undegraded":"2023-10-06T05:27:09.451678+0000","last_fullsized":"2023-10-06T05:27:09.451678+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:20.653667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471978+0000","last_change":"2023-10-06T05:27:09.466635+0000","last_active":"2023-10-06T05:27:09.471978+0000","last_peered":"2023-10-06T05:27:09.471978+0000","last_clean":"2023-10-06T05:27:09.471978+0000","last_became_active":"2023-10-06T05:27:09.466324+0000","last_became_peered":"2023-10-06T05:27:09.466324+0000","last_unstale":"2023-10-06T05:27:09.471978+0000","last_undegraded":"2023-10-06T05:27:09.471978+0000","last_fullsized":"2023-10-06T05:27:09.471978+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:41.300979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.455261+0000","last_change":"2023-10-06T05:27:08.466399+0000","last_active":"2023-10-06T05:27:09.455261+0000","last_peered":"2023-10-06T05:27:09.455261+0000","last_clean":"2023-10-06T05:27:09.455261+0000","last_became_active":"2023-10-06T05:27:08.466126+0000","last_became_peered":"2023-10-06T05:27:08.466126+0000","last_unstale":"2023-10-06T05:27:09.455261+0000","last_undegraded":"2023-10-06T05:27:09.455261+0000","last_fullsized":"2023-10-06T05:27:09.455261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:54.035088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.447581+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:27:09.447581+0000","last_peered":"2023-10-06T05:27:09.447581+0000","last_clean":"2023-10-06T05:27:09.447581+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:27:09.447581+0000","last_undegraded":"2023-10-06T05:27:09.447581+0000","last_fullsized":"2023-10-06T05:27:09.447581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.455251+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:27:09.455251+0000","last_peered":"2023-10-06T05:27:09.455251+0000","last_clean":"2023-10-06T05:27:09.455251+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:27:09.455251+0000","last_undegraded":"2023-10-06T05:27:09.455251+0000","last_fullsized":"2023-10-06T05:27:09.455251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.478819+0000","last_change":"2023-10-06T05:27:09.468732+0000","last_active":"2023-10-06T05:27:09.478819+0000","last_peered":"2023-10-06T05:27:09.478819+0000","last_clean":"2023-10-06T05:27:09.478819+0000","last_became_active":"2023-10-06T05:27:09.465353+0000","last_became_peered":"2023-10-06T05:27:09.465353+0000","last_unstale":"2023-10-06T05:27:09.478819+0000","last_undegraded":"2023-10-06T05:27:09.478819+0000","last_fullsized":"2023-10-06T05:27:09.478819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:54.289894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.448733+0000","last_change":"2023-10-06T05:27:08.454716+0000","last_active":"2023-10-06T05:27:09.448733+0000","last_peered":"2023-10-06T05:27:09.448733+0000","last_clean":"2023-10-06T05:27:09.448733+0000","last_became_active":"2023-10-06T05:27:08.454402+0000","last_became_peered":"2023-10-06T05:27:08.454402+0000","last_unstale":"2023-10-06T05:27:09.448733+0000","last_undegraded":"2023-10-06T05:27:09.448733+0000","last_fullsized":"2023-10-06T05:27:09.448733+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:18.414035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.447360+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:27:09.447360+0000","last_peered":"2023-10-06T05:27:09.447360+0000","last_clean":"2023-10-06T05:27:09.447360+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:27:09.447360+0000","last_undegraded":"2023-10-06T05:27:09.447360+0000","last_fullsized":"2023-10-06T05:27:09.447360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473984+0000","last_change":"2023-10-06T05:27:09.463360+0000","last_active":"2023-10-06T05:27:09.473984+0000","last_peered":"2023-10-06T05:27:09.473984+0000","last_clean":"2023-10-06T05:27:09.473984+0000","last_became_active":"2023-10-06T05:27:09.462991+0000","last_became_peered":"2023-10-06T05:27:09.462991+0000","last_unstale":"2023-10-06T05:27:09.473984+0000","last_undegraded":"2023-10-06T05:27:09.473984+0000","last_fullsized":"2023-10-06T05:27:09.473984+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:18.072057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.454235+0000","last_change":"2023-10-06T05:27:08.465107+0000","last_active":"2023-10-06T05:27:09.454235+0000","last_peered":"2023-10-06T05:27:09.454235+0000","last_clean":"2023-10-06T05:27:09.454235+0000","last_became_active":"2023-10-06T05:27:08.464027+0000","last_became_peered":"2023-10-06T05:27:08.464027+0000","last_unstale":"2023-10-06T05:27:09.454235+0000","last_undegraded":"2023-10-06T05:27:09.454235+0000","last_fullsized":"2023-10-06T05:27:09.454235+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:18.414035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.451944+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:27:09.451944+0000","last_peered":"2023-10-06T05:27:09.451944+0000","last_clean":"2023-10-06T05:27:09.451944+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:27:09.451944+0000","last_undegraded":"2023-10-06T05:27:09.451944+0000","last_fullsized":"2023-10-06T05:27:09.451944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472269+0000","last_change":"2023-10-06T05:27:09.468446+0000","last_active":"2023-10-06T05:27:09.472269+0000","last_peered":"2023-10-06T05:27:09.472269+0000","last_clean":"2023-10-06T05:27:09.472269+0000","last_became_active":"2023-10-06T05:27:09.467739+0000","last_became_peered":"2023-10-06T05:27:09.467739+0000","last_unstale":"2023-10-06T05:27:09.472269+0000","last_undegraded":"2023-10-06T05:27:09.472269+0000","last_fullsized":"2023-10-06T05:27:09.472269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:00.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.481668+0000","last_change":"2023-10-06T05:27:08.471971+0000","last_active":"2023-10-06T05:27:09.481668+0000","last_peered":"2023-10-06T05:27:09.481668+0000","last_clean":"2023-10-06T05:27:09.481668+0000","last_became_active":"2023-10-06T05:27:08.471672+0000","last_became_peered":"2023-10-06T05:27:08.471672+0000","last_unstale":"2023-10-06T05:27:09.481668+0000","last_undegraded":"2023-10-06T05:27:09.481668+0000","last_fullsized":"2023-10-06T05:27:09.481668+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:46.129002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.455162+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:27:09.455162+0000","last_peered":"2023-10-06T05:27:09.455162+0000","last_clean":"2023-10-06T05:27:09.455162+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:27:09.455162+0000","last_undegraded":"2023-10-06T05:27:09.455162+0000","last_fullsized":"2023-10-06T05:27:09.455162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473647+0000","last_change":"2023-10-06T05:27:09.469435+0000","last_active":"2023-10-06T05:27:09.473647+0000","last_peered":"2023-10-06T05:27:09.473647+0000","last_clean":"2023-10-06T05:27:09.473647+0000","last_became_active":"2023-10-06T05:27:09.466794+0000","last_became_peered":"2023-10-06T05:27:09.466794+0000","last_unstale":"2023-10-06T05:27:09.473647+0000","last_undegraded":"2023-10-06T05:27:09.473647+0000","last_fullsized":"2023-10-06T05:27:09.473647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:43.295093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449781+0000","last_change":"2023-10-06T05:27:08.462882+0000","last_active":"2023-10-06T05:27:09.449781+0000","last_peered":"2023-10-06T05:27:09.449781+0000","last_clean":"2023-10-06T05:27:09.449781+0000","last_became_active":"2023-10-06T05:27:08.462583+0000","last_became_peered":"2023-10-06T05:27:08.462583+0000","last_unstale":"2023-10-06T05:27:09.449781+0000","last_undegraded":"2023-10-06T05:27:09.449781+0000","last_fullsized":"2023-10-06T05:27:09.449781+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:28.476040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.456163+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:27:09.456163+0000","last_peered":"2023-10-06T05:27:09.456163+0000","last_clean":"2023-10-06T05:27:09.456163+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:27:09.456163+0000","last_undegraded":"2023-10-06T05:27:09.456163+0000","last_fullsized":"2023-10-06T05:27:09.456163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.474247+0000","last_change":"2023-10-06T05:27:09.465769+0000","last_active":"2023-10-06T05:27:09.474247+0000","last_peered":"2023-10-06T05:27:09.474247+0000","last_clean":"2023-10-06T05:27:09.474247+0000","last_became_active":"2023-10-06T05:27:09.465424+0000","last_became_peered":"2023-10-06T05:27:09.465424+0000","last_unstale":"2023-10-06T05:27:09.474247+0000","last_undegraded":"2023-10-06T05:27:09.474247+0000","last_fullsized":"2023-10-06T05:27:09.474247+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:37.742410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.454480+0000","last_change":"2023-10-06T05:27:08.460204+0000","last_active":"2023-10-06T05:27:09.454480+0000","last_peered":"2023-10-06T05:27:09.454480+0000","last_clean":"2023-10-06T05:27:09.454480+0000","last_became_active":"2023-10-06T05:27:08.459894+0000","last_became_peered":"2023-10-06T05:27:08.459894+0000","last_unstale":"2023-10-06T05:27:09.454480+0000","last_undegraded":"2023-10-06T05:27:09.454480+0000","last_fullsized":"2023-10-06T05:27:09.454480+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:13.240736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449130+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:27:09.449130+0000","last_peered":"2023-10-06T05:27:09.449130+0000","last_clean":"2023-10-06T05:27:09.449130+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:27:09.449130+0000","last_undegraded":"2023-10-06T05:27:09.449130+0000","last_fullsized":"2023-10-06T05:27:09.449130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473675+0000","last_change":"2023-10-06T05:27:09.469294+0000","last_active":"2023-10-06T05:27:09.473675+0000","last_peered":"2023-10-06T05:27:09.473675+0000","last_clean":"2023-10-06T05:27:09.473675+0000","last_became_active":"2023-10-06T05:27:09.468948+0000","last_became_peered":"2023-10-06T05:27:09.468948+0000","last_unstale":"2023-10-06T05:27:09.473675+0000","last_undegraded":"2023-10-06T05:27:09.473675+0000","last_fullsized":"2023-10-06T05:27:09.473675+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:37.742410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.460879+0000","last_change":"2023-10-06T05:27:08.463911+0000","last_active":"2023-10-06T05:27:09.460879+0000","last_peered":"2023-10-06T05:27:09.460879+0000","last_clean":"2023-10-06T05:27:09.460879+0000","last_became_active":"2023-10-06T05:27:08.463633+0000","last_became_peered":"2023-10-06T05:27:08.463633+0000","last_unstale":"2023-10-06T05:27:09.460879+0000","last_undegraded":"2023-10-06T05:27:09.460879+0000","last_fullsized":"2023-10-06T05:27:09.460879+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:55.656738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.459007+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:27:09.459007+0000","last_peered":"2023-10-06T05:27:09.459007+0000","last_clean":"2023-10-06T05:27:09.459007+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:27:09.459007+0000","last_undegraded":"2023-10-06T05:27:09.459007+0000","last_fullsized":"2023-10-06T05:27:09.459007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471040+0000","last_change":"2023-10-06T05:27:09.463847+0000","last_active":"2023-10-06T05:27:09.471040+0000","last_peered":"2023-10-06T05:27:09.471040+0000","last_clean":"2023-10-06T05:27:09.471040+0000","last_became_active":"2023-10-06T05:27:09.463415+0000","last_became_peered":"2023-10-06T05:27:09.463415+0000","last_unstale":"2023-10-06T05:27:09.471040+0000","last_undegraded":"2023-10-06T05:27:09.471040+0000","last_fullsized":"2023-10-06T05:27:09.471040+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:11.061434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.455770+0000","last_change":"2023-10-06T05:27:08.464101+0000","last_active":"2023-10-06T05:27:09.455770+0000","last_peered":"2023-10-06T05:27:09.455770+0000","last_clean":"2023-10-06T05:27:09.455770+0000","last_became_active":"2023-10-06T05:27:08.463820+0000","last_became_peered":"2023-10-06T05:27:08.463820+0000","last_unstale":"2023-10-06T05:27:09.455770+0000","last_undegraded":"2023-10-06T05:27:09.455770+0000","last_fullsized":"2023-10-06T05:27:09.455770+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:54.277427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.459157+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:27:09.459157+0000","last_peered":"2023-10-06T05:27:09.459157+0000","last_clean":"2023-10-06T05:27:09.459157+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:27:09.459157+0000","last_undegraded":"2023-10-06T05:27:09.459157+0000","last_fullsized":"2023-10-06T05:27:09.459157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302524,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069316,"statfs":{"total":96636764160,"available":96326979584,"internally_reserved":0,"allocated":1167360,"data_stored":829684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.1910000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.117}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.2809999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.24},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.373}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.1539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297848,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":573440,"data_stored":239816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.497},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.155},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.996}]},{"osd":2,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.2370000000000001}]},{"osd":4,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.018}]},{"osd":5,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.29}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":239192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0469999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.3260000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.2210000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.1259999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.097}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.2709999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.244}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297844,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":569344,"data_stored":239746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.2130000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":1.044},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.081}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.1919999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.115},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.145},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.282}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.306}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.365},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.345}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":581632,"data_stored":240750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.65700000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.628},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.97799999999999998}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301948,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069892,"statfs":{"total":96636764160,"available":96327569408,"internally_reserved":0,"allocated":577536,"data_stored":240728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.433}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301944,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069896,"statfs":{"total":96636764160,"available":96327573504,"internally_reserved":0,"allocated":573440,"data_stored":239352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.468},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.90000000000000002}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.84199999999999997}]},{"osd":4,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.252},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.5720000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.194},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.1060000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.3899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302524,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069316,"statfs":{"total":96636764160,"available":96326979584,"internally_reserved":0,"allocated":1167360,"data_stored":829616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.99399999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.139},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.542}]},{"osd":7,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.1779999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:27:20.301 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:27:20.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6c9c0700 1 Processor -- start 2023-10-06T05:27:20.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6c9c0700 1 -- start start 2023-10-06T05:27:20.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6c9c0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8d68158fa0 0x7f8d680ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6c9c0700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d680acc40 0x7f8d680c9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6c9c0700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d680c7090 con 0x7f8d68158bd0 2023-10-06T05:27:20.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6c9c0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d68159420 con 0x7f8d68158fa0 2023-10-06T05:27:20.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6c9c0700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6806b9b0 con 0x7f8d680acc40 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8d68158fa0 0x7f8d680ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d680acc40 0x7f8d680c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d680acc40 0x7f8d680c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:42888/0 (socket says 172.21.15.29:42888) 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d66d9d700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f8d68158bd0 0x7f8d6806b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:49990/0 (socket says 172.21.15.29:49990) 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6759e700 1 -- 172.21.15.29:0/2411242313 learned_addr learned my addr 172.21.15.29:0/2411242313 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8d68158fa0 0x7f8d680ac700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55048/0 (socket says 172.21.15.29:55048) 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6759e700 1 -- 172.21.15.29:0/2411242313 >> v2:172.21.15.29:3300/0 conn(0x7f8d68158fa0 msgr2=0x7f8d680ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6759e700 1 --2- 172.21.15.29:0/2411242313 >> v2:172.21.15.29:3300/0 conn(0x7f8d68158fa0 0x7f8d680ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6759e700 1 -- 172.21.15.29:0/2411242313 >> v1:172.21.15.173:6789/0 conn(0x7f8d68158bd0 legacy=0x7f8d6806b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d65d9b700 1 -- 172.21.15.29:0/2411242313 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908820767 0 0) 0x7f8d680c7090 con 0x7f8d68158bd0 2023-10-06T05:27:20.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6759e700 1 -- 172.21.15.29:0/2411242313 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6806bc80 con 0x7f8d680acc40 2023-10-06T05:27:20.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.412+0000 7f8d6759e700 1 --2- 172.21.15.29:0/2411242313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d680acc40 0x7f8d680c9220 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8d6806b150 tx=0x7f8d60009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa8199dc3b362255 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:20.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d65d9b700 1 -- 172.21.15.29:0/2411242313 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60009e70 con 0x7f8d680acc40 2023-10-06T05:27:20.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d65d9b700 1 -- 172.21.15.29:0/2411242313 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6000b860 con 0x7f8d680acc40 2023-10-06T05:27:20.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d65d9b700 1 -- 172.21.15.29:0/2411242313 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000bc00 con 0x7f8d680acc40 2023-10-06T05:27:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2411242313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d680acc40 msgr2=0x7f8d680c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 --2- 172.21.15.29:0/2411242313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d680acc40 0x7f8d680c9220 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8d6806b150 tx=0x7f8d60009250 comp rx=0 tx=0).stop 2023-10-06T05:27:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2411242313 shutdown_connections 2023-10-06T05:27:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 --2- 172.21.15.29:0/2411242313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d680acc40 0x7f8d680c9220 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 --2- 172.21.15.29:0/2411242313 >> v2:172.21.15.29:3300/0 conn(0x7f8d68158fa0 0x7f8d680ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2411242313 >> 172.21.15.29:0/2411242313 conn(0x7f8d6806d7d0 msgr2=0x7f8d6806dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2411242313 shutdown_connections 2023-10-06T05:27:20.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2411242313 wait complete. 2023-10-06T05:27:20.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 Processor -- start 2023-10-06T05:27:20.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.416+0000 7f8d6c9c0700 1 -- start start 2023-10-06T05:27:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6c9c0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d680acc40 0x7f8d68169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6c9c0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d68158bd0 0x7f8d68155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6c9c0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d68158fa0 0x7f8d6815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6c9c0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68159980 con 0x7f8d68158bd0 2023-10-06T05:27:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6c9c0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680a9ba0 con 0x7f8d680acc40 2023-10-06T05:27:20.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6c9c0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680a9e40 con 0x7f8d68158fa0 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d68158bd0 0x7f8d68155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d68158bd0 0x7f8d68155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55062/0 (socket says 172.21.15.29:55062) 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6659c700 1 -- 172.21.15.29:0/2681367269 learned_addr learned my addr 172.21.15.29:0/2681367269 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d66d9d700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d680acc40 0x7f8d68169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6759e700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d68158fa0 0x7f8d6815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6659c700 1 -- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d68158fa0 msgr2=0x7f8d6815b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6659c700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d68158fa0 0x7f8d6815b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6659c700 1 -- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d680acc40 msgr2=0x7f8d68169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6659c700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d680acc40 0x7f8d68169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6659c700 1 -- 172.21.15.29:0/2681367269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d600094f0 con 0x7f8d68158bd0 2023-10-06T05:27:20.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6659c700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d68158bd0 0x7f8d68155e30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00e930 tx=0x7f8d5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:20.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d4effd700 1 -- 172.21.15.29:0/2681367269 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c013680 con 0x7f8d68158bd0 2023-10-06T05:27:20.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d4effd700 1 -- 172.21.15.29:0/2681367269 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c0137e0 con 0x7f8d68158bd0 2023-10-06T05:27:20.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d68159610 con 0x7f8d68158bd0 2023-10-06T05:27:20.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d4effd700 1 -- 172.21.15.29:0/2681367269 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c013b80 con 0x7f8d68158bd0 2023-10-06T05:27:20.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.420+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d680aa120 con 0x7f8d68158bd0 2023-10-06T05:27:20.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.424+0000 7f8d4effd700 1 -- 172.21.15.29:0/2681367269 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8d5c00c3e0 con 0x7f8d68158bd0 2023-10-06T05:27:20.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.424+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d68159b30 con 0x7f8d68158bd0 2023-10-06T05:27:20.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.424+0000 7f8d4effd700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d54060550 0x7f8d54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.424+0000 7f8d4effd700 1 -- 172.21.15.29:0/2681367269 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d5c07c990 con 0x7f8d68158bd0 2023-10-06T05:27:20.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.424+0000 7f8d66d9d700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d54060550 0x7f8d54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.424+0000 7f8d66d9d700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d54060550 0x7f8d54062a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d680b1d30 tx=0x7f8d58001b00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:20.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.428+0000 7f8d4effd700 1 -- 172.21.15.29:0/2681367269 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8d68159b30 con 0x7f8d68158bd0 2023-10-06T05:27:20.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.584+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d6804be00 con 0x7f8d54060550 2023-10-06T05:27:20.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.604+0000 7f8d4effd700 1 -- 172.21.15.29:0/2681367269 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310064 (secure 0 0 0) 0x7f8d6804be00 con 0x7f8d54060550 2023-10-06T05:27:20.611 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:20.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d54060550 msgr2=0x7f8d54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d54060550 0x7f8d54062a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d680b1d30 tx=0x7f8d58001b00 comp rx=0 tx=0).stop 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d68158bd0 msgr2=0x7f8d68155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d68158bd0 0x7f8d68155e30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00e930 tx=0x7f8d5c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 shutdown_connections 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8d68158fa0 0x7f8d6815b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d68158bd0 0x7f8d68155e30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8d54060550 0x7f8d54062a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 --2- 172.21.15.29:0/2681367269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d680acc40 0x7f8d68169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 >> 172.21.15.29:0/2681367269 conn(0x7f8d6806d7d0 msgr2=0x7f8d680adcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:20.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 shutdown_connections 2023-10-06T05:27:20.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.608+0000 7f8d6c9c0700 1 -- 172.21.15.29:0/2681367269 wait complete. 2023-10-06T05:27:20.616 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:27:20.629 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-10-06T05:27:18.683077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404424,"kb_used_data":5640,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570296,"statfs":{"total":773094113280,"available":770631983104,"internally_reserved":0,"allocated":5775360,"data_stored":3098884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.238292"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473552+0000","last_change":"2023-10-06T05:27:09.467339+0000","last_active":"2023-10-06T05:27:09.473552+0000","last_peered":"2023-10-06T05:27:09.473552+0000","last_clean":"2023-10-06T05:27:09.473552+0000","last_became_active":"2023-10-06T05:27:09.466947+0000","last_became_peered":"2023-10-06T05:27:09.466947+0000","last_unstale":"2023-10-06T05:27:09.473552+0000","last_undegraded":"2023-10-06T05:27:09.473552+0000","last_fullsized":"2023-10-06T05:27:09.473552+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:38.548281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471131+0000","last_change":"2023-10-06T05:27:09.461527+0000","last_active":"2023-10-06T05:27:09.471131+0000","last_peered":"2023-10-06T05:27:09.471131+0000","last_clean":"2023-10-06T05:27:09.471131+0000","last_became_active":"2023-10-06T05:27:09.461213+0000","last_became_peered":"2023-10-06T05:27:09.461213+0000","last_unstale":"2023-10-06T05:27:09.471131+0000","last_undegraded":"2023-10-06T05:27:09.471131+0000","last_fullsized":"2023-10-06T05:27:09.471131+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:38.548281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473913+0000","last_change":"2023-10-06T05:27:09.470141+0000","last_active":"2023-10-06T05:27:09.473913+0000","last_peered":"2023-10-06T05:27:09.473913+0000","last_clean":"2023-10-06T05:27:09.473913+0000","last_became_active":"2023-10-06T05:27:09.466967+0000","last_became_peered":"2023-10-06T05:27:09.466967+0000","last_unstale":"2023-10-06T05:27:09.473913+0000","last_undegraded":"2023-10-06T05:27:09.473913+0000","last_fullsized":"2023-10-06T05:27:09.473913+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:00.610554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471453+0000","last_change":"2023-10-06T05:27:09.468052+0000","last_active":"2023-10-06T05:27:09.471453+0000","last_peered":"2023-10-06T05:27:09.471453+0000","last_clean":"2023-10-06T05:27:09.471453+0000","last_became_active":"2023-10-06T05:27:09.467740+0000","last_became_peered":"2023-10-06T05:27:09.467740+0000","last_unstale":"2023-10-06T05:27:09.471453+0000","last_undegraded":"2023-10-06T05:27:09.471453+0000","last_fullsized":"2023-10-06T05:27:09.471453+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:28.584719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473140+0000","last_change":"2023-10-06T05:27:09.469091+0000","last_active":"2023-10-06T05:27:09.473140+0000","last_peered":"2023-10-06T05:27:09.473140+0000","last_clean":"2023-10-06T05:27:09.473140+0000","last_became_active":"2023-10-06T05:27:09.468775+0000","last_became_peered":"2023-10-06T05:27:09.468775+0000","last_unstale":"2023-10-06T05:27:09.473140+0000","last_undegraded":"2023-10-06T05:27:09.473140+0000","last_fullsized":"2023-10-06T05:27:09.473140+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:15.747971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.478859+0000","last_change":"2023-10-06T05:27:09.469255+0000","last_active":"2023-10-06T05:27:09.478859+0000","last_peered":"2023-10-06T05:27:09.478859+0000","last_clean":"2023-10-06T05:27:09.478859+0000","last_became_active":"2023-10-06T05:27:09.468996+0000","last_became_peered":"2023-10-06T05:27:09.468996+0000","last_unstale":"2023-10-06T05:27:09.478859+0000","last_undegraded":"2023-10-06T05:27:09.478859+0000","last_fullsized":"2023-10-06T05:27:09.478859+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:56.669139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473612+0000","last_change":"2023-10-06T05:27:09.469344+0000","last_active":"2023-10-06T05:27:09.473612+0000","last_peered":"2023-10-06T05:27:09.473612+0000","last_clean":"2023-10-06T05:27:09.473612+0000","last_became_active":"2023-10-06T05:27:09.468839+0000","last_became_peered":"2023-10-06T05:27:09.468839+0000","last_unstale":"2023-10-06T05:27:09.473612+0000","last_undegraded":"2023-10-06T05:27:09.473612+0000","last_fullsized":"2023-10-06T05:27:09.473612+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:58.859726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.483848+0000","last_change":"2023-10-06T05:27:09.475748+0000","last_active":"2023-10-06T05:27:09.483848+0000","last_peered":"2023-10-06T05:27:09.483848+0000","last_clean":"2023-10-06T05:27:09.483848+0000","last_became_active":"2023-10-06T05:27:09.475476+0000","last_became_peered":"2023-10-06T05:27:09.475476+0000","last_unstale":"2023-10-06T05:27:09.483848+0000","last_undegraded":"2023-10-06T05:27:09.483848+0000","last_fullsized":"2023-10-06T05:27:09.483848+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:08.985033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.483347+0000","last_change":"2023-10-06T05:27:09.475174+0000","last_active":"2023-10-06T05:27:09.483347+0000","last_peered":"2023-10-06T05:27:09.483347+0000","last_clean":"2023-10-06T05:27:09.483347+0000","last_became_active":"2023-10-06T05:27:09.474865+0000","last_became_peered":"2023-10-06T05:27:09.474865+0000","last_unstale":"2023-10-06T05:27:09.483347+0000","last_undegraded":"2023-10-06T05:27:09.483347+0000","last_fullsized":"2023-10-06T05:27:09.483347+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:10.229866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473493+0000","last_change":"2023-10-06T05:27:09.465447+0000","last_active":"2023-10-06T05:27:09.473493+0000","last_peered":"2023-10-06T05:27:09.473493+0000","last_clean":"2023-10-06T05:27:09.473493+0000","last_became_active":"2023-10-06T05:27:09.465146+0000","last_became_peered":"2023-10-06T05:27:09.465146+0000","last_unstale":"2023-10-06T05:27:09.473493+0000","last_undegraded":"2023-10-06T05:27:09.473493+0000","last_fullsized":"2023-10-06T05:27:09.473493+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:21.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.476744+0000","last_change":"2023-10-06T05:27:09.464263+0000","last_active":"2023-10-06T05:27:09.476744+0000","last_peered":"2023-10-06T05:27:09.476744+0000","last_clean":"2023-10-06T05:27:09.476744+0000","last_became_active":"2023-10-06T05:27:09.463934+0000","last_became_peered":"2023-10-06T05:27:09.463934+0000","last_unstale":"2023-10-06T05:27:09.476744+0000","last_undegraded":"2023-10-06T05:27:09.476744+0000","last_fullsized":"2023-10-06T05:27:09.476744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:58.461069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.479932+0000","last_change":"2023-10-06T05:27:09.466456+0000","last_active":"2023-10-06T05:27:09.479932+0000","last_peered":"2023-10-06T05:27:09.479932+0000","last_clean":"2023-10-06T05:27:09.479932+0000","last_became_active":"2023-10-06T05:27:09.466012+0000","last_became_peered":"2023-10-06T05:27:09.466012+0000","last_unstale":"2023-10-06T05:27:09.479932+0000","last_undegraded":"2023-10-06T05:27:09.479932+0000","last_fullsized":"2023-10-06T05:27:09.479932+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:50.033168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473436+0000","last_change":"2023-10-06T05:27:09.467052+0000","last_active":"2023-10-06T05:27:09.473436+0000","last_peered":"2023-10-06T05:27:09.473436+0000","last_clean":"2023-10-06T05:27:09.473436+0000","last_became_active":"2023-10-06T05:27:09.465635+0000","last_became_peered":"2023-10-06T05:27:09.465635+0000","last_unstale":"2023-10-06T05:27:09.473436+0000","last_undegraded":"2023-10-06T05:27:09.473436+0000","last_fullsized":"2023-10-06T05:27:09.473436+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:29.488441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473707+0000","last_change":"2023-10-06T05:27:09.469570+0000","last_active":"2023-10-06T05:27:09.473707+0000","last_peered":"2023-10-06T05:27:09.473707+0000","last_clean":"2023-10-06T05:27:09.473707+0000","last_became_active":"2023-10-06T05:27:09.469205+0000","last_became_peered":"2023-10-06T05:27:09.469205+0000","last_unstale":"2023-10-06T05:27:09.473707+0000","last_undegraded":"2023-10-06T05:27:09.473707+0000","last_fullsized":"2023-10-06T05:27:09.473707+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:50.062500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471293+0000","last_change":"2023-10-06T05:27:09.462502+0000","last_active":"2023-10-06T05:27:09.471293+0000","last_peered":"2023-10-06T05:27:09.471293+0000","last_clean":"2023-10-06T05:27:09.471293+0000","last_became_active":"2023-10-06T05:27:09.462149+0000","last_became_peered":"2023-10-06T05:27:09.462149+0000","last_unstale":"2023-10-06T05:27:09.471293+0000","last_undegraded":"2023-10-06T05:27:09.471293+0000","last_fullsized":"2023-10-06T05:27:09.471293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:56.669139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473449+0000","last_change":"2023-10-06T05:27:09.465729+0000","last_active":"2023-10-06T05:27:09.473449+0000","last_peered":"2023-10-06T05:27:09.473449+0000","last_clean":"2023-10-06T05:27:09.473449+0000","last_became_active":"2023-10-06T05:27:09.464939+0000","last_became_peered":"2023-10-06T05:27:09.464939+0000","last_unstale":"2023-10-06T05:27:09.473449+0000","last_undegraded":"2023-10-06T05:27:09.473449+0000","last_fullsized":"2023-10-06T05:27:09.473449+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:14.253137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473208+0000","last_change":"2023-10-06T05:27:09.465490+0000","last_active":"2023-10-06T05:27:09.473208+0000","last_peered":"2023-10-06T05:27:09.473208+0000","last_clean":"2023-10-06T05:27:09.473208+0000","last_became_active":"2023-10-06T05:27:09.464550+0000","last_became_peered":"2023-10-06T05:27:09.464550+0000","last_unstale":"2023-10-06T05:27:09.473208+0000","last_undegraded":"2023-10-06T05:27:09.473208+0000","last_fullsized":"2023-10-06T05:27:09.473208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:58.753411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471154+0000","last_change":"2023-10-06T05:27:09.461722+0000","last_active":"2023-10-06T05:27:09.471154+0000","last_peered":"2023-10-06T05:27:09.471154+0000","last_clean":"2023-10-06T05:27:09.471154+0000","last_became_active":"2023-10-06T05:27:09.461254+0000","last_became_peered":"2023-10-06T05:27:09.461254+0000","last_unstale":"2023-10-06T05:27:09.471154+0000","last_undegraded":"2023-10-06T05:27:09.471154+0000","last_fullsized":"2023-10-06T05:27:09.471154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:29.488441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473132+0000","last_change":"2023-10-06T05:27:09.462771+0000","last_active":"2023-10-06T05:27:09.473132+0000","last_peered":"2023-10-06T05:27:09.473132+0000","last_clean":"2023-10-06T05:27:09.473132+0000","last_became_active":"2023-10-06T05:27:09.462390+0000","last_became_peered":"2023-10-06T05:27:09.462390+0000","last_unstale":"2023-10-06T05:27:09.473132+0000","last_undegraded":"2023-10-06T05:27:09.473132+0000","last_fullsized":"2023-10-06T05:27:09.473132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:50.033168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472101+0000","last_change":"2023-10-06T05:27:09.467005+0000","last_active":"2023-10-06T05:27:09.472101+0000","last_peered":"2023-10-06T05:27:09.472101+0000","last_clean":"2023-10-06T05:27:09.472101+0000","last_became_active":"2023-10-06T05:27:09.466489+0000","last_became_peered":"2023-10-06T05:27:09.466489+0000","last_unstale":"2023-10-06T05:27:09.472101+0000","last_undegraded":"2023-10-06T05:27:09.472101+0000","last_fullsized":"2023-10-06T05:27:09.472101+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:27.636961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472158+0000","last_change":"2023-10-06T05:27:09.469766+0000","last_active":"2023-10-06T05:27:09.472158+0000","last_peered":"2023-10-06T05:27:09.472158+0000","last_clean":"2023-10-06T05:27:09.472158+0000","last_became_active":"2023-10-06T05:27:09.469388+0000","last_became_peered":"2023-10-06T05:27:09.469388+0000","last_unstale":"2023-10-06T05:27:09.472158+0000","last_undegraded":"2023-10-06T05:27:09.472158+0000","last_fullsized":"2023-10-06T05:27:09.472158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:55.047489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.483355+0000","last_change":"2023-10-06T05:27:09.475304+0000","last_active":"2023-10-06T05:27:09.483355+0000","last_peered":"2023-10-06T05:27:09.483355+0000","last_clean":"2023-10-06T05:27:09.483355+0000","last_became_active":"2023-10-06T05:27:09.474989+0000","last_became_peered":"2023-10-06T05:27:09.474989+0000","last_unstale":"2023-10-06T05:27:09.483355+0000","last_undegraded":"2023-10-06T05:27:09.483355+0000","last_fullsized":"2023-10-06T05:27:09.483355+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:03.051979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.476969+0000","last_change":"2023-10-06T05:27:09.463775+0000","last_active":"2023-10-06T05:27:09.476969+0000","last_peered":"2023-10-06T05:27:09.476969+0000","last_clean":"2023-10-06T05:27:09.476969+0000","last_became_active":"2023-10-06T05:27:09.463431+0000","last_became_peered":"2023-10-06T05:27:09.463431+0000","last_unstale":"2023-10-06T05:27:09.476969+0000","last_undegraded":"2023-10-06T05:27:09.476969+0000","last_fullsized":"2023-10-06T05:27:09.476969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:07.045340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.460263+0000","last_change":"2023-10-06T05:27:09.458420+0000","last_active":"2023-10-06T05:27:09.460263+0000","last_peered":"2023-10-06T05:27:09.460263+0000","last_clean":"2023-10-06T05:27:09.460263+0000","last_became_active":"2023-10-06T05:27:09.458103+0000","last_became_peered":"2023-10-06T05:27:09.458103+0000","last_unstale":"2023-10-06T05:27:09.460263+0000","last_undegraded":"2023-10-06T05:27:09.460263+0000","last_fullsized":"2023-10-06T05:27:09.460263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:56.669139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473956+0000","last_change":"2023-10-06T05:27:09.471937+0000","last_active":"2023-10-06T05:27:09.473956+0000","last_peered":"2023-10-06T05:27:09.473956+0000","last_clean":"2023-10-06T05:27:09.473956+0000","last_became_active":"2023-10-06T05:27:09.468813+0000","last_became_peered":"2023-10-06T05:27:09.468813+0000","last_unstale":"2023-10-06T05:27:09.473956+0000","last_undegraded":"2023-10-06T05:27:09.473956+0000","last_fullsized":"2023-10-06T05:27:09.473956+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:11.612360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485271+0000","last_change":"2023-10-06T05:27:09.478612+0000","last_active":"2023-10-06T05:27:09.485271+0000","last_peered":"2023-10-06T05:27:09.485271+0000","last_clean":"2023-10-06T05:27:09.485271+0000","last_became_active":"2023-10-06T05:27:09.478298+0000","last_became_peered":"2023-10-06T05:27:09.478298+0000","last_unstale":"2023-10-06T05:27:09.485271+0000","last_undegraded":"2023-10-06T05:27:09.485271+0000","last_fullsized":"2023-10-06T05:27:09.485271+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:58.753411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473457+0000","last_change":"2023-10-06T05:27:09.464924+0000","last_active":"2023-10-06T05:27:09.473457+0000","last_peered":"2023-10-06T05:27:09.473457+0000","last_clean":"2023-10-06T05:27:09.473457+0000","last_became_active":"2023-10-06T05:27:09.464479+0000","last_became_peered":"2023-10-06T05:27:09.464479+0000","last_unstale":"2023-10-06T05:27:09.473457+0000","last_undegraded":"2023-10-06T05:27:09.473457+0000","last_fullsized":"2023-10-06T05:27:09.473457+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:34.716115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470801+0000","last_change":"2023-10-06T05:27:09.463541+0000","last_active":"2023-10-06T05:27:09.470801+0000","last_peered":"2023-10-06T05:27:09.470801+0000","last_clean":"2023-10-06T05:27:09.470801+0000","last_became_active":"2023-10-06T05:27:09.463277+0000","last_became_peered":"2023-10-06T05:27:09.463277+0000","last_unstale":"2023-10-06T05:27:09.470801+0000","last_undegraded":"2023-10-06T05:27:09.470801+0000","last_fullsized":"2023-10-06T05:27:09.470801+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:40.107384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471647+0000","last_change":"2023-10-06T05:27:09.461750+0000","last_active":"2023-10-06T05:27:09.471647+0000","last_peered":"2023-10-06T05:27:09.471647+0000","last_clean":"2023-10-06T05:27:09.471647+0000","last_became_active":"2023-10-06T05:27:09.461407+0000","last_became_peered":"2023-10-06T05:27:09.461407+0000","last_unstale":"2023-10-06T05:27:09.471647+0000","last_undegraded":"2023-10-06T05:27:09.471647+0000","last_fullsized":"2023-10-06T05:27:09.471647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:00.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471396+0000","last_change":"2023-10-06T05:27:09.466522+0000","last_active":"2023-10-06T05:27:09.471396+0000","last_peered":"2023-10-06T05:27:09.471396+0000","last_clean":"2023-10-06T05:27:09.471396+0000","last_became_active":"2023-10-06T05:27:09.466193+0000","last_became_peered":"2023-10-06T05:27:09.466193+0000","last_unstale":"2023-10-06T05:27:09.471396+0000","last_undegraded":"2023-10-06T05:27:09.471396+0000","last_fullsized":"2023-10-06T05:27:09.471396+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:25.582818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473588+0000","last_change":"2023-10-06T05:27:09.469138+0000","last_active":"2023-10-06T05:27:09.473588+0000","last_peered":"2023-10-06T05:27:09.473588+0000","last_clean":"2023-10-06T05:27:09.473588+0000","last_became_active":"2023-10-06T05:27:09.466465+0000","last_became_peered":"2023-10-06T05:27:09.466465+0000","last_unstale":"2023-10-06T05:27:09.473588+0000","last_undegraded":"2023-10-06T05:27:09.473588+0000","last_fullsized":"2023-10-06T05:27:09.473588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:12.236888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472283+0000","last_change":"2023-10-06T05:27:09.468648+0000","last_active":"2023-10-06T05:27:09.472283+0000","last_peered":"2023-10-06T05:27:09.472283+0000","last_clean":"2023-10-06T05:27:09.472283+0000","last_became_active":"2023-10-06T05:27:09.468174+0000","last_became_peered":"2023-10-06T05:27:09.468174+0000","last_unstale":"2023-10-06T05:27:09.472283+0000","last_undegraded":"2023-10-06T05:27:09.472283+0000","last_fullsized":"2023-10-06T05:27:09.472283+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:39.360520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.468421+0000","last_change":"2023-10-06T05:27:09.460060+0000","last_active":"2023-10-06T05:27:09.468421+0000","last_peered":"2023-10-06T05:27:09.468421+0000","last_clean":"2023-10-06T05:27:09.468421+0000","last_became_active":"2023-10-06T05:27:09.459670+0000","last_became_peered":"2023-10-06T05:27:09.459670+0000","last_unstale":"2023-10-06T05:27:09.468421+0000","last_undegraded":"2023-10-06T05:27:09.468421+0000","last_fullsized":"2023-10-06T05:27:09.468421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:14.253137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.481524+0000","last_change":"2023-10-06T05:27:08.454537+0000","last_active":"2023-10-06T05:27:09.481524+0000","last_peered":"2023-10-06T05:27:09.481524+0000","last_clean":"2023-10-06T05:27:09.481524+0000","last_became_active":"2023-10-06T05:27:08.454244+0000","last_became_peered":"2023-10-06T05:27:08.454244+0000","last_unstale":"2023-10-06T05:27:09.481524+0000","last_undegraded":"2023-10-06T05:27:09.481524+0000","last_fullsized":"2023-10-06T05:27:09.481524+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:10.700348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470979+0000","last_change":"2023-10-06T05:27:09.463837+0000","last_active":"2023-10-06T05:27:09.470979+0000","last_peered":"2023-10-06T05:27:09.470979+0000","last_clean":"2023-10-06T05:27:09.470979+0000","last_became_active":"2023-10-06T05:27:09.463133+0000","last_became_peered":"2023-10-06T05:27:09.463133+0000","last_unstale":"2023-10-06T05:27:09.470979+0000","last_undegraded":"2023-10-06T05:27:09.470979+0000","last_fullsized":"2023-10-06T05:27:09.470979+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:26.248711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485464+0000","last_change":"2023-10-06T05:27:08.469048+0000","last_active":"2023-10-06T05:27:09.485464+0000","last_peered":"2023-10-06T05:27:09.485464+0000","last_clean":"2023-10-06T05:27:09.485464+0000","last_became_active":"2023-10-06T05:27:08.468758+0000","last_became_peered":"2023-10-06T05:27:08.468758+0000","last_unstale":"2023-10-06T05:27:09.485464+0000","last_undegraded":"2023-10-06T05:27:09.485464+0000","last_fullsized":"2023-10-06T05:27:09.485464+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:07.241389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472109+0000","last_change":"2023-10-06T05:27:09.469079+0000","last_active":"2023-10-06T05:27:09.472109+0000","last_peered":"2023-10-06T05:27:09.472109+0000","last_clean":"2023-10-06T05:27:09.472109+0000","last_became_active":"2023-10-06T05:27:09.468799+0000","last_became_peered":"2023-10-06T05:27:09.468799+0000","last_unstale":"2023-10-06T05:27:09.472109+0000","last_undegraded":"2023-10-06T05:27:09.472109+0000","last_fullsized":"2023-10-06T05:27:09.472109+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:29.435631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.482017+0000","last_change":"2023-10-06T05:27:08.459693+0000","last_active":"2023-10-06T05:27:09.482017+0000","last_peered":"2023-10-06T05:27:09.482017+0000","last_clean":"2023-10-06T05:27:09.482017+0000","last_became_active":"2023-10-06T05:27:08.459348+0000","last_became_peered":"2023-10-06T05:27:08.459348+0000","last_unstale":"2023-10-06T05:27:09.482017+0000","last_undegraded":"2023-10-06T05:27:09.482017+0000","last_fullsized":"2023-10-06T05:27:09.482017+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:20.524038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.479897+0000","last_change":"2023-10-06T05:27:09.466076+0000","last_active":"2023-10-06T05:27:09.479897+0000","last_peered":"2023-10-06T05:27:09.479897+0000","last_clean":"2023-10-06T05:27:09.479897+0000","last_became_active":"2023-10-06T05:27:09.465698+0000","last_became_peered":"2023-10-06T05:27:09.465698+0000","last_unstale":"2023-10-06T05:27:09.479897+0000","last_undegraded":"2023-10-06T05:27:09.479897+0000","last_fullsized":"2023-10-06T05:27:09.479897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:43.295093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485738+0000","last_change":"2023-10-06T05:27:08.461036+0000","last_active":"2023-10-06T05:27:09.485738+0000","last_peered":"2023-10-06T05:27:09.485738+0000","last_clean":"2023-10-06T05:27:09.485738+0000","last_became_active":"2023-10-06T05:27:08.460769+0000","last_became_peered":"2023-10-06T05:27:08.460769+0000","last_unstale":"2023-10-06T05:27:09.485738+0000","last_undegraded":"2023-10-06T05:27:09.485738+0000","last_fullsized":"2023-10-06T05:27:09.485738+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:53.277493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.465042+0000","last_change":"2023-10-06T05:27:09.462605+0000","last_active":"2023-10-06T05:27:09.465042+0000","last_peered":"2023-10-06T05:27:09.465042+0000","last_clean":"2023-10-06T05:27:09.465042+0000","last_became_active":"2023-10-06T05:27:09.462335+0000","last_became_peered":"2023-10-06T05:27:09.462335+0000","last_unstale":"2023-10-06T05:27:09.465042+0000","last_undegraded":"2023-10-06T05:27:09.465042+0000","last_fullsized":"2023-10-06T05:27:09.465042+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:23.152618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.484733+0000","last_change":"2023-10-06T05:27:08.465190+0000","last_active":"2023-10-06T05:27:09.484733+0000","last_peered":"2023-10-06T05:27:09.484733+0000","last_clean":"2023-10-06T05:27:09.484733+0000","last_became_active":"2023-10-06T05:27:08.464090+0000","last_became_peered":"2023-10-06T05:27:08.464090+0000","last_unstale":"2023-10-06T05:27:09.484733+0000","last_undegraded":"2023-10-06T05:27:09.484733+0000","last_fullsized":"2023-10-06T05:27:09.484733+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:58.692007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471414+0000","last_change":"2023-10-06T05:27:09.466576+0000","last_active":"2023-10-06T05:27:09.471414+0000","last_peered":"2023-10-06T05:27:09.471414+0000","last_clean":"2023-10-06T05:27:09.471414+0000","last_became_active":"2023-10-06T05:27:09.466231+0000","last_became_peered":"2023-10-06T05:27:09.466231+0000","last_unstale":"2023-10-06T05:27:09.471414+0000","last_undegraded":"2023-10-06T05:27:09.471414+0000","last_fullsized":"2023-10-06T05:27:09.471414+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:55.289829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.481041+0000","last_change":"2023-10-06T05:27:08.456349+0000","last_active":"2023-10-06T05:27:09.481041+0000","last_peered":"2023-10-06T05:27:09.481041+0000","last_clean":"2023-10-06T05:27:09.481041+0000","last_became_active":"2023-10-06T05:27:08.456061+0000","last_became_peered":"2023-10-06T05:27:08.456061+0000","last_unstale":"2023-10-06T05:27:09.481041+0000","last_undegraded":"2023-10-06T05:27:09.481041+0000","last_fullsized":"2023-10-06T05:27:09.481041+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:13.240736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.484789+0000","last_change":"2023-10-06T05:27:09.478058+0000","last_active":"2023-10-06T05:27:09.484789+0000","last_peered":"2023-10-06T05:27:09.484789+0000","last_clean":"2023-10-06T05:27:09.484789+0000","last_became_active":"2023-10-06T05:27:09.477449+0000","last_became_peered":"2023-10-06T05:27:09.477449+0000","last_unstale":"2023-10-06T05:27:09.484789+0000","last_undegraded":"2023-10-06T05:27:09.484789+0000","last_fullsized":"2023-10-06T05:27:09.484789+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:58.859726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.459005+0000","last_change":"2023-10-06T05:27:08.459170+0000","last_active":"2023-10-06T05:27:09.459005+0000","last_peered":"2023-10-06T05:27:09.459005+0000","last_clean":"2023-10-06T05:27:09.459005+0000","last_became_active":"2023-10-06T05:27:08.458864+0000","last_became_peered":"2023-10-06T05:27:08.458864+0000","last_unstale":"2023-10-06T05:27:09.459005+0000","last_undegraded":"2023-10-06T05:27:09.459005+0000","last_fullsized":"2023-10-06T05:27:09.459005+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:06.032939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471239+0000","last_change":"2023-10-06T05:27:09.462866+0000","last_active":"2023-10-06T05:27:09.471239+0000","last_peered":"2023-10-06T05:27:09.471239+0000","last_clean":"2023-10-06T05:27:09.471239+0000","last_became_active":"2023-10-06T05:27:09.462436+0000","last_became_peered":"2023-10-06T05:27:09.462436+0000","last_unstale":"2023-10-06T05:27:09.471239+0000","last_undegraded":"2023-10-06T05:27:09.471239+0000","last_fullsized":"2023-10-06T05:27:09.471239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:34.716115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.451138+0000","last_change":"2023-10-06T05:27:08.467065+0000","last_active":"2023-10-06T05:27:09.451138+0000","last_peered":"2023-10-06T05:27:09.451138+0000","last_clean":"2023-10-06T05:27:09.451138+0000","last_became_active":"2023-10-06T05:27:08.466667+0000","last_became_peered":"2023-10-06T05:27:08.466667+0000","last_unstale":"2023-10-06T05:27:09.451138+0000","last_undegraded":"2023-10-06T05:27:09.451138+0000","last_fullsized":"2023-10-06T05:27:09.451138+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:46.413295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473089+0000","last_change":"2023-10-06T05:27:09.468057+0000","last_active":"2023-10-06T05:27:09.473089+0000","last_peered":"2023-10-06T05:27:09.473089+0000","last_clean":"2023-10-06T05:27:09.473089+0000","last_became_active":"2023-10-06T05:27:09.467745+0000","last_became_peered":"2023-10-06T05:27:09.467745+0000","last_unstale":"2023-10-06T05:27:09.473089+0000","last_undegraded":"2023-10-06T05:27:09.473089+0000","last_fullsized":"2023-10-06T05:27:09.473089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:26.248711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449503+0000","last_change":"2023-10-06T05:27:08.457838+0000","last_active":"2023-10-06T05:27:09.449503+0000","last_peered":"2023-10-06T05:27:09.449503+0000","last_clean":"2023-10-06T05:27:09.449503+0000","last_became_active":"2023-10-06T05:27:08.457440+0000","last_became_peered":"2023-10-06T05:27:08.457440+0000","last_unstale":"2023-10-06T05:27:09.449503+0000","last_undegraded":"2023-10-06T05:27:09.449503+0000","last_fullsized":"2023-10-06T05:27:09.449503+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:07.241389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470957+0000","last_change":"2023-10-06T05:27:09.462829+0000","last_active":"2023-10-06T05:27:09.470957+0000","last_peered":"2023-10-06T05:27:09.470957+0000","last_clean":"2023-10-06T05:27:09.470957+0000","last_became_active":"2023-10-06T05:27:09.462571+0000","last_became_peered":"2023-10-06T05:27:09.462571+0000","last_unstale":"2023-10-06T05:27:09.470957+0000","last_undegraded":"2023-10-06T05:27:09.470957+0000","last_fullsized":"2023-10-06T05:27:09.470957+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:15.747971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449876+0000","last_change":"2023-10-06T05:27:08.468417+0000","last_active":"2023-10-06T05:27:09.449876+0000","last_peered":"2023-10-06T05:27:09.449876+0000","last_clean":"2023-10-06T05:27:09.449876+0000","last_became_active":"2023-10-06T05:27:08.468116+0000","last_became_peered":"2023-10-06T05:27:08.468116+0000","last_unstale":"2023-10-06T05:27:09.449876+0000","last_undegraded":"2023-10-06T05:27:09.449876+0000","last_fullsized":"2023-10-06T05:27:09.449876+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:55.656738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473689+0000","last_change":"2023-10-06T05:27:09.468918+0000","last_active":"2023-10-06T05:27:09.473689+0000","last_peered":"2023-10-06T05:27:09.473689+0000","last_clean":"2023-10-06T05:27:09.473689+0000","last_became_active":"2023-10-06T05:27:09.461508+0000","last_became_peered":"2023-10-06T05:27:09.461508+0000","last_unstale":"2023-10-06T05:27:09.473689+0000","last_undegraded":"2023-10-06T05:27:09.473689+0000","last_fullsized":"2023-10-06T05:27:09.473689+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:26.248711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485873+0000","last_change":"2023-10-06T05:27:08.462121+0000","last_active":"2023-10-06T05:27:09.485873+0000","last_peered":"2023-10-06T05:27:09.485873+0000","last_clean":"2023-10-06T05:27:09.485873+0000","last_became_active":"2023-10-06T05:27:08.461840+0000","last_became_peered":"2023-10-06T05:27:08.461840+0000","last_unstale":"2023-10-06T05:27:09.485873+0000","last_undegraded":"2023-10-06T05:27:09.485873+0000","last_fullsized":"2023-10-06T05:27:09.485873+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:54.035088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.465383+0000","last_change":"2023-10-06T05:27:09.462503+0000","last_active":"2023-10-06T05:27:09.465383+0000","last_peered":"2023-10-06T05:27:09.465383+0000","last_clean":"2023-10-06T05:27:09.465383+0000","last_became_active":"2023-10-06T05:27:09.462195+0000","last_became_peered":"2023-10-06T05:27:09.462195+0000","last_unstale":"2023-10-06T05:27:09.465383+0000","last_undegraded":"2023-10-06T05:27:09.465383+0000","last_fullsized":"2023-10-06T05:27:09.465383+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:07.301491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.488956+0000","last_change":"2023-10-06T05:27:08.468574+0000","last_active":"2023-10-06T05:27:09.488956+0000","last_peered":"2023-10-06T05:27:09.488956+0000","last_clean":"2023-10-06T05:27:09.488956+0000","last_became_active":"2023-10-06T05:27:08.468256+0000","last_became_peered":"2023-10-06T05:27:08.468256+0000","last_unstale":"2023-10-06T05:27:09.488956+0000","last_undegraded":"2023-10-06T05:27:09.488956+0000","last_fullsized":"2023-10-06T05:27:09.488956+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:28.476040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471099+0000","last_change":"2023-10-06T05:27:09.465117+0000","last_active":"2023-10-06T05:27:09.471099+0000","last_peered":"2023-10-06T05:27:09.471099+0000","last_clean":"2023-10-06T05:27:09.471099+0000","last_became_active":"2023-10-06T05:27:09.463502+0000","last_became_peered":"2023-10-06T05:27:09.463502+0000","last_unstale":"2023-10-06T05:27:09.471099+0000","last_undegraded":"2023-10-06T05:27:09.471099+0000","last_fullsized":"2023-10-06T05:27:09.471099+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:23.152618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.483384+0000","last_change":"2023-10-06T05:27:08.465731+0000","last_active":"2023-10-06T05:27:09.483384+0000","last_peered":"2023-10-06T05:27:09.483384+0000","last_clean":"2023-10-06T05:27:09.483384+0000","last_became_active":"2023-10-06T05:27:08.465421+0000","last_became_peered":"2023-10-06T05:27:08.465421+0000","last_unstale":"2023-10-06T05:27:09.483384+0000","last_undegraded":"2023-10-06T05:27:09.483384+0000","last_fullsized":"2023-10-06T05:27:09.483384+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:28.423230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473937+0000","last_change":"2023-10-06T05:27:09.470692+0000","last_active":"2023-10-06T05:27:09.473937+0000","last_peered":"2023-10-06T05:27:09.473937+0000","last_clean":"2023-10-06T05:27:09.473937+0000","last_became_active":"2023-10-06T05:27:09.470406+0000","last_became_peered":"2023-10-06T05:27:09.470406+0000","last_unstale":"2023-10-06T05:27:09.473937+0000","last_undegraded":"2023-10-06T05:27:09.473937+0000","last_fullsized":"2023-10-06T05:27:09.473937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:39.360520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.456695+0000","last_change":"2023-10-06T05:27:08.468965+0000","last_active":"2023-10-06T05:27:09.456695+0000","last_peered":"2023-10-06T05:27:09.456695+0000","last_clean":"2023-10-06T05:27:09.456695+0000","last_became_active":"2023-10-06T05:27:08.468665+0000","last_became_peered":"2023-10-06T05:27:08.468665+0000","last_unstale":"2023-10-06T05:27:09.456695+0000","last_undegraded":"2023-10-06T05:27:09.456695+0000","last_fullsized":"2023-10-06T05:27:09.456695+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:16.545506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.480089+0000","last_change":"2023-10-06T05:27:09.471152+0000","last_active":"2023-10-06T05:27:09.480089+0000","last_peered":"2023-10-06T05:27:09.480089+0000","last_clean":"2023-10-06T05:27:09.480089+0000","last_became_active":"2023-10-06T05:27:09.470891+0000","last_became_peered":"2023-10-06T05:27:09.470891+0000","last_unstale":"2023-10-06T05:27:09.480089+0000","last_undegraded":"2023-10-06T05:27:09.480089+0000","last_fullsized":"2023-10-06T05:27:09.480089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:02.407473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449002+0000","last_change":"2023-10-06T05:27:08.454807+0000","last_active":"2023-10-06T05:27:09.449002+0000","last_peered":"2023-10-06T05:27:09.449002+0000","last_clean":"2023-10-06T05:27:09.449002+0000","last_became_active":"2023-10-06T05:27:08.454540+0000","last_became_peered":"2023-10-06T05:27:08.454540+0000","last_unstale":"2023-10-06T05:27:09.449002+0000","last_undegraded":"2023-10-06T05:27:09.449002+0000","last_fullsized":"2023-10-06T05:27:09.449002+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:55.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473321+0000","last_change":"2023-10-06T05:27:09.465676+0000","last_active":"2023-10-06T05:27:09.473321+0000","last_peered":"2023-10-06T05:27:09.473321+0000","last_clean":"2023-10-06T05:27:09.473321+0000","last_became_active":"2023-10-06T05:27:09.464931+0000","last_became_peered":"2023-10-06T05:27:09.464931+0000","last_unstale":"2023-10-06T05:27:09.473321+0000","last_undegraded":"2023-10-06T05:27:09.473321+0000","last_fullsized":"2023-10-06T05:27:09.473321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:18.072057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.487407+0000","last_change":"2023-10-06T05:27:08.462691+0000","last_active":"2023-10-06T05:27:09.487407+0000","last_peered":"2023-10-06T05:27:09.487407+0000","last_clean":"2023-10-06T05:27:09.487407+0000","last_became_active":"2023-10-06T05:27:08.461024+0000","last_became_peered":"2023-10-06T05:27:08.461024+0000","last_unstale":"2023-10-06T05:27:09.487407+0000","last_undegraded":"2023-10-06T05:27:09.487407+0000","last_fullsized":"2023-10-06T05:27:09.487407+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:24.570417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.481882+0000","last_change":"2023-10-06T05:27:09.472524+0000","last_active":"2023-10-06T05:27:09.481882+0000","last_peered":"2023-10-06T05:27:09.481882+0000","last_clean":"2023-10-06T05:27:09.481882+0000","last_became_active":"2023-10-06T05:27:09.472246+0000","last_became_peered":"2023-10-06T05:27:09.472246+0000","last_unstale":"2023-10-06T05:27:09.481882+0000","last_undegraded":"2023-10-06T05:27:09.481882+0000","last_fullsized":"2023-10-06T05:27:09.481882+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:11.612360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485987+0000","last_change":"2023-10-06T05:27:08.468994+0000","last_active":"2023-10-06T05:27:09.485987+0000","last_peered":"2023-10-06T05:27:09.485987+0000","last_clean":"2023-10-06T05:27:09.485987+0000","last_became_active":"2023-10-06T05:27:08.468681+0000","last_became_peered":"2023-10-06T05:27:08.468681+0000","last_unstale":"2023-10-06T05:27:09.485987+0000","last_undegraded":"2023-10-06T05:27:09.485987+0000","last_fullsized":"2023-10-06T05:27:09.485987+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:39.094983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.477153+0000","last_change":"2023-10-06T05:27:09.474104+0000","last_active":"2023-10-06T05:27:09.477153+0000","last_peered":"2023-10-06T05:27:09.477153+0000","last_clean":"2023-10-06T05:27:09.477153+0000","last_became_active":"2023-10-06T05:27:09.473702+0000","last_became_peered":"2023-10-06T05:27:09.473702+0000","last_unstale":"2023-10-06T05:27:09.477153+0000","last_undegraded":"2023-10-06T05:27:09.477153+0000","last_fullsized":"2023-10-06T05:27:09.477153+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:28.584719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.484833+0000","last_change":"2023-10-06T05:27:08.457313+0000","last_active":"2023-10-06T05:27:09.484833+0000","last_peered":"2023-10-06T05:27:09.484833+0000","last_clean":"2023-10-06T05:27:09.484833+0000","last_became_active":"2023-10-06T05:27:08.456931+0000","last_became_peered":"2023-10-06T05:27:08.456931+0000","last_unstale":"2023-10-06T05:27:09.484833+0000","last_undegraded":"2023-10-06T05:27:09.484833+0000","last_fullsized":"2023-10-06T05:27:09.484833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:00.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.479663+0000","last_change":"2023-10-06T05:27:09.475087+0000","last_active":"2023-10-06T05:27:09.479663+0000","last_peered":"2023-10-06T05:27:09.479663+0000","last_clean":"2023-10-06T05:27:09.479663+0000","last_became_active":"2023-10-06T05:27:09.474659+0000","last_became_peered":"2023-10-06T05:27:09.474659+0000","last_unstale":"2023-10-06T05:27:09.479663+0000","last_undegraded":"2023-10-06T05:27:09.479663+0000","last_fullsized":"2023-10-06T05:27:09.479663+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:11.061434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.480826+0000","last_change":"2023-10-06T05:27:08.461975+0000","last_active":"2023-10-06T05:27:09.480826+0000","last_peered":"2023-10-06T05:27:09.480826+0000","last_clean":"2023-10-06T05:27:09.480826+0000","last_became_active":"2023-10-06T05:27:08.461719+0000","last_became_peered":"2023-10-06T05:27:08.461719+0000","last_unstale":"2023-10-06T05:27:09.480826+0000","last_undegraded":"2023-10-06T05:27:09.480826+0000","last_fullsized":"2023-10-06T05:27:09.480826+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:48.444105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.478890+0000","last_change":"2023-10-06T05:27:09.467854+0000","last_active":"2023-10-06T05:27:09.478890+0000","last_peered":"2023-10-06T05:27:09.478890+0000","last_clean":"2023-10-06T05:27:09.478890+0000","last_became_active":"2023-10-06T05:27:09.467479+0000","last_became_peered":"2023-10-06T05:27:09.467479+0000","last_unstale":"2023-10-06T05:27:09.478890+0000","last_undegraded":"2023-10-06T05:27:09.478890+0000","last_fullsized":"2023-10-06T05:27:09.478890+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:25.582818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.460187+0000","last_change":"2023-10-06T05:27:08.469919+0000","last_active":"2023-10-06T05:27:09.460187+0000","last_peered":"2023-10-06T05:27:09.460187+0000","last_clean":"2023-10-06T05:27:09.460187+0000","last_became_active":"2023-10-06T05:27:08.469535+0000","last_became_peered":"2023-10-06T05:27:08.469535+0000","last_unstale":"2023-10-06T05:27:09.460187+0000","last_undegraded":"2023-10-06T05:27:09.460187+0000","last_fullsized":"2023-10-06T05:27:09.460187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:57.448667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470840+0000","last_change":"2023-10-06T05:27:09.462300+0000","last_active":"2023-10-06T05:27:09.470840+0000","last_peered":"2023-10-06T05:27:09.470840+0000","last_clean":"2023-10-06T05:27:09.470840+0000","last_became_active":"2023-10-06T05:27:09.461998+0000","last_became_peered":"2023-10-06T05:27:09.461998+0000","last_unstale":"2023-10-06T05:27:09.470840+0000","last_undegraded":"2023-10-06T05:27:09.470840+0000","last_fullsized":"2023-10-06T05:27:09.470840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:07.301491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.485122+0000","last_change":"2023-10-06T05:27:08.461738+0000","last_active":"2023-10-06T05:27:09.485122+0000","last_peered":"2023-10-06T05:27:09.485122+0000","last_clean":"2023-10-06T05:27:09.485122+0000","last_became_active":"2023-10-06T05:27:08.461423+0000","last_became_peered":"2023-10-06T05:27:08.461423+0000","last_unstale":"2023-10-06T05:27:09.485122+0000","last_undegraded":"2023-10-06T05:27:09.485122+0000","last_fullsized":"2023-10-06T05:27:09.485122+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:46.413295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.470777+0000","last_change":"2023-10-06T05:27:09.462832+0000","last_active":"2023-10-06T05:27:09.470777+0000","last_peered":"2023-10-06T05:27:09.470777+0000","last_clean":"2023-10-06T05:27:09.470777+0000","last_became_active":"2023-10-06T05:27:09.462552+0000","last_became_peered":"2023-10-06T05:27:09.462552+0000","last_unstale":"2023-10-06T05:27:09.470777+0000","last_undegraded":"2023-10-06T05:27:09.470777+0000","last_fullsized":"2023-10-06T05:27:09.470777+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:56.104542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.455511+0000","last_change":"2023-10-06T05:27:08.458730+0000","last_active":"2023-10-06T05:27:09.455511+0000","last_peered":"2023-10-06T05:27:09.455511+0000","last_clean":"2023-10-06T05:27:09.455511+0000","last_became_active":"2023-10-06T05:27:08.458344+0000","last_became_peered":"2023-10-06T05:27:08.458344+0000","last_unstale":"2023-10-06T05:27:09.455511+0000","last_undegraded":"2023-10-06T05:27:09.455511+0000","last_fullsized":"2023-10-06T05:27:09.455511+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:37.535880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473499+0000","last_change":"2023-10-06T05:27:09.462823+0000","last_active":"2023-10-06T05:27:09.473499+0000","last_peered":"2023-10-06T05:27:09.473499+0000","last_clean":"2023-10-06T05:27:09.473499+0000","last_became_active":"2023-10-06T05:27:09.462469+0000","last_became_peered":"2023-10-06T05:27:09.462469+0000","last_unstale":"2023-10-06T05:27:09.473499+0000","last_undegraded":"2023-10-06T05:27:09.473499+0000","last_fullsized":"2023-10-06T05:27:09.473499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:11.061434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.453375+0000","last_change":"2023-10-06T05:27:08.463721+0000","last_active":"2023-10-06T05:27:09.453375+0000","last_peered":"2023-10-06T05:27:09.453375+0000","last_clean":"2023-10-06T05:27:09.453375+0000","last_became_active":"2023-10-06T05:27:08.463110+0000","last_became_peered":"2023-10-06T05:27:08.463110+0000","last_unstale":"2023-10-06T05:27:09.453375+0000","last_undegraded":"2023-10-06T05:27:09.453375+0000","last_fullsized":"2023-10-06T05:27:09.453375+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:26.624560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.475273+0000","last_change":"2023-10-06T05:27:09.468402+0000","last_active":"2023-10-06T05:27:09.475273+0000","last_peered":"2023-10-06T05:27:09.475273+0000","last_clean":"2023-10-06T05:27:09.475273+0000","last_became_active":"2023-10-06T05:27:09.467709+0000","last_became_peered":"2023-10-06T05:27:09.467709+0000","last_unstale":"2023-10-06T05:27:09.475273+0000","last_undegraded":"2023-10-06T05:27:09.475273+0000","last_fullsized":"2023-10-06T05:27:09.475273+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:55.289829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.451678+0000","last_change":"2023-10-06T05:27:08.458728+0000","last_active":"2023-10-06T05:27:09.451678+0000","last_peered":"2023-10-06T05:27:09.451678+0000","last_clean":"2023-10-06T05:27:09.451678+0000","last_became_active":"2023-10-06T05:27:08.458427+0000","last_became_peered":"2023-10-06T05:27:08.458427+0000","last_unstale":"2023-10-06T05:27:09.451678+0000","last_undegraded":"2023-10-06T05:27:09.451678+0000","last_fullsized":"2023-10-06T05:27:09.451678+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:20.653667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471978+0000","last_change":"2023-10-06T05:27:09.466635+0000","last_active":"2023-10-06T05:27:09.471978+0000","last_peered":"2023-10-06T05:27:09.471978+0000","last_clean":"2023-10-06T05:27:09.471978+0000","last_became_active":"2023-10-06T05:27:09.466324+0000","last_became_peered":"2023-10-06T05:27:09.466324+0000","last_unstale":"2023-10-06T05:27:09.471978+0000","last_undegraded":"2023-10-06T05:27:09.471978+0000","last_fullsized":"2023-10-06T05:27:09.471978+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:41.300979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T05:27:11.824754+0000","last_change":"2023-10-06T05:27:08.466399+0000","last_active":"2023-10-06T05:27:11.824754+0000","last_peered":"2023-10-06T05:27:11.824754+0000","last_clean":"2023-10-06T05:27:11.824754+0000","last_became_active":"2023-10-06T05:27:08.466126+0000","last_became_peered":"2023-10-06T05:27:08.466126+0000","last_unstale":"2023-10-06T05:27:11.824754+0000","last_undegraded":"2023-10-06T05:27:11.824754+0000","last_fullsized":"2023-10-06T05:27:11.824754+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:54.035088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.447581+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:27:09.447581+0000","last_peered":"2023-10-06T05:27:09.447581+0000","last_clean":"2023-10-06T05:27:09.447581+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:27:09.447581+0000","last_undegraded":"2023-10-06T05:27:09.447581+0000","last_fullsized":"2023-10-06T05:27:09.447581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.455251+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:27:09.455251+0000","last_peered":"2023-10-06T05:27:09.455251+0000","last_clean":"2023-10-06T05:27:09.455251+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:27:09.455251+0000","last_undegraded":"2023-10-06T05:27:09.455251+0000","last_fullsized":"2023-10-06T05:27:09.455251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.478819+0000","last_change":"2023-10-06T05:27:09.468732+0000","last_active":"2023-10-06T05:27:09.478819+0000","last_peered":"2023-10-06T05:27:09.478819+0000","last_clean":"2023-10-06T05:27:09.478819+0000","last_became_active":"2023-10-06T05:27:09.465353+0000","last_became_peered":"2023-10-06T05:27:09.465353+0000","last_unstale":"2023-10-06T05:27:09.478819+0000","last_undegraded":"2023-10-06T05:27:09.478819+0000","last_fullsized":"2023-10-06T05:27:09.478819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:54.289894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.448733+0000","last_change":"2023-10-06T05:27:08.454716+0000","last_active":"2023-10-06T05:27:09.448733+0000","last_peered":"2023-10-06T05:27:09.448733+0000","last_clean":"2023-10-06T05:27:09.448733+0000","last_became_active":"2023-10-06T05:27:08.454402+0000","last_became_peered":"2023-10-06T05:27:08.454402+0000","last_unstale":"2023-10-06T05:27:09.448733+0000","last_undegraded":"2023-10-06T05:27:09.448733+0000","last_fullsized":"2023-10-06T05:27:09.448733+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:18.414035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.447360+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:27:09.447360+0000","last_peered":"2023-10-06T05:27:09.447360+0000","last_clean":"2023-10-06T05:27:09.447360+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:27:09.447360+0000","last_undegraded":"2023-10-06T05:27:09.447360+0000","last_fullsized":"2023-10-06T05:27:09.447360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473984+0000","last_change":"2023-10-06T05:27:09.463360+0000","last_active":"2023-10-06T05:27:09.473984+0000","last_peered":"2023-10-06T05:27:09.473984+0000","last_clean":"2023-10-06T05:27:09.473984+0000","last_became_active":"2023-10-06T05:27:09.462991+0000","last_became_peered":"2023-10-06T05:27:09.462991+0000","last_unstale":"2023-10-06T05:27:09.473984+0000","last_undegraded":"2023-10-06T05:27:09.473984+0000","last_fullsized":"2023-10-06T05:27:09.473984+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:18.072057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.454235+0000","last_change":"2023-10-06T05:27:08.465107+0000","last_active":"2023-10-06T05:27:09.454235+0000","last_peered":"2023-10-06T05:27:09.454235+0000","last_clean":"2023-10-06T05:27:09.454235+0000","last_became_active":"2023-10-06T05:27:08.464027+0000","last_became_peered":"2023-10-06T05:27:08.464027+0000","last_unstale":"2023-10-06T05:27:09.454235+0000","last_undegraded":"2023-10-06T05:27:09.454235+0000","last_fullsized":"2023-10-06T05:27:09.454235+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:18.414035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.451944+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:27:09.451944+0000","last_peered":"2023-10-06T05:27:09.451944+0000","last_clean":"2023-10-06T05:27:09.451944+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:27:09.451944+0000","last_undegraded":"2023-10-06T05:27:09.451944+0000","last_fullsized":"2023-10-06T05:27:09.451944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.472269+0000","last_change":"2023-10-06T05:27:09.468446+0000","last_active":"2023-10-06T05:27:09.472269+0000","last_peered":"2023-10-06T05:27:09.472269+0000","last_clean":"2023-10-06T05:27:09.472269+0000","last_became_active":"2023-10-06T05:27:09.467739+0000","last_became_peered":"2023-10-06T05:27:09.467739+0000","last_unstale":"2023-10-06T05:27:09.472269+0000","last_undegraded":"2023-10-06T05:27:09.472269+0000","last_fullsized":"2023-10-06T05:27:09.472269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:46:00.781374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.481668+0000","last_change":"2023-10-06T05:27:08.471971+0000","last_active":"2023-10-06T05:27:09.481668+0000","last_peered":"2023-10-06T05:27:09.481668+0000","last_clean":"2023-10-06T05:27:09.481668+0000","last_became_active":"2023-10-06T05:27:08.471672+0000","last_became_peered":"2023-10-06T05:27:08.471672+0000","last_unstale":"2023-10-06T05:27:09.481668+0000","last_undegraded":"2023-10-06T05:27:09.481668+0000","last_fullsized":"2023-10-06T05:27:09.481668+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:46.129002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.455162+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:27:09.455162+0000","last_peered":"2023-10-06T05:27:09.455162+0000","last_clean":"2023-10-06T05:27:09.455162+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:27:09.455162+0000","last_undegraded":"2023-10-06T05:27:09.455162+0000","last_fullsized":"2023-10-06T05:27:09.455162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473647+0000","last_change":"2023-10-06T05:27:09.469435+0000","last_active":"2023-10-06T05:27:09.473647+0000","last_peered":"2023-10-06T05:27:09.473647+0000","last_clean":"2023-10-06T05:27:09.473647+0000","last_became_active":"2023-10-06T05:27:09.466794+0000","last_became_peered":"2023-10-06T05:27:09.466794+0000","last_unstale":"2023-10-06T05:27:09.473647+0000","last_undegraded":"2023-10-06T05:27:09.473647+0000","last_fullsized":"2023-10-06T05:27:09.473647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:43.295093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449781+0000","last_change":"2023-10-06T05:27:08.462882+0000","last_active":"2023-10-06T05:27:09.449781+0000","last_peered":"2023-10-06T05:27:09.449781+0000","last_clean":"2023-10-06T05:27:09.449781+0000","last_became_active":"2023-10-06T05:27:08.462583+0000","last_became_peered":"2023-10-06T05:27:08.462583+0000","last_unstale":"2023-10-06T05:27:09.449781+0000","last_undegraded":"2023-10-06T05:27:09.449781+0000","last_fullsized":"2023-10-06T05:27:09.449781+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:28.476040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.456163+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:27:09.456163+0000","last_peered":"2023-10-06T05:27:09.456163+0000","last_clean":"2023-10-06T05:27:09.456163+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:27:09.456163+0000","last_undegraded":"2023-10-06T05:27:09.456163+0000","last_fullsized":"2023-10-06T05:27:09.456163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.474247+0000","last_change":"2023-10-06T05:27:09.465769+0000","last_active":"2023-10-06T05:27:09.474247+0000","last_peered":"2023-10-06T05:27:09.474247+0000","last_clean":"2023-10-06T05:27:09.474247+0000","last_became_active":"2023-10-06T05:27:09.465424+0000","last_became_peered":"2023-10-06T05:27:09.465424+0000","last_unstale":"2023-10-06T05:27:09.474247+0000","last_undegraded":"2023-10-06T05:27:09.474247+0000","last_fullsized":"2023-10-06T05:27:09.474247+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:37.742410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.454480+0000","last_change":"2023-10-06T05:27:08.460204+0000","last_active":"2023-10-06T05:27:09.454480+0000","last_peered":"2023-10-06T05:27:09.454480+0000","last_clean":"2023-10-06T05:27:09.454480+0000","last_became_active":"2023-10-06T05:27:08.459894+0000","last_became_peered":"2023-10-06T05:27:08.459894+0000","last_unstale":"2023-10-06T05:27:09.454480+0000","last_undegraded":"2023-10-06T05:27:09.454480+0000","last_fullsized":"2023-10-06T05:27:09.454480+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:13.240736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.449130+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:27:09.449130+0000","last_peered":"2023-10-06T05:27:09.449130+0000","last_clean":"2023-10-06T05:27:09.449130+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:27:09.449130+0000","last_undegraded":"2023-10-06T05:27:09.449130+0000","last_fullsized":"2023-10-06T05:27:09.449130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.473675+0000","last_change":"2023-10-06T05:27:09.469294+0000","last_active":"2023-10-06T05:27:09.473675+0000","last_peered":"2023-10-06T05:27:09.473675+0000","last_clean":"2023-10-06T05:27:09.473675+0000","last_became_active":"2023-10-06T05:27:09.468948+0000","last_became_peered":"2023-10-06T05:27:09.468948+0000","last_unstale":"2023-10-06T05:27:09.473675+0000","last_undegraded":"2023-10-06T05:27:09.473675+0000","last_fullsized":"2023-10-06T05:27:09.473675+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:37.742410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.460879+0000","last_change":"2023-10-06T05:27:08.463911+0000","last_active":"2023-10-06T05:27:09.460879+0000","last_peered":"2023-10-06T05:27:09.460879+0000","last_clean":"2023-10-06T05:27:09.460879+0000","last_became_active":"2023-10-06T05:27:08.463633+0000","last_became_peered":"2023-10-06T05:27:08.463633+0000","last_unstale":"2023-10-06T05:27:09.460879+0000","last_undegraded":"2023-10-06T05:27:09.460879+0000","last_fullsized":"2023-10-06T05:27:09.460879+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:55.656738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.459007+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:27:09.459007+0000","last_peered":"2023-10-06T05:27:09.459007+0000","last_clean":"2023-10-06T05:27:09.459007+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:27:09.459007+0000","last_undegraded":"2023-10-06T05:27:09.459007+0000","last_fullsized":"2023-10-06T05:27:09.459007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.471040+0000","last_change":"2023-10-06T05:27:09.463847+0000","last_active":"2023-10-06T05:27:09.471040+0000","last_peered":"2023-10-06T05:27:09.471040+0000","last_clean":"2023-10-06T05:27:09.471040+0000","last_became_active":"2023-10-06T05:27:09.463415+0000","last_became_peered":"2023-10-06T05:27:09.463415+0000","last_unstale":"2023-10-06T05:27:09.471040+0000","last_undegraded":"2023-10-06T05:27:09.471040+0000","last_fullsized":"2023-10-06T05:27:09.471040+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:08.424631+0000","last_clean_scrub_stamp":"2023-10-06T05:27:08.424631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:11.061434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.455770+0000","last_change":"2023-10-06T05:27:08.464101+0000","last_active":"2023-10-06T05:27:09.455770+0000","last_peered":"2023-10-06T05:27:09.455770+0000","last_clean":"2023-10-06T05:27:09.455770+0000","last_became_active":"2023-10-06T05:27:08.463820+0000","last_became_peered":"2023-10-06T05:27:08.463820+0000","last_unstale":"2023-10-06T05:27:09.455770+0000","last_undegraded":"2023-10-06T05:27:09.455770+0000","last_fullsized":"2023-10-06T05:27:09.455770+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:27:07.412229+0000","last_clean_scrub_stamp":"2023-10-06T05:27:07.412229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:54.277427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T05:27:09.459157+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:27:09.459157+0000","last_peered":"2023-10-06T05:27:09.459157+0000","last_clean":"2023-10-06T05:27:09.459157+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:27:09.459157+0000","last_undegraded":"2023-10-06T05:27:09.459157+0000","last_fullsized":"2023-10-06T05:27:09.459157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302524,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069316,"statfs":{"total":96636764160,"available":96326979584,"internally_reserved":0,"allocated":1167360,"data_stored":829684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.63300000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.92600000000000005}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.73399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297848,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":573440,"data_stored":239816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.82899999999999996}]},{"osd":1,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.92000000000000004}]},{"osd":2,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.878}]},{"osd":4,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.171},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.079}]},{"osd":5,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.123}]},{"osd":7,"last update":"Fri Oct 6 05:26:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.145}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":239192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.115}]},{"osd":2,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.085}]},{"osd":3,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.137}]},{"osd":4,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.0549999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.169},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.2290000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297844,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":569344,"data_stored":239746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.874}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80700000000000005}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.1499999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.91000000000000003}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.034}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.2470000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301952,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069888,"statfs":{"total":96636764160,"available":96327565312,"internally_reserved":0,"allocated":581632,"data_stored":240750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.91300000000000003}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.99199999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.133},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.1679999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.202},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.2450000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2729999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301948,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069892,"statfs":{"total":96636764160,"available":96327569408,"internally_reserved":0,"allocated":577536,"data_stored":240728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.505},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.76700000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.879},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.83699999999999997}]},{"osd":5,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.751},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.94799999999999995}]},{"osd":7,"last update":"Fri Oct 6 05:26:27 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.113},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1339999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301944,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069896,"statfs":{"total":96636764160,"available":96327573504,"internally_reserved":0,"allocated":573440,"data_stored":239352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0269999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.83499999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.0720000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:26:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.1259999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302524,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069316,"statfs":{"total":96636764160,"available":96326979584,"internally_reserved":0,"allocated":1167360,"data_stored":829616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88300000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.94799999999999995}]},{"osd":3,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.97099999999999997}]},{"osd":4,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.92900000000000005}]},{"osd":5,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.107}]},{"osd":6,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.165},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.425}]},{"osd":7,"last update":"Fri Oct 6 05:26:30 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.016}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:27:20.637 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T05:27:20.637 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T05:27:20.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f7083d700 1 Processor -- start 2023-10-06T05:27:20.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f7083d700 1 -- start start 2023-10-06T05:27:20.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f7083d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1f6c13f080 0x7f1f6c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f7083d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c06dde0 0x7f1f6c0c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f7083d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6c0c8930 con 0x7f1f6c13ecb0 2023-10-06T05:27:20.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f7083d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6c0688a0 con 0x7f1f6c13f080 2023-10-06T05:27:20.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f7083d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0c7d20 con 0x7f1f6c06dde0 2023-10-06T05:27:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f6b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1f6c13ecb0 0x7f1f6c06d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35716/0 (socket says 172.21.15.29:35716) 2023-10-06T05:27:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f6b7fe700 1 -- 172.21.15.29:0/2831117602 learned_addr learned my addr 172.21.15.29:0/2831117602 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f6bfff700 1 --2- 172.21.15.29:0/2831117602 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c06dde0 0x7f1f6c0c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f6affd700 1 --2- 172.21.15.29:0/2831117602 >> v2:172.21.15.173:3300/0 conn(0x7f1f6c13f080 0x7f1f6c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f6bfff700 1 -- 172.21.15.29:0/2831117602 >> v2:172.21.15.173:3300/0 conn(0x7f1f6c13f080 msgr2=0x7f1f6c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f6bfff700 1 --2- 172.21.15.29:0/2831117602 >> v2:172.21.15.173:3300/0 conn(0x7f1f6c13f080 0x7f1f6c159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f6bfff700 1 -- 172.21.15.29:0/2831117602 >> v1:172.21.15.29:6789/0 conn(0x7f1f6c13ecb0 legacy=0x7f1f6c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f6bfff700 1 -- 172.21.15.29:0/2831117602 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0c8000 con 0x7f1f6c06dde0 2023-10-06T05:27:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.756+0000 7f1f6affd700 1 --2- 172.21.15.29:0/2831117602 >> v2:172.21.15.173:3300/0 conn(0x7f1f6c13f080 0x7f1f6c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6bfff700 1 --2- 172.21.15.29:0/2831117602 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c06dde0 0x7f1f6c0c9f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009e60 tx=0x7f1f64009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79e00da5e1c1a93e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6a7fc700 1 -- 172.21.15.29:0/2831117602 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400e070 con 0x7f1f6c06dde0 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6a7fc700 1 -- 172.21.15.29:0/2831117602 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6400bb60 con 0x7f1f6c06dde0 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6a7fc700 1 -- 172.21.15.29:0/2831117602 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64012430 con 0x7f1f6c06dde0 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 -- 172.21.15.29:0/2831117602 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c06dde0 msgr2=0x7f1f6c0c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 --2- 172.21.15.29:0/2831117602 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c06dde0 0x7f1f6c0c9f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009e60 tx=0x7f1f64009780 comp rx=0 tx=0).stop 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 -- 172.21.15.29:0/2831117602 shutdown_connections 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 --2- 172.21.15.29:0/2831117602 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c06dde0 0x7f1f6c0c9f50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 --2- 172.21.15.29:0/2831117602 >> v2:172.21.15.173:3300/0 conn(0x7f1f6c13f080 0x7f1f6c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 -- 172.21.15.29:0/2831117602 >> 172.21.15.29:0/2831117602 conn(0x7f1f6c0c9830 msgr2=0x7f1f6c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 -- 172.21.15.29:0/2831117602 shutdown_connections 2023-10-06T05:27:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 -- 172.21.15.29:0/2831117602 wait complete. 2023-10-06T05:27:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 Processor -- start 2023-10-06T05:27:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 -- start start 2023-10-06T05:27:20.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c06dde0 0x7f1f6c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f6c13ecb0 0x7f1f6c13ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c13f080 0x7f1f6c0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c166e10 con 0x7f1f6c06dde0 2023-10-06T05:27:20.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c158210 con 0x7f1f6c13ecb0 2023-10-06T05:27:20.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f7083d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c1584f0 con 0x7f1f6c13f080 2023-10-06T05:27:20.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c06dde0 0x7f1f6c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c06dde0 0x7f1f6c1579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55070/0 (socket says 172.21.15.29:55070) 2023-10-06T05:27:20.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6b7fe700 1 -- 172.21.15.29:0/3359574714 learned_addr learned my addr 172.21.15.29:0/3359574714 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:20.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6bfff700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c13f080 0x7f1f6c0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6affd700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f6c13ecb0 0x7f1f6c13ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6b7fe700 1 -- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c13f080 msgr2=0x7f1f6c0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6b7fe700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c13f080 0x7f1f6c0cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6b7fe700 1 -- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f6c13ecb0 msgr2=0x7f1f6c13ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6b7fe700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f6c13ecb0 0x7f1f6c13ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.760+0000 7f1f6b7fe700 1 -- 172.21.15.29:0/3359574714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f60009420 con 0x7f1f6c06dde0 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f6b7fe700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c06dde0 0x7f1f6c1579c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c7c0 tx=0x7f1f5c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f537fe700 1 -- 172.21.15.29:0/3359574714 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c005b30 con 0x7f1f6c06dde0 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f537fe700 1 -- 172.21.15.29:0/3359574714 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c005c90 con 0x7f1f6c06dde0 2023-10-06T05:27:20.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f64009a20 con 0x7f1f6c06dde0 2023-10-06T05:27:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f537fe700 1 -- 172.21.15.29:0/3359574714 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c004a80 con 0x7f1f6c06dde0 2023-10-06T05:27:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c158ab0 con 0x7f1f6c06dde0 2023-10-06T05:27:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f537fe700 1 -- 172.21.15.29:0/3359574714 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1f5c0070d0 con 0x7f1f6c06dde0 2023-10-06T05:27:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c166f80 con 0x7f1f6c06dde0 2023-10-06T05:27:20.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f537fe700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1f58060580 0x7f1f58062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f537fe700 1 -- 172.21.15.29:0/3359574714 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1f5c07bc30 con 0x7f1f6c06dde0 2023-10-06T05:27:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f6affd700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1f58060580 0x7f1f58062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.764+0000 7f1f6affd700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1f58060580 0x7f1f58062a30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c06e360 tx=0x7f1f60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.772+0000 7f1f537fe700 1 -- 172.21.15.29:0/3359574714 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1f5c049be0 con 0x7f1f6c06dde0 2023-10-06T05:27:20.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.988+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1f6c04be00 con 0x7f1f6c06dde0 2023-10-06T05:27:21.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:20.996+0000 7f1f537fe700 1 -- 172.21.15.29:0/3359574714 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1f5c04fb10 con 0x7f1f6c06dde0 2023-10-06T05:27:21.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1f58060580 msgr2=0x7f1f58062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1f58060580 0x7f1f58062a30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c06e360 tx=0x7f1f60008040 comp rx=0 tx=0).stop 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c06dde0 msgr2=0x7f1f6c1579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c06dde0 0x7f1f6c1579c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c7c0 tx=0x7f1f5c007f70 comp rx=0 tx=0).stop 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 shutdown_connections 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f6c13f080 0x7f1f6c0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1f58060580 0x7f1f58062a30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f6c13ecb0 0x7f1f6c13ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 --2- 172.21.15.29:0/3359574714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f6c06dde0 0x7f1f6c1579c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 >> 172.21.15.29:0/3359574714 conn(0x7f1f6c0c9830 msgr2=0x7f1f6c0b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:21.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 shutdown_connections 2023-10-06T05:27:21.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.000+0000 7f1f7083d700 1 -- 172.21.15.29:0/3359574714 wait complete. 2023-10-06T05:27:21.007 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2023-10-06T05:27:21.020 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:27:21.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.116+0000 7ff3b5b7e700 1 Processor -- start 2023-10-06T05:27:21.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.116+0000 7ff3b5b7e700 1 -- start start 2023-10-06T05:27:21.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3b0158e70 0x7ff3b00c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff3b0159240 0x7ff3b00cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b00ad940 0x7ff3b00ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b00c8060 con 0x7ff3b0158e70 2023-10-06T05:27:21.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b00c8930 con 0x7ff3b0159240 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00c8c10 con 0x7ff3b00ad940 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3af7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3b0158e70 0x7ff3b00c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3af7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3b0158e70 0x7ff3b00c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55082/0 (socket says 172.21.15.29:55082) 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3af7fe700 1 -- 172.21.15.29:0/4268418341 learned_addr learned my addr 172.21.15.29:0/4268418341 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3affff700 1 --2- 172.21.15.29:0/4268418341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b00ad940 0x7ff3b00ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3aeffd700 1 --2- 172.21.15.29:0/4268418341 >> v2:172.21.15.173:3300/0 conn(0x7ff3b0159240 0x7ff3b00cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3af7fe700 1 -- 172.21.15.29:0/4268418341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b00ad940 msgr2=0x7ff3b00ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3af7fe700 1 --2- 172.21.15.29:0/4268418341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b00ad940 0x7ff3b00ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3af7fe700 1 -- 172.21.15.29:0/4268418341 >> v2:172.21.15.173:3300/0 conn(0x7ff3b0159240 msgr2=0x7ff3b00cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3af7fe700 1 --2- 172.21.15.29:0/4268418341 >> v2:172.21.15.173:3300/0 conn(0x7ff3b0159240 0x7ff3b00cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3af7fe700 1 -- 172.21.15.29:0/4268418341 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b00c8ef0 con 0x7ff3b0158e70 2023-10-06T05:27:21.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3aeffd700 1 --2- 172.21.15.29:0/4268418341 >> v2:172.21.15.173:3300/0 conn(0x7ff3b0159240 0x7ff3b00cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:21.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3af7fe700 1 --2- 172.21.15.29:0/4268418341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b0158e70 0x7ff3b00c82a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff3b006a260 tx=0x7ff3a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e923381b69e80bba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3ae7fc700 1 -- 172.21.15.29:0/4268418341 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000e070 con 0x7ff3b0158e70 2023-10-06T05:27:21.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3ae7fc700 1 -- 172.21.15.29:0/4268418341 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a000ba50 con 0x7ff3b0158e70 2023-10-06T05:27:21.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3ae7fc700 1 -- 172.21.15.29:0/4268418341 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00092e0 con 0x7ff3b0158e70 2023-10-06T05:27:21.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/4268418341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b0158e70 msgr2=0x7ff3b00c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/4268418341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b0158e70 0x7ff3b00c82a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff3b006a260 tx=0x7ff3a0009840 comp rx=0 tx=0).stop 2023-10-06T05:27:21.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/4268418341 shutdown_connections 2023-10-06T05:27:21.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/4268418341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b00ad940 0x7ff3b00ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/4268418341 >> v2:172.21.15.173:3300/0 conn(0x7ff3b0159240 0x7ff3b00cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/4268418341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b0158e70 0x7ff3b00c82a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/4268418341 >> 172.21.15.29:0/4268418341 conn(0x7ff3b00692b0 msgr2=0x7ff3b00696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:21.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/4268418341 shutdown_connections 2023-10-06T05:27:21.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.120+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/4268418341 wait complete. 2023-10-06T05:27:21.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 Processor -- start 2023-10-06T05:27:21.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 -- start start 2023-10-06T05:27:21.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b00ad940 0x7ff3b015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b0158e70 0x7ff3b00b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b0159240 0x7ff3b00cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00cc2e0 con 0x7ff3b00ad940 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00cb9b0 con 0x7ff3b0158e70 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00cbc90 con 0x7ff3b0159240 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3af7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b00ad940 0x7ff3b015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3af7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b00ad940 0x7ff3b015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55094/0 (socket says 172.21.15.29:55094) 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3af7fe700 1 -- 172.21.15.29:0/3323613713 learned_addr learned my addr 172.21.15.29:0/3323613713 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3aeffd700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b0158e70 0x7ff3b00b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3affff700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b0159240 0x7ff3b00cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3af7fe700 1 -- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b0159240 msgr2=0x7ff3b00cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3af7fe700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b0159240 0x7ff3b00cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3af7fe700 1 -- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b0158e70 msgr2=0x7ff3b00b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3af7fe700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b0158e70 0x7ff3b00b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3af7fe700 1 -- 172.21.15.29:0/3323613713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0009ae0 con 0x7ff3b00ad940 2023-10-06T05:27:21.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3affff700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b0159240 0x7ff3b00cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:21.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3af7fe700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b00ad940 0x7ff3b015cf00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009fd0 tx=0x7ff3a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3a77fe700 1 -- 172.21.15.29:0/3323613713 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0007190 con 0x7ff3b00ad940 2023-10-06T05:27:21.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3a77fe700 1 -- 172.21.15.29:0/3323613713 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0007ac0 con 0x7ff3b00ad940 2023-10-06T05:27:21.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b00cbf70 con 0x7ff3b00ad940 2023-10-06T05:27:21.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3a77fe700 1 -- 172.21.15.29:0/3323613713 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0007e80 con 0x7ff3b00ad940 2023-10-06T05:27:21.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.124+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b00b1fa0 con 0x7ff3b00ad940 2023-10-06T05:27:21.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.128+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b004be00 con 0x7ff3b00ad940 2023-10-06T05:27:21.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.128+0000 7ff3a77fe700 1 -- 172.21.15.29:0/3323613713 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff3a001c410 con 0x7ff3b00ad940 2023-10-06T05:27:21.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.128+0000 7ff3a77fe700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff390060550 0x7ff390062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.128+0000 7ff3a77fe700 1 -- 172.21.15.29:0/3323613713 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff3a007e400 con 0x7ff3b00ad940 2023-10-06T05:27:21.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.128+0000 7ff3aeffd700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff390060550 0x7ff390062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.128+0000 7ff3aeffd700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff390060550 0x7ff390062a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3b015adf0 tx=0x7ff398008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.136+0000 7ff3a77fe700 1 -- 172.21.15.29:0/3323613713 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff3a004e850 con 0x7ff3b00ad940 2023-10-06T05:27:21.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.332+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3b0067250 con 0x7ff3b00ad940 2023-10-06T05:27:21.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.332+0000 7ff3a77fe700 1 -- 172.21.15.29:0/3323613713 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4603 (secure 0 0 0) 0x7ff3a0051e70 con 0x7ff3b00ad940 2023-10-06T05:27:21.339 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:21.339 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3538089078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3538089078},{"type":"v1","addr":"172.21.15.173:6835","nonce":3538089078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3499370562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3499370562},{"type":"v1","addr":"172.21.15.173:6837","nonce":3499370562}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3369448997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3369448997},{"type":"v1","addr":"172.21.15.29:6833","nonce":3369448997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:27:08.808178+0000","modified":"2023-10-06T05:27:12.494062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5460":{"gid":5460,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2111647358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2111647358},{"type":"v1","addr":"172.21.15.29:6835","nonce":2111647358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T05:27:21.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff390060550 msgr2=0x7ff390062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff390060550 0x7ff390062a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3b015adf0 tx=0x7ff398008040 comp rx=0 tx=0).stop 2023-10-06T05:27:21.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b00ad940 msgr2=0x7ff3b015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b00ad940 0x7ff3b015cf00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009fd0 tx=0x7ff3a0018000 comp rx=0 tx=0).stop 2023-10-06T05:27:21.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 shutdown_connections 2023-10-06T05:27:21.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3b0159240 0x7ff3b00cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff390060550 0x7ff390062a00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b0158e70 0x7ff3b00b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 --2- 172.21.15.29:0/3323613713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3b00ad940 0x7ff3b015cf00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 >> 172.21.15.29:0/3323613713 conn(0x7ff3b00692b0 msgr2=0x7ff3b00afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:21.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 shutdown_connections 2023-10-06T05:27:21.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.336+0000 7ff3b5b7e700 1 -- 172.21.15.29:0/3323613713 wait complete. 2023-10-06T05:27:21.343 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 21 2023-10-06T05:27:21.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:27:08.808178+0000', 'modified': '2023-10-06T05:27:12.494062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5460': {'gid': 5460, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/2111647358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 2111647358}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 2111647358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:27:21.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T05:27:21.762 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T05:27:21.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa008674700 1 Processor -- start 2023-10-06T05:27:21.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa008674700 1 -- start start 2023-10-06T05:27:21.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa008674700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa000158fd0 0x7fa0001593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa008674700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa00015cb00 0x7fa00006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa008674700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0000afbe0 con 0x7fa00006ec70 2023-10-06T05:27:21.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa008674700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0001598e0 con 0x7fa00015cb00 2023-10-06T05:27:21.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa008674700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00006f090 con 0x7fa000158fd0 2023-10-06T05:27:21.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa005c0f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa00015cb00 0x7fa00006e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa005c0f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa00015cb00 0x7fa00006e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55106/0 (socket says 172.21.15.29:55106) 2023-10-06T05:27:21.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa005c0f700 1 -- 172.21.15.29:0/4012074596 learned_addr learned my addr 172.21.15.29:0/4012074596 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:21.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa006410700 1 --2- 172.21.15.29:0/4012074596 >> v2:172.21.15.173:3300/0 conn(0x7fa000158fd0 0x7fa0001593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa005c0f700 1 -- 172.21.15.29:0/4012074596 >> v2:172.21.15.173:3300/0 conn(0x7fa000158fd0 msgr2=0x7fa0001593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa005c0f700 1 --2- 172.21.15.29:0/4012074596 >> v2:172.21.15.173:3300/0 conn(0x7fa000158fd0 0x7fa0001593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa005c0f700 1 -- 172.21.15.29:0/4012074596 >> v1:172.21.15.173:6789/0 conn(0x7fa00006ec70 legacy=0x7fa00006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa005c0f700 1 -- 172.21.15.29:0/4012074596 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00015d350 con 0x7fa00015cb00 2023-10-06T05:27:21.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa005c0f700 1 --2- 172.21.15.29:0/4012074596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa00015cb00 0x7fa00006e730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa00006f4e0 tx=0x7f9ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb8273ec9525d63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa00540e700 1 -- 172.21.15.29:0/4012074596 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0009e70 con 0x7fa00015cb00 2023-10-06T05:27:21.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa00540e700 1 -- 172.21.15.29:0/4012074596 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff000b860 con 0x7fa00015cb00 2023-10-06T05:27:21.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.876+0000 7fa00540e700 1 -- 172.21.15.29:0/4012074596 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000bc00 con 0x7fa00015cb00 2023-10-06T05:27:21.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.880+0000 7fa008674700 1 -- 172.21.15.29:0/4012074596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa00015cb00 msgr2=0x7fa00006e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.880+0000 7fa008674700 1 --2- 172.21.15.29:0/4012074596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa00015cb00 0x7fa00006e730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa00006f4e0 tx=0x7f9ff0009250 comp rx=0 tx=0).stop 2023-10-06T05:27:21.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.880+0000 7fa008674700 1 -- 172.21.15.29:0/4012074596 shutdown_connections 2023-10-06T05:27:21.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.880+0000 7fa008674700 1 --2- 172.21.15.29:0/4012074596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa00015cb00 0x7fa00006e730 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.880+0000 7fa008674700 1 --2- 172.21.15.29:0/4012074596 >> v2:172.21.15.173:3300/0 conn(0x7fa000158fd0 0x7fa0001593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.880+0000 7fa008674700 1 -- 172.21.15.29:0/4012074596 >> 172.21.15.29:0/4012074596 conn(0x7fa000067b70 msgr2=0x7fa00006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:21.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.880+0000 7fa008674700 1 -- 172.21.15.29:0/4012074596 shutdown_connections 2023-10-06T05:27:21.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.880+0000 7fa008674700 1 -- 172.21.15.29:0/4012074596 wait complete. 2023-10-06T05:27:21.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 Processor -- start 2023-10-06T05:27:21.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 -- start start 2023-10-06T05:27:21.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa00006ec70 0x7fa0000b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa000158fd0 0x7fa000144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa00015cb00 0x7fa0001575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00016d790 con 0x7fa000158fd0 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0000b39e0 con 0x7fa00015cb00 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0000b33d0 con 0x7fa00006ec70 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa005c0f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa000158fd0 0x7fa000144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa005c0f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa000158fd0 0x7fa000144910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55120/0 (socket says 172.21.15.29:55120) 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa005c0f700 1 -- 172.21.15.29:0/1629223864 learned_addr learned my addr 172.21.15.29:0/1629223864 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa006410700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa00006ec70 0x7fa0000b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa006c11700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa00015cb00 0x7fa0001575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa005c0f700 1 -- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa00006ec70 msgr2=0x7fa0000b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa005c0f700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa00006ec70 0x7fa0000b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa005c0f700 1 -- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa00015cb00 msgr2=0x7fa0001575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa005c0f700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa00015cb00 0x7fa0001575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa005c0f700 1 -- 172.21.15.29:0/1629223864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff00094f0 con 0x7fa000158fd0 2023-10-06T05:27:21.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa005c0f700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa000158fd0 0x7fa000144910 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa000063680 tx=0x7f9ff0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7f9ff67fc700 1 -- 172.21.15.29:0/1629223864 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000bbe0 con 0x7fa000158fd0 2023-10-06T05:27:21.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7f9ff67fc700 1 -- 172.21.15.29:0/1629223864 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff0011420 con 0x7fa000158fd0 2023-10-06T05:27:21.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 -- 172.21.15.29:0/1629223864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00016d4b0 con 0x7fa000158fd0 2023-10-06T05:27:21.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7f9ff67fc700 1 -- 172.21.15.29:0/1629223864 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00117c0 con 0x7fa000158fd0 2023-10-06T05:27:21.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.884+0000 7fa008674700 1 -- 172.21.15.29:0/1629223864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa000144e50 con 0x7fa000158fd0 2023-10-06T05:27:21.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.888+0000 7f9ff67fc700 1 -- 172.21.15.29:0/1629223864 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9ff0011bb0 con 0x7fa000158fd0 2023-10-06T05:27:21.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.888+0000 7f9ff67fc700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fec060550 0x7f9fec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.888+0000 7f9ff67fc700 1 -- 172.21.15.29:0/1629223864 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9ff007e1a0 con 0x7fa000158fd0 2023-10-06T05:27:21.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.888+0000 7fa006410700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fec060550 0x7f9fec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.888+0000 7fa006410700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fec060550 0x7f9fec062a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009db0 tx=0x7f9ffc0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.892+0000 7fa00a91d740 1 Processor -- start 2023-10-06T05:27:21.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.892+0000 7fa00a91d740 1 -- start start 2023-10-06T05:27:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 0x15cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x14f9f30 con 0x1399790 2023-10-06T05:27:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x14f5ed0 con 0x134eae0 2023-10-06T05:27:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x14bc0b0 con 0x134e710 2023-10-06T05:27:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006c11700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006410700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa005c0f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 0x15cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006c11700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55128/0 (socket says 172.21.15.29:55128) 2023-10-06T05:27:21.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006410700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:42970/0 (socket says 172.21.15.29:42970) 2023-10-06T05:27:21.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006c11700 1 -- 172.21.15.29:0/3149073069 learned_addr learned my addr 172.21.15.29:0/3149073069 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:21.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006c11700 1 -- 172.21.15.29:0/3149073069 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 msgr2=0x15cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006c11700 1 --2- 172.21.15.29:0/3149073069 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 0x15cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006c11700 1 -- 172.21.15.29:0/3149073069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 msgr2=0x15cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006c11700 1 --2- 172.21.15.29:0/3149073069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006c11700 1 -- 172.21.15.29:0/3149073069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x139a9e0 con 0x1399790 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa006c11700 1 --2- 172.21.15.29:0/3149073069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15cc0b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8001e20 tx=0x7f9ff8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce7bdba51149ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7f9fe77fe700 1 -- 172.21.15.29:0/3149073069 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800f8d0 con 0x1399790 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7f9fe77fe700 1 -- 172.21.15.29:0/3149073069 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff800fa30 con 0x1399790 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7f9fe77fe700 1 -- 172.21.15.29:0/3149073069 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800fdb0 con 0x1399790 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 -- 172.21.15.29:0/3149073069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 msgr2=0x15cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3149073069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15cc0b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8001e20 tx=0x7f9ff8009040 comp rx=0 tx=0).stop 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 -- 172.21.15.29:0/3149073069 shutdown_connections 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3149073069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15cc0b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3149073069 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 0x15cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3149073069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 -- 172.21.15.29:0/3149073069 >> 172.21.15.29:0/3149073069 conn(0x134eeb0 msgr2=0x1588060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:21.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 -- 172.21.15.29:0/3149073069 shutdown_connections 2023-10-06T05:27:21.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.896+0000 7fa00a91d740 1 -- 172.21.15.29:0/3149073069 wait complete. 2023-10-06T05:27:21.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 1 -- start start 2023-10-06T05:27:21.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 1 Processor -- start 2023-10-06T05:27:21.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134e710 0x15cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134eae0 0x15d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x1585c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x14bbd50 con 0x1399790 2023-10-06T05:27:21.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1494970 con 0x134e710 2023-10-06T05:27:21.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1410ef0 con 0x134eae0 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 10 client.0 _ll_register_callbacks cb 0x1498b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006c11700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x1585c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006c11700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x1585c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55144/0 (socket says 172.21.15.29:55144) 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006c11700 1 -- 172.21.15.29:0/1349070378 learned_addr learned my addr 172.21.15.29:0/1349070378 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006410700 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134e710 0x15cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa005c0f700 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134eae0 0x15d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006c11700 1 -- 172.21.15.29:0/1349070378 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134eae0 msgr2=0x15d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006c11700 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134eae0 0x15d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006c11700 1 -- 172.21.15.29:0/1349070378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134e710 msgr2=0x15cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006c11700 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134e710 0x15cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006c11700 1 -- 172.21.15.29:0/1349070378 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0000afbe0 con 0x1399790 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa006c11700 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x1585c60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800f4b0 tx=0x7f9ff8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de090146ca47350 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7f9fe4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:27:21.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/1349070378 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8023070 con 0x1399790 2023-10-06T05:27:21.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7fa00a91d740 1 -- 172.21.15.29:0/1349070378 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1494cc0 con 0x1399790 2023-10-06T05:27:21.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.900+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/1349070378 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9ff8013960 con 0x1399790 2023-10-06T05:27:21.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/1349070378 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ff8013d30 con 0x1399790 2023-10-06T05:27:21.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 10 client.5622 fetch_fsmap learned FSMap version 21 2023-10-06T05:27:21.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 -- 172.21.15.29:0/1349070378 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x14c4370 con 0x1399790 2023-10-06T05:27:21.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/1349070378 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1494cc0 con 0x1399790 2023-10-06T05:27:21.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/1349070378 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 21) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9ff8012070 con 0x1399790 2023-10-06T05:27:21.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 10 client.5622 fetch_fsmap finished waiting for FSMap version 21 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 10 client.5622 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 20 client.5622 populate_metadata read hostname 'smithi029' 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x15871d0 0x15dade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 4 client.5622 mds_command: new command op to 5460 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 -- 172.21.15.29:0/1349070378 --> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14983e0 con 0x15871d0 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa006410700 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x15871d0 0x15dade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa006410700 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x15871d0 0x15dade0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a4416c78f6bdec server_cookie=ac94cc0b876f9c0a in_seq=0 out_seq=0 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7f9fe4ff9700 10 client.5622 ms_handle_connect on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/1349070378 <== mds.0 v2:172.21.15.29:6834/2111647358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x14983e0 con 0x15871d0 2023-10-06T05:27:21.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7f9fe4ff9700 10 client.5622 handle_command_reply: tid=0 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 client.5622 shutdown 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 -- 172.21.15.29:0/1349070378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 msgr2=0x1585c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x1585c60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800f4b0 tx=0x7f9ff8019000 comp rx=0 tx=0).stop 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 -- 172.21.15.29:0/1349070378 shutdown_connections 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x15871d0 0x15dade0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x1585c60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7f9fe4ff9700 0 client.5622 ms_handle_reset on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134eae0 0x15d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 --2- 172.21.15.29:0/1349070378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134e710 0x15cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 -- 172.21.15.29:0/1349070378 >> 172.21.15.29:0/1349070378 conn(0x134eeb0 msgr2=0x15af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 -- 172.21.15.29:0/1349070378 shutdown_connections 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 1 -- 172.21.15.29:0/1349070378 wait complete. 2023-10-06T05:27:21.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.904+0000 7fa00a91d740 20 client.5622 trim_cache size 0 max 16384 2023-10-06T05:27:21.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa00a91d740 1 Processor -- start 2023-10-06T05:27:21.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa00a91d740 1 -- start start 2023-10-06T05:27:21.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x134e710 0x1621040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x1621580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1399790 0x1621ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa00a91d740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x14f4d60 con 0x134e710 2023-10-06T05:27:21.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa00a91d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x14f95d0 con 0x134eae0 2023-10-06T05:27:21.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa00a91d740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x14a4c90 con 0x1399790 2023-10-06T05:27:21.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa006410700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x134e710 0x1621040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa006410700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x134e710 0x1621040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55152/0 (socket says 172.21.15.29:55152) 2023-10-06T05:27:21.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa006410700 1 -- 172.21.15.29:0/737076549 learned_addr learned my addr 172.21.15.29:0/737076549 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:21.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa006c11700 1 --2- 172.21.15.29:0/737076549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1399790 0x1621ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.924+0000 7fa005c0f700 1 --2- 172.21.15.29:0/737076549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x1621580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa006410700 1 -- 172.21.15.29:0/737076549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1399790 msgr2=0x1621ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa006410700 1 --2- 172.21.15.29:0/737076549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1399790 0x1621ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa006410700 1 -- 172.21.15.29:0/737076549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 msgr2=0x1621580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa006410700 1 --2- 172.21.15.29:0/737076549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x1621580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa006410700 1 -- 172.21.15.29:0/737076549 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000157e60 con 0x134e710 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa006410700 1 --2- 172.21.15.29:0/737076549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x134e710 0x1621040 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0145d0 tx=0x7f9ffc025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e19ee11b853d0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7f9fe7fff700 1 -- 172.21.15.29:0/737076549 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc028040 con 0x134e710 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7f9fe7fff700 1 -- 172.21.15.29:0/737076549 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc014e70 con 0x134e710 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7f9fe7fff700 1 -- 172.21.15.29:0/737076549 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc02c680 con 0x134e710 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 -- 172.21.15.29:0/737076549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x134e710 msgr2=0x1621040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 --2- 172.21.15.29:0/737076549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x134e710 0x1621040 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0145d0 tx=0x7f9ffc025040 comp rx=0 tx=0).stop 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 -- 172.21.15.29:0/737076549 shutdown_connections 2023-10-06T05:27:21.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 --2- 172.21.15.29:0/737076549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1399790 0x1621ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 --2- 172.21.15.29:0/737076549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x1621580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 --2- 172.21.15.29:0/737076549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x134e710 0x1621040 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 -- 172.21.15.29:0/737076549 >> 172.21.15.29:0/737076549 conn(0x134eeb0 msgr2=0x15ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:21.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 -- 172.21.15.29:0/737076549 shutdown_connections 2023-10-06T05:27:21.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 -- 172.21.15.29:0/737076549 wait complete. 2023-10-06T05:27:21.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 -- start start 2023-10-06T05:27:21.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.928+0000 7fa00a91d740 1 Processor -- start 2023-10-06T05:27:21.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 0x15dbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x14c9f40 con 0x1399790 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x14f3890 con 0x134eae0 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x14cb010 con 0x134e710 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 10 client.0 _ll_register_callbacks cb 0x14c1110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006c11700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006c11700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15a73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55160/0 (socket says 172.21.15.29:55160) 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006c11700 1 -- 172.21.15.29:0/3722652116 learned_addr learned my addr 172.21.15.29:0/3722652116 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:21.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa005c0f700 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006410700 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 0x15dbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006c11700 1 -- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 msgr2=0x15dbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006c11700 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 0x15dbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006c11700 1 -- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 msgr2=0x15a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:21.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006c11700 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006c11700 1 -- 172.21.15.29:0/3722652116 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc009ad0 con 0x1399790 2023-10-06T05:27:21.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa005c0f700 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:21.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006410700 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 0x15dbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:21.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006c11700 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15a73b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80013d0 tx=0x7f9ff8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6a729bad6d74a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:21.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7f9fe4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:27:21.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/3722652116 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8037060 con 0x1399790 2023-10-06T05:27:21.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/3722652116 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9ff8029c70 con 0x1399790 2023-10-06T05:27:21.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 -- 172.21.15.29:0/3722652116 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ff800fa30 con 0x1399790 2023-10-06T05:27:21.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/3722652116 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ff8029e30 con 0x1399790 2023-10-06T05:27:21.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 10 client.5628 fetch_fsmap learned FSMap version 21 2023-10-06T05:27:21.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 -- 172.21.15.29:0/3722652116 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x14aad80 con 0x1399790 2023-10-06T05:27:21.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/3722652116 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff800fa30 con 0x1399790 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/3722652116 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 21) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9ff801c6d0 con 0x1399790 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 10 client.5628 fetch_fsmap finished waiting for FSMap version 21 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 10 client.5628 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 20 client.5628 populate_metadata read hostname 'smithi029' 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x15a78f0 0x162d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 4 client.5628 mds_command: new command op to 5460 tid=0[{"prefix": "status"}] 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa00a91d740 1 -- 172.21.15.29:0/3722652116 --> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] -- command(tid 0: {"prefix": "status"}) v1 -- 0x14ca410 con 0x15a78f0 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006410700 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x15a78f0 0x162d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7f9fe4ff9700 10 client.5628 ms_handle_connect on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.932+0000 7fa006410700 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x15a78f0 0x162d2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9976cf15a8528752 server_cookie=74b721f4f351efc9 in_seq=0 out_seq=0 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7f9fe4ff9700 1 -- 172.21.15.29:0/3722652116 <== mds.0 v2:172.21.15.29:6834/2111647358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x14ca410 con 0x15a78f0 2023-10-06T05:27:21.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7f9fe4ff9700 10 client.5628 handle_command_reply: tid=0 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 client.5628 shutdown 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 -- 172.21.15.29:0/3722652116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 msgr2=0x15a73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15a73b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80013d0 tx=0x7f9ff8023000 comp rx=0 tx=0).stop 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 -- 172.21.15.29:0/3722652116 shutdown_connections 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x15a78f0 0x162d2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1399790 0x15a73b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7f9fe4ff9700 0 client.5628 ms_handle_reset on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x134eae0 0x15a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 --2- 172.21.15.29:0/3722652116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x134e710 0x15dbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 -- 172.21.15.29:0/3722652116 >> 172.21.15.29:0/3722652116 conn(0x134eeb0 msgr2=0x1620020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 -- 172.21.15.29:0/3722652116 shutdown_connections 2023-10-06T05:27:21.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 1 -- 172.21.15.29:0/3722652116 wait complete. 2023-10-06T05:27:21.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa00a91d740 20 client.5628 trim_cache size 0 max 16384 2023-10-06T05:27:21.944 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:27:21.944 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "bd99696d-d9bf-47c8-93f5-f978334ae590", 2023-10-06T05:27:21.944 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-06T05:27:21.944 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5460, 2023-10-06T05:27:21.944 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-06T05:27:21.944 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-06T05:27:21.944 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-06T05:27:21.944 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 12.471094878000001, 2023-10-06T05:27:21.945 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 21, 2023-10-06T05:27:21.945 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 50, 2023-10-06T05:27:21.945 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 48, 2023-10-06T05:27:21.945 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 18.318949246999999 2023-10-06T05:27:21.945 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:27:21.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 -- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fec060550 msgr2=0x7f9fec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fec060550 0x7f9fec062a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009db0 tx=0x7f9ffc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 -- 172.21.15.29:0/1629223864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa000158fd0 msgr2=0x7fa000144910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:21.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa000158fd0 0x7fa000144910 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa000063680 tx=0x7f9ff0017000 comp rx=0 tx=0).stop 2023-10-06T05:27:21.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 -- 172.21.15.29:0/1629223864 shutdown_connections 2023-10-06T05:27:21.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9fec060550 0x7f9fec062a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa00015cb00 0x7fa0001575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa000158fd0 0x7fa000144910 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 --2- 172.21.15.29:0/1629223864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa00006ec70 0x7fa0000b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:21.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 -- 172.21.15.29:0/1629223864 >> 172.21.15.29:0/1629223864 conn(0x7fa000067b70 msgr2=0x7fa000154ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:21.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 -- 172.21.15.29:0/1629223864 shutdown_connections 2023-10-06T05:27:21.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:21.936+0000 7fa008674700 1 -- 172.21.15.29:0/1629223864 wait complete. 2023-10-06T05:27:21.959 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:27:22.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a30a7700 1 Processor -- start 2023-10-06T05:27:22.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a30a7700 1 -- start start 2023-10-06T05:27:22.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a30a7700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff59c0c8100 0x7ff59c06ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:22.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a30a7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff59c15a080 0x7ff59c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:22.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a30a7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c159bf0 con 0x7ff59c06e960 2023-10-06T05:27:22.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a30a7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c0cbaa0 con 0x7ff59c15a080 2023-10-06T05:27:22.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a30a7700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c0cbbe0 con 0x7ff59c0c8100 2023-10-06T05:27:22.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a1644700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff59c15a080 0x7ff59c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:22.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a1644700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff59c15a080 0x7ff59c14fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55162/0 (socket says 172.21.15.29:55162) 2023-10-06T05:27:22.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a1644700 1 -- 172.21.15.29:0/246567457 learned_addr learned my addr 172.21.15.29:0/246567457 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:22.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a0e43700 1 --1- 172.21.15.29:0/246567457 >> v1:172.21.15.29:6789/0 conn(0x7ff59c06e960 0x7ff59c156220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35720/0 (socket says 172.21.15.29:35720) 2023-10-06T05:27:22.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff59bfff700 1 --2- 172.21.15.29:0/246567457 >> v2:172.21.15.173:3300/0 conn(0x7ff59c0c8100 0x7ff59c06ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:22.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a1644700 1 -- 172.21.15.29:0/246567457 >> v2:172.21.15.173:3300/0 conn(0x7ff59c0c8100 msgr2=0x7ff59c06ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:22.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a1644700 1 --2- 172.21.15.29:0/246567457 >> v2:172.21.15.173:3300/0 conn(0x7ff59c0c8100 0x7ff59c06ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a1644700 1 -- 172.21.15.29:0/246567457 >> v1:172.21.15.29:6789/0 conn(0x7ff59c06e960 legacy=0x7ff59c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:22.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a1644700 1 -- 172.21.15.29:0/246567457 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c0cbd50 con 0x7ff59c15a080 2023-10-06T05:27:22.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff59bfff700 1 --2- 172.21.15.29:0/246567457 >> v2:172.21.15.173:3300/0 conn(0x7ff59c0c8100 0x7ff59c06ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:22.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a1644700 1 --2- 172.21.15.29:0/246567457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c15a080 0x7ff59c14fd70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06f4c0 tx=0x7ff594009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87164a35f46d6bb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:22.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff59b7fe700 1 -- 172.21.15.29:0/246567457 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400b860 con 0x7ff59c15a080 2023-10-06T05:27:22.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff59b7fe700 1 -- 172.21.15.29:0/246567457 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59400b9c0 con 0x7ff59c15a080 2023-10-06T05:27:22.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff59b7fe700 1 -- 172.21.15.29:0/246567457 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400bd60 con 0x7ff59c15a080 2023-10-06T05:27:22.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.072+0000 7ff5a30a7700 1 -- 172.21.15.29:0/246567457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c15a080 msgr2=0x7ff59c14fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:22.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 --2- 172.21.15.29:0/246567457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c15a080 0x7ff59c14fd70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06f4c0 tx=0x7ff594009250 comp rx=0 tx=0).stop 2023-10-06T05:27:22.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 -- 172.21.15.29:0/246567457 shutdown_connections 2023-10-06T05:27:22.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 --2- 172.21.15.29:0/246567457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c15a080 0x7ff59c14fd70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 --2- 172.21.15.29:0/246567457 >> v2:172.21.15.173:3300/0 conn(0x7ff59c0c8100 0x7ff59c06ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 -- 172.21.15.29:0/246567457 >> 172.21.15.29:0/246567457 conn(0x7ff59c067b70 msgr2=0x7ff59c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:22.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 -- 172.21.15.29:0/246567457 shutdown_connections 2023-10-06T05:27:22.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 -- 172.21.15.29:0/246567457 wait complete. 2023-10-06T05:27:22.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 Processor -- start 2023-10-06T05:27:22.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 -- start start 2023-10-06T05:27:22.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c06e960 0x7ff59c153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:22.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59c0c8100 0x7ff59c135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:22.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59c15a080 0x7ff59c14a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:22.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c1535c0 con 0x7ff59c06e960 2023-10-06T05:27:22.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c14ba40 con 0x7ff59c15a080 2023-10-06T05:27:22.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a30a7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c14ae30 con 0x7ff59c0c8100 2023-10-06T05:27:22.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a0e43700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c06e960 0x7ff59c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:22.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a0e43700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c06e960 0x7ff59c153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55172/0 (socket says 172.21.15.29:55172) 2023-10-06T05:27:22.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a0e43700 1 -- 172.21.15.29:0/2600217205 learned_addr learned my addr 172.21.15.29:0/2600217205 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff59bfff700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59c0c8100 0x7ff59c135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a1644700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59c15a080 0x7ff59c14a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a0e43700 1 -- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59c0c8100 msgr2=0x7ff59c135bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a0e43700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59c0c8100 0x7ff59c135bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a0e43700 1 -- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59c15a080 msgr2=0x7ff59c14a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a0e43700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59c15a080 0x7ff59c14a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.076+0000 7ff5a0e43700 1 -- 172.21.15.29:0/2600217205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940094f0 con 0x7ff59c06e960 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff5a0e43700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c06e960 0x7ff59c153080 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff58400c7c0 tx=0x7ff584007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff598ff9700 1 -- 172.21.15.29:0/2600217205 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584005a70 con 0x7ff59c06e960 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff598ff9700 1 -- 172.21.15.29:0/2600217205 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584005bd0 con 0x7ff59c06e960 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c14b110 con 0x7ff59c06e960 2023-10-06T05:27:22.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff598ff9700 1 -- 172.21.15.29:0/2600217205 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5840070d0 con 0x7ff59c06e960 2023-10-06T05:27:22.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c14b6d0 con 0x7ff59c06e960 2023-10-06T05:27:22.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c04be00 con 0x7ff59c06e960 2023-10-06T05:27:22.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff598ff9700 1 -- 172.21.15.29:0/2600217205 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff584007440 con 0x7ff59c06e960 2023-10-06T05:27:22.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff598ff9700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff57c060550 0x7ff57c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:22.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.080+0000 7ff598ff9700 1 -- 172.21.15.29:0/2600217205 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff58407bef0 con 0x7ff59c06e960 2023-10-06T05:27:22.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.084+0000 7ff59bfff700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff57c060550 0x7ff57c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:22.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.084+0000 7ff59bfff700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff57c060550 0x7ff57c062a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff59c153ca0 tx=0x7ff58c0098f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.092+0000 7ff598ff9700 1 -- 172.21.15.29:0/2600217205 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff58404c340 con 0x7ff59c06e960 2023-10-06T05:27:22.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.288+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff59c06f4f0 con 0x7ff59c06e960 2023-10-06T05:27:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.288+0000 7ff598ff9700 1 -- 172.21.15.29:0/2600217205 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff584017070 con 0x7ff59c06e960 2023-10-06T05:27:22.295 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff57c060550 msgr2=0x7ff57c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff57c060550 0x7ff57c062a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff59c153ca0 tx=0x7ff58c0098f0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c06e960 msgr2=0x7ff59c153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c06e960 0x7ff59c153080 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff58400c7c0 tx=0x7ff584007f30 comp rx=0 tx=0).stop 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 shutdown_connections 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff57c060550 0x7ff57c062a00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59c15a080 0x7ff59c14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59c0c8100 0x7ff59c135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 --2- 172.21.15.29:0/2600217205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff59c06e960 0x7ff59c153080 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 >> 172.21.15.29:0/2600217205 conn(0x7ff59c067b70 msgr2=0x7ff59c0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 shutdown_connections 2023-10-06T05:27:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:22.292+0000 7ff5a30a7700 1 -- 172.21.15.29:0/2600217205 wait complete. 2023-10-06T05:27:22.308 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:27:22.309 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:27:22.309 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:27:22.309 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T05:27:22.309 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T05:27:22.309 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:27:22.309 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:27:22.309 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:27:22.309 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:27:22.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:22.310 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:27:22.316 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:27:22.316 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:27:22.316 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:27:22.316 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:27:22.316 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:27:22.316 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42485sec preferred_lft 42485sec 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:27:22.317 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:27:22.318 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:27:22.318 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:27:22.318 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:27:22.318 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:27:22.318 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:27:22.318 INFO:teuthology.orchestra.run.smithi029.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:27:22.318 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::38dc:3fff:fed0:feb0/64 scope link 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c88:ceff:fe77:b613/64 scope link 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether aa:ad:a4:57:7d:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a8ad:a4ff:fe57:7d6d/64 scope link 2023-10-06T05:27:22.319 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:27:22.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:22.320 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:27:22.373 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:27:22.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:22.375 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:27:22.384 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:27:22.384 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:27:22.384 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:27:22.385 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:27:22.385 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:27:22.385 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:27:22.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:22.385 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:27:22.386 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:27:22.386 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:27:22.386 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:27:22.386 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:27:22.386 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:27:22.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:22.425 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:27:22.474 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T05:27:22.474 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:27:22.475 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:27:22.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:22.475 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-06T05:27:22.490 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T05:27:22.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:27:22.491 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T05:27:22.498 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:27:22.498 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:27:22.498 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:27:22.544 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:27:22.560 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:27:22.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:27:22.577 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:27:22.578 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:27:22.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:27:22.579 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:27:22.585 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:27:22.585 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T05:27:22.587 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:27:22.602 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:27:22.602 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:27:22.613 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:27:22.614 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:27:22.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:27:22.614 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:27:22.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2023-10-06T05:27:22.664+0000 7fcc9519a380 -1 init, newargv = 0x55cf959f2c70 newargc=15 2023-10-06T05:27:22.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[44138]: starting ceph client 2023-10-06T05:27:22.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[44138]: starting fuse 2023-10-06T05:27:23.764 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:27:23.783 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:27:23.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:27:23.794 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:27:23.795 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:27:23.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:27:23.796 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:27:23.846 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:27:23.846 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:27:23.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:27:23.846 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:27:23.846 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:27:23.847 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2023-10-06T05:27:23.848 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:27:23.929 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.44138.asok 2023-10-06T05:27:24.115 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44138.asok 2023-10-06T05:27:24.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:27:24.116 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44138.asok status 2023-10-06T05:27:24.214 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:27:24.214 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:27:24.214 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "44138", 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5643, 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:27:24.215 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 5643 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2641818960 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:27:24.216 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:27:24.217 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2641818960 2023-10-06T05:27:24.217 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:24.217 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.5643 192.168.0.1:0/2641818960", 2023-10-06T05:27:24.217 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/2641818960", 2023-10-06T05:27:24.217 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:27:24.217 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 21, 2023-10-06T05:27:24.217 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 50, 2023-10-06T05:27:24.217 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:27:24.218 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:27:24.218 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:27:24.218 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:27:24.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:27:24.223 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:27:24.223 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T05:27:24.232 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:27:24.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T05:27:24.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:27:24.232 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:27:24.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:27:24.247 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-10-06T05:27:24.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:27:24.266 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-10-06T05:27:24.279 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:27:24.279 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:27:24.279 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:27:24.280 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:27:24.280 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-10-06T05:27:24.280 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:27:24.392 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627777 2023-10-06T05:27:24.582 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:27:24.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb9559e700 1 Processor -- start 2023-10-06T05:27:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb9559e700 1 -- start start 2023-10-06T05:27:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb9559e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbb900b00a0 0x7fbb900adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb9559e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900ae440 0x7fbb900cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb9559e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb900b0470 0x7fbb900ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:24.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb9559e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb901583a0 con 0x7fbb900b0470 2023-10-06T05:27:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb9559e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb90157790 con 0x7fbb900b00a0 2023-10-06T05:27:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb9559e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90157a70 con 0x7fbb900ae440 2023-10-06T05:27:24.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb900b0470 0x7fbb900ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb900b0470 0x7fbb900ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41072/0 (socket says 172.21.15.29:41072) 2023-10-06T05:27:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8f7fe700 1 -- 172.21.15.29:0/751061514 learned_addr learned my addr 172.21.15.29:0/751061514 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8effd700 1 --2- 172.21.15.29:0/751061514 >> v2:172.21.15.173:3300/0 conn(0x7fbb900b00a0 0x7fbb900adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8e7fc700 1 --2- 172.21.15.29:0/751061514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900ae440 0x7fbb900cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8f7fe700 1 -- 172.21.15.29:0/751061514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900ae440 msgr2=0x7fbb900cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8f7fe700 1 --2- 172.21.15.29:0/751061514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900ae440 0x7fbb900cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8f7fe700 1 -- 172.21.15.29:0/751061514 >> v2:172.21.15.173:3300/0 conn(0x7fbb900b00a0 msgr2=0x7fbb900adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8f7fe700 1 --2- 172.21.15.29:0/751061514 >> v2:172.21.15.173:3300/0 conn(0x7fbb900b00a0 0x7fbb900adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8f7fe700 1 -- 172.21.15.29:0/751061514 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90157d50 con 0x7fbb900b0470 2023-10-06T05:27:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.679+0000 7fbb8f7fe700 1 --2- 172.21.15.29:0/751061514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b0470 0x7fbb900ce1a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbb9006baf0 tx=0x7fbb80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9764d04759bb3201 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb8dffb700 1 -- 172.21.15.29:0/751061514 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8000b640 con 0x7fbb900b0470 2023-10-06T05:27:24.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb8dffb700 1 -- 172.21.15.29:0/751061514 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8000b7a0 con 0x7fbb900b0470 2023-10-06T05:27:24.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb8dffb700 1 -- 172.21.15.29:0/751061514 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8000bb60 con 0x7fbb900b0470 2023-10-06T05:27:24.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 -- 172.21.15.29:0/751061514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b0470 msgr2=0x7fbb900ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:24.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 --2- 172.21.15.29:0/751061514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b0470 0x7fbb900ce1a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbb9006baf0 tx=0x7fbb80009250 comp rx=0 tx=0).stop 2023-10-06T05:27:24.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 -- 172.21.15.29:0/751061514 shutdown_connections 2023-10-06T05:27:24.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 --2- 172.21.15.29:0/751061514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b0470 0x7fbb900ce1a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 --2- 172.21.15.29:0/751061514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900ae440 0x7fbb900cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 --2- 172.21.15.29:0/751061514 >> v2:172.21.15.173:3300/0 conn(0x7fbb900b00a0 0x7fbb900adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 -- 172.21.15.29:0/751061514 >> 172.21.15.29:0/751061514 conn(0x7fbb900692b0 msgr2=0x7fbb900696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 -- 172.21.15.29:0/751061514 shutdown_connections 2023-10-06T05:27:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 -- 172.21.15.29:0/751061514 wait complete. 2023-10-06T05:27:24.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 Processor -- start 2023-10-06T05:27:24.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.683+0000 7fbb9559e700 1 -- start start 2023-10-06T05:27:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb9559e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb900ae440 0x7fbb900c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb9559e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b00a0 0x7fbb900b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb9559e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900b0470 0x7fbb900cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:24.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb9559e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb900c3640 con 0x7fbb900b00a0 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb9559e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb900cd180 con 0x7fbb900ae440 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb9559e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb900c33b0 con 0x7fbb900b0470 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b00a0 0x7fbb900b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8effd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb900ae440 0x7fbb900c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8f7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900b0470 0x7fbb900cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b00a0 0x7fbb900b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41086/0 (socket says 172.21.15.29:41086) 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8e7fc700 1 -- 172.21.15.29:0/3641670452 learned_addr learned my addr 172.21.15.29:0/3641670452 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8e7fc700 1 -- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900b0470 msgr2=0x7fbb900cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8e7fc700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900b0470 0x7fbb900cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8e7fc700 1 -- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb900ae440 msgr2=0x7fbb900c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8e7fc700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb900ae440 0x7fbb900c29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8e7fc700 1 -- 172.21.15.29:0/3641670452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800094f0 con 0x7fbb900b00a0 2023-10-06T05:27:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb8e7fc700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b00a0 0x7fbb900b2810 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009f10 tx=0x7fbb8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:24.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb86ffd700 1 -- 172.21.15.29:0/3641670452 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8800cb70 con 0x7fbb900b00a0 2023-10-06T05:27:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb86ffd700 1 -- 172.21.15.29:0/3641670452 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8800f040 con 0x7fbb900b00a0 2023-10-06T05:27:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb900cd670 con 0x7fbb900b00a0 2023-10-06T05:27:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb86ffd700 1 -- 172.21.15.29:0/3641670452 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88014480 con 0x7fbb900b00a0 2023-10-06T05:27:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.687+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb900c2f30 con 0x7fbb900b00a0 2023-10-06T05:27:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.691+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb900c3120 con 0x7fbb900b00a0 2023-10-06T05:27:24.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.691+0000 7fbb86ffd700 1 -- 172.21.15.29:0/3641670452 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbb88014830 con 0x7fbb900b00a0 2023-10-06T05:27:24.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.691+0000 7fbb86ffd700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbb70060580 0x7fbb70062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:24.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.691+0000 7fbb86ffd700 1 -- 172.21.15.29:0/3641670452 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fbb8807d270 con 0x7fbb900b00a0 2023-10-06T05:27:24.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.691+0000 7fbb8effd700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbb70060580 0x7fbb70062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:24.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.691+0000 7fbb8effd700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbb70060580 0x7fbb70062a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009db0 tx=0x7fbb780091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:24.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.699+0000 7fbb86ffd700 1 -- 172.21.15.29:0/3641670452 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbb900c3120 con 0x7fbb900b00a0 2023-10-06T05:27:24.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.899+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb900c3120 con 0x7fbb900b00a0 2023-10-06T05:27:24.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.899+0000 7fbb86ffd700 1 -- 172.21.15.29:0/3641670452 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fbb900c3120 con 0x7fbb900b00a0 2023-10-06T05:27:24.907 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:24.907 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3538089078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3538089078},{"type":"v1","addr":"172.21.15.173:6835","nonce":3538089078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3499370562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3499370562},{"type":"v1","addr":"172.21.15.173:6837","nonce":3499370562}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3369448997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3369448997},{"type":"v1","addr":"172.21.15.29:6833","nonce":3369448997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:27:08.808178+0000","modified":"2023-10-06T05:27:12.494062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5460":{"gid":5460,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2111647358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2111647358},{"type":"v1","addr":"172.21.15.29:6835","nonce":2111647358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T05:27:24.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbb70060580 msgr2=0x7fbb70062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:24.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbb70060580 0x7fbb70062a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009db0 tx=0x7fbb780091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b00a0 msgr2=0x7fbb900b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:24.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b00a0 0x7fbb900b2810 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009f10 tx=0x7fbb8800b040 comp rx=0 tx=0).stop 2023-10-06T05:27:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 shutdown_connections 2023-10-06T05:27:24.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbb900b0470 0x7fbb900cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb900b00a0 0x7fbb900b2810 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbb70060580 0x7fbb70062a30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 --2- 172.21.15.29:0/3641670452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb900ae440 0x7fbb900c29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 >> 172.21.15.29:0/3641670452 conn(0x7fbb900692b0 msgr2=0x7fbb900c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 shutdown_connections 2023-10-06T05:27:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:24.903+0000 7fbb9559e700 1 -- 172.21.15.29:0/3641670452 wait complete. 2023-10-06T05:27:24.911 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 21 2023-10-06T05:27:24.921 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T05:27:25.049 INFO:teuthology.orchestra.run.smithi029.stdout:{"message":"","return_code":0} 2023-10-06T05:27:25.049 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T05:27:25.049 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-10-06T05:27:25.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.075+0000 7f237f66ae80 1 Processor -- start 2023-10-06T05:27:26.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.075+0000 7f237f66ae80 1 -- start start 2023-10-06T05:27:26.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37700a30 0x55db3772a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db37745ca0 0x55db3772adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55db377d3dc0 0x55db377e0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db376a5220 con 0x55db37745ca0 2023-10-06T05:27:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37649840 con 0x55db37700a30 2023-10-06T05:27:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db376494e0 con 0x55db377d3dc0 2023-10-06T05:27:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237d1a1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37700a30 0x55db3772a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237c9a0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db37745ca0 0x55db3772adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237d1a1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37700a30 0x55db3772a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:46920/0 (socket says 172.21.15.29:46920) 2023-10-06T05:27:26.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237d1a1700 1 -- 172.21.15.29:0/1806850169 learned_addr learned my addr 172.21.15.29:0/1806850169 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237d9a2700 1 --2- 172.21.15.29:0/1806850169 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55db377d3dc0 0x55db377e0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237c9a0700 1 -- 172.21.15.29:0/1806850169 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55db377d3dc0 msgr2=0x55db377e0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237c9a0700 1 --2- 172.21.15.29:0/1806850169 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55db377d3dc0 0x55db377e0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237c9a0700 1 -- 172.21.15.29:0/1806850169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37700a30 msgr2=0x55db3772a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237c9a0700 1 --2- 172.21.15.29:0/1806850169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37700a30 0x55db3772a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237c9a0700 1 -- 172.21.15.29:0/1806850169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2368005cf0 con 0x55db37745ca0 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237d1a1700 1 --2- 172.21.15.29:0/1806850169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37700a30 0x55db3772a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237c9a0700 1 --2- 172.21.15.29:0/1806850169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db37745ca0 0x55db3772adf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x55db3774ae90 tx=0x7f2368016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754b980796aa9d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f23777fe700 1 -- 172.21.15.29:0/1806850169 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2368000c90 con 0x55db37745ca0 2023-10-06T05:27:26.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f23777fe700 1 -- 172.21.15.29:0/1806850169 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2368008970 con 0x55db37745ca0 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f23777fe700 1 -- 172.21.15.29:0/1806850169 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236801c410 con 0x55db37745ca0 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 -- 172.21.15.29:0/1806850169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db37745ca0 msgr2=0x55db3772adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 --2- 172.21.15.29:0/1806850169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db37745ca0 0x55db3772adf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x55db3774ae90 tx=0x7f2368016000 comp rx=0 tx=0).stop 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 -- 172.21.15.29:0/1806850169 shutdown_connections 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 --2- 172.21.15.29:0/1806850169 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55db377d3dc0 0x55db377e0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 --2- 172.21.15.29:0/1806850169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db37745ca0 0x55db3772adf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 --2- 172.21.15.29:0/1806850169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37700a30 0x55db3772a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 -- 172.21.15.29:0/1806850169 >> 172.21.15.29:0/1806850169 conn(0x55db3774afc0 msgr2=0x55db3772dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 -- 172.21.15.29:0/1806850169 shutdown_connections 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.079+0000 7f237f66ae80 1 -- 172.21.15.29:0/1806850169 wait complete. 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237f66ae80 1 Processor -- start 2023-10-06T05:27:26.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237f66ae80 1 -- start start 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237f66ae80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55db37700a30 0x55db377e0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237f66ae80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37745ca0 0x55db377cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237f66ae80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db377d3dc0 0x55db377de890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237f66ae80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37640270 con 0x55db377d3dc0 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237f66ae80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db377dfdf0 con 0x55db37745ca0 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237f66ae80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db377e07c0 con 0x55db37700a30 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237d9a2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db377d3dc0 0x55db377de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237d9a2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db377d3dc0 0x55db377de890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41118/0 (socket says 172.21.15.29:41118) 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237d9a2700 1 -- 172.21.15.29:0/1131553653 learned_addr learned my addr 172.21.15.29:0/1131553653 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237c9a0700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37745ca0 0x55db377cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.083+0000 7f237d1a1700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55db37700a30 0x55db377e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f237d9a2700 1 -- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55db37700a30 msgr2=0x55db377e0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f237d9a2700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55db37700a30 0x55db377e0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f237d9a2700 1 -- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37745ca0 msgr2=0x55db377cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f237d9a2700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55db37745ca0 0x55db377cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f237d9a2700 1 -- 172.21.15.29:0/1131553653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c001e10 con 0x55db377d3dc0 2023-10-06T05:27:26.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f237d9a2700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db377d3dc0 0x55db377de890 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2370002e50 tx=0x7f23700017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f2375ffb700 1 -- 172.21.15.29:0/1131553653 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000cbd0 con 0x55db377d3dc0 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f2375ffb700 1 -- 172.21.15.29:0/1131553653 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370008030 con 0x55db377d3dc0 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55db37658250 con 0x55db377d3dc0 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f2375ffb700 1 -- 172.21.15.29:0/1131553653 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370011450 con 0x55db377d3dc0 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db3764b770 con 0x55db377d3dc0 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f2375ffb700 1 -- 172.21.15.29:0/1131553653 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f23700117c0 con 0x55db377d3dc0 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.087+0000 7f2375ffb700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f236005eee0 0x7f2360061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f2375ffb700 1 -- 172.21.15.29:0/1131553653 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f237007b460 con 0x55db377d3dc0 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55db37744d70 0x55db377e4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) v8 -- 0x55db377e5250 con 0x55db37744d70 2023-10-06T05:27:26.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237d1a1700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f236005eee0 0x7f2360061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237c9a0700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55db37744d70 0x55db377e4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237c9a0700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55db37744d70 0x55db377e4d10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237d1a1700 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f236005eee0 0x7f2360061390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2378000f80 tx=0x7f2378006a20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237c9a0700 1 -- 172.21.15.29:0/1131553653 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f2368023020 con 0x55db37744d70 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55db37744d70 msgr2=0x55db377e4d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55db37744d70 0x55db377e4d10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f236005eee0 msgr2=0x7f2360061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f236005eee0 0x7f2360061390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2378000f80 tx=0x7f2378006a20 comp rx=0 tx=0).stop 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db377d3dc0 msgr2=0x55db377de890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 --2- 172.21.15.29:0/1131553653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55db377d3dc0 0x55db377de890 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2370002e50 tx=0x7f23700017e0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237d9a2700 1 -- 172.21.15.29:0/1131553653 reap_dead start 2023-10-06T05:27:26.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 shutdown_connections 2023-10-06T05:27:26.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 >> 172.21.15.29:0/1131553653 conn(0x55db3774afc0 msgr2=0x55db377d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 shutdown_connections 2023-10-06T05:27:26.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:25.091+0000 7f237f66ae80 1 -- 172.21.15.29:0/1131553653 wait complete. 2023-10-06T05:27:26.123 INFO:teuthology.orchestra.run.smithi029.stdout:Yalphaparent_a 2023-10-06T05:27:26.124 DEBUG:teuthology.orchestra.run.smithi029:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T05:27:26.183 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: "ino": 1099511627777, 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: "ancestors": [ 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: "dirino": 1099511627776, 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: "dname": "alpha", 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 2 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: "dirino": 1, 2023-10-06T05:27:26.309 INFO:teuthology.orchestra.run.smithi029.stdout: "dname": "parent_a", 2023-10-06T05:27:26.310 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 4 2023-10-06T05:27:26.310 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:26.310 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-06T05:27:26.310 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 8, 2023-10-06T05:27:26.310 INFO:teuthology.orchestra.run.smithi029.stdout: "old_pools": [] 2023-10-06T05:27:26.310 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:27:26.310 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:26.311 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2023-10-06T05:27:26.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 Processor -- start 2023-10-06T05:27:26.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 -- start start 2023-10-06T05:27:26.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 0x56169846aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561698508910 0x56169847d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56169850e840 0x561698502e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x561698381840 con 0x561698508910 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616983814e0 con 0x56169847fd90 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x561698378270 con 0x56169850e840 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a48f4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561698508910 0x56169847d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a58f6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56169850e840 0x561698502e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a48f4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561698508910 0x56169847d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41132/0 (socket says 172.21.15.29:41132) 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a48f4700 1 -- 172.21.15.29:0/1904442231 learned_addr learned my addr 172.21.15.29:0/1904442231 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a50f5700 1 --2- 172.21.15.29:0/1904442231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 0x56169846aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a58f6700 1 -- 172.21.15.29:0/1904442231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 msgr2=0x56169846aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a58f6700 1 --2- 172.21.15.29:0/1904442231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 0x56169846aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a58f6700 1 -- 172.21.15.29:0/1904442231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561698508910 msgr2=0x56169847d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a58f6700 1 --2- 172.21.15.29:0/1904442231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561698508910 0x56169847d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a58f6700 1 -- 172.21.15.29:0/1904442231 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889000a0e0 con 0x56169850e840 2023-10-06T05:27:26.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a48f4700 1 --2- 172.21.15.29:0/1904442231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561698508910 0x56169847d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:26.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a58f6700 1 --2- 172.21.15.29:0/1904442231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56169850e840 0x561698502e30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f88a0001c50 tx=0x7f88a00016d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf596ddd1314ebff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f889f7fe700 1 -- 172.21.15.29:0/1904442231 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0014070 con 0x56169850e840 2023-10-06T05:27:26.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f889f7fe700 1 -- 172.21.15.29:0/1904442231 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a000bc10 con 0x56169850e840 2023-10-06T05:27:26.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f889f7fe700 1 -- 172.21.15.29:0/1904442231 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a000f450 con 0x56169850e840 2023-10-06T05:27:26.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 -- 172.21.15.29:0/1904442231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56169850e840 msgr2=0x561698502e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 --2- 172.21.15.29:0/1904442231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56169850e840 0x561698502e30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f88a0001c50 tx=0x7f88a00016d0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 -- 172.21.15.29:0/1904442231 shutdown_connections 2023-10-06T05:27:26.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 --2- 172.21.15.29:0/1904442231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56169850e840 0x561698502e30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 --2- 172.21.15.29:0/1904442231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561698508910 0x56169847d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 --2- 172.21.15.29:0/1904442231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 0x56169846aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 -- 172.21.15.29:0/1904442231 >> 172.21.15.29:0/1904442231 conn(0x561698485ce0 msgr2=0x56169846a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 -- 172.21.15.29:0/1904442231 shutdown_connections 2023-10-06T05:27:26.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.347+0000 7f88a75bee80 1 -- 172.21.15.29:0/1904442231 wait complete. 2023-10-06T05:27:26.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 Processor -- start 2023-10-06T05:27:26.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 -- start start 2023-10-06T05:27:26.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 0x561698503580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x561698508910 0x561698501420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56169850e840 0x561698504e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x561698503ac0 con 0x56169850e840 2023-10-06T05:27:26.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x561698504040 con 0x56169847fd90 2023-10-06T05:27:26.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x561698504320 con 0x561698508910 2023-10-06T05:27:26.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a58f6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56169850e840 0x561698504e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a58f6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56169850e840 0x561698504e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41142/0 (socket says 172.21.15.29:41142) 2023-10-06T05:27:26.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a58f6700 1 -- 172.21.15.29:0/2769753401 learned_addr learned my addr 172.21.15.29:0/2769753401 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a50f5700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 0x561698503580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a48f4700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x561698508910 0x561698501420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a58f6700 1 -- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x561698508910 msgr2=0x561698501420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a58f6700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x561698508910 0x561698501420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a58f6700 1 -- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 msgr2=0x561698503580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a58f6700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 0x561698503580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a58f6700 1 -- 172.21.15.29:0/2769753401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889000a5d0 con 0x56169850e840 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a50f5700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56169847fd90 0x561698503580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a58f6700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56169850e840 0x561698504e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f88a0001260 tx=0x7f88a0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f889dffb700 1 -- 172.21.15.29:0/2769753401 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a001a690 con 0x56169850e840 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f889dffb700 1 -- 172.21.15.29:0/2769753401 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0021070 con 0x56169850e840 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8894001e10 con 0x56169850e840 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f889dffb700 1 -- 172.21.15.29:0/2769753401 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a001a850 con 0x56169850e840 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.351+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8898005db0 con 0x56169850e840 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.355+0000 7f889dffb700 1 -- 172.21.15.29:0/2769753401 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f88a001ac00 con 0x56169850e840 2023-10-06T05:27:26.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.355+0000 7f889dffb700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f888805eee0 0x7f8888061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.355+0000 7f889dffb700 1 -- 172.21.15.29:0/2769753401 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f88a0008030 con 0x56169850e840 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.355+0000 7f88a50f5700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f888805eee0 0x7f8888061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.355+0000 7f88a75bee80 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x561698505340 0x561698469570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.355+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) v8 -- 0x56169847e990 con 0x561698505340 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.355+0000 7f88a48f4700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x561698505340 0x561698469570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.355+0000 7f88a50f5700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f888805eee0 0x7f8888061390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8898005b50 tx=0x7f8898016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.355+0000 7f88a48f4700 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x561698505340 0x561698469570 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a48f4700 1 -- 172.21.15.29:0/2769753401 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v50'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8890014420 con 0x561698505340 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x561698505340 msgr2=0x561698469570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x561698505340 0x561698469570 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f888805eee0 msgr2=0x7f8888061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f888805eee0 0x7f8888061390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8898005b50 tx=0x7f8898016000 comp rx=0 tx=0).stop 2023-10-06T05:27:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56169850e840 msgr2=0x561698504e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 --2- 172.21.15.29:0/2769753401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56169850e840 0x561698504e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f88a0001260 tx=0x7f88a0014000 comp rx=0 tx=0).stop 2023-10-06T05:27:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a58f6700 1 -- 172.21.15.29:0/2769753401 reap_dead start 2023-10-06T05:27:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 shutdown_connections 2023-10-06T05:27:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 >> 172.21.15.29:0/2769753401 conn(0x561698485ce0 msgr2=0x561698507ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 shutdown_connections 2023-10-06T05:27:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.359+0000 7f88a75bee80 1 -- 172.21.15.29:0/2769753401 wait complete. 2023-10-06T05:27:26.438 DEBUG:teuthology.orchestra.run.smithi029:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-06T05:27:26.441 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-10-06T05:27:26.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.559+0000 7fba95ee9700 1 Processor -- start 2023-10-06T05:27:26.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.559+0000 7fba95ee9700 1 -- start start 2023-10-06T05:27:26.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba90157040 0x7fba900c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fba9006d6d0 0x7fba9006db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba900c6b40 con 0x7fba90156c70 2023-10-06T05:27:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9006e090 con 0x7fba9006d6d0 2023-10-06T05:27:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9006bdd0 con 0x7fba90157040 2023-10-06T05:27:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba90157040 0x7fba900c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba94ee7700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fba90156c70 0x7fba9006b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:45298/0 (socket says 172.21.15.29:45298) 2023-10-06T05:27:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba94ee7700 1 -- 172.21.15.29:0/896163004 learned_addr learned my addr 172.21.15.29:0/896163004 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba956e8700 1 --2- 172.21.15.29:0/896163004 >> v2:172.21.15.173:3300/0 conn(0x7fba9006d6d0 0x7fba9006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8f7fe700 1 -- 172.21.15.29:0/896163004 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868821839 0 0) 0x7fba900c6b40 con 0x7fba90156c70 2023-10-06T05:27:26.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8f7fe700 1 -- 172.21.15.29:0/896163004 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba80003570 con 0x7fba90156c70 2023-10-06T05:27:26.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8ffff700 1 -- 172.21.15.29:0/896163004 >> v2:172.21.15.173:3300/0 conn(0x7fba9006d6d0 msgr2=0x7fba9006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8ffff700 1 --2- 172.21.15.29:0/896163004 >> v2:172.21.15.173:3300/0 conn(0x7fba9006d6d0 0x7fba9006db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8ffff700 1 -- 172.21.15.29:0/896163004 >> v1:172.21.15.173:6789/0 conn(0x7fba90156c70 legacy=0x7fba9006b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8ffff700 1 -- 172.21.15.29:0/896163004 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900c6d90 con 0x7fba90157040 2023-10-06T05:27:26.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba956e8700 1 --2- 172.21.15.29:0/896163004 >> v2:172.21.15.173:3300/0 conn(0x7fba9006d6d0 0x7fba9006db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:26.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8ffff700 1 --2- 172.21.15.29:0/896163004 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba90157040 0x7fba900c7870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0098e0 tx=0x7fba7c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d04b8462da9653c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8f7fe700 1 -- 172.21.15.29:0/896163004 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c011630 con 0x7fba90157040 2023-10-06T05:27:26.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8f7fe700 1 -- 172.21.15.29:0/896163004 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c011790 con 0x7fba90157040 2023-10-06T05:27:26.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba8f7fe700 1 -- 172.21.15.29:0/896163004 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c011b30 con 0x7fba90157040 2023-10-06T05:27:26.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 -- 172.21.15.29:0/896163004 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba90157040 msgr2=0x7fba900c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 --2- 172.21.15.29:0/896163004 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba90157040 0x7fba900c7870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0098e0 tx=0x7fba7c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 -- 172.21.15.29:0/896163004 shutdown_connections 2023-10-06T05:27:26.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 --2- 172.21.15.29:0/896163004 >> v2:172.21.15.173:3300/0 conn(0x7fba9006d6d0 0x7fba9006db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 --2- 172.21.15.29:0/896163004 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba90157040 0x7fba900c7870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.563+0000 7fba95ee9700 1 -- 172.21.15.29:0/896163004 >> 172.21.15.29:0/896163004 conn(0x7fba900c9830 msgr2=0x7fba9006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 -- 172.21.15.29:0/896163004 shutdown_connections 2023-10-06T05:27:26.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 -- 172.21.15.29:0/896163004 wait complete. 2023-10-06T05:27:26.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 Processor -- start 2023-10-06T05:27:26.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 -- start start 2023-10-06T05:27:26.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fc931fd5700 1 Processor -- start 2023-10-06T05:27:26.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fc931fd5700 1 -- start start 2023-10-06T05:27:26.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9006d6d0 0x7fba9014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba90156c70 0x7fba90166fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba90157040 0x7fba90167500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900af090 con 0x7fba90157040 2023-10-06T05:27:26.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900af650 con 0x7fba90156c70 2023-10-06T05:27:26.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba95ee9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba90167af0 con 0x7fba9006d6d0 2023-10-06T05:27:26.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba956e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba90157040 0x7fba90167500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba956e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba90157040 0x7fba90167500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41144/0 (socket says 172.21.15.29:41144) 2023-10-06T05:27:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba956e8700 1 -- 172.21.15.29:0/91502171 learned_addr learned my addr 172.21.15.29:0/91502171 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba8ffff700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba90156c70 0x7fba90166fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba94ee7700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9006d6d0 0x7fba9014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba956e8700 1 -- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9006d6d0 msgr2=0x7fba9014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba956e8700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9006d6d0 0x7fba9014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba956e8700 1 -- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba90156c70 msgr2=0x7fba90166fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba956e8700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba90156c70 0x7fba90166fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba956e8700 1 -- 172.21.15.29:0/91502171 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88009a20 con 0x7fba90157040 2023-10-06T05:27:26.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fba8ffff700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba90156c70 0x7fba90166fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:26.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fc931fd5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc92c159c80 0x7fc92c06b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fc931fd5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c06e0d0 con 0x7fc92c154ea0 2023-10-06T05:27:26.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fc931fd5700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c06d120 con 0x7fc92c06af80 2023-10-06T05:27:26.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fc931fd5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c0b0280 con 0x7fc92c159c80 2023-10-06T05:27:26.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.567+0000 7fc9317d4700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc92c154ea0 0x7fc92c1552c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56862/0 (socket says 172.21.15.29:56862) 2023-10-06T05:27:26.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc9317d4700 1 -- 172.21.15.29:0/4183898604 learned_addr learned my addr 172.21.15.29:0/4183898604 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:26.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fba956e8700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba90157040 0x7fba90167500 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fba8800c0f0 tx=0x7fba8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92bfff700 1 --2- 172.21.15.29:0/4183898604 >> v2:172.21.15.29:3300/0 conn(0x7fc92c159c80 0x7fc92c06b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92b7fe700 1 -- 172.21.15.29:0/4183898604 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482355478 0 0) 0x7fc92c06e0d0 con 0x7fc92c154ea0 2023-10-06T05:27:26.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92b7fe700 1 -- 172.21.15.29:0/4183898604 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc91c003570 con 0x7fc92c154ea0 2023-10-06T05:27:26.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fba8cff9700 1 -- 172.21.15.29:0/91502171 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8800cc30 con 0x7fba90157040 2023-10-06T05:27:26.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fba8cff9700 1 -- 172.21.15.29:0/91502171 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8800f040 con 0x7fba90157040 2023-10-06T05:27:26.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fba8cff9700 1 -- 172.21.15.29:0/91502171 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88014480 con 0x7fba90157040 2023-10-06T05:27:26.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fba95ee9700 1 -- 172.21.15.29:0/91502171 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c009420 con 0x7fba90157040 2023-10-06T05:27:26.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fba95ee9700 1 -- 172.21.15.29:0/91502171 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba900af2e0 con 0x7fba90157040 2023-10-06T05:27:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92bfff700 1 -- 172.21.15.29:0/4183898604 >> v1:172.21.15.173:6789/0 conn(0x7fc92c06af80 legacy=0x7fc92c06d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92bfff700 1 -- 172.21.15.29:0/4183898604 >> v1:172.21.15.29:6789/0 conn(0x7fc92c154ea0 legacy=0x7fc92c1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92bfff700 1 -- 172.21.15.29:0/4183898604 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c06d5b0 con 0x7fc92c159c80 2023-10-06T05:27:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92bfff700 1 --2- 172.21.15.29:0/4183898604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c159c80 0x7fc92c06b350 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc91800aa90 tx=0x7fc91800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54ca87b026361e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92b7fe700 1 -- 172.21.15.29:0/4183898604 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800c970 con 0x7fc92c159c80 2023-10-06T05:27:26.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92b7fe700 1 -- 172.21.15.29:0/4183898604 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91800cad0 con 0x7fc92c159c80 2023-10-06T05:27:26.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc92b7fe700 1 -- 172.21.15.29:0/4183898604 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800ce90 con 0x7fc92c159c80 2023-10-06T05:27:26.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc931fd5700 1 -- 172.21.15.29:0/4183898604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c159c80 msgr2=0x7fc92c06b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fc931fd5700 1 --2- 172.21.15.29:0/4183898604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c159c80 0x7fc92c06b350 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc91800aa90 tx=0x7fc91800a330 comp rx=0 tx=0).stop 2023-10-06T05:27:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fba8cff9700 1 -- 172.21.15.29:0/91502171 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fba88003020 con 0x7fba90157040 2023-10-06T05:27:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.571+0000 7fba8cff9700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba74060550 0x7fba74062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba74060550 0x7fba74062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba8cff9700 1 -- 172.21.15.29:0/91502171 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fba8807d310 con 0x7fba90157040 2023-10-06T05:27:26.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba74060550 0x7fba74062a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fba84007fd0 tx=0x7fba84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba993f4740 1 Processor -- start 2023-10-06T05:27:26.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba993f4740 1 -- start start 2023-10-06T05:27:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fc931fd5700 1 -- 172.21.15.29:0/4183898604 shutdown_connections 2023-10-06T05:27:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fc931fd5700 1 --2- 172.21.15.29:0/4183898604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c159c80 0x7fc92c06b350 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fc931fd5700 1 -- 172.21.15.29:0/4183898604 >> 172.21.15.29:0/4183898604 conn(0x7fc92c067b20 msgr2=0x7fc92c0cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fc931fd5700 1 -- 172.21.15.29:0/4183898604 shutdown_connections 2023-10-06T05:27:26.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fc931fd5700 1 -- 172.21.15.29:0/4183898604 wait complete. 2023-10-06T05:27:26.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba993f4740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe2a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba993f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 0xe2abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba993f4740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 0xe2b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba993f4740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0xd54120 con 0xba8d80 2023-10-06T05:27:26.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba993f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0xd500c0 con 0xba89b0 2023-10-06T05:27:26.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba993f4740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0xd16270 con 0xbf3a30 2023-10-06T05:27:26.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe2a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe2a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41150/0 (socket says 172.21.15.29:41150) 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 -- 172.21.15.29:0/2555184383 learned_addr learned my addr 172.21.15.29:0/2555184383 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba8ffff700 1 --2- 172.21.15.29:0/2555184383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 0xe2abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba956e8700 1 --2- 172.21.15.29:0/2555184383 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 0xe2b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 -- 172.21.15.29:0/2555184383 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 msgr2=0xe2b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 --2- 172.21.15.29:0/2555184383 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 0xe2b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 -- 172.21.15.29:0/2555184383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 msgr2=0xe2abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 --2- 172.21.15.29:0/2555184383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 0xe2abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 -- 172.21.15.29:0/2555184383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xbf4c80 con 0xba8d80 2023-10-06T05:27:26.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba94ee7700 1 --2- 172.21.15.29:0/2555184383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe2a690 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fba8400f990 tx=0x7fba84015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b78e6528ef2ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.575+0000 7fba79ffb700 1 -- 172.21.15.29:0/2555184383 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84001690 con 0xba8d80 2023-10-06T05:27:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba79ffb700 1 -- 172.21.15.29:0/2555184383 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84004a40 con 0xba8d80 2023-10-06T05:27:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba79ffb700 1 -- 172.21.15.29:0/2555184383 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84004dc0 con 0xba8d80 2023-10-06T05:27:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 Processor -- start 2023-10-06T05:27:26.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 -- start start 2023-10-06T05:27:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 -- 172.21.15.29:0/2555184383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 msgr2=0xe2a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 --2- 172.21.15.29:0/2555184383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe2a690 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fba8400f990 tx=0x7fba84015000 comp rx=0 tx=0).stop 2023-10-06T05:27:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 -- 172.21.15.29:0/2555184383 shutdown_connections 2023-10-06T05:27:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 --2- 172.21.15.29:0/2555184383 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 0xe2b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 --2- 172.21.15.29:0/2555184383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 0xe2abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 --2- 172.21.15.29:0/2555184383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe2a690 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 -- 172.21.15.29:0/2555184383 >> 172.21.15.29:0/2555184383 conn(0xba9150 msgr2=0xde3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 -- 172.21.15.29:0/2555184383 shutdown_connections 2023-10-06T05:27:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 -- 172.21.15.29:0/2555184383 wait complete. 2023-10-06T05:27:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c06af80 0x7fc92c1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc92c154ea0 0x7fc92c165620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c159c80 0x7fc92c0aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c165e20 con 0x7fc92c06af80 2023-10-06T05:27:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c156f20 con 0x7fc92c159c80 2023-10-06T05:27:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c165b60 con 0x7fc92c154ea0 2023-10-06T05:27:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc930fd3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c06af80 0x7fc92c1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 -- start start 2023-10-06T05:27:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc930fd3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c06af80 0x7fc92c1595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41154/0 (socket says 172.21.15.29:41154) 2023-10-06T05:27:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc930fd3700 1 -- 172.21.15.29:0/3520812056 learned_addr learned my addr 172.21.15.29:0/3520812056 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc9317d4700 1 --2- 172.21.15.29:0/3520812056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c159c80 0x7fc92c0aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc92bfff700 1 --2- 172.21.15.29:0/3520812056 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc92c154ea0 0x7fc92c165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 Processor -- start 2023-10-06T05:27:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc930fd3700 1 -- 172.21.15.29:0/3520812056 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc92c154ea0 msgr2=0x7fc92c165620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc930fd3700 1 --2- 172.21.15.29:0/3520812056 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc92c154ea0 0x7fc92c165620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc930fd3700 1 -- 172.21.15.29:0/3520812056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c159c80 msgr2=0x7fc92c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc930fd3700 1 --2- 172.21.15.29:0/3520812056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc92c159c80 0x7fc92c0aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc930fd3700 1 -- 172.21.15.29:0/3520812056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91800a5d0 con 0x7fc92c06af80 2023-10-06T05:27:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc930fd3700 1 --2- 172.21.15.29:0/3520812056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c06af80 0x7fc92c1595d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc92000c510 tx=0x7fc92000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc928ff9700 1 -- 172.21.15.29:0/3520812056 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920011590 con 0x7fc92c06af80 2023-10-06T05:27:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc928ff9700 1 -- 172.21.15.29:0/3520812056 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc920011710 con 0x7fc92c06af80 2023-10-06T05:27:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 -- 172.21.15.29:0/3520812056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c1565f0 con 0x7fc92c06af80 2023-10-06T05:27:26.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc928ff9700 1 -- 172.21.15.29:0/3520812056 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920011ad0 con 0x7fc92c06af80 2023-10-06T05:27:26.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fc931fd5700 1 -- 172.21.15.29:0/3520812056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c156bb0 con 0x7fc92c06af80 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba89b0 0xe0ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba8d80 0xe0ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xbf3a30 0xe0f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0xd15f10 con 0xba89b0 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0xceeb30 con 0xbf3a30 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.579+0000 7fba993f4740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0xd22270 con 0xba8d80 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba94ee7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba89b0 0xe0ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 10 client.0 _ll_register_callbacks cb 0xcf2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba94ee7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba89b0 0xe0ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41170/0 (socket says 172.21.15.29:41170) 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba94ee7700 1 -- 172.21.15.29:0/4090002568 learned_addr learned my addr 172.21.15.29:0/4090002568 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba8ffff700 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba8d80 0xe0ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba956e8700 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xbf3a30 0xe0f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fc931fd5700 1 -- 172.21.15.29:0/3520812056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fc92c154d00 con 0x7fc92c06af80 2023-10-06T05:27:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba94ee7700 1 -- 172.21.15.29:0/4090002568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba8d80 msgr2=0xe0ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba94ee7700 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba8d80 0xe0ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba94ee7700 1 -- 172.21.15.29:0/4090002568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xbf3a30 msgr2=0xe0f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba94ee7700 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xbf3a30 0xe0f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba94ee7700 1 -- 172.21.15.29:0/4090002568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba80003570 con 0xba89b0 2023-10-06T05:27:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba94ee7700 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba89b0 0xe0ea20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0xcf0860 tx=0x7fba84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4273c7a077f23a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:27:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 1 -- 172.21.15.29:0/4090002568 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8400fe80 con 0xba89b0 2023-10-06T05:27:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 1 -- 172.21.15.29:0/4090002568 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fba84019070 con 0xba89b0 2023-10-06T05:27:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 -- 172.21.15.29:0/4090002568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xcf2670 con 0xba89b0 2023-10-06T05:27:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 1 -- 172.21.15.29:0/4090002568 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba84014660 con 0xba89b0 2023-10-06T05:27:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 10 client.5688 fetch_fsmap learned FSMap version 21 2023-10-06T05:27:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 -- 172.21.15.29:0/4090002568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0xd1e490 con 0xba89b0 2023-10-06T05:27:26.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fc928ff9700 1 -- 172.21.15.29:0/3520812056 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc92001b3b0 con 0x7fc92c06af80 2023-10-06T05:27:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 1 -- 172.21.15.29:0/4090002568 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xcf2670 con 0xba89b0 2023-10-06T05:27:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 1 -- 172.21.15.29:0/4090002568 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 21) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fba840147c0 con 0xba89b0 2023-10-06T05:27:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 10 client.5688 fetch_fsmap finished waiting for FSMap version 21 2023-10-06T05:27:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 10 client.5688 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T05:27:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 20 client.5688 populate_metadata read hostname 'smithi029' 2023-10-06T05:27:26.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0xe37100 0xe394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 4 client.5688 mds_command: new command op to 5460 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:27:26.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 -- 172.21.15.29:0/4090002568 --> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd24530 con 0xe37100 2023-10-06T05:27:26.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba8ffff700 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0xe37100 0xe394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fc928ff9700 1 --2- 172.21.15.29:0/3520812056 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc910060550 0x7fc910062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fc928ff9700 1 -- 172.21.15.29:0/3520812056 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fc92007bcb0 con 0x7fc92c06af80 2023-10-06T05:27:26.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fc928ff9700 1 -- 172.21.15.29:0/3520812056 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+503 (secure 0 0 0) 0x7fc92c154d00 con 0x7fc92c06af80 2023-10-06T05:27:26.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fc92bfff700 1 --2- 172.21.15.29:0/3520812056 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc910060550 0x7fc910062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 10 client.5688 ms_handle_connect on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:26.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba8ffff700 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0xe37100 0xe394e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40035d79b9cf79e1 server_cookie=b920b919c2309a9a in_seq=0 out_seq=0 2023-10-06T05:27:26.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fc931fd5700 1 -- 172.21.15.29:0/3520812056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fc92c154d00 con 0x7fc92c06af80 2023-10-06T05:27:26.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 1 -- 172.21.15.29:0/4090002568 <== mds.0 v2:172.21.15.29:6834/2111647358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0xd24530 con 0xe37100 2023-10-06T05:27:26.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 10 client.5688 handle_command_reply: tid=0 2023-10-06T05:27:26.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fc92bfff700 1 --2- 172.21.15.29:0/3520812056 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc910060550 0x7fc910062a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc918008010 tx=0x7fc918019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 client.5688 shutdown 2023-10-06T05:27:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 -- 172.21.15.29:0/4090002568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba89b0 msgr2=0xe0ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba89b0 0xe0ea20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0xcf0860 tx=0x7fba84018000 comp rx=0 tx=0).stop 2023-10-06T05:27:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 -- 172.21.15.29:0/4090002568 shutdown_connections 2023-10-06T05:27:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0xe37100 0xe394e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xbf3a30 0xe0f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba6effd700 0 client.5688 ms_handle_reset on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba8d80 0xe0ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 --2- 172.21.15.29:0/4090002568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba89b0 0xe0ea20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.583+0000 7fba993f4740 1 -- 172.21.15.29:0/4090002568 >> 172.21.15.29:0/4090002568 conn(0xba9150 msgr2=0xde27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.587+0000 7fba993f4740 1 -- 172.21.15.29:0/4090002568 shutdown_connections 2023-10-06T05:27:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.587+0000 7fba993f4740 1 -- 172.21.15.29:0/4090002568 wait complete. 2023-10-06T05:27:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.587+0000 7fba993f4740 20 client.5688 trim_cache size 0 max 16384 2023-10-06T05:27:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.599+0000 7fba993f4740 1 Processor -- start 2023-10-06T05:27:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.599+0000 7fba993f4740 1 -- start start 2023-10-06T05:27:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba89b0 0xe80f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba8d80 0xe81460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xbf3a30 0xe819a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0xd20d30 con 0xbf3a30 2023-10-06T05:27:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0xc21a60 con 0xba8d80 2023-10-06T05:27:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0xc32120 con 0xba89b0 2023-10-06T05:27:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba956e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xbf3a30 0xe819a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba956e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xbf3a30 0xe819a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41174/0 (socket says 172.21.15.29:41174) 2023-10-06T05:27:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba956e8700 1 -- 172.21.15.29:0/225248345 learned_addr learned my addr 172.21.15.29:0/225248345 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba8ffff700 1 --2- 172.21.15.29:0/225248345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba8d80 0xe81460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba94ee7700 1 --2- 172.21.15.29:0/225248345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba89b0 0xe80f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba956e8700 1 -- 172.21.15.29:0/225248345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba89b0 msgr2=0xe80f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba956e8700 1 --2- 172.21.15.29:0/225248345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba89b0 0xe80f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba956e8700 1 -- 172.21.15.29:0/225248345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba8d80 msgr2=0xe81460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba956e8700 1 --2- 172.21.15.29:0/225248345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba8d80 0xe81460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba956e8700 1 -- 172.21.15.29:0/225248345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90154800 con 0xbf3a30 2023-10-06T05:27:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba956e8700 1 --2- 172.21.15.29:0/225248345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xbf3a30 0xe819a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fba8800c0c0 tx=0x7fba8807b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e417b54b90a3c66d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba7a7fc700 1 -- 172.21.15.29:0/225248345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88054610 con 0xbf3a30 2023-10-06T05:27:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba7a7fc700 1 -- 172.21.15.29:0/225248345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba88058360 con 0xbf3a30 2023-10-06T05:27:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba7a7fc700 1 -- 172.21.15.29:0/225248345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8807d0c0 con 0xbf3a30 2023-10-06T05:27:26.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 -- 172.21.15.29:0/225248345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xbf3a30 msgr2=0xe819a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 --2- 172.21.15.29:0/225248345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xbf3a30 0xe819a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fba8800c0c0 tx=0x7fba8807b550 comp rx=0 tx=0).stop 2023-10-06T05:27:26.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 -- 172.21.15.29:0/225248345 shutdown_connections 2023-10-06T05:27:26.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 --2- 172.21.15.29:0/225248345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xbf3a30 0xe819a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 --2- 172.21.15.29:0/225248345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba8d80 0xe81460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 --2- 172.21.15.29:0/225248345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xba89b0 0xe80f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 -- 172.21.15.29:0/225248345 >> 172.21.15.29:0/225248345 conn(0xba9150 msgr2=0xe394e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 -- 172.21.15.29:0/225248345 shutdown_connections 2023-10-06T05:27:26.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.603+0000 7fba993f4740 1 -- 172.21.15.29:0/225248345 wait complete. 2023-10-06T05:27:26.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 -- start start 2023-10-06T05:27:26.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 Processor -- start 2023-10-06T05:27:26.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 0xe84cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe85230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 0xe07970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0xd4da80 con 0xba8d80 2023-10-06T05:27:26.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0xd070c0 con 0xba89b0 2023-10-06T05:27:26.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0xd13cd0 con 0xbf3a30 2023-10-06T05:27:26.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 10 client.0 _ll_register_callbacks cb 0xcf9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:27:26.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba8ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe85230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba8ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe85230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41190/0 (socket says 172.21.15.29:41190) 2023-10-06T05:27:26.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba94ee7700 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 0xe84cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba8ffff700 1 -- 172.21.15.29:0/364300904 learned_addr learned my addr 172.21.15.29:0/364300904 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba956e8700 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 0xe07970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba8ffff700 1 -- 172.21.15.29:0/364300904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 msgr2=0xe07970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba8ffff700 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 0xe07970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba8ffff700 1 -- 172.21.15.29:0/364300904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 msgr2=0xe84cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba8ffff700 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 0xe84cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba8ffff700 1 -- 172.21.15.29:0/364300904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba900af2e0 con 0xba8d80 2023-10-06T05:27:26.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba8ffff700 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe85230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fba9006bf10 tx=0x7fba7c028250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462a6bfefd880348 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba6effd700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:27:26.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba6effd700 1 -- 172.21.15.29:0/364300904 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c01bad0 con 0xba8d80 2023-10-06T05:27:26.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba6effd700 1 -- 172.21.15.29:0/364300904 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fba7c01bc30 con 0xba8d80 2023-10-06T05:27:26.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 -- 172.21.15.29:0/364300904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba84004a40 con 0xba8d80 2023-10-06T05:27:26.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba6effd700 1 -- 172.21.15.29:0/364300904 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba7c02a400 con 0xba8d80 2023-10-06T05:27:26.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 10 client.5694 fetch_fsmap learned FSMap version 21 2023-10-06T05:27:26.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.607+0000 7fba993f4740 1 -- 172.21.15.29:0/364300904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x7fba900cbf40 con 0xba8d80 2023-10-06T05:27:26.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba6effd700 1 -- 172.21.15.29:0/364300904 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84004a40 con 0xba8d80 2023-10-06T05:27:26.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba6effd700 1 -- 172.21.15.29:0/364300904 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 21) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fba7c02a560 con 0xba8d80 2023-10-06T05:27:26.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 10 client.5694 fetch_fsmap finished waiting for FSMap version 21 2023-10-06T05:27:26.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 10 client.5694 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T05:27:26.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 20 client.5694 populate_metadata read hostname 'smithi029' 2023-10-06T05:27:26.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0xe08890 0xe08c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 4 client.5694 mds_command: new command op to 5460 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-10-06T05:27:26.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 -- 172.21.15.29:0/364300904 --> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0xc00780 con 0xe08890 2023-10-06T05:27:26.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba94ee7700 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0xe08890 0xe08c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba6effd700 10 client.5694 ms_handle_connect on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:26.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba94ee7700 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0xe08890 0xe08c90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e0de2142acbbf3 server_cookie=c9714405b08fd935 in_seq=0 out_seq=0 2023-10-06T05:27:26.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba6effd700 1 -- 172.21.15.29:0/364300904 <== mds.0 v2:172.21.15.29:6834/2111647358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xc00780 con 0xe08890 2023-10-06T05:27:26.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba6effd700 10 client.5694 handle_command_reply: tid=0 2023-10-06T05:27:26.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 client.5694 shutdown 2023-10-06T05:27:26.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 -- 172.21.15.29:0/364300904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 msgr2=0xe85230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe85230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fba9006bf10 tx=0x7fba7c028250 comp rx=0 tx=0).stop 2023-10-06T05:27:26.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 -- 172.21.15.29:0/364300904 shutdown_connections 2023-10-06T05:27:26.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0xe08890 0xe08c90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0xbf3a30 0xe07970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0xba8d80 0xe85230 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 --2- 172.21.15.29:0/364300904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0xba89b0 0xe84cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba6effd700 0 client.5694 ms_handle_reset on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:26.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 -- 172.21.15.29:0/364300904 >> 172.21.15.29:0/364300904 conn(0xba9150 msgr2=0xe394e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.633 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:27:26.611+0000 7f136e28b700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5643=0-4194304@1} caps={5643=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5643 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x559969b93b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-06T05:27:26.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 -- 172.21.15.29:0/364300904 shutdown_connections 2023-10-06T05:27:26.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 1 -- 172.21.15.29:0/364300904 wait complete. 2023-10-06T05:27:26.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba993f4740 20 client.5694 trim_cache size 0 max 16384 2023-10-06T05:27:26.634 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:27:26.634 INFO:teuthology.orchestra.run.smithi029.stdout: "return_code": 0, 2023-10-06T05:27:26.634 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_tag": "e3a05b19-db09-4f4d-b497-05dc4dc6195c", 2023-10-06T05:27:26.634 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": "asynchronous" 2023-10-06T05:27:26.635 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:27:26.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba95ee9700 1 -- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba74060550 msgr2=0x7fba74062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba95ee9700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba74060550 0x7fba74062a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fba84007fd0 tx=0x7fba84009040 comp rx=0 tx=0).stop 2023-10-06T05:27:26.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba95ee9700 1 -- 172.21.15.29:0/91502171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba90157040 msgr2=0x7fba90167500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.611+0000 7fba95ee9700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba90157040 0x7fba90167500 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fba8800c0f0 tx=0x7fba8800b040 comp rx=0 tx=0).stop 2023-10-06T05:27:26.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.615+0000 7fba95ee9700 1 -- 172.21.15.29:0/91502171 shutdown_connections 2023-10-06T05:27:26.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.615+0000 7fba95ee9700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba90157040 0x7fba90167500 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.615+0000 7fba95ee9700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fba74060550 0x7fba74062a00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.615+0000 7fba95ee9700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba90156c70 0x7fba90166fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.615+0000 7fba95ee9700 1 --2- 172.21.15.29:0/91502171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba9006d6d0 0x7fba9014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.615+0000 7fba95ee9700 1 -- 172.21.15.29:0/91502171 >> 172.21.15.29:0/91502171 conn(0x7fba900c9830 msgr2=0x7fba900c2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.615+0000 7fba95ee9700 1 -- 172.21.15.29:0/91502171 shutdown_connections 2023-10-06T05:27:26.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.615+0000 7fba95ee9700 1 -- 172.21.15.29:0/91502171 wait complete. 2023-10-06T05:27:26.637 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-10-06T05:27:26.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9432128700 1 Processor -- start 2023-10-06T05:27:26.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9432128700 1 -- start start 2023-10-06T05:27:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9432128700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f942c15d890 0x7f942c159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9432128700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f942c06b810 0x7f942c0cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9432128700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942c06b380 con 0x7f942c158c30 2023-10-06T05:27:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9432128700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942c06bc50 con 0x7f942c15d890 2023-10-06T05:27:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9432128700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942c06a770 con 0x7f942c06b810 2023-10-06T05:27:26.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9422ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f942c15d890 0x7f942c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9422ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f942c15d890 0x7f942c159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41204/0 (socket says 172.21.15.29:41204) 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.751+0000 7f9422ffd700 1 -- 172.21.15.29:0/574449396 learned_addr learned my addr 172.21.15.29:0/574449396 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f942bfff700 1 --2- 172.21.15.29:0/574449396 >> v2:172.21.15.173:3300/0 conn(0x7f942c06b810 0x7f942c0cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9422ffd700 1 -- 172.21.15.29:0/574449396 >> v2:172.21.15.173:3300/0 conn(0x7f942c06b810 msgr2=0x7f942c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9422ffd700 1 --2- 172.21.15.29:0/574449396 >> v2:172.21.15.173:3300/0 conn(0x7f942c06b810 0x7f942c0cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9422ffd700 1 -- 172.21.15.29:0/574449396 >> v1:172.21.15.173:6789/0 conn(0x7f942c158c30 legacy=0x7f942c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9422ffd700 1 -- 172.21.15.29:0/574449396 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c06aa50 con 0x7f942c15d890 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9422ffd700 1 --2- 172.21.15.29:0/574449396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c15d890 0x7f942c159000 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f942c0b6040 tx=0x7f9414009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82aea33fa4070072 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f942affd700 1 -- 172.21.15.29:0/574449396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414009e70 con 0x7f942c15d890 2023-10-06T05:27:26.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f942affd700 1 -- 172.21.15.29:0/574449396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400b860 con 0x7f942c15d890 2023-10-06T05:27:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f942affd700 1 -- 172.21.15.29:0/574449396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400bc00 con 0x7f942c15d890 2023-10-06T05:27:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9432128700 1 -- 172.21.15.29:0/574449396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c15d890 msgr2=0x7f942c159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9432128700 1 --2- 172.21.15.29:0/574449396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c15d890 0x7f942c159000 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f942c0b6040 tx=0x7f9414009250 comp rx=0 tx=0).stop 2023-10-06T05:27:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9432128700 1 -- 172.21.15.29:0/574449396 shutdown_connections 2023-10-06T05:27:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9432128700 1 --2- 172.21.15.29:0/574449396 >> v2:172.21.15.173:3300/0 conn(0x7f942c06b810 0x7f942c0cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9432128700 1 --2- 172.21.15.29:0/574449396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c15d890 0x7f942c159000 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9432128700 1 -- 172.21.15.29:0/574449396 >> 172.21.15.29:0/574449396 conn(0x7f942c0670a0 msgr2=0x7f942c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9432128700 1 -- 172.21.15.29:0/574449396 shutdown_connections 2023-10-06T05:27:26.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.755+0000 7f9432128700 1 -- 172.21.15.29:0/574449396 wait complete. 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f9432128700 1 Processor -- start 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f9432128700 1 -- start start 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f9432128700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c06b810 0x7f942c0c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f9432128700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f942c158c30 0x7f942c0b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f9432128700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f942c15d890 0x7f942c0cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f9432128700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0c7350 con 0x7f942c06b810 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f9432128700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0c94b0 con 0x7f942c15d890 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f9432128700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0b11e0 con 0x7f942c158c30 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f942b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c06b810 0x7f942c0c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f9422ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f942c158c30 0x7f942c0b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f942bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f942c15d890 0x7f942c0cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f942b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c06b810 0x7f942c0c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41218/0 (socket says 172.21.15.29:41218) 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f942b7fe700 1 -- 172.21.15.29:0/2467188847 learned_addr learned my addr 172.21.15.29:0/2467188847 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f942b7fe700 1 -- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f942c158c30 msgr2=0x7f942c0b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f942b7fe700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f942c158c30 0x7f942c0b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f942b7fe700 1 -- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f942c15d890 msgr2=0x7f942c0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f942b7fe700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f942c15d890 0x7f942c0cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.759+0000 7f942b7fe700 1 -- 172.21.15.29:0/2467188847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140094f0 con 0x7f942c06b810 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.763+0000 7f9422ffd700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f942c158c30 0x7f942c0b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:26.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.763+0000 7f942b7fe700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c06b810 0x7f942c0c8f70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c790 tx=0x7f941c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.763+0000 7f9423fff700 1 -- 172.21.15.29:0/2467188847 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c011590 con 0x7f942c06b810 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.763+0000 7f9423fff700 1 -- 172.21.15.29:0/2467188847 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c011710 con 0x7f942c06b810 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.763+0000 7f9432128700 1 -- 172.21.15.29:0/2467188847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942c0b5d90 con 0x7f942c06b810 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.763+0000 7f9423fff700 1 -- 172.21.15.29:0/2467188847 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c011ad0 con 0x7f942c06b810 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.763+0000 7f9432128700 1 -- 172.21.15.29:0/2467188847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c0c99c0 con 0x7f942c06b810 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.767+0000 7f9423fff700 1 -- 172.21.15.29:0/2467188847 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f941c01b3b0 con 0x7f942c06b810 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.767+0000 7f9423fff700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f940c060550 0x7f940c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.767+0000 7f9423fff700 1 -- 172.21.15.29:0/2467188847 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f941c07bda0 con 0x7f942c06b810 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.767+0000 7f9422ffd700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f940c060550 0x7f940c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.767+0000 7f9422ffd700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f940c060550 0x7f940c062a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f942c0b6040 tx=0x7f9414017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.767+0000 7f94343d1740 1 Processor -- start 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 -- start start 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 0x22a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x221a0f0 con 0x206ec10 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2215ee0 con 0x206e840 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x21dc020 con 0x20b98c0 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41232/0 (socket says 172.21.15.29:41232) 2023-10-06T05:27:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942b7fe700 1 -- 172.21.15.29:0/30599526 learned_addr learned my addr 172.21.15.29:0/30599526 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942bfff700 1 --2- 172.21.15.29:0/30599526 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 0x22a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f9422ffd700 1 --2- 172.21.15.29:0/30599526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942b7fe700 1 -- 172.21.15.29:0/30599526 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 msgr2=0x22a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942b7fe700 1 --2- 172.21.15.29:0/30599526 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 0x22a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942b7fe700 1 -- 172.21.15.29:0/30599526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 msgr2=0x22a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942b7fe700 1 --2- 172.21.15.29:0/30599526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22a2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942b7fe700 1 -- 172.21.15.29:0/30599526 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20bab10 con 0x206ec10 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f942b7fe700 1 --2- 172.21.15.29:0/30599526 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a2730 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f941c04fda0 tx=0x7f941c079fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ecd9a415d88abe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f9420ff9700 1 -- 172.21.15.29:0/30599526 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c050550 con 0x206ec10 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f9420ff9700 1 -- 172.21.15.29:0/30599526 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c0530a0 con 0x206ec10 2023-10-06T05:27:26.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f9420ff9700 1 -- 172.21.15.29:0/30599526 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c056df0 con 0x206ec10 2023-10-06T05:27:26.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 -- 172.21.15.29:0/30599526 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 msgr2=0x22a2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 --2- 172.21.15.29:0/30599526 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a2730 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f941c04fda0 tx=0x7f941c079fe0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 -- 172.21.15.29:0/30599526 shutdown_connections 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 --2- 172.21.15.29:0/30599526 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 0x22a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 --2- 172.21.15.29:0/30599526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 --2- 172.21.15.29:0/30599526 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a2730 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 -- 172.21.15.29:0/30599526 >> 172.21.15.29:0/30599526 conn(0x206efe0 msgr2=0x22cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 -- 172.21.15.29:0/30599526 shutdown_connections 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.771+0000 7f94343d1740 1 -- 172.21.15.29:0/30599526 wait complete. 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f94343d1740 1 -- start start 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f94343d1740 1 Processor -- start 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f94343d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22a8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f94343d1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f94343d1740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 0x22a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f94343d1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x21dbcc0 con 0x206ec10 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f94343d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x21b4820 con 0x206e840 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f94343d1740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2219110 con 0x20b98c0 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f94343d1740 10 client.0 _ll_register_callbacks cb 0x21b8b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9422ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9422ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41234/0 (socket says 172.21.15.29:41234) 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9422ffd700 1 -- 172.21.15.29:0/1936595164 learned_addr learned my addr 172.21.15.29:0/1936595164 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f942b7fe700 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f942bfff700 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 0x22a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9422ffd700 1 -- 172.21.15.29:0/1936595164 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 msgr2=0x22a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9422ffd700 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 0x22a6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9422ffd700 1 -- 172.21.15.29:0/1936595164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 msgr2=0x22a8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9422ffd700 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22a8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9422ffd700 1 -- 172.21.15.29:0/1936595164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c0c99c0 con 0x206ec10 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f942b7fe700 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22a8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9422ffd700 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a6750 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f941400b3c0 tx=0x7f9414021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7094cc31af821688 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9409ffb700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.775+0000 7f9409ffb700 1 -- 172.21.15.29:0/1936595164 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941402d070 con 0x206ec10 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f9409ffb700 1 -- 172.21.15.29:0/1936595164 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9414011700 con 0x206ec10 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 -- 172.21.15.29:0/1936595164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21cea10 con 0x206ec10 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f9409ffb700 1 -- 172.21.15.29:0/1936595164 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9414021070 con 0x206ec10 2023-10-06T05:27:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 10 client.5706 fetch_fsmap learned FSMap version 21 2023-10-06T05:27:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 -- 172.21.15.29:0/1936595164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x21e4220 con 0x206ec10 2023-10-06T05:27:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f9409ffb700 1 -- 172.21.15.29:0/1936595164 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21cea10 con 0x206ec10 2023-10-06T05:27:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f9409ffb700 1 -- 172.21.15.29:0/1936595164 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 21) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9414011ad0 con 0x206ec10 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 10 client.5706 fetch_fsmap finished waiting for FSMap version 21 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 10 client.5706 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 20 client.5706 populate_metadata read hostname 'smithi029' 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x22cbe80 0x22cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 4 client.5706 mds_command: new command op to 5460 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 -- 172.21.15.29:0/1936595164 --> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x21b83f0 con 0x22cbe80 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f942b7fe700 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x22cbe80 0x22cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f942b7fe700 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x22cbe80 0x22cc280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e037b21fd04353bb server_cookie=c6713dde4f67d836 in_seq=0 out_seq=0 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f9409ffb700 10 client.5706 ms_handle_connect on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f9409ffb700 1 -- 172.21.15.29:0/1936595164 <== mds.0 v2:172.21.15.29:6834/2111647358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x21b83f0 con 0x22cbe80 2023-10-06T05:27:26.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f9409ffb700 10 client.5706 handle_command_reply: tid=0 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 client.5706 shutdown 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 -- 172.21.15.29:0/1936595164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 msgr2=0x22a6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a6750 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f941400b3c0 tx=0x7f9414021000 comp rx=0 tx=0).stop 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 -- 172.21.15.29:0/1936595164 shutdown_connections 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x22cbe80 0x22cc280 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x20b98c0 0x22a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206ec10 0x22a6750 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f9409ffb700 0 client.5706 ms_handle_reset on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 --2- 172.21.15.29:0/1936595164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22a8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 -- 172.21.15.29:0/1936595164 >> 172.21.15.29:0/1936595164 conn(0x206efe0 msgr2=0x22a1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 -- 172.21.15.29:0/1936595164 shutdown_connections 2023-10-06T05:27:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 1 -- 172.21.15.29:0/1936595164 wait complete. 2023-10-06T05:27:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.779+0000 7f94343d1740 20 client.5706 trim_cache size 0 max 16384 2023-10-06T05:27:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f94343d1740 1 Processor -- start 2023-10-06T05:27:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f94343d1740 1 -- start start 2023-10-06T05:27:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f94343d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f94343d1740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 0x22cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f94343d1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x20b98c0 0x22f9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f94343d1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x221a650 con 0x20b98c0 2023-10-06T05:27:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f94343d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x20e78f0 con 0x206e840 2023-10-06T05:27:26.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f94343d1740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x22185a0 con 0x206ec10 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x20b98c0 0x22f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x20b98c0 0x22f9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41250/0 (socket says 172.21.15.29:41250) 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942bfff700 1 -- 172.21.15.29:0/954582927 learned_addr learned my addr 172.21.15.29:0/954582927 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942b7fe700 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f9422ffd700 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 0x22cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942b7fe700 1 -- 172.21.15.29:0/954582927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 msgr2=0x22cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942b7fe700 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 0x22cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942b7fe700 1 -- 172.21.15.29:0/954582927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x20b98c0 msgr2=0x22f9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942b7fe700 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x20b98c0 0x22f9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942b7fe700 1 -- 172.21.15.29:0/954582927 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0cbbb0 con 0x206e840 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.799+0000 7f942bfff700 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x20b98c0 0x22f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942b7fe700 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22cebc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f941c04c310 tx=0x7f941c063040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=432cdfb7e174dd0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94217fa700 1 -- 172.21.15.29:0/954582927 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c050550 con 0x206e840 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94217fa700 1 -- 172.21.15.29:0/954582927 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c056df0 con 0x206e840 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94217fa700 1 -- 172.21.15.29:0/954582927 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c04fe10 con 0x206e840 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 -- 172.21.15.29:0/954582927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 msgr2=0x22cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22cebc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f941c04c310 tx=0x7f941c063040 comp rx=0 tx=0).stop 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 -- 172.21.15.29:0/954582927 shutdown_connections 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x20b98c0 0x22f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 0x22cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 --2- 172.21.15.29:0/954582927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x206e840 0x22cebc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 -- 172.21.15.29:0/954582927 >> 172.21.15.29:0/954582927 conn(0x206efe0 msgr2=0x22a1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 -- 172.21.15.29:0/954582927 shutdown_connections 2023-10-06T05:27:26.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 -- 172.21.15.29:0/954582927 wait complete. 2023-10-06T05:27:26.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 -- start start 2023-10-06T05:27:26.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 Processor -- start 2023-10-06T05:27:26.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206e840 0x234d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 0x234d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x20b98c0 0x22fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2284630 con 0x206e840 2023-10-06T05:27:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x21edaa0 con 0x20b98c0 2023-10-06T05:27:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x21e6930 con 0x206ec10 2023-10-06T05:27:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f94343d1740 10 client.0 _ll_register_callbacks cb 0x2192140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:27:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206e840 0x234d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206e840 0x234d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41252/0 (socket says 172.21.15.29:41252) 2023-10-06T05:27:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942b7fe700 1 -- 172.21.15.29:0/729470720 learned_addr learned my addr 172.21.15.29:0/729470720 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942bfff700 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x20b98c0 0x22fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f9422ffd700 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 0x234d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942b7fe700 1 -- 172.21.15.29:0/729470720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 msgr2=0x234d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942b7fe700 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 0x234d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942b7fe700 1 -- 172.21.15.29:0/729470720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x20b98c0 msgr2=0x22fb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942b7fe700 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x20b98c0 0x22fb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f942b7fe700 1 -- 172.21.15.29:0/729470720 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94240146a0 con 0x206e840 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.803+0000 7f9422ffd700 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 0x234d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f942b7fe700 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206e840 0x234d4a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f941c007fd0 tx=0x7f941c06b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a129c1f6f7b65d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 1 -- 172.21.15.29:0/729470720 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c04fee0 con 0x206e840 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 1 -- 172.21.15.29:0/729470720 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f941c04e1b0 con 0x206e840 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 -- 172.21.15.29:0/729470720 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f941c0530a0 con 0x206e840 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 1 -- 172.21.15.29:0/729470720 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f941c0500b0 con 0x206e840 2023-10-06T05:27:26.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 10 client.5712 fetch_fsmap learned FSMap version 21 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 -- 172.21.15.29:0/729470720 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x20bab10 con 0x206e840 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 1 -- 172.21.15.29:0/729470720 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c0530a0 con 0x206e840 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 1 -- 172.21.15.29:0/729470720 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 21) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f941c04f300 con 0x206e840 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 10 client.5712 fetch_fsmap finished waiting for FSMap version 21 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 10 client.5712 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 20 client.5712 populate_metadata read hostname 'smithi029' 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x22fbda0 0x22fc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 4 client.5712 mds_command: new command op to 5460 tid=0[{"prefix": "scrub status"}] 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 -- 172.21.15.29:0/729470720 --> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x21ea2c0 con 0x22fbda0 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9422ffd700 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x22fbda0 0x22fc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 10 client.5712 ms_handle_connect on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:26.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9422ffd700 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x22fbda0 0x22fc170 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dc1dbc9cd824691 server_cookie=c6eaeefa38365ecb in_seq=0 out_seq=0 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 1 -- 172.21.15.29:0/729470720 <== mds.0 v2:172.21.15.29:6834/2111647358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x21ea2c0 con 0x22fbda0 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 10 client.5712 handle_command_reply: tid=0 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 client.5712 shutdown 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 -- 172.21.15.29:0/729470720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206e840 msgr2=0x234d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206e840 0x234d4a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f941c007fd0 tx=0x7f941c06b000 comp rx=0 tx=0).stop 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 -- 172.21.15.29:0/729470720 shutdown_connections 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x22fbda0 0x22fc170 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x20b98c0 0x22fb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f9409ffb700 0 client.5712 ms_handle_reset on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x206ec10 0x234d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 --2- 172.21.15.29:0/729470720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x206e840 0x234d4a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 -- 172.21.15.29:0/729470720 >> 172.21.15.29:0/729470720 conn(0x206efe0 msgr2=0x22cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 -- 172.21.15.29:0/729470720 shutdown_connections 2023-10-06T05:27:26.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 1 -- 172.21.15.29:0/729470720 wait complete. 2023-10-06T05:27:26.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.807+0000 7f94343d1740 20 client.5712 trim_cache size 0 max 16384 2023-10-06T05:27:26.892 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:27:26.892 INFO:teuthology.orchestra.run.smithi029.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T05:27:26.892 INFO:teuthology.orchestra.run.smithi029.stdout: "scrubs": { 2023-10-06T05:27:26.892 INFO:teuthology.orchestra.run.smithi029.stdout: "e3a05b19-db09-4f4d-b497-05dc4dc6195c": { 2023-10-06T05:27:26.893 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2023-10-06T05:27:26.893 INFO:teuthology.orchestra.run.smithi029.stdout: "tag": "e3a05b19-db09-4f4d-b497-05dc4dc6195c", 2023-10-06T05:27:26.893 INFO:teuthology.orchestra.run.smithi029.stdout: "options": "recursive,repair" 2023-10-06T05:27:26.893 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:26.893 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:26.893 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:27:26.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 -- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f940c060550 msgr2=0x7f940c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f940c060550 0x7f940c062a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f942c0b6040 tx=0x7f9414017000 comp rx=0 tx=0).stop 2023-10-06T05:27:26.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 -- 172.21.15.29:0/2467188847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c06b810 msgr2=0x7f942c0c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:26.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c06b810 0x7f942c0c8f70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c790 tx=0x7f941c007f40 comp rx=0 tx=0).stop 2023-10-06T05:27:26.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 -- 172.21.15.29:0/2467188847 shutdown_connections 2023-10-06T05:27:26.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f940c060550 0x7f940c062a00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f942c15d890 0x7f942c0cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f942c158c30 0x7f942c0b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 --2- 172.21.15.29:0/2467188847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f942c06b810 0x7f942c0c8f70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:26.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 -- 172.21.15.29:0/2467188847 >> 172.21.15.29:0/2467188847 conn(0x7f942c0670a0 msgr2=0x7f942c0cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:26.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 -- 172.21.15.29:0/2467188847 shutdown_connections 2023-10-06T05:27:26.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:26.811+0000 7f9432128700 1 -- 172.21.15.29:0/2467188847 wait complete. 2023-10-06T05:27:26.896 INFO:tasks.cephfs.filesystem:scrub status for tag:e3a05b19-db09-4f4d-b497-05dc4dc6195c - {'path': '/', 'tag': 'e3a05b19-db09-4f4d-b497-05dc4dc6195c', 'options': 'recursive,repair'} 2023-10-06T05:27:27.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:27.419+0000 7fc928ff9700 1 -- 172.21.15.29:0/3520812056 <== mon.0 v2:172.21.15.29:3300/0 7 ==== log(6 entries from seq 1 at 2023-10-06T05:27:26.616087+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7fc920050500 con 0x7fc92c06af80 2023-10-06T05:27:27.425 INFO:teuthology.orchestra.run.smithi029.stdout: cluster: 2023-10-06T05:27:27.425 INFO:teuthology.orchestra.run.smithi029.stdout: id: bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:27:27.425 INFO:teuthology.orchestra.run.smithi029.stdout: health: HEALTH_OK 2023-10-06T05:27:27.425 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: services: 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: mgr: x(active, since 2m), standbys: y 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: mds: 1/1 daemons up, 3 standby 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: osd: 8 osds: 8 up (since 119s), 8 in (since 2m) 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: data: 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: volumes: 1/1 healthy 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: pools: 4 pools, 105 pgs 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: objects: 24 objects, 579 KiB 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: usage: 2.3 GiB used, 718 GiB / 720 GiB avail 2023-10-06T05:27:27.426 INFO:teuthology.orchestra.run.smithi029.stdout: pgs: 105 active+clean 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout: io: 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout: client: 127 B/s wr, 0 op/s rd, 0 op/s wr 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:27:26.616087+0000 mds.c [INF] scrub queued for path: / 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:27:26.616091+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:27:26.616097+0000 mds.c [INF] scrub summary: active paths [/] 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:27:26.617628+0000 mds.c [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:27:26.617651+0000 mds.c [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2023-10-06T05:27:27.427 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:27:26.618403+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T05:27:29.445 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:27:28.622897+0000 mds.c [INF] scrub summary: idle 2023-10-06T05:27:29.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:29.439+0000 7fc928ff9700 1 -- 172.21.15.29:0/3520812056 <== mon.0 v2:172.21.15.29:3300/0 8 ==== log(1 entries from seq 7 at 2023-10-06T05:27:28.622897+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fc920053050 con 0x7fc92c06af80 2023-10-06T05:27:40.097 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:27:40.100 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:27:56.896 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-10-06T05:27:57.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.007+0000 7f4466026700 1 Processor -- start 2023-10-06T05:27:57.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.007+0000 7f4466026700 1 -- start start 2023-10-06T05:27:57.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f4466026700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f446015d890 0x7f4460159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f4466026700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f446006b810 0x7f44600cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f4466026700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446006b380 con 0x7f4460158c30 2023-10-06T05:27:57.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f4466026700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446006bc70 con 0x7f446006b810 2023-10-06T05:27:57.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f4466026700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446006a770 con 0x7f446015d890 2023-10-06T05:27:57.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f446006b810 0x7f44600cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f446006b810 0x7f44600cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46584/0 (socket says 172.21.15.29:46584) 2023-10-06T05:27:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4460158c30 0x7f44600ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46088/0 (socket says 172.21.15.29:46088) 2023-10-06T05:27:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445ffff700 1 -- 172.21.15.29:0/660873327 learned_addr learned my addr 172.21.15.29:0/660873327 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f4456ffd700 1 --2- 172.21.15.29:0/660873327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f446015d890 0x7f4460159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445ffff700 1 -- 172.21.15.29:0/660873327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f446015d890 msgr2=0x7f4460159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445ffff700 1 --2- 172.21.15.29:0/660873327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f446015d890 0x7f4460159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445ffff700 1 -- 172.21.15.29:0/660873327 >> v1:172.21.15.29:6789/0 conn(0x7f4460158c30 legacy=0x7f44600ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445effd700 1 -- 172.21.15.29:0/660873327 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675713468 0 0) 0x7f446006b380 con 0x7f4460158c30 2023-10-06T05:27:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445ffff700 1 -- 172.21.15.29:0/660873327 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446006aa50 con 0x7f446006b810 2023-10-06T05:27:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445ffff700 1 --2- 172.21.15.29:0/660873327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 0x7f44600cfd60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4458009f20 tx=0x7f4458009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89907cbeb39be337 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445effd700 1 -- 172.21.15.29:0/660873327 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445800e070 con 0x7f446006b810 2023-10-06T05:27:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445effd700 1 -- 172.21.15.29:0/660873327 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445800b9d0 con 0x7f446006b810 2023-10-06T05:27:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f445effd700 1 -- 172.21.15.29:0/660873327 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44580092e0 con 0x7f446006b810 2023-10-06T05:27:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f4466026700 1 -- 172.21.15.29:0/660873327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 msgr2=0x7f44600cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.011+0000 7f4466026700 1 --2- 172.21.15.29:0/660873327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 0x7f44600cfd60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4458009f20 tx=0x7f4458009840 comp rx=0 tx=0).stop 2023-10-06T05:27:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.015+0000 7f4466026700 1 -- 172.21.15.29:0/660873327 shutdown_connections 2023-10-06T05:27:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.015+0000 7f4466026700 1 --2- 172.21.15.29:0/660873327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 0x7f44600cfd60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.015+0000 7f4466026700 1 --2- 172.21.15.29:0/660873327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f446015d890 0x7f4460159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.015+0000 7f4466026700 1 -- 172.21.15.29:0/660873327 >> 172.21.15.29:0/660873327 conn(0x7f44600670a0 msgr2=0x7f44600674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.015+0000 7f4466026700 1 -- 172.21.15.29:0/660873327 shutdown_connections 2023-10-06T05:27:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.015+0000 7f4466026700 1 -- 172.21.15.29:0/660873327 wait complete. 2023-10-06T05:27:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.015+0000 7f4466026700 1 Processor -- start 2023-10-06T05:27:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.015+0000 7f4466026700 1 -- start start 2023-10-06T05:27:57.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4466026700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 0x7f44600c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4466026700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4460158c30 0x7f44600b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4466026700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f446015d890 0x7f446014fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4466026700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4460155ad0 con 0x7f446006b810 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4466026700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44600b5410 con 0x7f446015d890 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4466026700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44600b4800 con 0x7f4460158c30 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 0x7f44600c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 0x7f44600c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46586/0 (socket says 172.21.15.29:46586) 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445f7fe700 1 -- 172.21.15.29:0/2958138660 learned_addr learned my addr 172.21.15.29:0/2958138660 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4456ffd700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4460158c30 0x7f44600b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445ffff700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f446015d890 0x7f446014fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445f7fe700 1 -- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4460158c30 msgr2=0x7f44600b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445f7fe700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4460158c30 0x7f44600b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445f7fe700 1 -- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f446015d890 msgr2=0x7f446014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445f7fe700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f446015d890 0x7f446014fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445f7fe700 1 -- 172.21.15.29:0/2958138660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458009ae0 con 0x7f446006b810 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f445f7fe700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 0x7f44600c7ee0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f44500011e0 tx=0x7f4450007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4457fff700 1 -- 172.21.15.29:0/2958138660 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450005a70 con 0x7f446006b810 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4457fff700 1 -- 172.21.15.29:0/2958138660 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4450005bd0 con 0x7f446006b810 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4466026700 1 -- 172.21.15.29:0/2958138660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44600b4ae0 con 0x7f446006b810 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4457fff700 1 -- 172.21.15.29:0/2958138660 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500070d0 con 0x7f446006b810 2023-10-06T05:27:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.019+0000 7f4466026700 1 -- 172.21.15.29:0/2958138660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44600b50a0 con 0x7f446006b810 2023-10-06T05:27:57.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.023+0000 7f4457fff700 1 -- 172.21.15.29:0/2958138660 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4450007440 con 0x7f446006b810 2023-10-06T05:27:57.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.023+0000 7f4457fff700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4440060580 0x7f4440062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.023+0000 7f4457fff700 1 -- 172.21.15.29:0/2958138660 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f445007beb0 con 0x7f446006b810 2023-10-06T05:27:57.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.023+0000 7f4456ffd700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4440060580 0x7f4440062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.023+0000 7f4456ffd700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4440060580 0x7f4440062a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f446016c9e0 tx=0x7f44480091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f44682cf740 1 Processor -- start 2023-10-06T05:27:57.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f44682cf740 1 -- start start 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f44682cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5c10 0x1a19730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f44682cf740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5840 0x1a19c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f44682cf740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a1a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f44682cf740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x19910f0 con 0x18308c0 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f44682cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x198cee0 con 0x17e5c10 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f44682cf740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1953020 con 0x17e5840 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a1a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a1a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46598/0 (socket says 172.21.15.29:46598) 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f4456ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5840 0x1a19c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445ffff700 1 -- 172.21.15.29:0/906383289 learned_addr learned my addr 172.21.15.29:0/906383289 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:57.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445f7fe700 1 --2- 172.21.15.29:0/906383289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5c10 0x1a19730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445ffff700 1 -- 172.21.15.29:0/906383289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5840 msgr2=0x1a19c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445ffff700 1 --2- 172.21.15.29:0/906383289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5840 0x1a19c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445ffff700 1 -- 172.21.15.29:0/906383289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5c10 msgr2=0x1a19730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445ffff700 1 --2- 172.21.15.29:0/906383289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5c10 0x1a19730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445ffff700 1 -- 172.21.15.29:0/906383289 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1831b10 con 0x18308c0 2023-10-06T05:27:57.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f445ffff700 1 --2- 172.21.15.29:0/906383289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a1a900 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f446006e090 tx=0x7f4458018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde5ed7dcd019486 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f4454ff9700 1 -- 172.21.15.29:0/906383289 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445800bb40 con 0x18308c0 2023-10-06T05:27:57.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f4454ff9700 1 -- 172.21.15.29:0/906383289 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445801d420 con 0x18308c0 2023-10-06T05:27:57.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.027+0000 7f4454ff9700 1 -- 172.21.15.29:0/906383289 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445801d7a0 con 0x18308c0 2023-10-06T05:27:57.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 -- 172.21.15.29:0/906383289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 msgr2=0x1a1a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 --2- 172.21.15.29:0/906383289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a1a900 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f446006e090 tx=0x7f4458018000 comp rx=0 tx=0).stop 2023-10-06T05:27:57.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 -- 172.21.15.29:0/906383289 shutdown_connections 2023-10-06T05:27:57.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 --2- 172.21.15.29:0/906383289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a1a900 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 --2- 172.21.15.29:0/906383289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5840 0x1a19c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 --2- 172.21.15.29:0/906383289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5c10 0x1a19730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 -- 172.21.15.29:0/906383289 >> 172.21.15.29:0/906383289 conn(0x17e5fe0 msgr2=0x1a45fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 -- 172.21.15.29:0/906383289 shutdown_connections 2023-10-06T05:27:57.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 -- 172.21.15.29:0/906383289 wait complete. 2023-10-06T05:27:57.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 -- start start 2023-10-06T05:27:57.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.031+0000 7f44682cf740 1 Processor -- start 2023-10-06T05:27:57.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a1f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1a1d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a1dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1952cc0 con 0x17e5840 2023-10-06T05:27:57.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x192b820 con 0x18308c0 2023-10-06T05:27:57.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1990110 con 0x17e5c10 2023-10-06T05:27:57.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a1f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 10 client.0 _ll_register_callbacks cb 0x192fb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:27:57.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a1f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46600/0 (socket says 172.21.15.29:46600) 2023-10-06T05:27:57.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445f7fe700 1 -- 172.21.15.29:0/679874036 learned_addr learned my addr 172.21.15.29:0/679874036 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:57.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f4456ffd700 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1a1d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445ffff700 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a1dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445f7fe700 1 -- 172.21.15.29:0/679874036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 msgr2=0x1a1d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445f7fe700 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1a1d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445f7fe700 1 -- 172.21.15.29:0/679874036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 msgr2=0x1a1dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445f7fe700 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a1dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445f7fe700 1 -- 172.21.15.29:0/679874036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446006aa50 con 0x17e5840 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445ffff700 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a1dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f445f7fe700 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a1f870 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f445004ff50 tx=0x7f4450053f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1632ef787f0f1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f443dffb700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f443dffb700 1 -- 172.21.15.29:0/679874036 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450053250 con 0x17e5840 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f443dffb700 1 -- 172.21.15.29:0/679874036 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f4450056fa0 con 0x17e5840 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 -- 172.21.15.29:0/679874036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1945a10 con 0x17e5840 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f443dffb700 1 -- 172.21.15.29:0/679874036 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f445006a200 con 0x17e5840 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 10 client.5727 fetch_fsmap learned FSMap version 21 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 -- 172.21.15.29:0/679874036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x195b220 con 0x17e5840 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f443dffb700 1 -- 172.21.15.29:0/679874036 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4450078070 con 0x17e5840 2023-10-06T05:27:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f443dffb700 1 -- 172.21.15.29:0/679874036 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 21) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f44500550f0 con 0x17e5840 2023-10-06T05:27:57.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 10 client.5727 fetch_fsmap finished waiting for FSMap version 21 2023-10-06T05:27:57.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 10 client.5727 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T05:27:57.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 20 client.5727 populate_metadata read hostname 'smithi029' 2023-10-06T05:27:57.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x1a42e80 0x1a43280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 4 client.5727 mds_command: new command op to 5460 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:27:57.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f44682cf740 1 -- 172.21.15.29:0/679874036 --> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x192f3f0 con 0x1a42e80 2023-10-06T05:27:57.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f4456ffd700 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x1a42e80 0x1a43280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f443dffb700 10 client.5727 ms_handle_connect on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:57.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.035+0000 7f4456ffd700 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x1a42e80 0x1a43280 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcad969f5e44fded server_cookie=444e8de37151baed in_seq=0 out_seq=0 2023-10-06T05:27:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f443dffb700 1 -- 172.21.15.29:0/679874036 <== mds.0 v2:172.21.15.29:6834/2111647358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x192f3f0 con 0x1a42e80 2023-10-06T05:27:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f443dffb700 10 client.5727 handle_command_reply: tid=0 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 client.5727 shutdown 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 -- 172.21.15.29:0/679874036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 msgr2=0x1a1f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a1f870 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f445004ff50 tx=0x7f4450053f90 comp rx=0 tx=0).stop 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 -- 172.21.15.29:0/679874036 shutdown_connections 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x1a42e80 0x1a43280 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a1dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1a1d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f443dffb700 0 client.5727 ms_handle_reset on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 --2- 172.21.15.29:0/679874036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a1f870 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 -- 172.21.15.29:0/679874036 >> 172.21.15.29:0/679874036 conn(0x17e5fe0 msgr2=0x1a18720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 -- 172.21.15.29:0/679874036 shutdown_connections 2023-10-06T05:27:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 1 -- 172.21.15.29:0/679874036 wait complete. 2023-10-06T05:27:57.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.039+0000 7f44682cf740 20 client.5727 trim_cache size 0 max 16384 2023-10-06T05:27:57.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f44682cf740 1 Processor -- start 2023-10-06T05:27:57.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f44682cf740 1 -- start start 2023-10-06T05:27:57.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f44682cf740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a45bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f44682cf740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1a46100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f44682cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a70190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f44682cf740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x19932f0 con 0x17e5840 2023-10-06T05:27:57.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f44682cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x198bd70 con 0x18308c0 2023-10-06T05:27:57.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f44682cf740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1943e50 con 0x17e5c10 2023-10-06T05:27:57.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a45bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a45bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46606/0 (socket says 172.21.15.29:46606) 2023-10-06T05:27:57.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445f7fe700 1 -- 172.21.15.29:0/1751371771 learned_addr learned my addr 172.21.15.29:0/1751371771 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:57.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f4456ffd700 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1a46100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445ffff700 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a70190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445f7fe700 1 -- 172.21.15.29:0/1751371771 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 msgr2=0x1a46100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445f7fe700 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1a46100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445f7fe700 1 -- 172.21.15.29:0/1751371771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 msgr2=0x1a70190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445f7fe700 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a70190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445f7fe700 1 -- 172.21.15.29:0/1751371771 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44600b17a0 con 0x17e5840 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445ffff700 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a70190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.059+0000 7f445f7fe700 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a45bc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f445004fcc0 tx=0x7f445001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d41a3a9abe389f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44557fa700 1 -- 172.21.15.29:0/1751371771 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445000e040 con 0x17e5840 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44557fa700 1 -- 172.21.15.29:0/1751371771 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4450078040 con 0x17e5840 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44557fa700 1 -- 172.21.15.29:0/1751371771 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445006a200 con 0x17e5840 2023-10-06T05:27:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 -- 172.21.15.29:0/1751371771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 msgr2=0x1a45bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a45bc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f445004fcc0 tx=0x7f445001e000 comp rx=0 tx=0).stop 2023-10-06T05:27:57.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 -- 172.21.15.29:0/1751371771 shutdown_connections 2023-10-06T05:27:57.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18308c0 0x1a70190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1a46100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 --2- 172.21.15.29:0/1751371771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x17e5840 0x1a45bc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 -- 172.21.15.29:0/1751371771 >> 172.21.15.29:0/1751371771 conn(0x17e5fe0 msgr2=0x1a18720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 -- 172.21.15.29:0/1751371771 shutdown_connections 2023-10-06T05:27:57.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 -- 172.21.15.29:0/1751371771 wait complete. 2023-10-06T05:27:57.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 -- start start 2023-10-06T05:27:57.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 Processor -- start 2023-10-06T05:27:57.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5840 0x1abc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1abc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a728f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1952340 con 0x18308c0 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1964aa0 con 0x17e5840 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x19920b0 con 0x17e5c10 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f44682cf740 10 client.0 _ll_register_callbacks cb 0x1909140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a728f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46620/0 (socket says 172.21.15.29:46620) 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445ffff700 1 -- 172.21.15.29:0/4242699945 learned_addr learned my addr 172.21.15.29:0/4242699945 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445f7fe700 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5840 0x1abc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f4456ffd700 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1abc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445ffff700 1 -- 172.21.15.29:0/4242699945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 msgr2=0x1abc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445ffff700 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1abc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445ffff700 1 -- 172.21.15.29:0/4242699945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5840 msgr2=0x1abc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445ffff700 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5840 0x1abc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445ffff700 1 -- 172.21.15.29:0/4242699945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x195b220 con 0x18308c0 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f4456ffd700 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1abc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f443dffb700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.063+0000 7f445ffff700 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a728f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4458000f80 tx=0x7f4458020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8b4a58914fcb28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f443dffb700 1 -- 172.21.15.29:0/4242699945 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445802e070 con 0x18308c0 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 -- 172.21.15.29:0/4242699945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f445801d420 con 0x18308c0 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f443dffb700 1 -- 172.21.15.29:0/4242699945 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f445800bd50 con 0x18308c0 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f443dffb700 1 -- 172.21.15.29:0/4242699945 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4458007000 con 0x18308c0 2023-10-06T05:27:57.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 10 client.5733 fetch_fsmap learned FSMap version 21 2023-10-06T05:27:57.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 -- 172.21.15.29:0/4242699945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x1941c30 con 0x18308c0 2023-10-06T05:27:57.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f443dffb700 1 -- 172.21.15.29:0/4242699945 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445801d420 con 0x18308c0 2023-10-06T05:27:57.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f443dffb700 1 -- 172.21.15.29:0/4242699945 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 21) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4458019070 con 0x18308c0 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 10 client.5733 fetch_fsmap finished waiting for FSMap version 21 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 10 client.5733 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 20 client.5733 populate_metadata read hostname 'smithi029' 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x1a732e0 0x1a736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 4 client.5733 mds_command: new command op to 5460 tid=0[{"prefix": "scrub status"}] 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 -- 172.21.15.29:0/4242699945 --> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x19612c0 con 0x1a732e0 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f445f7fe700 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x1a732e0 0x1a736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f443dffb700 10 client.5733 ms_handle_connect on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f445f7fe700 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x1a732e0 0x1a736e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b2bd7d16a1d46a4 server_cookie=6097e87f27e3dd09 in_seq=0 out_seq=0 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f443dffb700 1 -- 172.21.15.29:0/4242699945 <== mds.0 v2:172.21.15.29:6834/2111647358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x19612c0 con 0x1a732e0 2023-10-06T05:27:57.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f443dffb700 10 client.5733 handle_command_reply: tid=0 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 client.5733 shutdown 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 -- 172.21.15.29:0/4242699945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 msgr2=0x1a728f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a728f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4458000f80 tx=0x7f4458020040 comp rx=0 tx=0).stop 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 -- 172.21.15.29:0/4242699945 shutdown_connections 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.29:6834/2111647358,v1:172.21.15.29:6835/2111647358] conn(0x1a732e0 0x1a736e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18308c0 0x1a728f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x17e5c10 0x1abc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 --2- 172.21.15.29:0/4242699945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x17e5840 0x1abc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 -- 172.21.15.29:0/4242699945 >> 172.21.15.29:0/4242699945 conn(0x17e5fe0 msgr2=0x1a45dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f443dffb700 0 client.5733 ms_handle_reset on v2:172.21.15.29:6834/2111647358 2023-10-06T05:27:57.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 -- 172.21.15.29:0/4242699945 shutdown_connections 2023-10-06T05:27:57.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 1 -- 172.21.15.29:0/4242699945 wait complete. 2023-10-06T05:27:57.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f44682cf740 20 client.5733 trim_cache size 0 max 16384 2023-10-06T05:27:57.079 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:27:57.079 INFO:teuthology.orchestra.run.smithi029.stdout: "status": "no active scrubs running", 2023-10-06T05:27:57.079 INFO:teuthology.orchestra.run.smithi029.stdout: "scrubs": {} 2023-10-06T05:27:57.079 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:27:57.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f4466026700 1 -- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4440060580 msgr2=0x7f4440062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f4466026700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4440060580 0x7f4440062a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f446016c9e0 tx=0x7f44480091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f4466026700 1 -- 172.21.15.29:0/2958138660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 msgr2=0x7f44600c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.067+0000 7f4466026700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 0x7f44600c7ee0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f44500011e0 tx=0x7f4450007e10 comp rx=0 tx=0).stop 2023-10-06T05:27:57.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.071+0000 7f4466026700 1 -- 172.21.15.29:0/2958138660 shutdown_connections 2023-10-06T05:27:57.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.071+0000 7f4466026700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4440060580 0x7f4440062a30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.071+0000 7f4466026700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f446015d890 0x7f446014fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.071+0000 7f4466026700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4460158c30 0x7f44600b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.071+0000 7f4466026700 1 --2- 172.21.15.29:0/2958138660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f446006b810 0x7f44600c7ee0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.071+0000 7f4466026700 1 -- 172.21.15.29:0/2958138660 >> 172.21.15.29:0/2958138660 conn(0x7f44600670a0 msgr2=0x7f44600cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.071+0000 7f4466026700 1 -- 172.21.15.29:0/2958138660 shutdown_connections 2023-10-06T05:27:57.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.071+0000 7f4466026700 1 -- 172.21.15.29:0/2958138660 wait complete. 2023-10-06T05:27:57.090 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T05:27:57.191 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:27:57.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.295+0000 7fa3c6054700 1 Processor -- start 2023-10-06T05:27:57.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.295+0000 7fa3c6054700 1 -- start start 2023-10-06T05:27:57.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3c6054700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3c00af990 0x7fa3c006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3c6054700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c01614c0 con 0x7fa3c006a9a0 2023-10-06T05:27:57.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3c6054700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c006d420 con 0x7fa3c00af5c0 2023-10-06T05:27:57.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3c6054700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0160f40 con 0x7fa3c00af990 2023-10-06T05:27:57.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3bffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa3c006a9a0 0x7fa3c015cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46102/0 (socket says 172.21.15.29:46102) 2023-10-06T05:27:57.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3bffff700 1 -- 172.21.15.29:0/3904894746 learned_addr learned my addr 172.21.15.29:0/3904894746 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:57.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3beffd700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3c00af990 0x7fa3c006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628417214 0 0) 0x7fa3c01614c0 con 0x7fa3c006a9a0 2023-10-06T05:27:57.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a8003570 con 0x7fa3c006a9a0 2023-10-06T05:27:57.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690249111 0 0) 0x7fa3c006d420 con 0x7fa3c00af5c0 2023-10-06T05:27:57.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c01614c0 con 0x7fa3c00af5c0 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3193526070 0 0) 0x7fa3a8003570 con 0x7fa3c006a9a0 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3c00af990 msgr2=0x7fa3c006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3c00af990 0x7fa3c006a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 >> v1:172.21.15.173:6789/0 conn(0x7fa3c00af5c0 legacy=0x7fa3c0161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c006af20 con 0x7fa3c006a9a0 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fa3b80017f0 con 0x7fa3c006a9a0 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 >> v1:172.21.15.29:6789/0 conn(0x7fa3c006a9a0 legacy=0x7fa3c015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3a8003c20 0x7fa3a8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8004810 0x7fa3a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3c00af990 0x7fa3a8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0160f40 con 0x7fa3a8004810 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a800bc20 con 0x7fa3a8003c20 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a800bde0 con 0x7fa3c00af990 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3beffd700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8004810 0x7fa3a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3bf7fe700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3a8003c20 0x7fa3a8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3bffff700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3c00af990 0x7fa3a8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3beffd700 1 -- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3c00af990 msgr2=0x7fa3a8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3beffd700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3c00af990 0x7fa3a8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3beffd700 1 -- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3a8003c20 msgr2=0x7fa3a8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3beffd700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3a8003c20 0x7fa3a8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3beffd700 1 -- 172.21.15.29:0/3904894746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8003570 con 0x7fa3a8004810 2023-10-06T05:27:57.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3bffff700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3c00af990 0x7fa3a8005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3beffd700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8004810 0x7fa3a8004c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009c00 tx=0x7fa3b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881246882f62526e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000e710 con 0x7fa3a8004810 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b000e870 con 0x7fa3a8004810 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.299+0000 7fa3be7fc700 1 -- 172.21.15.29:0/3904894746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000ec30 con 0x7fa3a8004810 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.303+0000 7fa3c6054700 1 -- 172.21.15.29:0/3904894746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8004810 msgr2=0x7fa3a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.303+0000 7fa3c6054700 1 --2- 172.21.15.29:0/3904894746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8004810 0x7fa3a8004c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009c00 tx=0x7fa3b00091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.303+0000 7fa3bffff700 1 -- 172.21.15.29:0/3904894746 reap_dead start 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.303+0000 7fa3c6054700 1 -- 172.21.15.29:0/3904894746 shutdown_connections 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.303+0000 7fa3c6054700 1 -- 172.21.15.29:0/3904894746 >> 172.21.15.29:0/3904894746 conn(0x7fa3c0067b70 msgr2=0x7fa3c006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.303+0000 7fa3c6054700 1 -- 172.21.15.29:0/3904894746 shutdown_connections 2023-10-06T05:27:57.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.303+0000 7fa3c6054700 1 -- 172.21.15.29:0/3904894746 wait complete. 2023-10-06T05:27:57.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.303+0000 7fa3c6054700 1 Processor -- start 2023-10-06T05:27:57.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.303+0000 7fa3c6054700 1 -- start start 2023-10-06T05:27:57.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3c6054700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3a8004810 0x7fa3c0157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3c6054700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3c016e560 0x7fa3c015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3c6054700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3c015b270 0x7fa3c01617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3c6054700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c015b710 con 0x7fa3c015b270 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3c6054700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0163c10 con 0x7fa3c016e560 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3c6054700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c016f360 con 0x7fa3a8004810 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3c015b270 0x7fa3c01617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3c015b270 0x7fa3c01617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46638/0 (socket says 172.21.15.29:46638) 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bffff700 1 -- 172.21.15.29:0/1335216370 learned_addr learned my addr 172.21.15.29:0/1335216370 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bf7fe700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3a8004810 0x7fa3c0157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3beffd700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3c016e560 0x7fa3c015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bffff700 1 -- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3a8004810 msgr2=0x7fa3c0157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bffff700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3a8004810 0x7fa3c0157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bffff700 1 -- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3c016e560 msgr2=0x7fa3c015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bffff700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3c016e560 0x7fa3c015ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bffff700 1 -- 172.21.15.29:0/1335216370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c016e9d0 con 0x7fa3c015b270 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3bffff700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3c015b270 0x7fa3c01617a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00b1b00 tx=0x7fa3b8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1335216370 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8004e90 con 0x7fa3c015b270 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1335216370 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8007190 con 0x7fa3c015b270 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c0163930 con 0x7fa3c015b270 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1335216370 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8007530 con 0x7fa3c015b270 2023-10-06T05:27:57.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.307+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c016eff0 con 0x7fa3c015b270 2023-10-06T05:27:57.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.311+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1335216370 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa3b8007920 con 0x7fa3c015b270 2023-10-06T05:27:57.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.311+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c0163d80 con 0x7fa3c015b270 2023-10-06T05:27:57.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.311+0000 7fa3a77fe700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa3ac060580 0x7fa3ac062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.311+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1335216370 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa3b807c550 con 0x7fa3c015b270 2023-10-06T05:27:57.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.311+0000 7fa3bf7fe700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa3ac060580 0x7fa3ac062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.311+0000 7fa3bf7fe700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa3ac060580 0x7fa3ac062a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa3c015b930 tx=0x7fa3b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.319+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1335216370 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa3b804abe0 con 0x7fa3c015b270 2023-10-06T05:27:57.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.523+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3c004be00 con 0x7fa3c015b270 2023-10-06T05:27:57.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.523+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1335216370 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fa3b804ca20 con 0x7fa3c015b270 2023-10-06T05:27:57.530 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:57.531 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3538089078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3538089078},{"type":"v1","addr":"172.21.15.173:6835","nonce":3538089078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3499370562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3499370562},{"type":"v1","addr":"172.21.15.173:6837","nonce":3499370562}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3369448997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3369448997},{"type":"v1","addr":"172.21.15.29:6833","nonce":3369448997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:27:08.808178+0000","modified":"2023-10-06T05:27:12.494062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5460":{"gid":5460,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2111647358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2111647358},{"type":"v1","addr":"172.21.15.29:6835","nonce":2111647358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T05:27:57.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa3ac060580 msgr2=0x7fa3ac062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa3ac060580 0x7fa3ac062a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa3c015b930 tx=0x7fa3b4009040 comp rx=0 tx=0).stop 2023-10-06T05:27:57.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3c015b270 msgr2=0x7fa3c01617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3c015b270 0x7fa3c01617a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00b1b00 tx=0x7fa3b8009040 comp rx=0 tx=0).stop 2023-10-06T05:27:57.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 shutdown_connections 2023-10-06T05:27:57.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3c015b270 0x7fa3c01617a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa3ac060580 0x7fa3ac062a30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3c016e560 0x7fa3c015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 --2- 172.21.15.29:0/1335216370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3a8004810 0x7fa3c0157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 >> 172.21.15.29:0/1335216370 conn(0x7fa3c0067b70 msgr2=0x7fa3c006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 shutdown_connections 2023-10-06T05:27:57.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.527+0000 7fa3c6054700 1 -- 172.21.15.29:0/1335216370 wait complete. 2023-10-06T05:27:57.534 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 21 2023-10-06T05:27:57.552 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T05:27:57.675 INFO:teuthology.orchestra.run.smithi029.stdout:{"message":"","return_code":0} 2023-10-06T05:27:57.676 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T05:27:57.676 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-10-06T05:27:57.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c5804e80 1 Processor -- start 2023-10-06T05:27:57.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c5804e80 1 -- start start 2023-10-06T05:27:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c5804e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79b00030b0 0x55d9b63692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c5804e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d9b640e220 0x55d9b63697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c5804e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b641bd20 0x55d9b641c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c5804e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9b62e0220 con 0x55d9b641bd20 2023-10-06T05:27:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c5804e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9b6284840 con 0x7f79b00030b0 2023-10-06T05:27:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c5804e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9b62844e0 con 0x55d9b640e220 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c3b3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b641bd20 0x55d9b641c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c3b3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b641bd20 0x55d9b641c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46664/0 (socket says 172.21.15.29:46664) 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c3b3c700 1 -- 172.21.15.29:0/2111315718 learned_addr learned my addr 172.21.15.29:0/2111315718 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c333b700 1 --2- 172.21.15.29:0/2111315718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79b00030b0 0x55d9b63692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c2b3a700 1 --2- 172.21.15.29:0/2111315718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d9b640e220 0x55d9b63697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c3b3c700 1 -- 172.21.15.29:0/2111315718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d9b640e220 msgr2=0x55d9b63697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c3b3c700 1 --2- 172.21.15.29:0/2111315718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d9b640e220 0x55d9b63697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c3b3c700 1 -- 172.21.15.29:0/2111315718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79b00030b0 msgr2=0x55d9b63692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c3b3c700 1 --2- 172.21.15.29:0/2111315718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79b00030b0 0x55d9b63692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c3b3c700 1 -- 172.21.15.29:0/2111315718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9b6286770 con 0x55d9b641bd20 2023-10-06T05:27:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c3b3c700 1 --2- 172.21.15.29:0/2111315718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b641bd20 0x55d9b641c0f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55d9b6367e40 tx=0x7f79bc001780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd9a3bd2bb51490 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.707+0000 7f79c1b38700 1 -- 172.21.15.29:0/2111315718 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc016030 con 0x55d9b641bd20 2023-10-06T05:27:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c1b38700 1 -- 172.21.15.29:0/2111315718 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc008040 con 0x55d9b641bd20 2023-10-06T05:27:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c1b38700 1 -- 172.21.15.29:0/2111315718 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00ee50 con 0x55d9b641bd20 2023-10-06T05:27:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 -- 172.21.15.29:0/2111315718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b641bd20 msgr2=0x55d9b641c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 --2- 172.21.15.29:0/2111315718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b641bd20 0x55d9b641c0f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55d9b6367e40 tx=0x7f79bc001780 comp rx=0 tx=0).stop 2023-10-06T05:27:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 -- 172.21.15.29:0/2111315718 shutdown_connections 2023-10-06T05:27:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 --2- 172.21.15.29:0/2111315718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b641bd20 0x55d9b641c0f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 --2- 172.21.15.29:0/2111315718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d9b640e220 0x55d9b63697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 --2- 172.21.15.29:0/2111315718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79b00030b0 0x55d9b63692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 -- 172.21.15.29:0/2111315718 >> 172.21.15.29:0/2111315718 conn(0x55d9b6381970 msgr2=0x55d9b6336980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 -- 172.21.15.29:0/2111315718 shutdown_connections 2023-10-06T05:27:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 -- 172.21.15.29:0/2111315718 wait complete. 2023-10-06T05:27:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 Processor -- start 2023-10-06T05:27:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.711+0000 7f79c5804e80 1 -- start start 2023-10-06T05:27:57.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c5804e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b640e220 0x55d9b640b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c5804e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d9b641bd20 0x55d9b64233e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c5804e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79b00030b0 0x55d9b6423920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c5804e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9b627b270 con 0x55d9b640e220 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c5804e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9b640c1a0 con 0x7f79b00030b0 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c5804e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9b6423e60 con 0x55d9b641bd20 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c333b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b640e220 0x55d9b640b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c333b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b640e220 0x55d9b640b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46678/0 (socket says 172.21.15.29:46678) 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c333b700 1 -- 172.21.15.29:0/712126851 learned_addr learned my addr 172.21.15.29:0/712126851 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c3b3c700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79b00030b0 0x55d9b6423920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c2b3a700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d9b641bd20 0x55d9b64233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c333b700 1 -- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d9b641bd20 msgr2=0x55d9b64233e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c333b700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55d9b641bd20 0x55d9b64233e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c333b700 1 -- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79b00030b0 msgr2=0x55d9b6423920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c333b700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79b00030b0 0x55d9b6423920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c333b700 1 -- 172.21.15.29:0/712126851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc00a040 con 0x55d9b640e220 2023-10-06T05:27:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c333b700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b640e220 0x55d9b640b130 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f79b4013b40 tx=0x7f79b4007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79bbfff700 1 -- 172.21.15.29:0/712126851 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4014550 con 0x55d9b640e220 2023-10-06T05:27:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79bbfff700 1 -- 172.21.15.29:0/712126851 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b4018070 con 0x55d9b640e220 2023-10-06T05:27:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d9b62861d0 con 0x55d9b640e220 2023-10-06T05:27:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79bbfff700 1 -- 172.21.15.29:0/712126851 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40148c0 con 0x55d9b640e220 2023-10-06T05:27:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.715+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9b6424050 con 0x55d9b640e220 2023-10-06T05:27:57.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79bbfff700 1 -- 172.21.15.29:0/712126851 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f79b401a030 con 0x55d9b640e220 2023-10-06T05:27:57.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79bbfff700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f79a405eeb0 0x7f79a4061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79bbfff700 1 -- 172.21.15.29:0/712126851 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f79b407c0a0 con 0x55d9b640e220 2023-10-06T05:27:57.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55d9b637b690 0x55d9b640fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:57.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c2b3a700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f79a405eeb0 0x7f79a4061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) v8 -- 0x55d9b63782d0 con 0x55d9b637b690 2023-10-06T05:27:57.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c3b3c700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55d9b637b690 0x55d9b640fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:57.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c3b3c700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55d9b637b690 0x55d9b640fff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c2b3a700 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f79a405eeb0 0x7f79a4061360 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009690 tx=0x7f79ac017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:57.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c3b3c700 1 -- 172.21.15.29:0/712126851 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f79bc00ece0 con 0x55d9b637b690 2023-10-06T05:27:57.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55d9b637b690 msgr2=0x55d9b640fff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55d9b637b690 0x55d9b640fff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f79a405eeb0 msgr2=0x7f79a4061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f79a405eeb0 0x7f79a4061360 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009690 tx=0x7f79ac017000 comp rx=0 tx=0).stop 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b640e220 msgr2=0x55d9b640b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 --2- 172.21.15.29:0/712126851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d9b640e220 0x55d9b640b130 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f79b4013b40 tx=0x7f79b4007040 comp rx=0 tx=0).stop 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c3b3c700 1 -- 172.21.15.29:0/712126851 reap_dead start 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 shutdown_connections 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 >> 172.21.15.29:0/712126851 conn(0x55d9b6381970 msgr2=0x55d9b6337a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 shutdown_connections 2023-10-06T05:27:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:57.719+0000 7f79c5804e80 1 -- 172.21.15.29:0/712126851 wait complete. 2023-10-06T05:27:57.729 INFO:teuthology.orchestra.run.smithi029.stdout:Yalphaparent_a 2023-10-06T05:27:57.730 DEBUG:teuthology.orchestra.run.smithi029:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T05:27:57.809 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:27:57.809 INFO:teuthology.orchestra.run.smithi029.stdout: "ino": 1099511627777, 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: "ancestors": [ 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: "dirino": 1099511627776, 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: "dname": "alpha", 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 4 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: "dirino": 1, 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: "dname": "parent_a", 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 7 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:27:57.810 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-06T05:27:57.811 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 8, 2023-10-06T05:27:57.811 INFO:teuthology.orchestra.run.smithi029.stdout: "old_pools": [] 2023-10-06T05:27:57.811 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:27:57.811 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:57.813 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T05:27:57.813 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:27:57.833 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:27:57.855 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T05:27:57.855 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:27:57.855 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:27:57.855 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T05:27:57.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[44138]: fuse finished with error 0 and tester_r 0 2023-10-06T05:27:57.870 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:27:57.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:57.871 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:27:58.040 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:27:58.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:58.040 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T05:27:58.047 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T05:27:58.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:27:58.048 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:27:58.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:58.049 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T05:27:58.055 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T05:27:58.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:27:58.056 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:27:58.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:27:58.056 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T05:27:58.095 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T05:27:58.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:27:58.096 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:27:58.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.207+0000 7efd1bfff700 1 Processor -- start 2023-10-06T05:27:58.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 -- start start 2023-10-06T05:27:58.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efd1c06c8f0 0x7efd1c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efd1c06ccc0 0x7efd1c0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1c06aef0 con 0x7efd1c0c94a0 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1c06a2e0 con 0x7efd1c06ccc0 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1c06a5c0 con 0x7efd1c06c8f0 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd13fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efd1c06ccc0 0x7efd1c0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd13fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efd1c06ccc0 0x7efd1c0c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46694/0 (socket says 172.21.15.29:46694) 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efd1c0c94a0 0x7efd1c0c9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46124/0 (socket says 172.21.15.29:46124) 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd13fff700 1 -- 172.21.15.29:0/1261740913 learned_addr learned my addr 172.21.15.29:0/1261740913 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1affd700 1 --2- 172.21.15.29:0/1261740913 >> v2:172.21.15.173:3300/0 conn(0x7efd1c06c8f0 0x7efd1c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd13fff700 1 -- 172.21.15.29:0/1261740913 >> v2:172.21.15.173:3300/0 conn(0x7efd1c06c8f0 msgr2=0x7efd1c06b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd13fff700 1 --2- 172.21.15.29:0/1261740913 >> v2:172.21.15.173:3300/0 conn(0x7efd1c06c8f0 0x7efd1c06b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd13fff700 1 -- 172.21.15.29:0/1261740913 >> v1:172.21.15.29:6789/0 conn(0x7efd1c0c94a0 legacy=0x7efd1c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd13fff700 1 -- 172.21.15.29:0/1261740913 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c06a8a0 con 0x7efd1c06ccc0 2023-10-06T05:27:58.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1affd700 1 --2- 172.21.15.29:0/1261740913 >> v2:172.21.15.173:3300/0 conn(0x7efd1c06c8f0 0x7efd1c06b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:27:58.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd13fff700 1 --2- 172.21.15.29:0/1261740913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c06ccc0 0x7efd1c0c7970 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efd1c06dec0 tx=0x7efd0400a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1658f2dffa35493 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:58.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1a7fc700 1 -- 172.21.15.29:0/1261740913 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400ca40 con 0x7efd1c06ccc0 2023-10-06T05:27:58.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1a7fc700 1 -- 172.21.15.29:0/1261740913 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0400cba0 con 0x7efd1c06ccc0 2023-10-06T05:27:58.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1a7fc700 1 -- 172.21.15.29:0/1261740913 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd04018400 con 0x7efd1c06ccc0 2023-10-06T05:27:58.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 -- 172.21.15.29:0/1261740913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c06ccc0 msgr2=0x7efd1c0c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 --2- 172.21.15.29:0/1261740913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c06ccc0 0x7efd1c0c7970 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efd1c06dec0 tx=0x7efd0400a3f0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 -- 172.21.15.29:0/1261740913 shutdown_connections 2023-10-06T05:27:58.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 --2- 172.21.15.29:0/1261740913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c06ccc0 0x7efd1c0c7970 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 --2- 172.21.15.29:0/1261740913 >> v2:172.21.15.173:3300/0 conn(0x7efd1c06c8f0 0x7efd1c06b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 -- 172.21.15.29:0/1261740913 >> 172.21.15.29:0/1261740913 conn(0x7efd1c0670a0 msgr2=0x7efd1c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:58.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 -- 172.21.15.29:0/1261740913 shutdown_connections 2023-10-06T05:27:58.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.211+0000 7efd1bfff700 1 -- 172.21.15.29:0/1261740913 wait complete. 2023-10-06T05:27:58.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.215+0000 7efd1bfff700 1 Processor -- start 2023-10-06T05:27:58.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.215+0000 7efd1bfff700 1 -- start start 2023-10-06T05:27:58.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd1c06c8f0 0x7efd1c14d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c06ccc0 0x7efd1c14caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c0c94a0 0x7efd1c0c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c0abd70 con 0x7efd1c0c94a0 2023-10-06T05:27:58.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c0c3930 con 0x7efd1c06ccc0 2023-10-06T05:27:58.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c0ab440 con 0x7efd1c06c8f0 2023-10-06T05:27:58.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c0c94a0 0x7efd1c0c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c0c94a0 0x7efd1c0c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46710/0 (socket says 172.21.15.29:46710) 2023-10-06T05:27:58.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1b7fe700 1 -- 172.21.15.29:0/1155275707 learned_addr learned my addr 172.21.15.29:0/1155275707 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1affd700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd1c06c8f0 0x7efd1c14d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd13fff700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c06ccc0 0x7efd1c14caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1b7fe700 1 -- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd1c06c8f0 msgr2=0x7efd1c14d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1b7fe700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd1c06c8f0 0x7efd1c14d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1b7fe700 1 -- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c06ccc0 msgr2=0x7efd1c14caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1b7fe700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c06ccc0 0x7efd1c14caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1b7fe700 1 -- 172.21.15.29:0/1155275707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0400a690 con 0x7efd1c0c94a0 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1b7fe700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c0c94a0 0x7efd1c0c3d50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efd1400cc70 tx=0x7efd14001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd12ffd700 1 -- 172.21.15.29:0/1155275707 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd14004bb0 con 0x7efd1c0c94a0 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd12ffd700 1 -- 172.21.15.29:0/1155275707 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14004d10 con 0x7efd1c0c94a0 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd12ffd700 1 -- 172.21.15.29:0/1155275707 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1400ab90 con 0x7efd1c0c94a0 2023-10-06T05:27:58.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1c0ab720 con 0x7efd1c0c94a0 2023-10-06T05:27:58.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.219+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c0c4290 con 0x7efd1c0c94a0 2023-10-06T05:27:58.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.223+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1c0abee0 con 0x7efd1c0c94a0 2023-10-06T05:27:58.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.223+0000 7efd12ffd700 1 -- 172.21.15.29:0/1155275707 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efd140070f0 con 0x7efd1c0c94a0 2023-10-06T05:27:58.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.223+0000 7efd12ffd700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcfc060550 0x7efcfc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.223+0000 7efd12ffd700 1 -- 172.21.15.29:0/1155275707 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7efd1407c470 con 0x7efd1c0c94a0 2023-10-06T05:27:58.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.223+0000 7efd1affd700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcfc060550 0x7efcfc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.223+0000 7efd1affd700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcfc060550 0x7efcfc062a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00ac00 tx=0x7efd0c006f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:58.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.231+0000 7efd12ffd700 1 -- 172.21.15.29:0/1155275707 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd1404c940 con 0x7efd1c0c94a0 2023-10-06T05:27:58.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.427+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd1c04be00 con 0x7efd1c0c94a0 2023-10-06T05:27:58.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd12ffd700 1 -- 172.21.15.29:0/1155275707 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4603 (secure 0 0 0) 0x7efd1404ff60 con 0x7efd1c0c94a0 2023-10-06T05:27:58.437 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:58.437 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3538089078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3538089078},{"type":"v1","addr":"172.21.15.173:6835","nonce":3538089078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3499370562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3499370562},{"type":"v1","addr":"172.21.15.173:6837","nonce":3499370562}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3369448997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3369448997},{"type":"v1","addr":"172.21.15.29:6833","nonce":3369448997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:27:08.808178+0000","modified":"2023-10-06T05:27:12.494062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5460":{"gid":5460,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2111647358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2111647358},{"type":"v1","addr":"172.21.15.29:6835","nonce":2111647358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T05:27:58.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcfc060550 msgr2=0x7efcfc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcfc060550 0x7efcfc062a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00ac00 tx=0x7efd0c006f90 comp rx=0 tx=0).stop 2023-10-06T05:27:58.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c0c94a0 msgr2=0x7efd1c0c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c0c94a0 0x7efd1c0c3d50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efd1400cc70 tx=0x7efd14001a70 comp rx=0 tx=0).stop 2023-10-06T05:27:58.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 shutdown_connections 2023-10-06T05:27:58.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd1c0c94a0 0x7efd1c0c3d50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcfc060550 0x7efcfc062a00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c06ccc0 0x7efd1c14caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 --2- 172.21.15.29:0/1155275707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd1c06c8f0 0x7efd1c14d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 >> 172.21.15.29:0/1155275707 conn(0x7efd1c0670a0 msgr2=0x7efd1c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 shutdown_connections 2023-10-06T05:27:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.431+0000 7efd1bfff700 1 -- 172.21.15.29:0/1155275707 wait complete. 2023-10-06T05:27:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 21 2023-10-06T05:27:58.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:27:58.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 Processor -- start 2023-10-06T05:27:58.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 -- start start 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0cec1605e0 0x7f0cec0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0cec06b320 0x7f0cec0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec0c2980 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec0ca630 con 0x7f0cec1605e0 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec0c6bb0 con 0x7f0cec06b320 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf0ba2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0cec1605e0 0x7f0cec0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf0ba2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0cec1605e0 0x7f0cec0c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46724/0 (socket says 172.21.15.29:46724) 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf0ba2700 1 -- 172.21.15.29:0/157368937 learned_addr learned my addr 172.21.15.29:0/157368937 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cebfff700 1 --2- 172.21.15.29:0/157368937 >> v2:172.21.15.173:3300/0 conn(0x7f0cec06b320 0x7f0cec0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf0ba2700 1 -- 172.21.15.29:0/157368937 >> v2:172.21.15.173:3300/0 conn(0x7f0cec06b320 msgr2=0x7f0cec0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:58.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf0ba2700 1 --2- 172.21.15.29:0/157368937 >> v2:172.21.15.173:3300/0 conn(0x7f0cec06b320 0x7f0cec0c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf0ba2700 1 -- 172.21.15.29:0/157368937 >> v1:172.21.15.29:6789/0 conn(0x7f0cec0ca1f0 legacy=0x7f0cec06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf0ba2700 1 -- 172.21.15.29:0/157368937 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0c6e90 con 0x7f0cec1605e0 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf0ba2700 1 --2- 172.21.15.29:0/157368937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec1605e0 0x7f0cec0c6540 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0c5980 tx=0x7f0cd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bb32eebb2d6222 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0ceb7fe700 1 -- 172.21.15.29:0/157368937 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400b860 con 0x7f0cec1605e0 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0ceb7fe700 1 -- 172.21.15.29:0/157368937 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd400b9c0 con 0x7f0cec1605e0 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0ceb7fe700 1 -- 172.21.15.29:0/157368937 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400bd60 con 0x7f0cec1605e0 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/157368937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec1605e0 msgr2=0x7f0cec0c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 --2- 172.21.15.29:0/157368937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec1605e0 0x7f0cec0c6540 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0c5980 tx=0x7f0cd4009250 comp rx=0 tx=0).stop 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/157368937 shutdown_connections 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 --2- 172.21.15.29:0/157368937 >> v2:172.21.15.173:3300/0 conn(0x7f0cec06b320 0x7f0cec0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 --2- 172.21.15.29:0/157368937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec1605e0 0x7f0cec0c6540 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/157368937 >> 172.21.15.29:0/157368937 conn(0x7f0cec0670a0 msgr2=0x7f0cec0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/157368937 shutdown_connections 2023-10-06T05:27:58.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.555+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/157368937 wait complete. 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 Processor -- start 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 -- start start 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cec06b320 0x7f0cec0c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec0ca1f0 0x7f0cec0b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec1511b0 0x7f0cec0b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0b17f0 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c3880 con 0x7f0cec1511b0 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c2cb0 con 0x7f0cec06b320 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cebfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec0ca1f0 0x7f0cec0b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cebfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec0ca1f0 0x7f0cec0b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46726/0 (socket says 172.21.15.29:46726) 2023-10-06T05:27:58.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cebfff700 1 -- 172.21.15.29:0/3317705445 learned_addr learned my addr 172.21.15.29:0/3317705445 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:58.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf0ba2700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cec06b320 0x7f0cec0c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf13a3700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec1511b0 0x7f0cec0b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cebfff700 1 -- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cec06b320 msgr2=0x7f0cec0c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cebfff700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cec06b320 0x7f0cec0c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cebfff700 1 -- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec1511b0 msgr2=0x7f0cec0b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cebfff700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec1511b0 0x7f0cec0b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cebfff700 1 -- 172.21.15.29:0/3317705445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd40094f0 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf13a3700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec1511b0 0x7f0cec0b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cebfff700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec0ca1f0 0x7f0cec0b0d70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00e190 tx=0x7f0cdc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0ce8ff9700 1 -- 172.21.15.29:0/3317705445 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00ec70 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0ce8ff9700 1 -- 172.21.15.29:0/3317705445 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00edf0 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec0c2f50 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0ce8ff9700 1 -- 172.21.15.29:0/3317705445 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc014670 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.559+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec0c3510 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.563+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec0c5a00 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.563+0000 7f0ce8ff9700 1 -- 172.21.15.29:0/3317705445 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0cdc0149e0 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.563+0000 7f0ce8ff9700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0cd0060550 0x7f0cd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.563+0000 7f0ce8ff9700 1 -- 172.21.15.29:0/3317705445 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f0cdc07d030 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.563+0000 7f0cf0ba2700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0cd0060550 0x7f0cd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.563+0000 7f0cf0ba2700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0cd0060550 0x7f0cd0062a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0c5980 tx=0x7f0cd4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:58.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.571+0000 7f0ce8ff9700 1 -- 172.21.15.29:0/3317705445 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0cec0c5a00 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.727+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cec0c5a00 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0ce8ff9700 1 -- 172.21.15.29:0/3317705445 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16962 (secure 0 0 0) 0x7f0cec0c5a00 con 0x7f0cec0ca1f0 2023-10-06T05:27:58.737 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:27:58.737 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":50,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:27:21.749611+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:27:06.728148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T05:27:07.815762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:27:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0cd0060550 msgr2=0x7f0cd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0cd0060550 0x7f0cd0062a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0c5980 tx=0x7f0cd4017000 comp rx=0 tx=0).stop 2023-10-06T05:27:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec0ca1f0 msgr2=0x7f0cec0b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec0ca1f0 0x7f0cec0b0d70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00e190 tx=0x7f0cdc009900 comp rx=0 tx=0).stop 2023-10-06T05:27:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 shutdown_connections 2023-10-06T05:27:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0cd0060550 0x7f0cd0062a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec1511b0 0x7f0cec0b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cec0ca1f0 0x7f0cec0b0d70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 --2- 172.21.15.29:0/3317705445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cec06b320 0x7f0cec0c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 >> 172.21.15.29:0/3317705445 conn(0x7f0cec0670a0 msgr2=0x7f0cec15db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 shutdown_connections 2023-10-06T05:27:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.731+0000 7f0cf1ba4700 1 -- 172.21.15.29:0/3317705445 wait complete. 2023-10-06T05:27:58.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:27:06.728148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:27:07.815762+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:27:58.753 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:27:58.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f542359e700 1 Processor -- start 2023-10-06T05:27:58.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f542359e700 1 -- start start 2023-10-06T05:27:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f542359e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5424155050 0x7f54240aac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f542359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542406afb0 con 0x7f54240677b0 2023-10-06T05:27:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f542359e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542406a410 con 0x7f542406b440 2023-10-06T05:27:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f542359e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542406a680 con 0x7f5424155050 2023-10-06T05:27:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f5422d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f54240677b0 0x7f5424155420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46156/0 (socket says 172.21.15.29:46156) 2023-10-06T05:27:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f5422d9d700 1 -- 172.21.15.29:0/177761105 learned_addr learned my addr 172.21.15.29:0/177761105 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:27:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f542259c700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5424155050 0x7f54240aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.859+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346675185 0 0) 0x7f542406afb0 con 0x7f54240677b0 2023-10-06T05:27:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f540c003570 con 0x7f54240677b0 2023-10-06T05:27:58.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3993081945 0 0) 0x7f540c003570 con 0x7f54240677b0 2023-10-06T05:27:58.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5424155050 msgr2=0x7f54240aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5424155050 0x7f54240aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 >> v1:172.21.15.173:6789/0 conn(0x7f542406b440 legacy=0x7f54240670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542406a960 con 0x7f54240677b0 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f541c0017f0 con 0x7f54240677b0 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 >> v1:172.21.15.29:6789/0 conn(0x7f54240677b0 legacy=0x7f5424155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f540c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5424155050 0x7f540c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540c004d50 0x7f540c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542406a680 con 0x7f540c003a90 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c00bb10 con 0x7f540c004d50 2023-10-06T05:27:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c00bcd0 con 0x7f5424155050 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542259c700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f540c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f5422d9d700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540c004d50 0x7f540c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f5421d9b700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5424155050 0x7f540c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542259c700 1 -- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5424155050 msgr2=0x7f540c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542259c700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5424155050 0x7f540c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542259c700 1 -- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540c004d50 msgr2=0x7f540c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542259c700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540c004d50 0x7f540c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542259c700 1 -- 172.21.15.29:0/177761105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c003570 con 0x7f540c003a90 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f5422d9d700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f540c004d50 0x7f540c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542259c700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f540c003e60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5418009c00 tx=0x7f54180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27620073888fe795 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800e710 con 0x7f540c003a90 2023-10-06T05:27:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541800e870 con 0x7f540c003a90 2023-10-06T05:27:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542159a700 1 -- 172.21.15.29:0/177761105 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800ec30 con 0x7f540c003a90 2023-10-06T05:27:58.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542359e700 1 -- 172.21.15.29:0/177761105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 msgr2=0x7f540c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542359e700 1 --2- 172.21.15.29:0/177761105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f540c003e60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5418009c00 tx=0x7f54180091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f5422d9d700 1 -- 172.21.15.29:0/177761105 reap_dead start 2023-10-06T05:27:58.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542359e700 1 -- 172.21.15.29:0/177761105 shutdown_connections 2023-10-06T05:27:58.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542359e700 1 -- 172.21.15.29:0/177761105 >> 172.21.15.29:0/177761105 conn(0x7f542406c6c0 msgr2=0x7f542406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:58.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542359e700 1 -- 172.21.15.29:0/177761105 shutdown_connections 2023-10-06T05:27:58.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.863+0000 7f542359e700 1 -- 172.21.15.29:0/177761105 wait complete. 2023-10-06T05:27:58.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.867+0000 7f542359e700 1 Processor -- start 2023-10-06T05:27:58.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.867+0000 7f542359e700 1 -- start start 2023-10-06T05:27:58.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.867+0000 7f542359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f54240c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.867+0000 7f542359e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542416ac00 0x7f5424146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.867+0000 7f542359e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54240abd90 0x7f54240ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.867+0000 7f542359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54240c4900 con 0x7f540c003a90 2023-10-06T05:27:58.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.867+0000 7f542359e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54240c4be0 con 0x7f542416ac00 2023-10-06T05:27:58.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.867+0000 7f542359e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54240c37e0 con 0x7f54240abd90 2023-10-06T05:27:58.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.867+0000 7f542259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f54240c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f54240c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46740/0 (socket says 172.21.15.29:46740) 2023-10-06T05:27:58.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542259c700 1 -- 172.21.15.29:0/2613105851 learned_addr learned my addr 172.21.15.29:0/2613105851 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:58.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f5422d9d700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54240abd90 0x7f54240ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f5421d9b700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542416ac00 0x7f5424146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542259c700 1 -- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54240abd90 msgr2=0x7f54240ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542259c700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54240abd90 0x7f54240ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542259c700 1 -- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542416ac00 msgr2=0x7f5424146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542259c700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542416ac00 0x7f5424146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542259c700 1 -- 172.21.15.29:0/2613105851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240c3ac0 con 0x7f540c003a90 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f5422d9d700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54240abd90 0x7f54240ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542259c700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f54240c2f90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f540c004770 tx=0x7f541801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f54127fc700 1 -- 172.21.15.29:0/2613105851 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418022070 con 0x7f540c003a90 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f54127fc700 1 -- 172.21.15.29:0/2613105851 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541800ebf0 con 0x7f540c003a90 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54240c4900 con 0x7f540c003a90 2023-10-06T05:27:58.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f54127fc700 1 -- 172.21.15.29:0/2613105851 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541801c6a0 con 0x7f540c003a90 2023-10-06T05:27:58.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.871+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54240c34d0 con 0x7f540c003a90 2023-10-06T05:27:58.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.875+0000 7f54127fc700 1 -- 172.21.15.29:0/2613105851 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f541801ca90 con 0x7f540c003a90 2023-10-06T05:27:58.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.875+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54240c3f40 con 0x7f540c003a90 2023-10-06T05:27:58.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.875+0000 7f54127fc700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5404060550 0x7f5404062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:58.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.875+0000 7f54127fc700 1 -- 172.21.15.29:0/2613105851 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f541807e200 con 0x7f540c003a90 2023-10-06T05:27:58.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.875+0000 7f5421d9b700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5404060550 0x7f5404062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:58.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.875+0000 7f5421d9b700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5404060550 0x7f5404062a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5414007a80 tx=0x7f5414009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:58.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:58.883+0000 7f54127fc700 1 -- 172.21.15.29:0/2613105851 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f541804e690 con 0x7f540c003a90 2023-10-06T05:27:59.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.039+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f542404be00 con 0x7f540c003a90 2023-10-06T05:27:59.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.039+0000 7f54127fc700 1 -- 172.21.15.29:0/2613105851 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f541802b020 con 0x7f540c003a90 2023-10-06T05:27:59.047 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:27:59.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5404060550 msgr2=0x7f5404062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5404060550 0x7f5404062a00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5414007a80 tx=0x7f5414009040 comp rx=0 tx=0).stop 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 msgr2=0x7f54240c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f54240c2f90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f540c004770 tx=0x7f541801a000 comp rx=0 tx=0).stop 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 shutdown_connections 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54240abd90 0x7f54240ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5404060550 0x7f5404062a00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542416ac00 0x7f5424146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 --2- 172.21.15.29:0/2613105851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f540c003a90 0x7f54240c2f90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 >> 172.21.15.29:0/2613105851 conn(0x7f542406c6c0 msgr2=0x7f5424147520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 shutdown_connections 2023-10-06T05:27:59.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.043+0000 7f542359e700 1 -- 172.21.15.29:0/2613105851 wait complete. 2023-10-06T05:27:59.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:27:59.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 Processor -- start 2023-10-06T05:27:59.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 -- start start 2023-10-06T05:27:59.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5850155c70 0x7f58500c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 0x7f58500b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f585006d200 0x7f585006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5850156040 con 0x7f585006d200 2023-10-06T05:27:59.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585006c760 con 0x7f5850155c70 2023-10-06T05:27:59.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58500b1560 con 0x7f58500b07e0 2023-10-06T05:27:59.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f585006d200 0x7f585006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f585006d200 0x7f585006d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46754/0 (socket says 172.21.15.29:46754) 2023-10-06T05:27:59.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584ffff700 1 -- 172.21.15.29:0/776835763 learned_addr learned my addr 172.21.15.29:0/776835763 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:59.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584f7fe700 1 --2- 172.21.15.29:0/776835763 >> v2:172.21.15.173:3300/0 conn(0x7f5850155c70 0x7f58500c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584effd700 1 --2- 172.21.15.29:0/776835763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 0x7f58500b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584f7fe700 1 -- 172.21.15.29:0/776835763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 msgr2=0x7f58500b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584f7fe700 1 --2- 172.21.15.29:0/776835763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 0x7f58500b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584f7fe700 1 -- 172.21.15.29:0/776835763 >> v2:172.21.15.29:3300/0 conn(0x7f585006d200 msgr2=0x7f585006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584f7fe700 1 --2- 172.21.15.29:0/776835763 >> v2:172.21.15.29:3300/0 conn(0x7f585006d200 0x7f585006d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584f7fe700 1 -- 172.21.15.29:0/776835763 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585006ca00 con 0x7f5850155c70 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584ffff700 1 --2- 172.21.15.29:0/776835763 >> v2:172.21.15.29:3300/0 conn(0x7f585006d200 0x7f585006d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584f7fe700 1 --2- 172.21.15.29:0/776835763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850155c70 0x7f58500c9800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5850069c40 tx=0x7f5840009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f77cd203e9909127 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584e7fc700 1 -- 172.21.15.29:0/776835763 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840005c10 con 0x7f5850155c70 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584e7fc700 1 -- 172.21.15.29:0/776835763 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5840005d70 con 0x7f5850155c70 2023-10-06T05:27:59.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f584e7fc700 1 -- 172.21.15.29:0/776835763 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840006260 con 0x7f5850155c70 2023-10-06T05:27:59.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 -- 172.21.15.29:0/776835763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850155c70 msgr2=0x7f58500c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 --2- 172.21.15.29:0/776835763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850155c70 0x7f58500c9800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5850069c40 tx=0x7f5840009120 comp rx=0 tx=0).stop 2023-10-06T05:27:59.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 -- 172.21.15.29:0/776835763 shutdown_connections 2023-10-06T05:27:59.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 --2- 172.21.15.29:0/776835763 >> v2:172.21.15.29:3300/0 conn(0x7f585006d200 0x7f585006d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 --2- 172.21.15.29:0/776835763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 0x7f58500b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 --2- 172.21.15.29:0/776835763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850155c70 0x7f58500c9800 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 -- 172.21.15.29:0/776835763 >> 172.21.15.29:0/776835763 conn(0x7f585006abc0 msgr2=0x7f58500adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:59.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 -- 172.21.15.29:0/776835763 shutdown_connections 2023-10-06T05:27:59.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.171+0000 7f5854894700 1 -- 172.21.15.29:0/776835763 wait complete. 2023-10-06T05:27:59.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.175+0000 7f5854894700 1 Processor -- start 2023-10-06T05:27:59.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.175+0000 7f5854894700 1 -- start start 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.175+0000 7f5854894700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f585006d200 0x7f5850169150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.175+0000 7f5854894700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 0x7f58501497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.175+0000 7f5854894700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850155c70 0x7f58501477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.175+0000 7f5854894700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585014a0f0 con 0x7f585006d200 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.175+0000 7f5854894700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585014a3d0 con 0x7f5850155c70 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.175+0000 7f5854894700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585014a6b0 con 0x7f58500b07e0 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f585006d200 0x7f5850169150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f585006d200 0x7f5850169150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46766/0 (socket says 172.21.15.29:46766) 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584f7fe700 1 -- 172.21.15.29:0/989147159 learned_addr learned my addr 172.21.15.29:0/989147159 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:59.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584effd700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 0x7f58501497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584ffff700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850155c70 0x7f58501477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584f7fe700 1 -- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 msgr2=0x7f58501497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584f7fe700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 0x7f58501497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584f7fe700 1 -- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850155c70 msgr2=0x7f58501477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584f7fe700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850155c70 0x7f58501477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584f7fe700 1 -- 172.21.15.29:0/989147159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848009ae0 con 0x7f585006d200 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f584f7fe700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f585006d200 0x7f5850169150 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f585006c8a0 tx=0x7f5840016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f58377fe700 1 -- 172.21.15.29:0/989147159 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584001a700 con 0x7f585006d200 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f58377fe700 1 -- 172.21.15.29:0/989147159 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584001a880 con 0x7f585006d200 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58400093c0 con 0x7f585006d200 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f58377fe700 1 -- 172.21.15.29:0/989147159 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584001ac40 con 0x7f585006d200 2023-10-06T05:27:59.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585014ac70 con 0x7f585006d200 2023-10-06T05:27:59.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58501569f0 con 0x7f585006d200 2023-10-06T05:27:59.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.179+0000 7f58377fe700 1 -- 172.21.15.29:0/989147159 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5840011420 con 0x7f585006d200 2023-10-06T05:27:59.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.183+0000 7f58377fe700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f583c060550 0x7f583c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.183+0000 7f58377fe700 1 -- 172.21.15.29:0/989147159 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f584007e0d0 con 0x7f585006d200 2023-10-06T05:27:59.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.183+0000 7f584effd700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f583c060550 0x7f583c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.183+0000 7f584effd700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f583c060550 0x7f583c062a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f585014c1e0 tx=0x7f58440091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:59.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.191+0000 7f58377fe700 1 -- 172.21.15.29:0/989147159 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f584004e480 con 0x7f585006d200 2023-10-06T05:27:59.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.351+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f585004be00 con 0x7f585006d200 2023-10-06T05:27:59.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f58377fe700 1 -- 172.21.15.29:0/989147159 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f584002b0a0 con 0x7f585006d200 2023-10-06T05:27:59.360 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:27:59.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f583c060550 msgr2=0x7f583c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f583c060550 0x7f583c062a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f585014c1e0 tx=0x7f58440091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f585006d200 msgr2=0x7f5850169150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f585006d200 0x7f5850169150 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f585006c8a0 tx=0x7f5840016000 comp rx=0 tx=0).stop 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 shutdown_connections 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f583c060550 0x7f583c062a00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5850155c70 0x7f58501477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58500b07e0 0x7f58501497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 --2- 172.21.15.29:0/989147159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f585006d200 0x7f5850169150 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 >> 172.21.15.29:0/989147159 conn(0x7f585006abc0 msgr2=0x7f585006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 shutdown_connections 2023-10-06T05:27:59.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.355+0000 7f5854894700 1 -- 172.21.15.29:0/989147159 wait complete. 2023-10-06T05:27:59.375 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:27:59.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0dc0b700 1 Processor -- start 2023-10-06T05:27:59.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0dc0b700 1 -- start start 2023-10-06T05:27:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0dc0b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b08158c40 0x7f1b080d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0dc0b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1b080ce320 0x7f1b080ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0dc0b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b080cae30 con 0x7f1b08159010 2023-10-06T05:27:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0dc0b700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080cece0 con 0x7f1b080ce320 2023-10-06T05:27:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0dc0b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0806ba70 con 0x7f1b08158c40 2023-10-06T05:27:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0d40a700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1b080ce320 0x7f1b080ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0cc09700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b08158c40 0x7f1b080d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0d40a700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1b080ce320 0x7f1b080ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:38354/0 (socket says 172.21.15.29:38354) 2023-10-06T05:27:59.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0cc09700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b08158c40 0x7f1b080d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52634/0 (socket says 172.21.15.29:52634) 2023-10-06T05:27:59.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0d40a700 1 -- 172.21.15.29:0/80952194 learned_addr learned my addr 172.21.15.29:0/80952194 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:59.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b07fff700 1 --1- 172.21.15.29:0/80952194 >> v1:172.21.15.173:6789/0 conn(0x7f1b08159010 0x7f1b0806aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:58066/0 (socket says 172.21.15.29:58066) 2023-10-06T05:27:59.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0d40a700 1 -- 172.21.15.29:0/80952194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b08158c40 msgr2=0x7f1b080d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:59.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0d40a700 1 --2- 172.21.15.29:0/80952194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b08158c40 0x7f1b080d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0d40a700 1 -- 172.21.15.29:0/80952194 >> v1:172.21.15.173:6789/0 conn(0x7f1b08159010 legacy=0x7f1b0806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b0d40a700 1 -- 172.21.15.29:0/80952194 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0806b4b0 con 0x7f1b080ce320 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.483+0000 7f1b077fe700 1 -- 172.21.15.29:0/80952194 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967978235 0 0) 0x7f1b080cae30 con 0x7f1b08159010 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0d40a700 1 --2- 172.21.15.29:0/80952194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b080ce320 0x7f1b080ce7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009f20 tx=0x7f1b00009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab6b1590d9002bf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b077fe700 1 -- 172.21.15.29:0/80952194 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000e070 con 0x7f1b080ce320 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b077fe700 1 -- 172.21.15.29:0/80952194 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0000b9d0 con 0x7f1b080ce320 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b077fe700 1 -- 172.21.15.29:0/80952194 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b000092e0 con 0x7f1b080ce320 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/80952194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b080ce320 msgr2=0x7f1b080ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0dc0b700 1 --2- 172.21.15.29:0/80952194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b080ce320 0x7f1b080ce7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009f20 tx=0x7f1b00009840 comp rx=0 tx=0).stop 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/80952194 shutdown_connections 2023-10-06T05:27:59.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0dc0b700 1 --2- 172.21.15.29:0/80952194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b080ce320 0x7f1b080ce7a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0dc0b700 1 --2- 172.21.15.29:0/80952194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b08158c40 0x7f1b080d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/80952194 >> 172.21.15.29:0/80952194 conn(0x7f1b080670a0 msgr2=0x7f1b080674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/80952194 shutdown_connections 2023-10-06T05:27:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/80952194 wait complete. 2023-10-06T05:27:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.487+0000 7f1b0dc0b700 1 Processor -- start 2023-10-06T05:27:59.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0dc0b700 1 -- start start 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0dc0b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b080ce320 0x7f1b08142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0dc0b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b08158c40 0x7f1b080c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0dc0b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b08159010 0x7f1b080b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0dc0b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0815ab40 con 0x7f1b08159010 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0dc0b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08159f30 con 0x7f1b08158c40 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0dc0b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0815a210 con 0x7f1b080ce320 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0d40a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b08159010 0x7f1b080b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0cc09700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b080ce320 0x7f1b08142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0d40a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b08159010 0x7f1b080b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46768/0 (socket says 172.21.15.29:46768) 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0d40a700 1 -- 172.21.15.29:0/158294486 learned_addr learned my addr 172.21.15.29:0/158294486 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b07fff700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b08158c40 0x7f1b080c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0d40a700 1 -- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b080ce320 msgr2=0x7f1b08142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0d40a700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b080ce320 0x7f1b08142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0d40a700 1 -- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b08158c40 msgr2=0x7f1b080c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0d40a700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b08158c40 0x7f1b080c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0d40a700 1 -- 172.21.15.29:0/158294486 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009ae0 con 0x7f1b08159010 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0d40a700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b08159010 0x7f1b080b2cf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1b0806e080 tx=0x7f1b00018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b04ff9700 1 -- 172.21.15.29:0/158294486 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00008b10 con 0x7f1b08159010 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b04ff9700 1 -- 172.21.15.29:0/158294486 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b00008c90 con 0x7f1b08159010 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0815a4f0 con 0x7f1b08159010 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b04ff9700 1 -- 172.21.15.29:0/158294486 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b000266b0 con 0x7f1b08159010 2023-10-06T05:27:59.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.491+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b08159aa0 con 0x7f1b08159010 2023-10-06T05:27:59.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.495+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0815a970 con 0x7f1b08159010 2023-10-06T05:27:59.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.495+0000 7f1b04ff9700 1 -- 172.21.15.29:0/158294486 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1b00003040 con 0x7f1b08159010 2023-10-06T05:27:59.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.495+0000 7f1b04ff9700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1aec060550 0x7f1aec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.495+0000 7f1b04ff9700 1 -- 172.21.15.29:0/158294486 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1b0007e770 con 0x7f1b08159010 2023-10-06T05:27:59.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.495+0000 7f1b0cc09700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1aec060550 0x7f1aec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.499+0000 7f1b0cc09700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1aec060550 0x7f1aec062a00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009db0 tx=0x7f1af40091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:59.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.507+0000 7f1b04ff9700 1 -- 172.21.15.29:0/158294486 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1b0004ebc0 con 0x7f1b08159010 2023-10-06T05:27:59.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.659+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b0804be00 con 0x7f1b08159010 2023-10-06T05:27:59.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b04ff9700 1 -- 172.21.15.29:0/158294486 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b000521e0 con 0x7f1b08159010 2023-10-06T05:27:59.669 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:27:59.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1aec060550 msgr2=0x7f1aec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1aec060550 0x7f1aec062a00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009db0 tx=0x7f1af40091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b08159010 msgr2=0x7f1b080b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b08159010 0x7f1b080b2cf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1b0806e080 tx=0x7f1b00018000 comp rx=0 tx=0).stop 2023-10-06T05:27:59.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 shutdown_connections 2023-10-06T05:27:59.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b08159010 0x7f1b080b2cf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1aec060550 0x7f1aec062a00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b08158c40 0x7f1b080c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 --2- 172.21.15.29:0/158294486 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b080ce320 0x7f1b08142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 >> 172.21.15.29:0/158294486 conn(0x7f1b080670a0 msgr2=0x7f1b08153990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:59.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 shutdown_connections 2023-10-06T05:27:59.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.663+0000 7f1b0dc0b700 1 -- 172.21.15.29:0/158294486 wait complete. 2023-10-06T05:27:59.683 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:27:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf459f700 1 Processor -- start 2023-10-06T05:27:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf459f700 1 -- start start 2023-10-06T05:27:59.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf459f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec156d60 0x7facec157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf459f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7facec157130 0x7facec06af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf459f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facec0c9c40 0x7facec06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf459f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facec0c6c50 con 0x7facec0c9c40 2023-10-06T05:27:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf459f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facec0c7ab0 con 0x7facec157130 2023-10-06T05:27:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf459f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec158480 con 0x7facec156d60 2023-10-06T05:27:59.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf2b3c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facec0c9c40 0x7facec06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf2b3c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facec0c9c40 0x7facec06b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46784/0 (socket says 172.21.15.29:46784) 2023-10-06T05:27:59.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf233b700 1 --2- 172.21.15.29:0/3626895744 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec156d60 0x7facec157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf2b3c700 1 -- 172.21.15.29:0/3626895744 learned_addr learned my addr 172.21.15.29:0/3626895744 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:59.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.795+0000 7facf1b3a700 1 --2- 172.21.15.29:0/3626895744 >> v2:172.21.15.173:3300/0 conn(0x7facec157130 0x7facec06af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf2b3c700 1 -- 172.21.15.29:0/3626895744 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec156d60 msgr2=0x7facec157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:59.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf2b3c700 1 --2- 172.21.15.29:0/3626895744 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec156d60 0x7facec157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf2b3c700 1 -- 172.21.15.29:0/3626895744 >> v2:172.21.15.173:3300/0 conn(0x7facec157130 msgr2=0x7facec06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:27:59.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf2b3c700 1 --2- 172.21.15.29:0/3626895744 >> v2:172.21.15.173:3300/0 conn(0x7facec157130 0x7facec06af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf2b3c700 1 -- 172.21.15.29:0/3626895744 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec0c6ea0 con 0x7facec0c9c40 2023-10-06T05:27:59.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf1b3a700 1 --2- 172.21.15.29:0/3626895744 >> v2:172.21.15.173:3300/0 conn(0x7facec157130 0x7facec06af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:27:59.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf2b3c700 1 --2- 172.21.15.29:0/3626895744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec0c9c40 0x7facec06b4b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7facec0cc4b0 tx=0x7face4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4785b032186051 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:59.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf1339700 1 -- 172.21.15.29:0/3626895744 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400e070 con 0x7facec0c9c40 2023-10-06T05:27:59.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf1339700 1 -- 172.21.15.29:0/3626895744 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400b970 con 0x7facec0c9c40 2023-10-06T05:27:59.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf1339700 1 -- 172.21.15.29:0/3626895744 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face40092e0 con 0x7facec0c9c40 2023-10-06T05:27:59.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf459f700 1 -- 172.21.15.29:0/3626895744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec0c9c40 msgr2=0x7facec06b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf459f700 1 --2- 172.21.15.29:0/3626895744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec0c9c40 0x7facec06b4b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7facec0cc4b0 tx=0x7face4009840 comp rx=0 tx=0).stop 2023-10-06T05:27:59.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf459f700 1 -- 172.21.15.29:0/3626895744 shutdown_connections 2023-10-06T05:27:59.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf459f700 1 --2- 172.21.15.29:0/3626895744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec0c9c40 0x7facec06b4b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf459f700 1 --2- 172.21.15.29:0/3626895744 >> v2:172.21.15.173:3300/0 conn(0x7facec157130 0x7facec06af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf459f700 1 --2- 172.21.15.29:0/3626895744 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec156d60 0x7facec157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf459f700 1 -- 172.21.15.29:0/3626895744 >> 172.21.15.29:0/3626895744 conn(0x7facec0cd0e0 msgr2=0x7facec0c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:59.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf459f700 1 -- 172.21.15.29:0/3626895744 shutdown_connections 2023-10-06T05:27:59.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.799+0000 7facf459f700 1 -- 172.21.15.29:0/3626895744 wait complete. 2023-10-06T05:27:59.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf459f700 1 Processor -- start 2023-10-06T05:27:59.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf459f700 1 -- start start 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf459f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec0c9c40 0x7facec0c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf459f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec156d60 0x7facec14ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf459f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec157130 0x7facec0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf459f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec150760 con 0x7facec156d60 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf459f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec0c6740 con 0x7facec0c9c40 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf459f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec0c5890 con 0x7facec157130 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf1b3a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec156d60 0x7facec14ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf1b3a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec156d60 0x7facec14ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46790/0 (socket says 172.21.15.29:46790) 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf1b3a700 1 -- 172.21.15.29:0/1935432973 learned_addr learned my addr 172.21.15.29:0/1935432973 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf233b700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec0c9c40 0x7facec0c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf2b3c700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec157130 0x7facec0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf1b3a700 1 -- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec157130 msgr2=0x7facec0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf1b3a700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec157130 0x7facec0c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf1b3a700 1 -- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec0c9c40 msgr2=0x7facec0c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf1b3a700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec0c9c40 0x7facec0c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.803+0000 7facf1b3a700 1 -- 172.21.15.29:0/1935432973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0009420 con 0x7facec156d60 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facf1b3a700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec156d60 0x7facec14ec60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7face000ec80 tx=0x7face00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facde7fc700 1 -- 172.21.15.29:0/1935432973 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face000c850 con 0x7facec156d60 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facde7fc700 1 -- 172.21.15.29:0/1935432973 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face000c9b0 con 0x7facec156d60 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face4009ae0 con 0x7facec156d60 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facde7fc700 1 -- 172.21.15.29:0/1935432973 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face000cd30 con 0x7facec156d60 2023-10-06T05:27:59.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec0c5e90 con 0x7facec156d60 2023-10-06T05:27:59.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec1508d0 con 0x7facec156d60 2023-10-06T05:27:59.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facde7fc700 1 -- 172.21.15.29:0/1935432973 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7face0013680 con 0x7facec156d60 2023-10-06T05:27:59.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facde7fc700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facd0060550 0x7facd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:27:59.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.807+0000 7facde7fc700 1 -- 172.21.15.29:0/1935432973 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7face007cf80 con 0x7facec156d60 2023-10-06T05:27:59.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.811+0000 7facf233b700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facd0060550 0x7facd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:27:59.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.811+0000 7facf233b700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facd0060550 0x7facd0062a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7face8009db0 tx=0x7face80091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:27:59.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.819+0000 7facde7fc700 1 -- 172.21.15.29:0/1935432973 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7face0050dc0 con 0x7facec156d60 2023-10-06T05:27:59.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.971+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7facec071120 con 0x7facec156d60 2023-10-06T05:27:59.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.971+0000 7facde7fc700 1 -- 172.21.15.29:0/1935432973 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7face0050950 con 0x7facec156d60 2023-10-06T05:27:59.979 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:27:59.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facd0060550 msgr2=0x7facd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facd0060550 0x7facd0062a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7face8009db0 tx=0x7face80091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec156d60 msgr2=0x7facec14ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:27:59.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec156d60 0x7facec14ec60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7face000ec80 tx=0x7face00091a0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 shutdown_connections 2023-10-06T05:27:59.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7facec157130 0x7facec0c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facec156d60 0x7facec14ec60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facd0060550 0x7facd0062a00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 --2- 172.21.15.29:0/1935432973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7facec0c9c40 0x7facec0c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:27:59.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 >> 172.21.15.29:0/1935432973 conn(0x7facec0cd0e0 msgr2=0x7facec0c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:27:59.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 shutdown_connections 2023-10-06T05:27:59.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:27:59.975+0000 7facf459f700 1 -- 172.21.15.29:0/1935432973 wait complete. 2023-10-06T05:27:59.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:28:00.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.107+0000 7fc983d36700 1 Processor -- start 2023-10-06T05:28:00.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.107+0000 7fc983d36700 1 -- start start 2023-10-06T05:28:00.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc97c06e960 0x7fc97c06ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 0x7fc97c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c0b0490 con 0x7fc97c15a220 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c0b06e0 con 0x7fc97c06e960 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0b09c0 con 0x7fc97c155d90 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc981ad2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc97c06e960 0x7fc97c06ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc981ad2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc97c06e960 0x7fc97c06ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46796/0 (socket says 172.21.15.29:46796) 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc981ad2700 1 -- 172.21.15.29:0/553026644 learned_addr learned my addr 172.21.15.29:0/553026644 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc9812d1700 1 --1- 172.21.15.29:0/553026644 >> v1:172.21.15.29:6789/0 conn(0x7fc97c15a220 0x7fc97c155680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46172/0 (socket says 172.21.15.29:46172) 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc9822d3700 1 --2- 172.21.15.29:0/553026644 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 0x7fc97c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc981ad2700 1 -- 172.21.15.29:0/553026644 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 msgr2=0x7fc97c0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc981ad2700 1 --2- 172.21.15.29:0/553026644 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 0x7fc97c0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc981ad2700 1 -- 172.21.15.29:0/553026644 >> v1:172.21.15.29:6789/0 conn(0x7fc97c15a220 legacy=0x7fc97c155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc981ad2700 1 -- 172.21.15.29:0/553026644 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0b0ca0 con 0x7fc97c06e960 2023-10-06T05:28:00.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc981ad2700 1 --2- 172.21.15.29:0/553026644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c06e960 0x7fc97c06ed30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc9780099b0 tx=0x7fc978009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e562bb22d4507ce6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:00.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc980ad0700 1 -- 172.21.15.29:0/553026644 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97800b860 con 0x7fc97c06e960 2023-10-06T05:28:00.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc980ad0700 1 -- 172.21.15.29:0/553026644 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97800b9c0 con 0x7fc97c06e960 2023-10-06T05:28:00.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc980ad0700 1 -- 172.21.15.29:0/553026644 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97800bd60 con 0x7fc97c06e960 2023-10-06T05:28:00.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 -- 172.21.15.29:0/553026644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c06e960 msgr2=0x7fc97c06ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 --2- 172.21.15.29:0/553026644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c06e960 0x7fc97c06ed30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc9780099b0 tx=0x7fc978009250 comp rx=0 tx=0).stop 2023-10-06T05:28:00.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 -- 172.21.15.29:0/553026644 shutdown_connections 2023-10-06T05:28:00.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 --2- 172.21.15.29:0/553026644 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 0x7fc97c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 --2- 172.21.15.29:0/553026644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c06e960 0x7fc97c06ed30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 -- 172.21.15.29:0/553026644 >> 172.21.15.29:0/553026644 conn(0x7fc97c067b70 msgr2=0x7fc97c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:00.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 -- 172.21.15.29:0/553026644 shutdown_connections 2023-10-06T05:28:00.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.111+0000 7fc983d36700 1 -- 172.21.15.29:0/553026644 wait complete. 2023-10-06T05:28:00.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc983d36700 1 Processor -- start 2023-10-06T05:28:00.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc983d36700 1 -- start start 2023-10-06T05:28:00.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc983d36700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc97c06e960 0x7fc97c0a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc983d36700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 0x7fc97c146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc983d36700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c15a220 0x7fc97c146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc983d36700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c146c90 con 0x7fc97c15a220 2023-10-06T05:28:00.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc983d36700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c156340 con 0x7fc97c06e960 2023-10-06T05:28:00.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc983d36700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0a5280 con 0x7fc97c155d90 2023-10-06T05:28:00.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc9822d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c15a220 0x7fc97c146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc981ad2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc97c06e960 0x7fc97c0a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc9822d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c15a220 0x7fc97c146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46804/0 (socket says 172.21.15.29:46804) 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc9812d1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 0x7fc97c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.115+0000 7fc9822d3700 1 -- 172.21.15.29:0/3793428112 learned_addr learned my addr 172.21.15.29:0/3793428112 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc9822d3700 1 -- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 msgr2=0x7fc97c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc9822d3700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 0x7fc97c146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc9822d3700 1 -- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc97c06e960 msgr2=0x7fc97c0a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc9822d3700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc97c06e960 0x7fc97c0a5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc9822d3700 1 -- 172.21.15.29:0/3793428112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780094f0 con 0x7fc97c15a220 2023-10-06T05:28:00.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc9822d3700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c15a220 0x7fc97c146750 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc974009fa0 tx=0x7fc974009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:00.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc971ffb700 1 -- 172.21.15.29:0/3793428112 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97400ebc0 con 0x7fc97c15a220 2023-10-06T05:28:00.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc971ffb700 1 -- 172.21.15.29:0/3793428112 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97400ed20 con 0x7fc97c15a220 2023-10-06T05:28:00.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c1565e0 con 0x7fc97c15a220 2023-10-06T05:28:00.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc971ffb700 1 -- 172.21.15.29:0/3793428112 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974014670 con 0x7fc97c15a220 2023-10-06T05:28:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c0a5560 con 0x7fc97c15a220 2023-10-06T05:28:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c156ac0 con 0x7fc97c15a220 2023-10-06T05:28:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc971ffb700 1 -- 172.21.15.29:0/3793428112 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc9740149e0 con 0x7fc97c15a220 2023-10-06T05:28:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.119+0000 7fc971ffb700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc960060550 0x7fc960062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.123+0000 7fc971ffb700 1 -- 172.21.15.29:0/3793428112 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fc97407cfe0 con 0x7fc97c15a220 2023-10-06T05:28:00.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.123+0000 7fc981ad2700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc960060550 0x7fc960062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.123+0000 7fc981ad2700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc960060550 0x7fc960062a00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc9780099b0 tx=0x7fc978017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.127+0000 7fc971ffb700 1 -- 172.21.15.29:0/3793428112 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc97404d410 con 0x7fc97c15a220 2023-10-06T05:28:00.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc97c0b0f80 con 0x7fc97c15a220 2023-10-06T05:28:00.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc971ffb700 1 -- 172.21.15.29:0/3793428112 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fc974050a30 con 0x7fc97c15a220 2023-10-06T05:28:00.333 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:00.333 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3538089078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3538089078},{"type":"v1","addr":"172.21.15.173:6835","nonce":3538089078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3499370562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3499370562},{"type":"v1","addr":"172.21.15.173:6837","nonce":3499370562}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3369448997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3369448997},{"type":"v1","addr":"172.21.15.29:6833","nonce":3369448997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:27:08.808178+0000","modified":"2023-10-06T05:27:12.494062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5460":{"gid":5460,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2111647358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2111647358},{"type":"v1","addr":"172.21.15.29:6835","nonce":2111647358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T05:28:00.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc960060550 msgr2=0x7fc960062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc960060550 0x7fc960062a00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc9780099b0 tx=0x7fc978017000 comp rx=0 tx=0).stop 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c15a220 msgr2=0x7fc97c146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c15a220 0x7fc97c146750 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc974009fa0 tx=0x7fc974009900 comp rx=0 tx=0).stop 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 shutdown_connections 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c15a220 0x7fc97c146750 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc97c155d90 0x7fc97c146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc960060550 0x7fc960062a00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 --2- 172.21.15.29:0/3793428112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc97c06e960 0x7fc97c0a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 >> 172.21.15.29:0/3793428112 conn(0x7fc97c067b70 msgr2=0x7fc97c152750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 shutdown_connections 2023-10-06T05:28:00.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.327+0000 7fc983d36700 1 -- 172.21.15.29:0/3793428112 wait complete. 2023-10-06T05:28:00.337 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 21 2023-10-06T05:28:00.347 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:28:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c2055700 1 Processor -- start 2023-10-06T05:28:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c2055700 1 -- start start 2023-10-06T05:28:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c2055700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc0bc06b3a0 0x7fc0bc0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c2055700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc0cb5f0 con 0x7fc0bc0cc9a0 2023-10-06T05:28:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c2055700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc0cb8d0 con 0x7fc0bc158f80 2023-10-06T05:28:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c2055700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0bc0cbbb0 con 0x7fc0bc06b3a0 2023-10-06T05:28:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c1053700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc0bc0cc9a0 0x7fc0bc158870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46180/0 (socket says 172.21.15.29:46180) 2023-10-06T05:28:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c1053700 1 -- 172.21.15.29:0/40602057 learned_addr learned my addr 172.21.15.29:0/40602057 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c1854700 1 --2- 172.21.15.29:0/40602057 >> v2:172.21.15.29:3300/0 conn(0x7fc0bc06b3a0 0x7fc0bc0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0b3fff700 1 -- 172.21.15.29:0/40602057 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978189192 0 0) 0x7fc0bc0cb5f0 con 0x7fc0bc0cc9a0 2023-10-06T05:28:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0b3fff700 1 -- 172.21.15.29:0/40602057 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a8003570 con 0x7fc0bc0cc9a0 2023-10-06T05:28:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0b3fff700 1 -- 172.21.15.29:0/40602057 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545756551 0 0) 0x7fc0bc0cb8d0 con 0x7fc0bc158f80 2023-10-06T05:28:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0b3fff700 1 -- 172.21.15.29:0/40602057 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0bc0cb5f0 con 0x7fc0bc158f80 2023-10-06T05:28:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c1854700 1 -- 172.21.15.29:0/40602057 >> v1:172.21.15.173:6789/0 conn(0x7fc0bc158f80 legacy=0x7fc0bc0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c1854700 1 -- 172.21.15.29:0/40602057 >> v1:172.21.15.29:6789/0 conn(0x7fc0bc0cc9a0 legacy=0x7fc0bc158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0b3fff700 1 -- 172.21.15.29:0/40602057 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1444281043 0 0) 0x7fc0a8003570 con 0x7fc0bc0cc9a0 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c1854700 1 -- 172.21.15.29:0/40602057 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc0cbe90 con 0x7fc0bc06b3a0 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0c1854700 1 --2- 172.21.15.29:0/40602057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc06b3a0 0x7fc0bc0ccd70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80098e0 tx=0x7fc0b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28349e168c4d60c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0b3fff700 1 -- 172.21.15.29:0/40602057 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8011630 con 0x7fc0bc06b3a0 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.447+0000 7fc0b3fff700 1 -- 172.21.15.29:0/40602057 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8011790 con 0x7fc0bc06b3a0 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0b3fff700 1 -- 172.21.15.29:0/40602057 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8011b10 con 0x7fc0bc06b3a0 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 -- 172.21.15.29:0/40602057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc06b3a0 msgr2=0x7fc0bc0ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 --2- 172.21.15.29:0/40602057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc06b3a0 0x7fc0bc0ccd70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80098e0 tx=0x7fc0b80091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 -- 172.21.15.29:0/40602057 shutdown_connections 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 --2- 172.21.15.29:0/40602057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc06b3a0 0x7fc0bc0ccd70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 -- 172.21.15.29:0/40602057 >> 172.21.15.29:0/40602057 conn(0x7fc0bc067b30 msgr2=0x7fc0bc06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 -- 172.21.15.29:0/40602057 shutdown_connections 2023-10-06T05:28:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 -- 172.21.15.29:0/40602057 wait complete. 2023-10-06T05:28:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 Processor -- start 2023-10-06T05:28:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 -- start start 2023-10-06T05:28:00.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0bc06b3a0 0x7fc0bc0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc0cc9a0 0x7fc0bc16ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0bc158f80 0x7fc0bc1423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc153b50 con 0x7fc0bc0cc9a0 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc154110 con 0x7fc0bc158f80 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c2055700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc16d670 con 0x7fc0bc06b3a0 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.451+0000 7fc0c0852700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc0cc9a0 0x7fc0bc16ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c0852700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc0cc9a0 0x7fc0bc16ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46828/0 (socket says 172.21.15.29:46828) 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c0852700 1 -- 172.21.15.29:0/3876665151 learned_addr learned my addr 172.21.15.29:0/3876665151 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c1854700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0bc158f80 0x7fc0bc1423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c1053700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0bc06b3a0 0x7fc0bc0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c1854700 1 -- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0bc06b3a0 msgr2=0x7fc0bc0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c1854700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0bc06b3a0 0x7fc0bc0c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c1854700 1 -- 172.21.15.29:0/3876665151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc0cc9a0 msgr2=0x7fc0bc16ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c1854700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc0cc9a0 0x7fc0bc16ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c1854700 1 -- 172.21.15.29:0/3876665151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b8009420 con 0x7fc0bc158f80 2023-10-06T05:28:00.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c1854700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0bc158f80 0x7fc0bc1423b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8016000 tx=0x7fc0b8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0b17fa700 1 -- 172.21.15.29:0/3876665151 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8011b10 con 0x7fc0bc158f80 2023-10-06T05:28:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0b17fa700 1 -- 172.21.15.29:0/3876665151 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b801a430 con 0x7fc0bc158f80 2023-10-06T05:28:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0bc0c7b10 con 0x7fc0bc158f80 2023-10-06T05:28:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0b17fa700 1 -- 172.21.15.29:0/3876665151 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b801a7b0 con 0x7fc0bc158f80 2023-10-06T05:28:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0bc153da0 con 0x7fc0bc158f80 2023-10-06T05:28:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0bc0c8010 con 0x7fc0bc158f80 2023-10-06T05:28:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0b17fa700 1 -- 172.21.15.29:0/3876665151 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc0b801ab20 con 0x7fc0bc158f80 2023-10-06T05:28:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0b17fa700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0a0060580 0x7fc0a0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0b17fa700 1 -- 172.21.15.29:0/3876665151 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fc0b807e730 con 0x7fc0bc158f80 2023-10-06T05:28:00.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.455+0000 7fc0c1053700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0a0060580 0x7fc0a0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.459+0000 7fc0c1053700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0a0060580 0x7fc0a0062a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4001560 tx=0x7fc0b4007f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:00.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.467+0000 7fc0b17fa700 1 -- 172.21.15.29:0/3876665151 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc0b804eb80 con 0x7fc0bc158f80 2023-10-06T05:28:00.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.631+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0bc04be00 con 0x7fc0bc158f80 2023-10-06T05:28:00.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0b17fa700 1 -- 172.21.15.29:0/3876665151 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16962 (secure 0 0 0) 0x7fc0b80521a0 con 0x7fc0bc158f80 2023-10-06T05:28:00.641 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:00.641 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":50,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:27:21.749611+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:27:06.728148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T05:27:07.815762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:28:00.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0a0060580 msgr2=0x7fc0a0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0a0060580 0x7fc0a0062a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4001560 tx=0x7fc0b4007f90 comp rx=0 tx=0).stop 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0bc158f80 msgr2=0x7fc0bc1423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0bc158f80 0x7fc0bc1423b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8016000 tx=0x7fc0b8017000 comp rx=0 tx=0).stop 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 shutdown_connections 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc0a0060580 0x7fc0a0062a30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0bc158f80 0x7fc0bc1423b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0bc0cc9a0 0x7fc0bc16ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 --2- 172.21.15.29:0/3876665151 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0bc06b3a0 0x7fc0bc0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.635+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 >> 172.21.15.29:0/3876665151 conn(0x7fc0bc067b30 msgr2=0x7fc0bc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.639+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 shutdown_connections 2023-10-06T05:28:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.639+0000 7fc0c2055700 1 -- 172.21.15.29:0/3876665151 wait complete. 2023-10-06T05:28:00.656 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T05:28:00.656 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:28:00.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.751+0000 7fd0e759e700 1 Processor -- start 2023-10-06T05:28:00.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.751+0000 7fd0e759e700 1 -- start start 2023-10-06T05:28:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd0e80cb0b0 0x7fd0e806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e8068de0 con 0x7fd0e806dc10 2023-10-06T05:28:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e806e010 con 0x7fd0e8158cd0 2023-10-06T05:28:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e80681d0 con 0x7fd0e80cb0b0 2023-10-06T05:28:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e6d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd0e806dc10 0x7fd0e80c6a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46186/0 (socket says 172.21.15.29:46186) 2023-10-06T05:28:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e6d9d700 1 -- 172.21.15.29:0/2818469219 learned_addr learned my addr 172.21.15.29:0/2818469219 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e5d9b700 1 --2- 172.21.15.29:0/2818469219 >> v2:172.21.15.173:3300/0 conn(0x7fd0e80cb0b0 0x7fd0e806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e559a700 1 -- 172.21.15.29:0/2818469219 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547993630 0 0) 0x7fd0e8068de0 con 0x7fd0e806dc10 2023-10-06T05:28:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e559a700 1 -- 172.21.15.29:0/2818469219 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0d0003570 con 0x7fd0e806dc10 2023-10-06T05:28:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e559a700 1 -- 172.21.15.29:0/2818469219 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163375434 0 0) 0x7fd0d0003570 con 0x7fd0e806dc10 2023-10-06T05:28:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e5d9b700 1 -- 172.21.15.29:0/2818469219 >> v1:172.21.15.173:6789/0 conn(0x7fd0e8158cd0 legacy=0x7fd0e8067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e5d9b700 1 -- 172.21.15.29:0/2818469219 >> v1:172.21.15.29:6789/0 conn(0x7fd0e806dc10 legacy=0x7fd0e80c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e5d9b700 1 -- 172.21.15.29:0/2818469219 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80684b0 con 0x7fd0e80cb0b0 2023-10-06T05:28:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e5d9b700 1 --2- 172.21.15.29:0/2818469219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e80cb0b0 0x7fd0e806d6d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0098e0 tx=0x7fd0dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=435d09f114fc7e5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e559a700 1 -- 172.21.15.29:0/2818469219 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00017f0 con 0x7fd0e80cb0b0 2023-10-06T05:28:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e559a700 1 -- 172.21.15.29:0/2818469219 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc011420 con 0x7fd0e80cb0b0 2023-10-06T05:28:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e559a700 1 -- 172.21.15.29:0/2818469219 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0117c0 con 0x7fd0e80cb0b0 2023-10-06T05:28:00.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 -- 172.21.15.29:0/2818469219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e80cb0b0 msgr2=0x7fd0e806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 --2- 172.21.15.29:0/2818469219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e80cb0b0 0x7fd0e806d6d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0098e0 tx=0x7fd0dc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 -- 172.21.15.29:0/2818469219 shutdown_connections 2023-10-06T05:28:00.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 --2- 172.21.15.29:0/2818469219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e80cb0b0 0x7fd0e806d6d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 -- 172.21.15.29:0/2818469219 >> 172.21.15.29:0/2818469219 conn(0x7fd0e806aaf0 msgr2=0x7fd0e806aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:00.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 -- 172.21.15.29:0/2818469219 shutdown_connections 2023-10-06T05:28:00.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.755+0000 7fd0e759e700 1 -- 172.21.15.29:0/2818469219 wait complete. 2023-10-06T05:28:00.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 Processor -- start 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 -- start start 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0e806dc10 0x7fd0e80c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e8158cd0 0x7fd0e8150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0e8151120 0x7fd0e80c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e815bee0 con 0x7fd0e806dc10 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e815b3a0 con 0x7fd0e8158cd0 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e81515a0 con 0x7fd0e8151120 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0e806dc10 0x7fd0e80c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0e806dc10 0x7fd0e80c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46832/0 (socket says 172.21.15.29:46832) 2023-10-06T05:28:00.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e659c700 1 -- 172.21.15.29:0/732851864 learned_addr learned my addr 172.21.15.29:0/732851864 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:00.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e5d9b700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e8158cd0 0x7fd0e8150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e6d9d700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0e8151120 0x7fd0e80c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e659c700 1 -- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0e8151120 msgr2=0x7fd0e80c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e659c700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0e8151120 0x7fd0e80c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e659c700 1 -- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e8158cd0 msgr2=0x7fd0e8150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e659c700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e8158cd0 0x7fd0e8150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e659c700 1 -- 172.21.15.29:0/732851864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc009420 con 0x7fd0e806dc10 2023-10-06T05:28:00.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e659c700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0e806dc10 0x7fd0e80c34a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c4e0 tx=0x7fd0d800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:00.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0d67fc700 1 -- 172.21.15.29:0/732851864 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8011590 con 0x7fd0e806dc10 2023-10-06T05:28:00.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0d67fc700 1 -- 172.21.15.29:0/732851864 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d8011710 con 0x7fd0e806dc10 2023-10-06T05:28:00.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e815b640 con 0x7fd0e806dc10 2023-10-06T05:28:00.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0d67fc700 1 -- 172.21.15.29:0/732851864 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8011ad0 con 0x7fd0e806dc10 2023-10-06T05:28:00.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.759+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e815bc00 con 0x7fd0e806dc10 2023-10-06T05:28:00.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.763+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e804be00 con 0x7fd0e806dc10 2023-10-06T05:28:00.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.763+0000 7fd0d67fc700 1 -- 172.21.15.29:0/732851864 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd0d801b3b0 con 0x7fd0e806dc10 2023-10-06T05:28:00.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.763+0000 7fd0d67fc700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd0c8060550 0x7fd0c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:00.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.763+0000 7fd0d67fc700 1 -- 172.21.15.29:0/732851864 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd0d807bdd0 con 0x7fd0e806dc10 2023-10-06T05:28:00.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.763+0000 7fd0e5d9b700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd0c8060550 0x7fd0c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:00.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.763+0000 7fd0e5d9b700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd0c8060550 0x7fd0c8062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0091e0 tx=0x7fd0dc016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:00.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.771+0000 7fd0d67fc700 1 -- 172.21.15.29:0/732851864 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd0d804c220 con 0x7fd0e806dc10 2023-10-06T05:28:00.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.967+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0e80af070 con 0x7fd0e806dc10 2023-10-06T05:28:00.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.967+0000 7fd0d67fc700 1 -- 172.21.15.29:0/732851864 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fd0d8017020 con 0x7fd0e806dc10 2023-10-06T05:28:00.975 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:00.975 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3538089078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3538089078},{"type":"v1","addr":"172.21.15.173:6835","nonce":3538089078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3499370562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3499370562},{"type":"v1","addr":"172.21.15.173:6837","nonce":3499370562}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3369448997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3369448997},{"type":"v1","addr":"172.21.15.29:6833","nonce":3369448997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:27:08.808178+0000","modified":"2023-10-06T05:27:12.494062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5460":{"gid":5460,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2111647358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2111647358},{"type":"v1","addr":"172.21.15.29:6835","nonce":2111647358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T05:28:00.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd0c8060550 msgr2=0x7fd0c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd0c8060550 0x7fd0c8062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0091e0 tx=0x7fd0dc016000 comp rx=0 tx=0).stop 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0e806dc10 msgr2=0x7fd0e80c34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0e806dc10 0x7fd0e80c34a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c4e0 tx=0x7fd0d800c7f0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 shutdown_connections 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0e8151120 0x7fd0e80c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd0c8060550 0x7fd0c8062a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e8158cd0 0x7fd0e8150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 --2- 172.21.15.29:0/732851864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0e806dc10 0x7fd0e80c34a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 >> 172.21.15.29:0/732851864 conn(0x7fd0e806aaf0 msgr2=0x7fd0e815dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:00.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 shutdown_connections 2023-10-06T05:28:00.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:00.971+0000 7fd0e759e700 1 -- 172.21.15.29:0/732851864 wait complete. 2023-10-06T05:28:00.979 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 21 2023-10-06T05:28:00.989 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:28:01.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.087+0000 7fee90b20700 1 Processor -- start 2023-10-06T05:28:01.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.087+0000 7fee90b20700 1 -- start start 2023-10-06T05:28:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.087+0000 7fee90b20700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee8c159fe0 0x7fee8c06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.087+0000 7fee90b20700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fee8c0cfb60 0x7fee8c0cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.087+0000 7fee90b20700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8c0cee50 con 0x7fee8c158c00 2023-10-06T05:28:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.087+0000 7fee90b20700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c06b250 con 0x7fee8c159fe0 2023-10-06T05:28:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.087+0000 7fee90b20700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c06a640 con 0x7fee8c0cfb60 2023-10-06T05:28:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.087+0000 7fee8affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee8c159fe0 0x7fee8c06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee8c159fe0 0x7fee8c06b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46838/0 (socket says 172.21.15.29:46838) 2023-10-06T05:28:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8affd700 1 -- 172.21.15.29:0/3328913053 learned_addr learned my addr 172.21.15.29:0/3328913053 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8bfff700 1 --2- 172.21.15.29:0/3328913053 >> v2:172.21.15.173:3300/0 conn(0x7fee8c0cfb60 0x7fee8c0cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8affd700 1 -- 172.21.15.29:0/3328913053 >> v2:172.21.15.173:3300/0 conn(0x7fee8c0cfb60 msgr2=0x7fee8c0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8affd700 1 --2- 172.21.15.29:0/3328913053 >> v2:172.21.15.173:3300/0 conn(0x7fee8c0cfb60 0x7fee8c0cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8affd700 1 -- 172.21.15.29:0/3328913053 >> v1:172.21.15.173:6789/0 conn(0x7fee8c158c00 legacy=0x7fee8c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8affd700 1 -- 172.21.15.29:0/3328913053 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c06a920 con 0x7fee8c159fe0 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8affd700 1 --2- 172.21.15.29:0/3328913053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 0x7fee8c06b6e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0b5dd0 tx=0x7fee74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be1459c75beeba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8a7fc700 1 -- 172.21.15.29:0/3328913053 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74009e70 con 0x7fee8c159fe0 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8a7fc700 1 -- 172.21.15.29:0/3328913053 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7400b860 con 0x7fee8c159fe0 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee8a7fc700 1 -- 172.21.15.29:0/3328913053 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7400bc00 con 0x7fee8c159fe0 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 -- 172.21.15.29:0/3328913053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 msgr2=0x7fee8c06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 --2- 172.21.15.29:0/3328913053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 0x7fee8c06b6e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0b5dd0 tx=0x7fee74009250 comp rx=0 tx=0).stop 2023-10-06T05:28:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 -- 172.21.15.29:0/3328913053 shutdown_connections 2023-10-06T05:28:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 --2- 172.21.15.29:0/3328913053 >> v2:172.21.15.173:3300/0 conn(0x7fee8c0cfb60 0x7fee8c0cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 --2- 172.21.15.29:0/3328913053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 0x7fee8c06b6e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 -- 172.21.15.29:0/3328913053 >> 172.21.15.29:0/3328913053 conn(0x7fee8c0670a0 msgr2=0x7fee8c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 -- 172.21.15.29:0/3328913053 shutdown_connections 2023-10-06T05:28:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 -- 172.21.15.29:0/3328913053 wait complete. 2023-10-06T05:28:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 Processor -- start 2023-10-06T05:28:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.091+0000 7fee90b20700 1 -- start start 2023-10-06T05:28:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee90b20700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee8c0cfb60 0x7fee8c0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee90b20700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee8c158c00 0x7fee8c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee90b20700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 0x7fee8c14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee90b20700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0b3c00 con 0x7fee8c159fe0 2023-10-06T05:28:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee90b20700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0b41f0 con 0x7fee8c158c00 2023-10-06T05:28:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee90b20700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c14e2c0 con 0x7fee8c0cfb60 2023-10-06T05:28:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 0x7fee8c14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 0x7fee8c14dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46846/0 (socket says 172.21.15.29:46846) 2023-10-06T05:28:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8bfff700 1 -- 172.21.15.29:0/1368455804 learned_addr learned my addr 172.21.15.29:0/1368455804 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8b7fe700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee8c0cfb60 0x7fee8c0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8affd700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee8c158c00 0x7fee8c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8bfff700 1 -- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee8c0cfb60 msgr2=0x7fee8c0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8bfff700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee8c0cfb60 0x7fee8c0b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8bfff700 1 -- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee8c158c00 msgr2=0x7fee8c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8bfff700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee8c158c00 0x7fee8c154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8bfff700 1 -- 172.21.15.29:0/1368455804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740094f0 con 0x7fee8c159fe0 2023-10-06T05:28:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8affd700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee8c158c00 0x7fee8c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee8bfff700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 0x7fee8c14dd80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fee84009df0 tx=0x7fee8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee837fe700 1 -- 172.21.15.29:0/1368455804 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400caa0 con 0x7fee8c159fe0 2023-10-06T05:28:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee837fe700 1 -- 172.21.15.29:0/1368455804 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8400f040 con 0x7fee8c159fe0 2023-10-06T05:28:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8c0b3360 con 0x7fee8c159fe0 2023-10-06T05:28:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee837fe700 1 -- 172.21.15.29:0/1368455804 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400ce70 con 0x7fee8c159fe0 2023-10-06T05:28:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.095+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8c0b3920 con 0x7fee8c159fe0 2023-10-06T05:28:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.099+0000 7fee837fe700 1 -- 172.21.15.29:0/1368455804 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fee84014690 con 0x7fee8c159fe0 2023-10-06T05:28:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.099+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8c04be00 con 0x7fee8c159fe0 2023-10-06T05:28:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.099+0000 7fee837fe700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fee70060580 0x7fee70062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.099+0000 7fee837fe700 1 -- 172.21.15.29:0/1368455804 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fee8407d0f0 con 0x7fee8c159fe0 2023-10-06T05:28:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.099+0000 7fee8b7fe700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fee70060580 0x7fee70062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.099+0000 7fee8b7fe700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fee70060580 0x7fee70062a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fee7c0039f0 tx=0x7fee7c007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:01.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.107+0000 7fee837fe700 1 -- 172.21.15.29:0/1368455804 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fee84050fd0 con 0x7fee8c159fe0 2023-10-06T05:28:01.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee8c06c040 con 0x7fee8c159fe0 2023-10-06T05:28:01.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee837fe700 1 -- 172.21.15.29:0/1368455804 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fee84050b60 con 0x7fee8c159fe0 2023-10-06T05:28:01.305 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:01.305 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3538089078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3538089078},{"type":"v1","addr":"172.21.15.173:6835","nonce":3538089078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3499370562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3499370562},{"type":"v1","addr":"172.21.15.173:6837","nonce":3499370562}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3369448997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3369448997},{"type":"v1","addr":"172.21.15.29:6833","nonce":3369448997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:27:08.808178+0000","modified":"2023-10-06T05:27:12.494062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5460":{"gid":5460,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2111647358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2111647358},{"type":"v1","addr":"172.21.15.29:6835","nonce":2111647358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T05:28:01.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fee70060580 msgr2=0x7fee70062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fee70060580 0x7fee70062a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fee7c0039f0 tx=0x7fee7c007ec0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 msgr2=0x7fee8c14dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 0x7fee8c14dd80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fee84009df0 tx=0x7fee8400b040 comp rx=0 tx=0).stop 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 shutdown_connections 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee8c159fe0 0x7fee8c14dd80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fee70060580 0x7fee70062a30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee8c158c00 0x7fee8c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 --2- 172.21.15.29:0/1368455804 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee8c0cfb60 0x7fee8c0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 >> 172.21.15.29:0/1368455804 conn(0x7fee8c0670a0 msgr2=0x7fee8c0cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 shutdown_connections 2023-10-06T05:28:01.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.299+0000 7fee90b20700 1 -- 172.21.15.29:0/1368455804 wait complete. 2023-10-06T05:28:01.309 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 21 2023-10-06T05:28:01.318 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:28:01.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.415+0000 7f19b983c700 1 Processor -- start 2023-10-06T05:28:01.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 -- start start 2023-10-06T05:28:01.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b41569f0 0x7f19b40ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f19b4156dc0 0x7f19b415a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b406a5b0 con 0x7f19b40c68b0 2023-10-06T05:28:01.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b415b0a0 con 0x7f19b4156dc0 2023-10-06T05:28:01.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b415b380 con 0x7f19b41569f0 2023-10-06T05:28:01.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b903b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f19b40c68b0 0x7f19b406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46200/0 (socket says 172.21.15.29:46200) 2023-10-06T05:28:01.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b903b700 1 -- 172.21.15.29:0/3830372882 learned_addr learned my addr 172.21.15.29:0/3830372882 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:01.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b3fff700 1 --2- 172.21.15.29:0/3830372882 >> v2:172.21.15.173:3300/0 conn(0x7f19b4156dc0 0x7f19b415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b883a700 1 --2- 172.21.15.29:0/3830372882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b41569f0 0x7f19b40ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b37fe700 1 -- 172.21.15.29:0/3830372882 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7166025 0 0) 0x7f19b406a5b0 con 0x7f19b40c68b0 2023-10-06T05:28:01.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b37fe700 1 -- 172.21.15.29:0/3830372882 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a0003570 con 0x7f19b40c68b0 2023-10-06T05:28:01.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b3fff700 1 -- 172.21.15.29:0/3830372882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b41569f0 msgr2=0x7f19b40ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:01.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b3fff700 1 --2- 172.21.15.29:0/3830372882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b41569f0 0x7f19b40ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b3fff700 1 -- 172.21.15.29:0/3830372882 >> v1:172.21.15.29:6789/0 conn(0x7f19b40c68b0 legacy=0x7f19b406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b3fff700 1 -- 172.21.15.29:0/3830372882 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b415b660 con 0x7f19b4156dc0 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b3fff700 1 --2- 172.21.15.29:0/3830372882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b4156dc0 0x7f19b415a870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f199c0098e0 tx=0x7f199c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ccd48f9ffb2481 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b37fe700 1 -- 172.21.15.29:0/3830372882 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c011630 con 0x7f19b4156dc0 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b37fe700 1 -- 172.21.15.29:0/3830372882 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c011790 con 0x7f19b4156dc0 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b37fe700 1 -- 172.21.15.29:0/3830372882 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c011b30 con 0x7f19b4156dc0 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 -- 172.21.15.29:0/3830372882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b4156dc0 msgr2=0x7f19b415a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 --2- 172.21.15.29:0/3830372882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b4156dc0 0x7f19b415a870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f199c0098e0 tx=0x7f199c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 -- 172.21.15.29:0/3830372882 shutdown_connections 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 --2- 172.21.15.29:0/3830372882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b4156dc0 0x7f19b415a870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 --2- 172.21.15.29:0/3830372882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b41569f0 0x7f19b40ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 -- 172.21.15.29:0/3830372882 >> 172.21.15.29:0/3830372882 conn(0x7f19b40670a0 msgr2=0x7f19b40674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:01.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 -- 172.21.15.29:0/3830372882 shutdown_connections 2023-10-06T05:28:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.419+0000 7f19b983c700 1 -- 172.21.15.29:0/3830372882 wait complete. 2023-10-06T05:28:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 Processor -- start 2023-10-06T05:28:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 -- start start 2023-10-06T05:28:01.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b40c68b0 0x7f19b40b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19b41569f0 0x7f19b40c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b4156dc0 0x7f19b40acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40b16c0 con 0x7f19b41569f0 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b41590d0 con 0x7f19b4156dc0 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40c3430 con 0x7f19b40c68b0 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19b41569f0 0x7f19b40c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19b41569f0 0x7f19b40c2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46850/0 (socket says 172.21.15.29:46850) 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b3fff700 1 -- 172.21.15.29:0/2928978766 learned_addr learned my addr 172.21.15.29:0/2928978766 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b903b700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b4156dc0 0x7f19b40acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b883a700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b40c68b0 0x7f19b40b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b3fff700 1 -- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b40c68b0 msgr2=0x7f19b40b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b3fff700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b40c68b0 0x7f19b40b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b3fff700 1 -- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b4156dc0 msgr2=0x7f19b40acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b3fff700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b4156dc0 0x7f19b40acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b3fff700 1 -- 172.21.15.29:0/2928978766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c009420 con 0x7f19b41569f0 2023-10-06T05:28:01.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b3fff700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19b41569f0 0x7f19b40c2980 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f19b406df30 tx=0x7f199c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:01.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b0ff9700 1 -- 172.21.15.29:0/2928978766 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c011b10 con 0x7f19b41569f0 2023-10-06T05:28:01.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b0ff9700 1 -- 172.21.15.29:0/2928978766 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0253f0 con 0x7f19b41569f0 2023-10-06T05:28:01.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b40c3710 con 0x7f19b41569f0 2023-10-06T05:28:01.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b0ff9700 1 -- 172.21.15.29:0/2928978766 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c025790 con 0x7f19b41569f0 2023-10-06T05:28:01.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.423+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b4158d10 con 0x7f19b41569f0 2023-10-06T05:28:01.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.427+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b4159240 con 0x7f19b41569f0 2023-10-06T05:28:01.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.431+0000 7f19b0ff9700 1 -- 172.21.15.29:0/2928978766 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f199c025b00 con 0x7f19b41569f0 2023-10-06T05:28:01.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.431+0000 7f19b0ff9700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1994060580 0x7f1994062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.431+0000 7f19b0ff9700 1 -- 172.21.15.29:0/2928978766 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f199c07ec90 con 0x7f19b41569f0 2023-10-06T05:28:01.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.431+0000 7f19b883a700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1994060580 0x7f1994062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.431+0000 7f19b883a700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1994060580 0x7f1994062a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009c10 tx=0x7f19a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:01.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.439+0000 7f19b0ff9700 1 -- 172.21.15.29:0/2928978766 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f199c04f190 con 0x7f19b41569f0 2023-10-06T05:28:01.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.603+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19b404be00 con 0x7f19b41569f0 2023-10-06T05:28:01.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.607+0000 7f19b0ff9700 1 -- 172.21.15.29:0/2928978766 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16962 (secure 0 0 0) 0x7f199c025db0 con 0x7f19b41569f0 2023-10-06T05:28:01.614 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":50,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:27:21.749611+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:27:06.728148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T05:27:07.815762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:28:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.607+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1994060580 msgr2=0x7f1994062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.607+0000 7f19b983c700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1994060580 0x7f1994062a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009c10 tx=0x7f19a4008040 comp rx=0 tx=0).stop 2023-10-06T05:28:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.607+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19b41569f0 msgr2=0x7f19b40c2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.607+0000 7f19b983c700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19b41569f0 0x7f19b40c2980 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f19b406df30 tx=0x7f199c017000 comp rx=0 tx=0).stop 2023-10-06T05:28:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.607+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 shutdown_connections 2023-10-06T05:28:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.611+0000 7f19b983c700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1994060580 0x7f1994062a30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.611+0000 7f19b983c700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19b4156dc0 0x7f19b40acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.611+0000 7f19b983c700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19b41569f0 0x7f19b40c2980 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.611+0000 7f19b983c700 1 --2- 172.21.15.29:0/2928978766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19b40c68b0 0x7f19b40b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.611+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 >> 172.21.15.29:0/2928978766 conn(0x7f19b40670a0 msgr2=0x7f19b4151190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:01.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.611+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 shutdown_connections 2023-10-06T05:28:01.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.611+0000 7f19b983c700 1 -- 172.21.15.29:0/2928978766 wait complete. 2023-10-06T05:28:01.628 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T05:28:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75759e700 1 Processor -- start 2023-10-06T05:28:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75759e700 1 -- start start 2023-10-06T05:28:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75806b620 0x7fc7580ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75806b190 con 0x7fc758158b50 2023-10-06T05:28:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75806a580 con 0x7fc7580ce960 2023-10-06T05:28:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75806a860 con 0x7fc75806b620 2023-10-06T05:28:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75659c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc758158b50 0x7fc7580ce250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46204/0 (socket says 172.21.15.29:46204) 2023-10-06T05:28:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75659c700 1 -- 172.21.15.29:0/1180124813 learned_addr learned my addr 172.21.15.29:0/1180124813 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc756d9d700 1 --2- 172.21.15.29:0/1180124813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75806b620 0x7fc7580ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75559a700 1 -- 172.21.15.29:0/1180124813 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621901356 0 0) 0x7fc75806b190 con 0x7fc758158b50 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.731+0000 7fc75559a700 1 -- 172.21.15.29:0/1180124813 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc744003570 con 0x7fc758158b50 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75559a700 1 -- 172.21.15.29:0/1180124813 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606874912 0 0) 0x7fc75806a580 con 0x7fc7580ce960 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75559a700 1 -- 172.21.15.29:0/1180124813 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc75806b190 con 0x7fc7580ce960 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75559a700 1 -- 172.21.15.29:0/1180124813 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1050608004 0 0) 0x7fc744003570 con 0x7fc758158b50 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc756d9d700 1 -- 172.21.15.29:0/1180124813 >> v1:172.21.15.173:6789/0 conn(0x7fc7580ce960 legacy=0x7fc7580cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc756d9d700 1 -- 172.21.15.29:0/1180124813 >> v1:172.21.15.29:6789/0 conn(0x7fc758158b50 legacy=0x7fc7580ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc756d9d700 1 -- 172.21.15.29:0/1180124813 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75806ab40 con 0x7fc75806b620 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc756d9d700 1 --2- 172.21.15.29:0/1180124813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75806b620 0x7fc7580ccf20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc750009e90 tx=0x7fc750009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e4e9007f66c283d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:01.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75559a700 1 -- 172.21.15.29:0/1180124813 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75000e070 con 0x7fc75806b620 2023-10-06T05:28:01.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75559a700 1 -- 172.21.15.29:0/1180124813 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75000b870 con 0x7fc75806b620 2023-10-06T05:28:01.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75559a700 1 -- 172.21.15.29:0/1180124813 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748001470 con 0x7fc75806b620 2023-10-06T05:28:01.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75759e700 1 -- 172.21.15.29:0/1180124813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75806b620 msgr2=0x7fc7580ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75759e700 1 --2- 172.21.15.29:0/1180124813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75806b620 0x7fc7580ccf20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc750009e90 tx=0x7fc750009780 comp rx=0 tx=0).stop 2023-10-06T05:28:01.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75759e700 1 -- 172.21.15.29:0/1180124813 shutdown_connections 2023-10-06T05:28:01.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75759e700 1 --2- 172.21.15.29:0/1180124813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc75806b620 0x7fc7580ccf20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75759e700 1 -- 172.21.15.29:0/1180124813 >> 172.21.15.29:0/1180124813 conn(0x7fc75806c6c0 msgr2=0x7fc75806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:01.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75759e700 1 -- 172.21.15.29:0/1180124813 shutdown_connections 2023-10-06T05:28:01.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.735+0000 7fc75759e700 1 -- 172.21.15.29:0/1180124813 wait complete. 2023-10-06T05:28:01.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 Processor -- start 2023-10-06T05:28:01.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 -- start start 2023-10-06T05:28:01.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc75806b620 0x7fc758154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7580ce960 0x7fc75815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc758158b50 0x7fc7580b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580b2ff0 con 0x7fc75806b620 2023-10-06T05:28:01.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758169400 con 0x7fc758158b50 2023-10-06T05:28:01.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581696e0 con 0x7fc7580ce960 2023-10-06T05:28:01.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc75806b620 0x7fc758154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc75806b620 0x7fc758154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46852/0 (socket says 172.21.15.29:46852) 2023-10-06T05:28:01.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75659c700 1 -- 172.21.15.29:0/2626669941 learned_addr learned my addr 172.21.15.29:0/2626669941 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:01.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc756d9d700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc758158b50 0x7fc7580b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc755d9b700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7580ce960 0x7fc75815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75659c700 1 -- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7580ce960 msgr2=0x7fc75815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75659c700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7580ce960 0x7fc75815a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75659c700 1 -- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc758158b50 msgr2=0x7fc7580b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75659c700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc758158b50 0x7fc7580b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75659c700 1 -- 172.21.15.29:0/2626669941 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc750009a20 con 0x7fc75806b620 2023-10-06T05:28:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75659c700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc75806b620 0x7fc758154550 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc74800cb70 tx=0x7fc748001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc74e7fc700 1 -- 172.21.15.29:0/2626669941 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748001d20 con 0x7fc75806b620 2023-10-06T05:28:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc74e7fc700 1 -- 172.21.15.29:0/2626669941 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748007360 con 0x7fc75806b620 2023-10-06T05:28:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7581699c0 con 0x7fc75806b620 2023-10-06T05:28:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc74e7fc700 1 -- 172.21.15.29:0/2626669941 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748004830 con 0x7fc75806b620 2023-10-06T05:28:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.739+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75815ae50 con 0x7fc75806b620 2023-10-06T05:28:01.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.743+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75804be00 con 0x7fc75806b620 2023-10-06T05:28:01.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.743+0000 7fc74e7fc700 1 -- 172.21.15.29:0/2626669941 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc748004be0 con 0x7fc75806b620 2023-10-06T05:28:01.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.743+0000 7fc74e7fc700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc738060550 0x7fc738062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:01.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.743+0000 7fc74e7fc700 1 -- 172.21.15.29:0/2626669941 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fc74807bcf0 con 0x7fc75806b620 2023-10-06T05:28:01.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.743+0000 7fc755d9b700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc738060550 0x7fc738062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:01.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.743+0000 7fc755d9b700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc738060550 0x7fc738062a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc758154a90 tx=0x7fc740009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:01.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.747+0000 7fc74e7fc700 1 -- 172.21.15.29:0/2626669941 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc748080070 con 0x7fc75806b620 2023-10-06T05:28:01.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.943+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc7580c5f00 con 0x7fc75806b620 2023-10-06T05:28:02.101 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-06T05:28:01.943+0000 7fe44aab2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T05:28:02.102 INFO:tasks.ceph.mds.c.smithi029.stderr: -4592> 2023-10-06T05:27:14.080+0000 7f1371a92700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:28:02.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.955+0000 7fc74e7fc700 1 -- 172.21.15.29:0/2626669941 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc748018090 con 0x7fc75806b620 2023-10-06T05:28:02.102 INFO:tasks.ceph.mds.c.smithi029.stderr: -2824> 2023-10-06T05:27:26.611+0000 7f136e28b700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5643=0-4194304@1} caps={5643=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5643 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x559969b93b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc738060550 msgr2=0x7fc738062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc738060550 0x7fc738062a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc758154a90 tx=0x7fc740009040 comp rx=0 tx=0).stop 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc75806b620 msgr2=0x7fc758154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc75806b620 0x7fc758154550 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc74800cb70 tx=0x7fc748001ab0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 shutdown_connections 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc738060550 0x7fc738062a00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc758158b50 0x7fc7580b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7580ce960 0x7fc75815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 --2- 172.21.15.29:0/2626669941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc75806b620 0x7fc758154550 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 >> 172.21.15.29:0/2626669941 conn(0x7fc75806c6c0 msgr2=0x7fc75815c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 shutdown_connections 2023-10-06T05:28:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:01.959+0000 7fc75759e700 1 -- 172.21.15.29:0/2626669941 wait complete. 2023-10-06T05:28:02.105 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T05:28:02.105 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T05:28:02.105 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:28:02.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb1665d3700 1 Processor -- start 2023-10-06T05:28:02.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb1665d3700 1 -- start start 2023-10-06T05:28:02.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb1665d3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb160156810 0x7fb1600ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:02.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb1665d3700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb1600ccaf0 0x7fb160159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:02.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb1665d3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600c7830 con 0x7fb160156be0 2023-10-06T05:28:02.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb1665d3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16015a400 con 0x7fb160156810 2023-10-06T05:28:02.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb1665d3700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1600cab50 con 0x7fb1600ccaf0 2023-10-06T05:28:02.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb1655d1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb160156810 0x7fb1600ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:02.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb165dd2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb160156be0 0x7fb1600c8890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46220/0 (socket says 172.21.15.29:46220) 2023-10-06T05:28:02.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb165dd2700 1 -- 172.21.15.29:0/1293918116 learned_addr learned my addr 172.21.15.29:0/1293918116 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:02.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.219+0000 7fb164dd0700 1 --2- 172.21.15.29:0/1293918116 >> v2:172.21.15.173:3300/0 conn(0x7fb1600ccaf0 0x7fb160159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1655d1700 1 -- 172.21.15.29:0/1293918116 >> v2:172.21.15.173:3300/0 conn(0x7fb1600ccaf0 msgr2=0x7fb160159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1655d1700 1 --2- 172.21.15.29:0/1293918116 >> v2:172.21.15.173:3300/0 conn(0x7fb1600ccaf0 0x7fb160159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb15ffff700 1 -- 172.21.15.29:0/1293918116 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75153912 0 0) 0x7fb1600c7830 con 0x7fb160156be0 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1655d1700 1 -- 172.21.15.29:0/1293918116 >> v1:172.21.15.29:6789/0 conn(0x7fb160156be0 legacy=0x7fb1600c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1655d1700 1 -- 172.21.15.29:0/1293918116 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600cc010 con 0x7fb160156810 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1655d1700 1 --2- 172.21.15.29:0/1293918116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 0x7fb1600ca450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb1600cb720 tx=0x7fb158009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16b98ca584c8d37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb15ffff700 1 -- 172.21.15.29:0/1293918116 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15800e070 con 0x7fb160156810 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb15ffff700 1 -- 172.21.15.29:0/1293918116 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15800bc30 con 0x7fb160156810 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb15ffff700 1 -- 172.21.15.29:0/1293918116 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158012430 con 0x7fb160156810 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 -- 172.21.15.29:0/1293918116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 msgr2=0x7fb1600ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 --2- 172.21.15.29:0/1293918116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 0x7fb1600ca450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb1600cb720 tx=0x7fb158009780 comp rx=0 tx=0).stop 2023-10-06T05:28:02.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 -- 172.21.15.29:0/1293918116 shutdown_connections 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 --2- 172.21.15.29:0/1293918116 >> v2:172.21.15.173:3300/0 conn(0x7fb1600ccaf0 0x7fb160159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 --2- 172.21.15.29:0/1293918116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 0x7fb1600ca450 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 -- 172.21.15.29:0/1293918116 >> 172.21.15.29:0/1293918116 conn(0x7fb1600670a0 msgr2=0x7fb1600674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 -- 172.21.15.29:0/1293918116 shutdown_connections 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 -- 172.21.15.29:0/1293918116 wait complete. 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 Processor -- start 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.223+0000 7fb1665d3700 1 -- start start 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1665d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 0x7fb16014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1665d3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb160156be0 0x7fb1600af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1665d3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1600af900 0x7fb1600c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1665d3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600afd80 con 0x7fb160156810 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1665d3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600c5860 con 0x7fb1600af900 2023-10-06T05:28:02.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1665d3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600c4c50 con 0x7fb160156be0 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1655d1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 0x7fb16014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1655d1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 0x7fb16014fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46882/0 (socket says 172.21.15.29:46882) 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1655d1700 1 -- 172.21.15.29:0/2386501146 learned_addr learned my addr 172.21.15.29:0/2386501146 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb164dd0700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb160156be0 0x7fb1600af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb165dd2700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1600af900 0x7fb1600c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1655d1700 1 -- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb160156be0 msgr2=0x7fb1600af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1655d1700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb160156be0 0x7fb1600af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1655d1700 1 -- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1600af900 msgr2=0x7fb1600c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1655d1700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1600af900 0x7fb1600c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1655d1700 1 -- 172.21.15.29:0/2386501146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158009a20 con 0x7fb160156810 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1655d1700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 0x7fb16014fa40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb158013000 tx=0x7fb158019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:02.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb15d7fa700 1 -- 172.21.15.29:0/2386501146 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158012e60 con 0x7fb160156810 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb15d7fa700 1 -- 172.21.15.29:0/2386501146 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15801d630 con 0x7fb160156810 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1600c4f30 con 0x7fb160156810 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb15d7fa700 1 -- 172.21.15.29:0/2386501146 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15801d9f0 con 0x7fb160156810 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1600c54f0 con 0x7fb160156810 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.227+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16004be00 con 0x7fb160156810 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.231+0000 7fb15d7fa700 1 -- 172.21.15.29:0/2386501146 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb158024070 con 0x7fb160156810 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.231+0000 7fb15d7fa700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb14c060550 0x7fb14c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.231+0000 7fb15d7fa700 1 -- 172.21.15.29:0/2386501146 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fb15807f3b0 con 0x7fb160156810 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.231+0000 7fb164dd0700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb14c060550 0x7fb14c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.231+0000 7fb164dd0700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb14c060550 0x7fb14c062a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb1600c3530 tx=0x7fb154008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:02.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.239+0000 7fb15d7fa700 1 -- 172.21.15.29:0/2386501146 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb15804f7b0 con 0x7fb160156810 2023-10-06T05:28:02.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.439+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb1600c7550 con 0x7fb160156810 2023-10-06T05:28:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.955+0000 7fb15d7fa700 1 -- 172.21.15.29:0/2386501146 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb158052dd0 con 0x7fb160156810 2023-10-06T05:28:02.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb14c060550 msgr2=0x7fb14c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:02.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb14c060550 0x7fb14c062a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb1600c3530 tx=0x7fb154008040 comp rx=0 tx=0).stop 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 msgr2=0x7fb16014fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 0x7fb16014fa40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb158013000 tx=0x7fb158019000 comp rx=0 tx=0).stop 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 shutdown_connections 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb14c060550 0x7fb14c062a00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1600af900 0x7fb1600c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb160156be0 0x7fb1600af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 --2- 172.21.15.29:0/2386501146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb160156810 0x7fb16014fa40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.959+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 >> 172.21.15.29:0/2386501146 conn(0x7fb1600670a0 msgr2=0x7fb160070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.963+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 shutdown_connections 2023-10-06T05:28:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:02.963+0000 7fb1665d3700 1 -- 172.21.15.29:0/2386501146 wait complete. 2023-10-06T05:28:02.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T05:28:03.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.099+0000 7f11608de700 1 Processor -- start 2023-10-06T05:28:03.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.099+0000 7f11608de700 1 -- start start 2023-10-06T05:28:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f11608de700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f115c156b50 0x7f115c0c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f11608de700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0cada0 0x7f115c0ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f11608de700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115c0c4380 con 0x7f115c0c9220 2023-10-06T05:28:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f11608de700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115c0c4810 con 0x7f115c156b50 2023-10-06T05:28:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f11608de700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0c3770 con 0x7f115c0cada0 2023-10-06T05:28:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f1153fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f115c0c9220 0x7f115c0ca690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46228/0 (socket says 172.21.15.29:46228) 2023-10-06T05:28:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f1153fff700 1 -- 172.21.15.29:0/180703012 learned_addr learned my addr 172.21.15.29:0/180703012 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f115c156b50 0x7f115c0c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115b59e700 1 --2- 172.21.15.29:0/180703012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0cada0 0x7f115c0ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115a59c700 1 -- 172.21.15.29:0/180703012 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463765409 0 0) 0x7f115c0c4380 con 0x7f115c0c9220 2023-10-06T05:28:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115a59c700 1 -- 172.21.15.29:0/180703012 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f113c003570 con 0x7f115c0c9220 2023-10-06T05:28:03.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115ad9d700 1 -- 172.21.15.29:0/180703012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0cada0 msgr2=0x7f115c0ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:03.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115ad9d700 1 --2- 172.21.15.29:0/180703012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0cada0 0x7f115c0ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115ad9d700 1 -- 172.21.15.29:0/180703012 >> v1:172.21.15.29:6789/0 conn(0x7f115c0c9220 legacy=0x7f115c0ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:03.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115ad9d700 1 -- 172.21.15.29:0/180703012 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0c3a50 con 0x7f115c156b50 2023-10-06T05:28:03.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115ad9d700 1 --2- 172.21.15.29:0/180703012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c156b50 0x7f115c0c8ce0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f114c0098e0 tx=0x7f114c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c021673ea19a0fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:03.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115a59c700 1 -- 172.21.15.29:0/180703012 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c011630 con 0x7f115c156b50 2023-10-06T05:28:03.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115a59c700 1 -- 172.21.15.29:0/180703012 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c011790 con 0x7f115c156b50 2023-10-06T05:28:03.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f115a59c700 1 -- 172.21.15.29:0/180703012 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c011b30 con 0x7f115c156b50 2023-10-06T05:28:03.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f11608de700 1 -- 172.21.15.29:0/180703012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c156b50 msgr2=0x7f115c0c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:03.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f11608de700 1 --2- 172.21.15.29:0/180703012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c156b50 0x7f115c0c8ce0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f114c0098e0 tx=0x7f114c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.103+0000 7f11608de700 1 -- 172.21.15.29:0/180703012 shutdown_connections 2023-10-06T05:28:03.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 --2- 172.21.15.29:0/180703012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0cada0 0x7f115c0ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 --2- 172.21.15.29:0/180703012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c156b50 0x7f115c0c8ce0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 -- 172.21.15.29:0/180703012 >> 172.21.15.29:0/180703012 conn(0x7f115c069d50 msgr2=0x7f115c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:03.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 -- 172.21.15.29:0/180703012 shutdown_connections 2023-10-06T05:28:03.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 -- 172.21.15.29:0/180703012 wait complete. 2023-10-06T05:28:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 Processor -- start 2023-10-06T05:28:03.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 -- start start 2023-10-06T05:28:03.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0c9220 0x7f115c150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:03.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f115c0cada0 0x7f115c0c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:03.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c155b60 0x7f115c167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:03.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0c6050 con 0x7f115c155b60 2023-10-06T05:28:03.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0c5050 con 0x7f115c0cada0 2023-10-06T05:28:03.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.107+0000 7f11608de700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c156120 con 0x7f115c0c9220 2023-10-06T05:28:03.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c155b60 0x7f115c167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:03.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c155b60 0x7f115c167cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46900/0 (socket says 172.21.15.29:46900) 2023-10-06T05:28:03.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115b59e700 1 -- 172.21.15.29:0/3920975171 learned_addr learned my addr 172.21.15.29:0/3920975171 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:03.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115ad9d700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0c9220 0x7f115c150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:03.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f1153fff700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f115c0cada0 0x7f115c0c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:03.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115b59e700 1 -- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0c9220 msgr2=0x7f115c150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:03.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115b59e700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0c9220 0x7f115c150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115b59e700 1 -- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f115c0cada0 msgr2=0x7f115c0c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:03.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115b59e700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f115c0cada0 0x7f115c0c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115b59e700 1 -- 172.21.15.29:0/3920975171 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c009420 con 0x7f115c155b60 2023-10-06T05:28:03.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f115b59e700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c155b60 0x7f115c167cc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1154009ec0 tx=0x7f115400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:03.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f1152ffd700 1 -- 172.21.15.29:0/3920975171 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115400cb70 con 0x7f115c155b60 2023-10-06T05:28:03.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f1152ffd700 1 -- 172.21.15.29:0/3920975171 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115400f040 con 0x7f115c155b60 2023-10-06T05:28:03.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115c0c5310 con 0x7f115c155b60 2023-10-06T05:28:03.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f1152ffd700 1 -- 172.21.15.29:0/3920975171 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154014480 con 0x7f115c155b60 2023-10-06T05:28:03.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115c168200 con 0x7f115c155b60 2023-10-06T05:28:03.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.111+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115c0c5810 con 0x7f115c155b60 2023-10-06T05:28:03.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.115+0000 7f1152ffd700 1 -- 172.21.15.29:0/3920975171 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f11540147f0 con 0x7f115c155b60 2023-10-06T05:28:03.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.115+0000 7f1152ffd700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1140060550 0x7f1140062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:03.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.115+0000 7f1152ffd700 1 -- 172.21.15.29:0/3920975171 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f115407d590 con 0x7f115c155b60 2023-10-06T05:28:03.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.115+0000 7f115ad9d700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1140060550 0x7f1140062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:03.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.115+0000 7f115ad9d700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1140060550 0x7f1140062a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f115c0cdba0 tx=0x7f114c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:03.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.119+0000 7f1152ffd700 1 -- 172.21.15.29:0/3920975171 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f115404d990 con 0x7f115c155b60 2023-10-06T05:28:03.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.287+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f115c04be00 con 0x7f115c155b60 2023-10-06T05:28:03.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.959+0000 7f1152ffd700 1 -- 172.21.15.29:0/3920975171 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1154050fb0 con 0x7f115c155b60 2023-10-06T05:28:03.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1140060550 msgr2=0x7f1140062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:03.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1140060550 0x7f1140062a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f115c0cdba0 tx=0x7f114c017000 comp rx=0 tx=0).stop 2023-10-06T05:28:03.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c155b60 msgr2=0x7f115c167cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:03.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c155b60 0x7f115c167cc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1154009ec0 tx=0x7f115400b040 comp rx=0 tx=0).stop 2023-10-06T05:28:03.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 shutdown_connections 2023-10-06T05:28:03.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f115c155b60 0x7f115c167cc0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1140060550 0x7f1140062a00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f115c0cada0 0x7f115c0c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 --2- 172.21.15.29:0/3920975171 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f115c0c9220 0x7f115c150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:03.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 >> 172.21.15.29:0/3920975171 conn(0x7f115c069d50 msgr2=0x7f115c0c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:03.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 shutdown_connections 2023-10-06T05:28:03.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:03.963+0000 7f11608de700 1 -- 172.21.15.29:0/3920975171 wait complete. 2023-10-06T05:28:03.972 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2023-10-06T05:28:03.987 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T05:28:04.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.099+0000 7f010e4ca700 1 Processor -- start 2023-10-06T05:28:04.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.099+0000 7f010e4ca700 1 -- start start 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0108155ac0 0x7f01080c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f01080cb8c0 0x7f01080c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 0x7f0108159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080c8ce0 con 0x7f01080cb8c0 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080c9f10 con 0x7f0108155ac0 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01080c8060 con 0x7f01080c9ab0 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010ccc7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f01080cb8c0 0x7f01080c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010ccc7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f01080cb8c0 0x7f01080c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46912/0 (socket says 172.21.15.29:46912) 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010ccc7700 1 -- 172.21.15.29:0/2362454079 learned_addr learned my addr 172.21.15.29:0/2362454079 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:04.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010dcc9700 1 --2- 172.21.15.29:0/2362454079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 0x7f0108159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010d4c8700 1 --2- 172.21.15.29:0/2362454079 >> v2:172.21.15.173:3300/0 conn(0x7f0108155ac0 0x7f01080c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010ccc7700 1 -- 172.21.15.29:0/2362454079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 msgr2=0x7f0108159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010ccc7700 1 --2- 172.21.15.29:0/2362454079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 0x7f0108159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010ccc7700 1 -- 172.21.15.29:0/2362454079 >> v2:172.21.15.173:3300/0 conn(0x7f0108155ac0 msgr2=0x7f01080c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010ccc7700 1 --2- 172.21.15.29:0/2362454079 >> v2:172.21.15.173:3300/0 conn(0x7f0108155ac0 0x7f01080c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010ccc7700 1 -- 172.21.15.29:0/2362454079 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080c8340 con 0x7f01080cb8c0 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010ccc7700 1 --2- 172.21.15.29:0/2362454079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01080cb8c0 0x7f01080c9570 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f010806af00 tx=0x7f010400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5de2b380259920d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f00fffff700 1 -- 172.21.15.29:0/2362454079 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010400dc50 con 0x7f01080cb8c0 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f00fffff700 1 -- 172.21.15.29:0/2362454079 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010400ddb0 con 0x7f01080cb8c0 2023-10-06T05:28:04.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f00fffff700 1 -- 172.21.15.29:0/2362454079 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040196d0 con 0x7f01080cb8c0 2023-10-06T05:28:04.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 -- 172.21.15.29:0/2362454079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01080cb8c0 msgr2=0x7f01080c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:04.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 --2- 172.21.15.29:0/2362454079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01080cb8c0 0x7f01080c9570 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f010806af00 tx=0x7f010400b4f0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 -- 172.21.15.29:0/2362454079 shutdown_connections 2023-10-06T05:28:04.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 --2- 172.21.15.29:0/2362454079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 0x7f0108159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 --2- 172.21.15.29:0/2362454079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01080cb8c0 0x7f01080c9570 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 --2- 172.21.15.29:0/2362454079 >> v2:172.21.15.173:3300/0 conn(0x7f0108155ac0 0x7f01080c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 -- 172.21.15.29:0/2362454079 >> 172.21.15.29:0/2362454079 conn(0x7f010806ba30 msgr2=0x7f0108095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:04.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 -- 172.21.15.29:0/2362454079 shutdown_connections 2023-10-06T05:28:04.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.103+0000 7f010e4ca700 1 -- 172.21.15.29:0/2362454079 wait complete. 2023-10-06T05:28:04.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010e4ca700 1 Processor -- start 2023-10-06T05:28:04.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010e4ca700 1 -- start start 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010e4ca700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 0x7f01080c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010e4ca700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01080cb8c0 0x7f01081418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010e4ca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0108155ac0 0x7f01081508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010e4ca700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108159810 con 0x7f0108155ac0 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010e4ca700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01080c70a0 con 0x7f01080cb8c0 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010e4ca700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01080c6490 con 0x7f01080c9ab0 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010dcc9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0108155ac0 0x7f01081508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010dcc9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0108155ac0 0x7f01081508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46922/0 (socket says 172.21.15.29:46922) 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010dcc9700 1 -- 172.21.15.29:0/573269727 learned_addr learned my addr 172.21.15.29:0/573269727 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:04.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010ccc7700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01080cb8c0 0x7f01081418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:04.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.107+0000 7f010d4c8700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 0x7f01080c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:04.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f010dcc9700 1 -- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 msgr2=0x7f01080c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:04.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f010dcc9700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 0x7f01080c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f010dcc9700 1 -- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01080cb8c0 msgr2=0x7f01081418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:04.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f010dcc9700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01080cb8c0 0x7f01081418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f010dcc9700 1 -- 172.21.15.29:0/573269727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010400b790 con 0x7f0108155ac0 2023-10-06T05:28:04.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f010dcc9700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0108155ac0 0x7f01081508d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0100009fa0 tx=0x7f0100009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:04.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f00fd7fa700 1 -- 172.21.15.29:0/573269727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010000ebc0 con 0x7f0108155ac0 2023-10-06T05:28:04.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f00fd7fa700 1 -- 172.21.15.29:0/573269727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010000ed20 con 0x7f0108155ac0 2023-10-06T05:28:04.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f00fd7fa700 1 -- 172.21.15.29:0/573269727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100014670 con 0x7f0108155ac0 2023-10-06T05:28:04.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01080c6770 con 0x7f0108155ac0 2023-10-06T05:28:04.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01080c6d30 con 0x7f0108155ac0 2023-10-06T05:28:04.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f00fd7fa700 1 -- 172.21.15.29:0/573269727 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f01000149e0 con 0x7f0108155ac0 2023-10-06T05:28:04.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010804be00 con 0x7f0108155ac0 2023-10-06T05:28:04.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f00fd7fa700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00ec060550 0x7f00ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:04.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.111+0000 7f00fd7fa700 1 -- 172.21.15.29:0/573269727 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f010007ce60 con 0x7f0108155ac0 2023-10-06T05:28:04.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.115+0000 7f010d4c8700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00ec060550 0x7f00ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:04.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.115+0000 7f010d4c8700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00ec060550 0x7f00ec062a00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f00f80061f0 tx=0x7f00f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:04.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.119+0000 7f00fd7fa700 1 -- 172.21.15.29:0/573269727 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f010004d410 con 0x7f0108155ac0 2023-10-06T05:28:04.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.283+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f01080c8620 con 0x7f0108155ac0 2023-10-06T05:28:04.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.967+0000 7f00fd7fa700 1 -- 172.21.15.29:0/573269727 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0100050a30 con 0x7f0108155ac0 2023-10-06T05:28:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00ec060550 msgr2=0x7f00ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00ec060550 0x7f00ec062a00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f00f80061f0 tx=0x7f00f8008040 comp rx=0 tx=0).stop 2023-10-06T05:28:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0108155ac0 msgr2=0x7f01081508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0108155ac0 0x7f01081508d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0100009fa0 tx=0x7f0100009900 comp rx=0 tx=0).stop 2023-10-06T05:28:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 shutdown_connections 2023-10-06T05:28:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0108155ac0 0x7f01081508d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f00ec060550 0x7f00ec062a00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01080cb8c0 0x7f01081418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 --2- 172.21.15.29:0/573269727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01080c9ab0 0x7f01080c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:04.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.971+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 >> 172.21.15.29:0/573269727 conn(0x7f010806ba30 msgr2=0x7f0108068c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:04.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.975+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 shutdown_connections 2023-10-06T05:28:04.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:04.975+0000 7f010e4ca700 1 -- 172.21.15.29:0/573269727 wait complete. 2023-10-06T05:28:04.981 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2023-10-06T05:28:04.996 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T05:28:05.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.111+0000 7fa238397700 1 Processor -- start 2023-10-06T05:28:05.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.111+0000 7fa238397700 1 -- start start 2023-10-06T05:28:05.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa238397700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa230155460 0x7fa23006af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa238397700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa230155830 0x7fa23006b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa238397700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa23006c6c0 0x7fa23006cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa238397700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2301591e0 con 0x7fa230155460 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa238397700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa230159a80 con 0x7fa230155830 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa238397700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23006d380 con 0x7fa23006c6c0 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236133700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa230155460 0x7fa23006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236133700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa230155460 0x7fa23006af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49236/0 (socket says 172.21.15.29:49236) 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236133700 1 -- 172.21.15.29:0/2451227152 learned_addr learned my addr 172.21.15.29:0/2451227152 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa235932700 1 --2- 172.21.15.29:0/2451227152 >> v2:172.21.15.173:3300/0 conn(0x7fa230155830 0x7fa23006b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236934700 1 --2- 172.21.15.29:0/2451227152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa23006c6c0 0x7fa23006cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236133700 1 -- 172.21.15.29:0/2451227152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa23006c6c0 msgr2=0x7fa23006cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236133700 1 --2- 172.21.15.29:0/2451227152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa23006c6c0 0x7fa23006cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236133700 1 -- 172.21.15.29:0/2451227152 >> v2:172.21.15.173:3300/0 conn(0x7fa230155830 msgr2=0x7fa23006b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236133700 1 --2- 172.21.15.29:0/2451227152 >> v2:172.21.15.173:3300/0 conn(0x7fa230155830 0x7fa23006b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236133700 1 -- 172.21.15.29:0/2451227152 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230159430 con 0x7fa230155460 2023-10-06T05:28:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236934700 1 --2- 172.21.15.29:0/2451227152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa23006c6c0 0x7fa23006cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa236133700 1 --2- 172.21.15.29:0/2451227152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 0x7fa23006af70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa2300c9c00 tx=0x7fa22c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdc6bf5b8f93710 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa235131700 1 -- 172.21.15.29:0/2451227152 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00b860 con 0x7fa230155460 2023-10-06T05:28:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa235131700 1 -- 172.21.15.29:0/2451227152 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c00b9c0 con 0x7fa230155460 2023-10-06T05:28:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.115+0000 7fa235131700 1 -- 172.21.15.29:0/2451227152 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00bd60 con 0x7fa230155460 2023-10-06T05:28:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 -- 172.21.15.29:0/2451227152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 msgr2=0x7fa23006af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 --2- 172.21.15.29:0/2451227152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 0x7fa23006af70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa2300c9c00 tx=0x7fa22c009250 comp rx=0 tx=0).stop 2023-10-06T05:28:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 -- 172.21.15.29:0/2451227152 shutdown_connections 2023-10-06T05:28:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 --2- 172.21.15.29:0/2451227152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa23006c6c0 0x7fa23006cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 --2- 172.21.15.29:0/2451227152 >> v2:172.21.15.173:3300/0 conn(0x7fa230155830 0x7fa23006b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 --2- 172.21.15.29:0/2451227152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 0x7fa23006af70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 -- 172.21.15.29:0/2451227152 >> 172.21.15.29:0/2451227152 conn(0x7fa2300cd0e0 msgr2=0x7fa2300c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 -- 172.21.15.29:0/2451227152 shutdown_connections 2023-10-06T05:28:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 -- 172.21.15.29:0/2451227152 wait complete. 2023-10-06T05:28:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 Processor -- start 2023-10-06T05:28:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.119+0000 7fa238397700 1 -- start start 2023-10-06T05:28:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa238397700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23006c6c0 0x7fa230167c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa238397700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 0x7fa2300b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa238397700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa230155830 0x7fa2300ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa238397700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300aff00 con 0x7fa230155460 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa238397700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa230168190 con 0x7fa23006c6c0 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa238397700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300afbb0 con 0x7fa230155830 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa235932700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 0x7fa2300b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa235932700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 0x7fa2300b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49240/0 (socket says 172.21.15.29:49240) 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa235932700 1 -- 172.21.15.29:0/2013807945 learned_addr learned my addr 172.21.15.29:0/2013807945 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa236133700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23006c6c0 0x7fa230167c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa236934700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa230155830 0x7fa2300ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa235932700 1 -- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa230155830 msgr2=0x7fa2300ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa235932700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa230155830 0x7fa2300ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa235932700 1 -- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23006c6c0 msgr2=0x7fa230167c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa235932700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23006c6c0 0x7fa230167c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa235932700 1 -- 172.21.15.29:0/2013807945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c0094f0 con 0x7fa230155460 2023-10-06T05:28:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa235932700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 0x7fa2300b0390 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa22000d860 tx=0x7fa220008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa2267fc700 1 -- 172.21.15.29:0/2013807945 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220011590 con 0x7fa230155460 2023-10-06T05:28:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa2267fc700 1 -- 172.21.15.29:0/2013807945 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2200116f0 con 0x7fa230155460 2023-10-06T05:28:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2300b1b40 con 0x7fa230155460 2023-10-06T05:28:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa2267fc700 1 -- 172.21.15.29:0/2013807945 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220011a90 con 0x7fa230155460 2023-10-06T05:28:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.123+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2300b2100 con 0x7fa230155460 2023-10-06T05:28:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.127+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2300b0070 con 0x7fa230155460 2023-10-06T05:28:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.127+0000 7fa2267fc700 1 -- 172.21.15.29:0/2013807945 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa22001c460 con 0x7fa230155460 2023-10-06T05:28:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.127+0000 7fa2267fc700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa214060550 0x7fa214062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.127+0000 7fa2267fc700 1 -- 172.21.15.29:0/2013807945 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa22007c6d0 con 0x7fa230155460 2023-10-06T05:28:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.127+0000 7fa236133700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa214060550 0x7fa214062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.127+0000 7fa236133700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa214060550 0x7fa214062a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa2300c9c00 tx=0x7fa22c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:05.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.139+0000 7fa2267fc700 1 -- 172.21.15.29:0/2013807945 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa220050850 con 0x7fa230155460 2023-10-06T05:28:05.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.295+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa2300afcf0 con 0x7fa230155460 2023-10-06T05:28:05.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa2267fc700 1 -- 172.21.15.29:0/2013807945 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa2300afcf0 con 0x7fa230155460 2023-10-06T05:28:05.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa214060550 msgr2=0x7fa214062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa214060550 0x7fa214062a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa2300c9c00 tx=0x7fa22c017000 comp rx=0 tx=0).stop 2023-10-06T05:28:05.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 msgr2=0x7fa2300b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 0x7fa2300b0390 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa22000d860 tx=0x7fa220008040 comp rx=0 tx=0).stop 2023-10-06T05:28:05.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 shutdown_connections 2023-10-06T05:28:05.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa230155830 0x7fa2300ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa230155460 0x7fa2300b0390 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa214060550 0x7fa214062a00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 --2- 172.21.15.29:0/2013807945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa23006c6c0 0x7fa230167c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 >> 172.21.15.29:0/2013807945 conn(0x7fa2300cd0e0 msgr2=0x7fa23006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:05.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 shutdown_connections 2023-10-06T05:28:05.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.303+0000 7fa238397700 1 -- 172.21.15.29:0/2013807945 wait complete. 2023-10-06T05:28:05.325 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-10-06T05:28:05.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.427+0000 7efccffff700 1 Processor -- start 2023-10-06T05:28:05.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.427+0000 7efccffff700 1 -- start start 2023-10-06T05:28:05.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efcd015c630 0x7efcd00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd00cb150 con 0x7efcd00aeb00 2023-10-06T05:28:05.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd00ca540 con 0x7efcd00cff90 2023-10-06T05:28:05.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd00cb5e0 con 0x7efcd015c630 2023-10-06T05:28:05.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efcce7fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efcd00aeb00 0x7efcd015bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43600/0 (socket says 172.21.15.29:43600) 2023-10-06T05:28:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efcce7fc700 1 -- 172.21.15.29:0/740565039 learned_addr learned my addr 172.21.15.29:0/740565039 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccf7fe700 1 --2- 172.21.15.29:0/740565039 >> v2:172.21.15.173:3300/0 conn(0x7efcd015c630 0x7efcd00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccdffb700 1 -- 172.21.15.29:0/740565039 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847263498 0 0) 0x7efcd00cb150 con 0x7efcd00aeb00 2023-10-06T05:28:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccdffb700 1 -- 172.21.15.29:0/740565039 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcbc003570 con 0x7efcd00aeb00 2023-10-06T05:28:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccdffb700 1 -- 172.21.15.29:0/740565039 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2826097655 0 0) 0x7efcbc003570 con 0x7efcd00aeb00 2023-10-06T05:28:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccf7fe700 1 -- 172.21.15.29:0/740565039 >> v1:172.21.15.173:6789/0 conn(0x7efcd00cff90 legacy=0x7efcd015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccf7fe700 1 -- 172.21.15.29:0/740565039 >> v1:172.21.15.29:6789/0 conn(0x7efcd00aeb00 legacy=0x7efcd015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccf7fe700 1 -- 172.21.15.29:0/740565039 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd00ca820 con 0x7efcd015c630 2023-10-06T05:28:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccf7fe700 1 --2- 172.21.15.29:0/740565039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd015c630 0x7efcd00d0360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009e60 tx=0x7efcc8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cada0f1a38ec836 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccdffb700 1 -- 172.21.15.29:0/740565039 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc800e070 con 0x7efcd015c630 2023-10-06T05:28:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccdffb700 1 -- 172.21.15.29:0/740565039 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc800b850 con 0x7efcd015c630 2023-10-06T05:28:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccdffb700 1 -- 172.21.15.29:0/740565039 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8001470 con 0x7efcd015c630 2023-10-06T05:28:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 -- 172.21.15.29:0/740565039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd015c630 msgr2=0x7efcd00d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 --2- 172.21.15.29:0/740565039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd015c630 0x7efcd00d0360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009e60 tx=0x7efcc8009780 comp rx=0 tx=0).stop 2023-10-06T05:28:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 -- 172.21.15.29:0/740565039 shutdown_connections 2023-10-06T05:28:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 --2- 172.21.15.29:0/740565039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd015c630 0x7efcd00d0360 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 -- 172.21.15.29:0/740565039 >> 172.21.15.29:0/740565039 conn(0x7efcd00670a0 msgr2=0x7efcd00674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 -- 172.21.15.29:0/740565039 shutdown_connections 2023-10-06T05:28:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.431+0000 7efccffff700 1 -- 172.21.15.29:0/740565039 wait complete. 2023-10-06T05:28:05.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efccffff700 1 Processor -- start 2023-10-06T05:28:05.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efccffff700 1 -- start start 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efccffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcd00aeb00 0x7efcd00c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efccffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd00cff90 0x7efcd015d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efccffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd015c630 0x7efcd00c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efccffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd015da60 con 0x7efcd00aeb00 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efccffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd00b3cf0 con 0x7efcd00cff90 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efccffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd00b3fd0 con 0x7efcd015c630 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcceffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcd00aeb00 0x7efcd00c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcceffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcd00aeb00 0x7efcd00c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49254/0 (socket says 172.21.15.29:49254) 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcceffd700 1 -- 172.21.15.29:0/1359692985 learned_addr learned my addr 172.21.15.29:0/1359692985 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:05.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcce7fc700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd00cff90 0x7efcd015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efccf7fe700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd015c630 0x7efcd00c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcceffd700 1 -- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd015c630 msgr2=0x7efcd00c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcceffd700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd015c630 0x7efcd00c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcceffd700 1 -- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd00cff90 msgr2=0x7efcd015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcceffd700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd00cff90 0x7efcd015d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcceffd700 1 -- 172.21.15.29:0/1359692985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8009a20 con 0x7efcd00aeb00 2023-10-06T05:28:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcceffd700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcd00aeb00 0x7efcd00c98a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c590 tx=0x7efcc000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcc6ffd700 1 -- 172.21.15.29:0/1359692985 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0011590 con 0x7efcd00aeb00 2023-10-06T05:28:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.435+0000 7efcc6ffd700 1 -- 172.21.15.29:0/1359692985 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0011710 con 0x7efcd00aeb00 2023-10-06T05:28:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.439+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd00b42b0 con 0x7efcd00aeb00 2023-10-06T05:28:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.439+0000 7efcc6ffd700 1 -- 172.21.15.29:0/1359692985 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0011ad0 con 0x7efcd00aeb00 2023-10-06T05:28:05.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.439+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd00c3a70 con 0x7efcd00aeb00 2023-10-06T05:28:05.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.439+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd004be00 con 0x7efcd00aeb00 2023-10-06T05:28:05.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.439+0000 7efcc6ffd700 1 -- 172.21.15.29:0/1359692985 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efcc001b3b0 con 0x7efcd00aeb00 2023-10-06T05:28:05.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.439+0000 7efcc6ffd700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcb0060550 0x7efcb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:05.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.439+0000 7efcc6ffd700 1 -- 172.21.15.29:0/1359692985 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5292+0+0 (secure 0 0 0) 0x7efcc007ba90 con 0x7efcd00aeb00 2023-10-06T05:28:05.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.443+0000 7efcce7fc700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcb0060550 0x7efcb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:05.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.443+0000 7efcce7fc700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcb0060550 0x7efcb0062a00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efcd015a8c0 tx=0x7efcb8000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.447+0000 7efcc6ffd700 1 -- 172.21.15.29:0/1359692985 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efcc004c220 con 0x7efcd00aeb00 2023-10-06T05:28:05.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.667+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7efcd00cab00 con 0x7efcd00aeb00 2023-10-06T05:28:05.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.971+0000 7efcc6ffd700 1 -- 172.21.15.29:0/1359692985 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v137) v1 ==== 149+0+0 (secure 0 0 0) 0x7efcc0017020 con 0x7efcd00aeb00 2023-10-06T05:28:05.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcb0060550 msgr2=0x7efcb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcb0060550 0x7efcb0062a00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efcd015a8c0 tx=0x7efcb8000bc0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcd00aeb00 msgr2=0x7efcd00c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:05.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcd00aeb00 0x7efcd00c98a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c590 tx=0x7efcc000c8a0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 shutdown_connections 2023-10-06T05:28:05.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd015c630 0x7efcd00c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efcb0060550 0x7efcb0062a00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd00cff90 0x7efcd015d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 --2- 172.21.15.29:0/1359692985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcd00aeb00 0x7efcd00c98a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:05.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 >> 172.21.15.29:0/1359692985 conn(0x7efcd00670a0 msgr2=0x7efcd00b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:05.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 shutdown_connections 2023-10-06T05:28:05.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:05.975+0000 7efccffff700 1 -- 172.21.15.29:0/1359692985 wait complete. 2023-10-06T05:28:05.999 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2023-10-06T05:28:06.000 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-10-06T05:28:06.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2023-10-06T05:28:06.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.107+0000 7f263bac8700 1 Processor -- start 2023-10-06T05:28:06.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.107+0000 7f263bac8700 1 -- start start 2023-10-06T05:28:06.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.107+0000 7f263bac8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f263406a500 0x7f263406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:06.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.107+0000 7f263bac8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26341592b0 0x7f263406cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:06.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.107+0000 7f263bac8700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26340c5a10 con 0x7f2634158ee0 2023-10-06T05:28:06.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.107+0000 7f263bac8700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26340cbb90 con 0x7f26341592b0 2023-10-06T05:28:06.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.107+0000 7f263bac8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263406a990 con 0x7f263406a500 2023-10-06T05:28:06.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263a065700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26341592b0 0x7f263406cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:06.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263a065700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26341592b0 0x7f263406cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49270/0 (socket says 172.21.15.29:49270) 2023-10-06T05:28:06.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263a065700 1 -- 172.21.15.29:0/964739789 learned_addr learned my addr 172.21.15.29:0/964739789 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:06.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f2639864700 1 --1- 172.21.15.29:0/964739789 >> v1:172.21.15.29:6789/0 conn(0x7f2634158ee0 0x7f263415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43612/0 (socket says 172.21.15.29:43612) 2023-10-06T05:28:06.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263a065700 1 -- 172.21.15.29:0/964739789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f263406a500 msgr2=0x7f263406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:06.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263a065700 1 --2- 172.21.15.29:0/964739789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f263406a500 0x7f263406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:06.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263a065700 1 -- 172.21.15.29:0/964739789 >> v1:172.21.15.29:6789/0 conn(0x7f2634158ee0 legacy=0x7f263415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:06.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f2638862700 1 -- 172.21.15.29:0/964739789 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252658873 0 0) 0x7f26340c5a10 con 0x7f2634158ee0 2023-10-06T05:28:06.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263a065700 1 -- 172.21.15.29:0/964739789 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263406ac70 con 0x7f26341592b0 2023-10-06T05:28:06.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263a065700 1 --2- 172.21.15.29:0/964739789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 0x7f263406cc00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f262c009f20 tx=0x7f262c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d2164fc82a653 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:06.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f2638862700 1 -- 172.21.15.29:0/964739789 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00e070 con 0x7f26341592b0 2023-10-06T05:28:06.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f2638862700 1 -- 172.21.15.29:0/964739789 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c00ba80 con 0x7f26341592b0 2023-10-06T05:28:06.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f2638862700 1 -- 172.21.15.29:0/964739789 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c0092e0 con 0x7f26341592b0 2023-10-06T05:28:06.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263bac8700 1 -- 172.21.15.29:0/964739789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 msgr2=0x7f263406cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:06.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263bac8700 1 --2- 172.21.15.29:0/964739789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 0x7f263406cc00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f262c009f20 tx=0x7f262c009840 comp rx=0 tx=0).stop 2023-10-06T05:28:06.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263bac8700 1 -- 172.21.15.29:0/964739789 shutdown_connections 2023-10-06T05:28:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263bac8700 1 --2- 172.21.15.29:0/964739789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 0x7f263406cc00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263bac8700 1 --2- 172.21.15.29:0/964739789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f263406a500 0x7f263406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263bac8700 1 -- 172.21.15.29:0/964739789 >> 172.21.15.29:0/964739789 conn(0x7f2634062b60 msgr2=0x7f2634062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263bac8700 1 -- 172.21.15.29:0/964739789 shutdown_connections 2023-10-06T05:28:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.111+0000 7f263bac8700 1 -- 172.21.15.29:0/964739789 wait complete. 2023-10-06T05:28:06.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263bac8700 1 Processor -- start 2023-10-06T05:28:06.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263bac8700 1 -- start start 2023-10-06T05:28:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263bac8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f263406a500 0x7f263414b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263bac8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2634158ee0 0x7f263414b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263bac8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 0x7f26341596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263bac8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2634159c30 con 0x7f26341592b0 2023-10-06T05:28:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263bac8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263415c5c0 con 0x7f2634158ee0 2023-10-06T05:28:06.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263bac8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263414c150 con 0x7f263406a500 2023-10-06T05:28:06.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263a065700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 0x7f26341596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:06.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263a065700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 0x7f26341596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49282/0 (socket says 172.21.15.29:49282) 2023-10-06T05:28:06.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263a065700 1 -- 172.21.15.29:0/1698739057 learned_addr learned my addr 172.21.15.29:0/1698739057 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:06.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f2639063700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2634158ee0 0x7f263414b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:06.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f2639864700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f263406a500 0x7f263414b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:06.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263a065700 1 -- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f263406a500 msgr2=0x7f263414b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:06.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263a065700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f263406a500 0x7f263414b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:06.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263a065700 1 -- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2634158ee0 msgr2=0x7f263414b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:06.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263a065700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2634158ee0 0x7f263414b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:06.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263a065700 1 -- 172.21.15.29:0/1698739057 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c009ae0 con 0x7f26341592b0 2023-10-06T05:28:06.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f263a065700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 0x7f26341596f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2634069df0 tx=0x7f262c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:06.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f2629ffb700 1 -- 172.21.15.29:0/1698739057 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c0092e0 con 0x7f26341592b0 2023-10-06T05:28:06.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.115+0000 7f2629ffb700 1 -- 172.21.15.29:0/1698739057 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c008d60 con 0x7f26341592b0 2023-10-06T05:28:06.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.119+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2634159e20 con 0x7f26341592b0 2023-10-06T05:28:06.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.119+0000 7f2629ffb700 1 -- 172.21.15.29:0/1698739057 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c0266b0 con 0x7f26341592b0 2023-10-06T05:28:06.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.119+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263415a3e0 con 0x7f26341592b0 2023-10-06T05:28:06.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.119+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263415a600 con 0x7f26341592b0 2023-10-06T05:28:06.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.119+0000 7f2629ffb700 1 -- 172.21.15.29:0/1698739057 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f262c003040 con 0x7f26341592b0 2023-10-06T05:28:06.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.119+0000 7f2629ffb700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2618060550 0x7f2618062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:06.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.119+0000 7f2629ffb700 1 -- 172.21.15.29:0/1698739057 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f262c07e490 con 0x7f26341592b0 2023-10-06T05:28:06.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.119+0000 7f2639864700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2618060550 0x7f2618062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:06.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.123+0000 7f2639864700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2618060550 0x7f2618062a00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2630007b30 tx=0x7f2630009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:06.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.127+0000 7f2629ffb700 1 -- 172.21.15.29:0/1698739057 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f262c04ec20 con 0x7f26341592b0 2023-10-06T05:28:06.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.343+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f263404be00 con 0x7f26341592b0 2023-10-06T05:28:06.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.975+0000 7f2629ffb700 1 -- 172.21.15.29:0/1698739057 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v138) v1 ==== 149+0+0 (secure 0 0 0) 0x7f262c052240 con 0x7f26341592b0 2023-10-06T05:28:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2618060550 msgr2=0x7f2618062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2618060550 0x7f2618062a00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2630007b30 tx=0x7f2630009040 comp rx=0 tx=0).stop 2023-10-06T05:28:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 msgr2=0x7f26341596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 0x7f26341596f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2634069df0 tx=0x7f262c018000 comp rx=0 tx=0).stop 2023-10-06T05:28:06.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 shutdown_connections 2023-10-06T05:28:06.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26341592b0 0x7f26341596f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:06.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2618060550 0x7f2618062a00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:06.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2634158ee0 0x7f263414b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:06.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 --2- 172.21.15.29:0/1698739057 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f263406a500 0x7f263414b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:06.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 >> 172.21.15.29:0/1698739057 conn(0x7f2634062b60 msgr2=0x7f2634156640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:06.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 shutdown_connections 2023-10-06T05:28:06.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:06.979+0000 7f263bac8700 1 -- 172.21.15.29:0/1698739057 wait complete. 2023-10-06T05:28:07.003 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T05:28:07.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7529149700 1 Processor -- start 2023-10-06T05:28:07.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7529149700 1 -- start start 2023-10-06T05:28:07.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7529149700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f75240c8af0 0x7f7524161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7529149700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752406b540 con 0x7f7524156870 2023-10-06T05:28:07.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7529149700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752406a930 con 0x7f752406a370 2023-10-06T05:28:07.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7529149700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752406ac10 con 0x7f75240c8af0 2023-10-06T05:28:07.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7523fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7524156870 0x7f752415b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43628/0 (socket says 172.21.15.29:43628) 2023-10-06T05:28:07.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7523fff700 1 -- 172.21.15.29:0/3820885408 learned_addr learned my addr 172.21.15.29:0/3820885408 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:07.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7528948700 1 --2- 172.21.15.29:0/3820885408 >> v2:172.21.15.173:3300/0 conn(0x7f75240c8af0 0x7f7524161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7522ffd700 1 -- 172.21.15.29:0/3820885408 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758167950 0 0) 0x7f752406b540 con 0x7f7524156870 2023-10-06T05:28:07.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7522ffd700 1 -- 172.21.15.29:0/3820885408 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7510003570 con 0x7f7524156870 2023-10-06T05:28:07.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7528948700 1 -- 172.21.15.29:0/3820885408 >> v1:172.21.15.173:6789/0 conn(0x7f752406a370 legacy=0x7f75240c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7528948700 1 -- 172.21.15.29:0/3820885408 >> v1:172.21.15.29:6789/0 conn(0x7f7524156870 legacy=0x7f752415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7522ffd700 1 -- 172.21.15.29:0/3820885408 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094429553 0 0) 0x7f752406a930 con 0x7f752406a370 2023-10-06T05:28:07.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.115+0000 7f7528948700 1 -- 172.21.15.29:0/3820885408 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752406aef0 con 0x7f75240c8af0 2023-10-06T05:28:07.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7528948700 1 --2- 172.21.15.29:0/3820885408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75240c8af0 0x7f7524161890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f751c009e60 tx=0x7f751c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6600e779f2b80824 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:07.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7522ffd700 1 -- 172.21.15.29:0/3820885408 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00e070 con 0x7f75240c8af0 2023-10-06T05:28:07.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7522ffd700 1 -- 172.21.15.29:0/3820885408 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c00bb60 con 0x7f75240c8af0 2023-10-06T05:28:07.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7522ffd700 1 -- 172.21.15.29:0/3820885408 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c012430 con 0x7f75240c8af0 2023-10-06T05:28:07.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7529149700 1 -- 172.21.15.29:0/3820885408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75240c8af0 msgr2=0x7f7524161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7529149700 1 --2- 172.21.15.29:0/3820885408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75240c8af0 0x7f7524161890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f751c009e60 tx=0x7f751c009780 comp rx=0 tx=0).stop 2023-10-06T05:28:07.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7529149700 1 -- 172.21.15.29:0/3820885408 shutdown_connections 2023-10-06T05:28:07.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7529149700 1 --2- 172.21.15.29:0/3820885408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75240c8af0 0x7f7524161890 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7529149700 1 -- 172.21.15.29:0/3820885408 >> 172.21.15.29:0/3820885408 conn(0x7f752406c6c0 msgr2=0x7f752406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:07.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7529149700 1 -- 172.21.15.29:0/3820885408 shutdown_connections 2023-10-06T05:28:07.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7529149700 1 -- 172.21.15.29:0/3820885408 wait complete. 2023-10-06T05:28:07.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7529149700 1 Processor -- start 2023-10-06T05:28:07.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.119+0000 7f7529149700 1 -- start start 2023-10-06T05:28:07.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7529149700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f752406a370 0x7f75240c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7529149700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75240c8af0 0x7f75241549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7529149700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7524156870 0x7f75240afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7529149700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75240af940 con 0x7f752406a370 2023-10-06T05:28:07.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7529149700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75240c5280 con 0x7f7524156870 2023-10-06T05:28:07.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7529149700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75240aed30 con 0x7f75240c8af0 2023-10-06T05:28:07.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7523fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f752406a370 0x7f75240c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7523fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f752406a370 0x7f75240c4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49296/0 (socket says 172.21.15.29:49296) 2023-10-06T05:28:07.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7523fff700 1 -- 172.21.15.29:0/3157837012 learned_addr learned my addr 172.21.15.29:0/3157837012 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:07.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f75237fe700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75240c8af0 0x7f75241549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7528948700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7524156870 0x7f75240afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7523fff700 1 -- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75240c8af0 msgr2=0x7f75241549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7523fff700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75240c8af0 0x7f75241549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7523fff700 1 -- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7524156870 msgr2=0x7f75240afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7523fff700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7524156870 0x7f75240afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7523fff700 1 -- 172.21.15.29:0/3157837012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c009a20 con 0x7f752406a370 2023-10-06T05:28:07.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7523fff700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f752406a370 0x7f75240c4d40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f75140011e0 tx=0x7f7514007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:07.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f751bfff700 1 -- 172.21.15.29:0/3157837012 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514005b30 con 0x7f752406a370 2023-10-06T05:28:07.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f751bfff700 1 -- 172.21.15.29:0/3157837012 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7514005c90 con 0x7f752406a370 2023-10-06T05:28:07.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75240af010 con 0x7f752406a370 2023-10-06T05:28:07.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f751bfff700 1 -- 172.21.15.29:0/3157837012 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514007320 con 0x7f752406a370 2023-10-06T05:28:07.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.123+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75240af5d0 con 0x7f752406a370 2023-10-06T05:28:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.127+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752404be00 con 0x7f752406a370 2023-10-06T05:28:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.127+0000 7f751bfff700 1 -- 172.21.15.29:0/3157837012 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7514007690 con 0x7f752406a370 2023-10-06T05:28:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.127+0000 7f751bfff700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7504060550 0x7f7504062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.127+0000 7f751bfff700 1 -- 172.21.15.29:0/3157837012 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f751407b990 con 0x7f752406a370 2023-10-06T05:28:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.127+0000 7f75237fe700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7504060550 0x7f7504062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.127+0000 7f75237fe700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7504060550 0x7f7504062a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f752415a570 tx=0x7f750c007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.135+0000 7f751bfff700 1 -- 172.21.15.29:0/3157837012 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f751404c120 con 0x7f752406a370 2023-10-06T05:28:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.299+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f752406b1d0 con 0x7f752406a370 2023-10-06T05:28:07.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.303+0000 7f751bfff700 1 -- 172.21.15.29:0/3157837012 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f751404f740 con 0x7f752406a370 2023-10-06T05:28:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7504060550 msgr2=0x7f7504062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7504060550 0x7f7504062a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f752415a570 tx=0x7f750c007d30 comp rx=0 tx=0).stop 2023-10-06T05:28:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f752406a370 msgr2=0x7f75240c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f752406a370 0x7f75240c4d40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f75140011e0 tx=0x7f7514007df0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 shutdown_connections 2023-10-06T05:28:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7504060550 0x7f7504062a00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7524156870 0x7f75240afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75240c8af0 0x7f75241549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 --2- 172.21.15.29:0/3157837012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f752406a370 0x7f75240c4d40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 >> 172.21.15.29:0/3157837012 conn(0x7f752406c6c0 msgr2=0x7f75240cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 shutdown_connections 2023-10-06T05:28:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.307+0000 7f7529149700 1 -- 172.21.15.29:0/3157837012 wait complete. 2023-10-06T05:28:07.331 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T05:28:07.331 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:28:07.348 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:28:07.367 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T05:28:07.367 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T05:28:07.368 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:28:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d5163700 1 Processor -- start 2023-10-06T05:28:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d5163700 1 -- start start 2023-10-06T05:28:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d5163700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1d00abe50 0x7fb1d00aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d5163700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb1d015a1a0 0x7fb1d00ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d5163700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d0159d10 con 0x7fb1d00cd240 2023-10-06T05:28:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d5163700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d00af1a0 con 0x7fb1d00abe50 2023-10-06T05:28:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d5163700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d0159430 con 0x7fb1d015a1a0 2023-10-06T05:28:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1cf7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1d00abe50 0x7fb1d00aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1cf7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1d00abe50 0x7fb1d00aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49304/0 (socket says 172.21.15.29:49304) 2023-10-06T05:28:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1cf7fe700 1 -- 172.21.15.29:0/3158927234 learned_addr learned my addr 172.21.15.29:0/3158927234 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d4962700 1 --2- 172.21.15.29:0/3158927234 >> v2:172.21.15.173:3300/0 conn(0x7fb1d015a1a0 0x7fb1d00ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1cf7fe700 1 -- 172.21.15.29:0/3158927234 >> v2:172.21.15.173:3300/0 conn(0x7fb1d015a1a0 msgr2=0x7fb1d00ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1cf7fe700 1 --2- 172.21.15.29:0/3158927234 >> v2:172.21.15.173:3300/0 conn(0x7fb1d015a1a0 0x7fb1d00ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1cf7fe700 1 -- 172.21.15.29:0/3158927234 >> v1:172.21.15.173:6789/0 conn(0x7fb1d00cd240 legacy=0x7fb1d00ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1cf7fe700 1 -- 172.21.15.29:0/3158927234 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00ac320 con 0x7fb1d00abe50 2023-10-06T05:28:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1cf7fe700 1 --2- 172.21.15.29:0/3158927234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d00abe50 0x7fb1d00aced0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00ace60 tx=0x7fb1b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8077734242b6eb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1ceffd700 1 -- 172.21.15.29:0/3158927234 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800e070 con 0x7fb1d00abe50 2023-10-06T05:28:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1ceffd700 1 -- 172.21.15.29:0/3158927234 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800ba50 con 0x7fb1d00abe50 2023-10-06T05:28:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1ceffd700 1 -- 172.21.15.29:0/3158927234 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80092e0 con 0x7fb1d00abe50 2023-10-06T05:28:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d5163700 1 -- 172.21.15.29:0/3158927234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d00abe50 msgr2=0x7fb1d00aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.475+0000 7fb1d5163700 1 --2- 172.21.15.29:0/3158927234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d00abe50 0x7fb1d00aced0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00ace60 tx=0x7fb1b8009840 comp rx=0 tx=0).stop 2023-10-06T05:28:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- 172.21.15.29:0/3158927234 shutdown_connections 2023-10-06T05:28:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 --2- 172.21.15.29:0/3158927234 >> v2:172.21.15.173:3300/0 conn(0x7fb1d015a1a0 0x7fb1d00ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 --2- 172.21.15.29:0/3158927234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d00abe50 0x7fb1d00aced0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- 172.21.15.29:0/3158927234 >> 172.21.15.29:0/3158927234 conn(0x7fb1d006b480 msgr2=0x7fb1d006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- 172.21.15.29:0/3158927234 shutdown_connections 2023-10-06T05:28:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- 172.21.15.29:0/3158927234 wait complete. 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 Processor -- start 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- start start 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1d00abe50 0x7fb1d0142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1d00cd240 0x7fb1d00cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d015a1a0 0x7fb1d00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d016a430 con 0x7fb1d015a1a0 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0152220 con 0x7fb1d00cd240 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00b0a30 con 0x7fb1d00abe50 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d4962700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d015a1a0 0x7fb1d00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d4962700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d015a1a0 0x7fb1d00cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49318/0 (socket says 172.21.15.29:49318) 2023-10-06T05:28:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d4962700 1 -- 172.21.15.29:0/365972360 learned_addr learned my addr 172.21.15.29:0/365972360 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1cffff700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1d00abe50 0x7fb1d0142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1cf7fe700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1d00cd240 0x7fb1d00cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d4962700 1 -- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1d00abe50 msgr2=0x7fb1d0142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d4962700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1d00abe50 0x7fb1d0142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d4962700 1 -- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1d00cd240 msgr2=0x7fb1d00cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d4962700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1d00cd240 0x7fb1d00cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d4962700 1 -- 172.21.15.29:0/365972360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8009ae0 con 0x7fb1d015a1a0 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1cf7fe700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1d00cd240 0x7fb1d00cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1cffff700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1d00abe50 0x7fb1d0142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d4962700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d015a1a0 0x7fb1d00cc580 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800d890 tx=0x7fb1c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1c7fff700 1 -- 172.21.15.29:0/365972360 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80125f0 con 0x7fb1d015a1a0 2023-10-06T05:28:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1c7fff700 1 -- 172.21.15.29:0/365972360 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8012770 con 0x7fb1d015a1a0 2023-10-06T05:28:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d00b0d10 con 0x7fb1d015a1a0 2023-10-06T05:28:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1c7fff700 1 -- 172.21.15.29:0/365972360 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8012b30 con 0x7fb1d015a1a0 2023-10-06T05:28:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.479+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d00b12d0 con 0x7fb1d015a1a0 2023-10-06T05:28:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.483+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d004be00 con 0x7fb1d015a1a0 2023-10-06T05:28:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.483+0000 7fb1c7fff700 1 -- 172.21.15.29:0/365972360 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb1c801e460 con 0x7fb1d015a1a0 2023-10-06T05:28:07.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.483+0000 7fb1c7fff700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb1b4060550 0x7fb1b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.483+0000 7fb1c7fff700 1 -- 172.21.15.29:0/365972360 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb1c807ce00 con 0x7fb1d015a1a0 2023-10-06T05:28:07.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.483+0000 7fb1cffff700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb1b4060550 0x7fb1b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.487+0000 7fb1cffff700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb1b4060550 0x7fb1b4062a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0007fd0 tx=0x7fb1c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:07.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.491+0000 7fb1c7fff700 1 -- 172.21.15.29:0/365972360 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb1c804d4f0 con 0x7fb1d015a1a0 2023-10-06T05:28:07.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.691+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1d00caa20 con 0x7fb1d015a1a0 2023-10-06T05:28:07.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.691+0000 7fb1c7fff700 1 -- 172.21.15.29:0/365972360 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fb1c8050b10 con 0x7fb1d015a1a0 2023-10-06T05:28:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:07.710 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3538089078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3538089078},{"type":"v1","addr":"172.21.15.173:6835","nonce":3538089078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3499370562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3499370562},{"type":"v1","addr":"172.21.15.173:6837","nonce":3499370562}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3369448997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3369448997},{"type":"v1","addr":"172.21.15.29:6833","nonce":3369448997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5832,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/648947228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":648947228},{"type":"v1","addr":"172.21.15.29:6835","nonce":648947228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[]} 2023-10-06T05:28:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb1b4060550 msgr2=0x7fb1b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb1b4060550 0x7fb1b4062a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0007fd0 tx=0x7fb1c0009040 comp rx=0 tx=0).stop 2023-10-06T05:28:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d015a1a0 msgr2=0x7fb1d00cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d015a1a0 0x7fb1d00cc580 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800d890 tx=0x7fb1c8008040 comp rx=0 tx=0).stop 2023-10-06T05:28:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 shutdown_connections 2023-10-06T05:28:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1d015a1a0 0x7fb1d00cc580 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb1b4060550 0x7fb1b4062a00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1d00cd240 0x7fb1d00cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 --2- 172.21.15.29:0/365972360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1d00abe50 0x7fb1d0142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 >> 172.21.15.29:0/365972360 conn(0x7fb1d006b480 msgr2=0x7fb1d006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:07.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 shutdown_connections 2023-10-06T05:28:07.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.695+0000 7fb1d5163700 1 -- 172.21.15.29:0/365972360 wait complete. 2023-10-06T05:28:07.717 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 23 2023-10-06T05:28:07.718 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T05:28:07.719 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T05:28:07.719 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T05:28:07.719 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:28:07.719 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T05:28:07.719 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T05:28:07.720 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T05:28:07.720 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:28:07.720 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T05:28:07.720 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T05:28:07.721 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T05:28:07.721 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:28:07.721 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T05:28:07.722 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T05:28:07.722 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T05:28:07.722 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:28:07.729 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T05:28:07.729 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T05:28:07.731 INFO:tasks.ceph.mds.a:Started 2023-10-06T05:28:07.731 DEBUG:teuthology.parallel:result is None 2023-10-06T05:28:07.736 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T05:28:07.736 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T05:28:07.737 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T05:28:07.738 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T05:28:07.738 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T05:28:07.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T05:28:07.741 INFO:tasks.ceph.mds.c:Started 2023-10-06T05:28:07.741 DEBUG:teuthology.parallel:result is None 2023-10-06T05:28:07.783 INFO:tasks.ceph.mds.b:Started 2023-10-06T05:28:07.784 DEBUG:teuthology.parallel:result is None 2023-10-06T05:28:07.784 INFO:tasks.ceph.mds.d:Started 2023-10-06T05:28:07.785 DEBUG:teuthology.parallel:result is None 2023-10-06T05:28:07.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T05:28:07.803 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-06T05:28:07.817 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:28:07.858 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-10-06T05:28:07.859 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-10-06T05:28:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.887+0000 7f16a80cb700 1 Processor -- start 2023-10-06T05:28:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.887+0000 7f16a80cb700 1 -- start start 2023-10-06T05:28:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.887+0000 7f16a80cb700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f16a015a220 0x7f16a00cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.887+0000 7f16a80cb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a006c6c0 0x7f16a01568a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.887+0000 7f16a80cb700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a00cb750 con 0x7f16a00c81b0 2023-10-06T05:28:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.887+0000 7f16a80cb700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a00c78e0 con 0x7f16a015a220 2023-10-06T05:28:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.887+0000 7f16a80cb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00c9c10 con 0x7f16a006c6c0 2023-10-06T05:28:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a5666700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f16a015a220 0x7f16a00cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a5e67700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f16a00c81b0 0x7f16a00c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:41994/0 (socket says 172.21.15.29:41994) 2023-10-06T05:28:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a5e67700 1 -- 172.21.15.29:0/2304646274 learned_addr learned my addr 172.21.15.29:0/2304646274 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a6668700 1 --2- 172.21.15.29:0/2304646274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a006c6c0 0x7f16a01568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a4e65700 1 -- 172.21.15.29:0/2304646274 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975059475 0 0) 0x7f169c001110 con 0x7f16a00c81b0 2023-10-06T05:28:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a4e65700 1 -- 172.21.15.29:0/2304646274 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f168c003570 con 0x7f16a00c81b0 2023-10-06T05:28:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a5666700 1 -- 172.21.15.29:0/2304646274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a006c6c0 msgr2=0x7f16a01568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a5666700 1 --2- 172.21.15.29:0/2304646274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a006c6c0 0x7f16a01568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a5666700 1 -- 172.21.15.29:0/2304646274 >> v1:172.21.15.173:6789/0 conn(0x7f16a00c81b0 legacy=0x7f16a00c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a5666700 1 -- 172.21.15.29:0/2304646274 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a0156410 con 0x7f16a015a220 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a5666700 1 --2- 172.21.15.29:0/2304646274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a015a220 0x7f16a00cb210 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16900098e0 tx=0x7f16900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afdc3cd008cac5b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a4e65700 1 -- 172.21.15.29:0/2304646274 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690011630 con 0x7f16a015a220 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a4e65700 1 -- 172.21.15.29:0/2304646274 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1690011790 con 0x7f16a015a220 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a4e65700 1 -- 172.21.15.29:0/2304646274 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690011b30 con 0x7f16a015a220 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a80cb700 1 -- 172.21.15.29:0/2304646274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a015a220 msgr2=0x7f16a00cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a80cb700 1 --2- 172.21.15.29:0/2304646274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a015a220 0x7f16a00cb210 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16900098e0 tx=0x7f16900091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a80cb700 1 -- 172.21.15.29:0/2304646274 shutdown_connections 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a80cb700 1 --2- 172.21.15.29:0/2304646274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a006c6c0 0x7f16a01568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a80cb700 1 --2- 172.21.15.29:0/2304646274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a015a220 0x7f16a00cb210 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a80cb700 1 -- 172.21.15.29:0/2304646274 >> 172.21.15.29:0/2304646274 conn(0x7f16a00ccef0 msgr2=0x7f16a00c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:07.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a80cb700 1 -- 172.21.15.29:0/2304646274 shutdown_connections 2023-10-06T05:28:07.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.891+0000 7f16a80cb700 1 -- 172.21.15.29:0/2304646274 wait complete. 2023-10-06T05:28:07.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a80cb700 1 Processor -- start 2023-10-06T05:28:07.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a80cb700 1 -- start start 2023-10-06T05:28:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a80cb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a006c6c0 0x7f16a00c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a80cb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a00c81b0 0x7f16a00685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a80cb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a015a220 0x7f16a016cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a80cb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a01429c0 con 0x7f16a00c81b0 2023-10-06T05:28:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a80cb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a0153de0 con 0x7f16a006c6c0 2023-10-06T05:28:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a80cb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a016d8c0 con 0x7f16a015a220 2023-10-06T05:28:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5666700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a00c81b0 0x7f16a00685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5666700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a00c81b0 0x7f16a00685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49366/0 (socket says 172.21.15.29:49366) 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5666700 1 -- 172.21.15.29:0/3984225576 learned_addr learned my addr 172.21.15.29:0/3984225576 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a6668700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a015a220 0x7f16a016cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5e67700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a006c6c0 0x7f16a00c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5666700 1 -- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a015a220 msgr2=0x7f16a016cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5666700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a015a220 0x7f16a016cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5666700 1 -- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a006c6c0 msgr2=0x7f16a00c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5666700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a006c6c0 0x7f16a00c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5666700 1 -- 172.21.15.29:0/3984225576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690009420 con 0x7f16a00c81b0 2023-10-06T05:28:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f16a5666700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a00c81b0 0x7f16a00685c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f16a00c3230 tx=0x7f1690017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:07.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f1695ffb700 1 -- 172.21.15.29:0/3984225576 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690000c40 con 0x7f16a00c81b0 2023-10-06T05:28:07.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f1695ffb700 1 -- 172.21.15.29:0/3984225576 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1690011900 con 0x7f16a00c81b0 2023-10-06T05:28:07.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.895+0000 7f1695ffb700 1 -- 172.21.15.29:0/3984225576 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690025420 con 0x7f16a00c81b0 2023-10-06T05:28:07.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.899+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a0154080 con 0x7f16a00c81b0 2023-10-06T05:28:07.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.899+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a016dba0 con 0x7f16a00c81b0 2023-10-06T05:28:07.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.899+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a0153c40 con 0x7f16a00c81b0 2023-10-06T05:28:07.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.899+0000 7f1695ffb700 1 -- 172.21.15.29:0/3984225576 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1690023070 con 0x7f16a00c81b0 2023-10-06T05:28:07.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.899+0000 7f1695ffb700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1684060580 0x7f1684062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:07.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.899+0000 7f1695ffb700 1 -- 172.21.15.29:0/3984225576 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f169007d9f0 con 0x7f16a00c81b0 2023-10-06T05:28:07.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.899+0000 7f16a5e67700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1684060580 0x7f1684062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:07.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.903+0000 7f16a5e67700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1684060580 0x7f1684062a30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f169c001270 tx=0x7f169c007bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:07.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:07.907+0000 7f1695ffb700 1 -- 172.21.15.29:0/3984225576 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f16a0153c40 con 0x7f16a00c81b0 2023-10-06T05:28:07.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-06T05:28:07.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T05:28:07.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-06T05:28:08.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:08.083+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f16a0153c40 con 0x7f16a00c81b0 2023-10-06T05:28:09.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.003+0000 7f1695ffb700 1 -- 172.21.15.29:0/3984225576 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7f16a0153c40 con 0x7f16a00c81b0 2023-10-06T05:28:09.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1684060580 msgr2=0x7f1684062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1684060580 0x7f1684062a30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f169c001270 tx=0x7f169c007bf0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a00c81b0 msgr2=0x7f16a00685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a00c81b0 0x7f16a00685c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f16a00c3230 tx=0x7f1690017000 comp rx=0 tx=0).stop 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 shutdown_connections 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16a015a220 0x7f16a016cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a00c81b0 0x7f16a00685c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1684060580 0x7f1684062a30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 --2- 172.21.15.29:0/3984225576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a006c6c0 0x7f16a00c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 >> 172.21.15.29:0/3984225576 conn(0x7f16a00ccef0 msgr2=0x7f16a00c8580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 shutdown_connections 2023-10-06T05:28:09.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.007+0000 7f16a80cb700 1 -- 172.21.15.29:0/3984225576 wait complete. 2023-10-06T05:28:09.015 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2023-10-06T05:28:09.030 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T05:28:09.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.179+0000 7f3f0e600700 1 Processor -- start 2023-10-06T05:28:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.179+0000 7f3f0e600700 1 -- start start 2023-10-06T05:28:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.179+0000 7f3f0e600700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3f080c8b50 0x7f3f0806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.179+0000 7f3f0e600700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f08155cb0 0x7f3f0806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.179+0000 7f3f0e600700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0806b9e0 con 0x7f3f0806c8f0 2023-10-06T05:28:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.179+0000 7f3f0e600700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f080cb7e0 con 0x7f3f080c8b50 2023-10-06T05:28:09.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.179+0000 7f3f0e600700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080caf80 con 0x7f3f08155cb0 2023-10-06T05:28:09.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0cdfd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3f080c8b50 0x7f3f0806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0cdfd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3f080c8b50 0x7f3f0806ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:60028/0 (socket says 172.21.15.29:60028) 2023-10-06T05:28:09.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0cdfd700 1 -- 172.21.15.29:0/2367845275 learned_addr learned my addr 172.21.15.29:0/2367845275 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:09.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0ddff700 1 --2- 172.21.15.29:0/2367845275 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f08155cb0 0x7f3f0806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0cdfd700 1 -- 172.21.15.29:0/2367845275 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f08155cb0 msgr2=0x7f3f0806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:09.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0cdfd700 1 --2- 172.21.15.29:0/2367845275 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f08155cb0 0x7f3f0806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0cdfd700 1 -- 172.21.15.29:0/2367845275 >> v1:172.21.15.173:6789/0 conn(0x7f3f0806c8f0 legacy=0x7f3f081555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0cdfd700 1 -- 172.21.15.29:0/2367845275 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f080c7660 con 0x7f3f080c8b50 2023-10-06T05:28:09.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0cdfd700 1 --2- 172.21.15.29:0/2367845275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f080c8b50 0x7f3f0806ccc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009f20 tx=0x7f3f04009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff300e28db26eabf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:09.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3efbfff700 1 -- 172.21.15.29:0/2367845275 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400e070 con 0x7f3f080c8b50 2023-10-06T05:28:09.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3efbfff700 1 -- 172.21.15.29:0/2367845275 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0400b9d0 con 0x7f3f080c8b50 2023-10-06T05:28:09.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3efbfff700 1 -- 172.21.15.29:0/2367845275 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f040092e0 con 0x7f3f080c8b50 2023-10-06T05:28:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0e600700 1 -- 172.21.15.29:0/2367845275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f080c8b50 msgr2=0x7f3f0806ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0e600700 1 --2- 172.21.15.29:0/2367845275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f080c8b50 0x7f3f0806ccc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009f20 tx=0x7f3f04009840 comp rx=0 tx=0).stop 2023-10-06T05:28:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0e600700 1 -- 172.21.15.29:0/2367845275 shutdown_connections 2023-10-06T05:28:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0e600700 1 --2- 172.21.15.29:0/2367845275 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f08155cb0 0x7f3f0806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0e600700 1 --2- 172.21.15.29:0/2367845275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f080c8b50 0x7f3f0806ccc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0e600700 1 -- 172.21.15.29:0/2367845275 >> 172.21.15.29:0/2367845275 conn(0x7f3f080670a0 msgr2=0x7f3f080674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0e600700 1 -- 172.21.15.29:0/2367845275 shutdown_connections 2023-10-06T05:28:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.183+0000 7f3f0e600700 1 -- 172.21.15.29:0/2367845275 wait complete. 2023-10-06T05:28:09.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0e600700 1 Processor -- start 2023-10-06T05:28:09.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0e600700 1 -- start start 2023-10-06T05:28:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0e600700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f0806c8f0 0x7f3f080b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0e600700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f08155cb0 0x7f3f0816c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0e600700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0816caf0 0x7f3f0813fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0e600700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0814a250 con 0x7f3f0816caf0 2023-10-06T05:28:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0e600700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f081499b0 con 0x7f3f08155cb0 2023-10-06T05:28:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0e600700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08149c90 con 0x7f3f0806c8f0 2023-10-06T05:28:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0ddff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0816caf0 0x7f3f0813fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0ddff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0816caf0 0x7f3f0813fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49382/0 (socket says 172.21.15.29:49382) 2023-10-06T05:28:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0cdfd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f08155cb0 0x7f3f0816c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0ddff700 1 -- 172.21.15.29:0/3463254425 learned_addr learned my addr 172.21.15.29:0/3463254425 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:09.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0d5fe700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f0806c8f0 0x7f3f080b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0ddff700 1 -- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f0806c8f0 msgr2=0x7f3f080b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0ddff700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f0806c8f0 0x7f3f080b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0ddff700 1 -- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f08155cb0 msgr2=0x7f3f0816c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0ddff700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f08155cb0 0x7f3f0816c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.187+0000 7f3f0ddff700 1 -- 172.21.15.29:0/3463254425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f04009ae0 con 0x7f3f0816caf0 2023-10-06T05:28:09.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.191+0000 7f3f0ddff700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0816caf0 0x7f3f0813fb00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e8d0 tx=0x7f3f000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:09.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.191+0000 7f3ef97fa700 1 -- 172.21.15.29:0/3463254425 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00013680 con 0x7f3f0816caf0 2023-10-06T05:28:09.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.191+0000 7f3ef97fa700 1 -- 172.21.15.29:0/3463254425 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f000137e0 con 0x7f3f0816caf0 2023-10-06T05:28:09.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.191+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f08149f70 con 0x7f3f0816caf0 2023-10-06T05:28:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.191+0000 7f3ef97fa700 1 -- 172.21.15.29:0/3463254425 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00013ba0 con 0x7f3f0816caf0 2023-10-06T05:28:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.191+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f080b1790 con 0x7f3f0816caf0 2023-10-06T05:28:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.191+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0804be00 con 0x7f3f0816caf0 2023-10-06T05:28:09.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.191+0000 7f3ef97fa700 1 -- 172.21.15.29:0/3463254425 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3f000123d0 con 0x7f3f0816caf0 2023-10-06T05:28:09.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.195+0000 7f3ef97fa700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eec060550 0x7f3eec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.195+0000 7f3ef97fa700 1 -- 172.21.15.29:0/3463254425 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3f0007c6c0 con 0x7f3f0816caf0 2023-10-06T05:28:09.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.195+0000 7f3f0d5fe700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eec060550 0x7f3eec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.195+0000 7f3f0d5fe700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eec060550 0x7f3eec062a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3efc003a80 tx=0x7f3efc007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:09.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.199+0000 7f3ef97fa700 1 -- 172.21.15.29:0/3463254425 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3f0004cea0 con 0x7f3f0816caf0 2023-10-06T05:28:09.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3f080ca450 con 0x7f3f0816caf0 2023-10-06T05:28:09.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3ef97fa700 1 -- 172.21.15.29:0/3463254425 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3f000504c0 con 0x7f3f0816caf0 2023-10-06T05:28:09.421 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:09.421 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:28:09.421 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2023-10-06T05:28:09.421 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.421 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lmmo6OBAAQpP+gZa78MNtTT1c5tK+vw==", 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.422 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2023-10-06T05:28:09.423 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lOCLABhAA38TEJqLAC+ccT54rGKcRHQ==", 2023-10-06T05:28:09.423 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.423 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:28:09.423 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:28:09.423 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:28:09.423 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lLN0yABAAa4pRtt5i1VwRUls37iQ6Ng==", 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.424 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9l/IkZChAAA0KqF/fQdw+Lvfgt3G7D1Q==", 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.425 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9liLI7OhAA2q9u7NoYTihYVqDD6feWqg==", 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.426 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAdmh9lVgGUABAAT+KgCiblIExCBVOWaW1KTQ==", 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.427 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAgmh9lTun5BhAAhxhwULNJol5kiIMd6cr4EQ==", 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2023-10-06T05:28:09.428 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAjmh9lJRz4DBAAPs7JW7cj58uGIh0CXjTPOA==", 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAomh9lF4v2MRAA6d30MwZe8jaJE2/KZ2v2fg==", 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:28:09.429 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAsmh9lLsIbCRAAW0z6kOmd/cRdSMyGXB43cA==", 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.430 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.431 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.431 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.431 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2023-10-06T05:28:09.431 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAvmh9lBdCTDhAACXtGHMjlSZ4mDObzP73SCw==", 2023-10-06T05:28:09.431 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.431 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:28:09.431 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:28:09.431 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.432 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.432 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.432 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.432 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2023-10-06T05:28:09.432 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAymh9lpfyEExAAKfZ7994WtblLHuzw9X2CjA==", 2023-10-06T05:28:09.432 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.432 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:28:09.432 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:28:09.433 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.433 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.433 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.433 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.433 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2023-10-06T05:28:09.433 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9l/dfwDBAAyd4qv0io8GSbP8ukYr6WaQ==", 2023-10-06T05:28:09.433 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.433 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:28:09.433 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow r", 2023-10-06T05:28:09.434 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T05:28:09.434 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.434 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.434 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.434 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2023-10-06T05:28:09.434 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lhSm7EhAA//AImYYn3pBpCmwsOv9X8g==", 2023-10-06T05:28:09.434 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.434 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:28:09.434 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:28:09.435 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:28:09.435 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:28:09.435 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.435 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.435 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.435 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.2", 2023-10-06T05:28:09.435 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lLAPFDxAA0M9C3WbeOYjQvGGIqPRrSw==", 2023-10-06T05:28:09.435 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.435 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:28:09.436 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:28:09.436 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:28:09.436 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:28:09.436 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.436 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.436 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.436 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.3", 2023-10-06T05:28:09.436 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lYEpMFRAAgFoS4+VPWcjT0TgyNTDFFA==", 2023-10-06T05:28:09.436 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lrcA0KxAAl4GK+rF0VWq9nkzu1RXN1A==", 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.437 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9l0ABYNRAAjZ6Ji5Q1o0HKn3oDYZaZ+w==", 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.438 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lCDNrMhAA/2ymYL+jXTRPLjyoHbWzPg==", 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-06T05:28:09.439 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:28:09.440 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.440 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:09.440 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-06T05:28:09.440 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:28:09.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eec060550 msgr2=0x7f3eec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eec060550 0x7f3eec062a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3efc003a80 tx=0x7f3efc007ec0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0816caf0 msgr2=0x7f3f0813fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0816caf0 0x7f3f0813fb00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e8d0 tx=0x7f3f000091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 shutdown_connections 2023-10-06T05:28:09.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0816caf0 0x7f3f0813fb00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3eec060550 0x7f3eec062a00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f08155cb0 0x7f3f0816c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 --2- 172.21.15.29:0/3463254425 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f0806c8f0 0x7f3f080b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 >> 172.21.15.29:0/3463254425 conn(0x7f3f080670a0 msgr2=0x7f3f08067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.415+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 shutdown_connections 2023-10-06T05:28:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.419+0000 7f3f0e600700 1 -- 172.21.15.29:0/3463254425 wait complete. 2023-10-06T05:28:09.444 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:28:09.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f1e30700 1 Processor -- start 2023-10-06T05:28:09.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f1e30700 1 -- start start 2023-10-06T05:28:09.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f1e30700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec1569f0 0x7f97ec0ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f1e30700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec06a5b0 con 0x7f97ec0c68b0 2023-10-06T05:28:09.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f1e30700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec15b0a0 con 0x7f97ec156dc0 2023-10-06T05:28:09.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f1e30700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec15b380 con 0x7f97ec1569f0 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f162f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f97ec0c68b0 0x7f97ec06aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43642/0 (socket says 172.21.15.29:43642) 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f162f700 1 -- 172.21.15.29:0/3034629476 learned_addr learned my addr 172.21.15.29:0/3034629476 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791444461 0 0) 0x7f97ec06a5b0 con 0x7f97ec0c68b0 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d8003570 con 0x7f97ec0c68b0 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1000402866 0 0) 0x7f97d8003570 con 0x7f97ec0c68b0 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec1569f0 msgr2=0x7f97ec0ab220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 --2- 172.21.15.29:0/3034629476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec1569f0 0x7f97ec0ab220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 >> v1:172.21.15.173:6789/0 conn(0x7f97ec156dc0 legacy=0x7f97ec15a870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec15b660 con 0x7f97ec0c68b0 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f97e40017f0 con 0x7f97ec0c68b0 2023-10-06T05:28:09.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 >> v1:172.21.15.29:6789/0 conn(0x7f97ec0c68b0 legacy=0x7f97ec06aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 --2- 172.21.15.29:0/3034629476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec1569f0 0x7f97d8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 --2- 172.21.15.29:0/3034629476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97d80041a0 0x7f97d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 --2- 172.21.15.29:0/3034629476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e70 0x7f97d80052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec15b380 con 0x7f97d8004e70 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d800bd60 con 0x7f97d80041a0 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d800bf20 con 0x7f97ec1569f0 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f162f700 1 --2- 172.21.15.29:0/3034629476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e70 0x7f97d80052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f162f700 1 -- 172.21.15.29:0/3034629476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec1569f0 msgr2=0x7f97d8003a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f162f700 1 --2- 172.21.15.29:0/3034629476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec1569f0 0x7f97d8003a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f162f700 1 -- 172.21.15.29:0/3034629476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97d80041a0 msgr2=0x7f97d8004810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f162f700 1 --2- 172.21.15.29:0/3034629476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97d80041a0 0x7f97d8004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f162f700 1 -- 172.21.15.29:0/3034629476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d8003570 con 0x7f97d8004e70 2023-10-06T05:28:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97f162f700 1 --2- 172.21.15.29:0/3034629476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e70 0x7f97d80052e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f97e400a970 tx=0x7f97e4002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e65ea25905de1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40070d0 con 0x7f97d8004e70 2023-10-06T05:28:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4007250 con 0x7f97d8004e70 2023-10-06T05:28:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.547+0000 7f97eb7fe700 1 -- 172.21.15.29:0/3034629476 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4007610 con 0x7f97d8004e70 2023-10-06T05:28:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.551+0000 7f97f1e30700 1 -- 172.21.15.29:0/3034629476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e70 msgr2=0x7f97d80052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.551+0000 7f97f1e30700 1 --2- 172.21.15.29:0/3034629476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e70 0x7f97d80052e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f97e400a970 tx=0x7f97e4002210 comp rx=0 tx=0).stop 2023-10-06T05:28:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.551+0000 7f97f162f700 1 -- 172.21.15.29:0/3034629476 reap_dead start 2023-10-06T05:28:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.551+0000 7f97f1e30700 1 -- 172.21.15.29:0/3034629476 shutdown_connections 2023-10-06T05:28:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.551+0000 7f97f1e30700 1 -- 172.21.15.29:0/3034629476 >> 172.21.15.29:0/3034629476 conn(0x7f97ec0670a0 msgr2=0x7f97ec0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.551+0000 7f97f1e30700 1 -- 172.21.15.29:0/3034629476 shutdown_connections 2023-10-06T05:28:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.551+0000 7f97f1e30700 1 -- 172.21.15.29:0/3034629476 wait complete. 2023-10-06T05:28:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.551+0000 7f97f1e30700 1 Processor -- start 2023-10-06T05:28:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.551+0000 7f97f1e30700 1 -- start start 2023-10-06T05:28:09.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f1e30700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97ec14ab40 0x7f97ec0c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f1e30700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec0ae870 0x7f97ec151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f1e30700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec152210 0x7f97ec158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f1e30700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec14af10 con 0x7f97ec152210 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f1e30700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec152690 con 0x7f97ec14ab40 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f1e30700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0c3430 con 0x7f97ec0ae870 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f162f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec152210 0x7f97ec158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f162f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec152210 0x7f97ec158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49404/0 (socket says 172.21.15.29:49404) 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f162f700 1 -- 172.21.15.29:0/3530176021 learned_addr learned my addr 172.21.15.29:0/3530176021 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97ebfff700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec0ae870 0x7f97ec151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f0e2e700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97ec14ab40 0x7f97ec0c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f162f700 1 -- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec0ae870 msgr2=0x7f97ec151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f162f700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec0ae870 0x7f97ec151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f162f700 1 -- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97ec14ab40 msgr2=0x7f97ec0c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f162f700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97ec14ab40 0x7f97ec0c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f162f700 1 -- 172.21.15.29:0/3530176021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0b10e0 con 0x7f97ec152210 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f162f700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec152210 0x7f97ec158310 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f97e4002250 tx=0x7f97e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97e8ff9700 1 -- 172.21.15.29:0/3530176021 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4001330 con 0x7f97ec152210 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97e8ff9700 1 -- 172.21.15.29:0/3530176021 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e401e450 con 0x7f97ec152210 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97e8ff9700 1 -- 172.21.15.29:0/3530176021 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e401e810 con 0x7f97ec152210 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec0b13c0 con 0x7f97ec152210 2023-10-06T05:28:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec0c2fe0 con 0x7f97ec152210 2023-10-06T05:28:09.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.555+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec0c35f0 con 0x7f97ec152210 2023-10-06T05:28:09.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.559+0000 7f97e8ff9700 1 -- 172.21.15.29:0/3530176021 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f97e401eb80 con 0x7f97ec152210 2023-10-06T05:28:09.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.559+0000 7f97e8ff9700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060580 0x7f97cc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.559+0000 7f97e8ff9700 1 -- 172.21.15.29:0/3530176021 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f97e407ea40 con 0x7f97ec152210 2023-10-06T05:28:09.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.559+0000 7f97f0e2e700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060580 0x7f97cc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.559+0000 7f97f0e2e700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060580 0x7f97cc062a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f97dc006fd0 tx=0x7f97dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:09.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.567+0000 7f97e8ff9700 1 -- 172.21.15.29:0/3530176021 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f97e4080e60 con 0x7f97ec152210 2023-10-06T05:28:09.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.727+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97ec04be00 con 0x7f97ec152210 2023-10-06T05:28:09.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.727+0000 7f97e8ff9700 1 -- 172.21.15.29:0/3530176021 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+13650 (secure 0 0 0) 0x7f97e404f220 con 0x7f97ec152210 2023-10-06T05:28:09.736 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:09.736 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":58,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:28:08.999289+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060580 msgr2=0x7f97cc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060580 0x7f97cc062a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f97dc006fd0 tx=0x7f97dc008040 comp rx=0 tx=0).stop 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec152210 msgr2=0x7f97ec158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec152210 0x7f97ec158310 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f97e4002250 tx=0x7f97e4015000 comp rx=0 tx=0).stop 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 shutdown_connections 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec152210 0x7f97ec158310 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97ec0ae870 0x7f97ec151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f97cc060580 0x7f97cc062a30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 --2- 172.21.15.29:0/3530176021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97ec14ab40 0x7f97ec0c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 >> 172.21.15.29:0/3530176021 conn(0x7f97ec0670a0 msgr2=0x7f97ec0ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:09.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 shutdown_connections 2023-10-06T05:28:09.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.731+0000 7f97f1e30700 1 -- 172.21.15.29:0/3530176021 wait complete. 2023-10-06T05:28:09.754 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T05:28:09.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:28:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.859+0000 7f545759e700 1 Processor -- start 2023-10-06T05:28:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.859+0000 7f545759e700 1 -- start start 2023-10-06T05:28:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54581559d0 0x7f54580c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5458155da0 0x7f54580c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54581596e0 con 0x7f54580cae80 2023-10-06T05:28:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545815a520 con 0x7f5458155da0 2023-10-06T05:28:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580ae800 con 0x7f54581559d0 2023-10-06T05:28:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f5455d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5458155da0 0x7f54580c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f5456d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f54580cae80 0x7f54580c95d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43644/0 (socket says 172.21.15.29:43644) 2023-10-06T05:28:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f5456d9d700 1 -- 172.21.15.29:0/3010347450 learned_addr learned my addr 172.21.15.29:0/3010347450 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:09.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545659c700 1 --2- 172.21.15.29:0/3010347450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54581559d0 0x7f54580c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f5455d9b700 1 -- 172.21.15.29:0/3010347450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54581559d0 msgr2=0x7f54580c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:09.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f5455d9b700 1 --2- 172.21.15.29:0/3010347450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54581559d0 0x7f54580c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f5455d9b700 1 -- 172.21.15.29:0/3010347450 >> v1:172.21.15.29:6789/0 conn(0x7f54580cae80 legacy=0x7f54580c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f5455d9b700 1 -- 172.21.15.29:0/3010347450 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458159910 con 0x7f5458155da0 2023-10-06T05:28:09.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f5455d9b700 1 --2- 172.21.15.29:0/3010347450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5458155da0 0x7f54580c89b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f54400098e0 tx=0x7f54400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acaac87d4dfc409 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:09.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545559a700 1 -- 172.21.15.29:0/3010347450 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440009e80 con 0x7f5458155da0 2023-10-06T05:28:09.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545559a700 1 -- 172.21.15.29:0/3010347450 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000b760 con 0x7f5458155da0 2023-10-06T05:28:09.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545559a700 1 -- 172.21.15.29:0/3010347450 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000bae0 con 0x7f5458155da0 2023-10-06T05:28:09.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 -- 172.21.15.29:0/3010347450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5458155da0 msgr2=0x7f54580c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 --2- 172.21.15.29:0/3010347450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5458155da0 0x7f54580c89b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f54400098e0 tx=0x7f54400091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 -- 172.21.15.29:0/3010347450 shutdown_connections 2023-10-06T05:28:09.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 --2- 172.21.15.29:0/3010347450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5458155da0 0x7f54580c89b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 --2- 172.21.15.29:0/3010347450 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54581559d0 0x7f54580c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 -- 172.21.15.29:0/3010347450 >> 172.21.15.29:0/3010347450 conn(0x7f545806c6c0 msgr2=0x7f545806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:09.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 -- 172.21.15.29:0/3010347450 shutdown_connections 2023-10-06T05:28:09.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.863+0000 7f545759e700 1 -- 172.21.15.29:0/3010347450 wait complete. 2023-10-06T05:28:09.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545759e700 1 Processor -- start 2023-10-06T05:28:09.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545759e700 1 -- start start 2023-10-06T05:28:09.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54580cae80 0x7f54580c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54581559d0 0x7f54580aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5458155da0 0x7f54580c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54580c3220 con 0x7f54581559d0 2023-10-06T05:28:09.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5458154160 con 0x7f54580cae80 2023-10-06T05:28:09.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580af300 con 0x7f5458155da0 2023-10-06T05:28:09.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5455d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54581559d0 0x7f54580aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5455d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54581559d0 0x7f54580aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49416/0 (socket says 172.21.15.29:49416) 2023-10-06T05:28:09.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5455d9b700 1 -- 172.21.15.29:0/3456226146 learned_addr learned my addr 172.21.15.29:0/3456226146 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:09.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5456d9d700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5458155da0 0x7f54580c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545659c700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54580cae80 0x7f54580c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5455d9b700 1 -- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5458155da0 msgr2=0x7f54580c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5455d9b700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5458155da0 0x7f54580c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5455d9b700 1 -- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54580cae80 msgr2=0x7f54580c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:09.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5455d9b700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54580cae80 0x7f54580c2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:09.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5455d9b700 1 -- 172.21.15.29:0/3456226146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5440009420 con 0x7f54581559d0 2023-10-06T05:28:09.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f5455d9b700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54581559d0 0x7f54580aedc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5458068f20 tx=0x7f5440016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:09.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f544e7fc700 1 -- 172.21.15.29:0/3456226146 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000b8d0 con 0x7f54581559d0 2023-10-06T05:28:09.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f544e7fc700 1 -- 172.21.15.29:0/3456226146 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000ba30 con 0x7f54581559d0 2023-10-06T05:28:09.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.867+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54580c5ae0 con 0x7f54581559d0 2023-10-06T05:28:09.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.871+0000 7f544e7fc700 1 -- 172.21.15.29:0/3456226146 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544001c6b0 con 0x7f54581559d0 2023-10-06T05:28:09.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.871+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5458153b10 con 0x7f54581559d0 2023-10-06T05:28:09.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.871+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54581542f0 con 0x7f54581559d0 2023-10-06T05:28:09.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.871+0000 7f544e7fc700 1 -- 172.21.15.29:0/3456226146 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f544001ca60 con 0x7f54581559d0 2023-10-06T05:28:09.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.871+0000 7f544e7fc700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5438060550 0x7f5438062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:09.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.871+0000 7f544e7fc700 1 -- 172.21.15.29:0/3456226146 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f544007ebb0 con 0x7f54581559d0 2023-10-06T05:28:09.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.871+0000 7f545659c700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5438060550 0x7f5438062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:09.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.875+0000 7f545659c700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5438060550 0x7f5438062a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5448006fd0 tx=0x7f5448008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:09.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:09.875+0000 7f544e7fc700 1 -- 172.21.15.29:0/3456226146 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f544004f410 con 0x7f54581559d0 2023-10-06T05:28:10.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.039+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54581542a0 con 0x7f54581559d0 2023-10-06T05:28:10.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.039+0000 7f544e7fc700 1 -- 172.21.15.29:0/3456226146 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5440052a30 con 0x7f54581559d0 2023-10-06T05:28:10.047 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5438060550 msgr2=0x7f5438062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5438060550 0x7f5438062a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5448006fd0 tx=0x7f5448008040 comp rx=0 tx=0).stop 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54581559d0 msgr2=0x7f54580aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54581559d0 0x7f54580aedc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5458068f20 tx=0x7f5440016000 comp rx=0 tx=0).stop 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 shutdown_connections 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5458155da0 0x7f54580c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54581559d0 0x7f54580aedc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5438060550 0x7f5438062a00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 --2- 172.21.15.29:0/3456226146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54580cae80 0x7f54580c2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 >> 172.21.15.29:0/3456226146 conn(0x7f545806c6c0 msgr2=0x7f54581512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:10.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 shutdown_connections 2023-10-06T05:28:10.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.043+0000 7f545759e700 1 -- 172.21.15.29:0/3456226146 wait complete. 2023-10-06T05:28:10.067 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:28:10.154 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:28:10.156 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:28:10.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.175+0000 7f5e2f59e700 1 Processor -- start 2023-10-06T05:28:10.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.175+0000 7f5e2f59e700 1 -- start start 2023-10-06T05:28:10.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e300c8c70 0x7f5e300cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300c87e0 con 0x7f5e3006a370 2023-10-06T05:28:10.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300ca3f0 con 0x7f5e300cb020 2023-10-06T05:28:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e300c7bd0 con 0x7f5e300c8c70 2023-10-06T05:28:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2dd9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e300c8c70 0x7f5e300cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2ed9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5e3006a370 0x7f5e300c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43652/0 (socket says 172.21.15.29:43652) 2023-10-06T05:28:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2ed9d700 1 -- 172.21.15.29:0/882485456 learned_addr learned my addr 172.21.15.29:0/882485456 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2dd9b700 1 -- 172.21.15.29:0/882485456 >> v1:172.21.15.173:6789/0 conn(0x7f5e300cb020 legacy=0x7f5e300c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2dd9b700 1 -- 172.21.15.29:0/882485456 >> v1:172.21.15.29:6789/0 conn(0x7f5e3006a370 legacy=0x7f5e300c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2d59a700 1 -- 172.21.15.29:0/882485456 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143737640 0 0) 0x7f5e300c87e0 con 0x7f5e3006a370 2023-10-06T05:28:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2dd9b700 1 -- 172.21.15.29:0/882485456 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300c7eb0 con 0x7f5e300c8c70 2023-10-06T05:28:10.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2dd9b700 1 --2- 172.21.15.29:0/882485456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 0x7f5e300cb3f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5e240098e0 tx=0x7f5e240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69b574ba6969d01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:10.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2d59a700 1 -- 172.21.15.29:0/882485456 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24009e80 con 0x7f5e300c8c70 2023-10-06T05:28:10.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2d59a700 1 -- 172.21.15.29:0/882485456 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2400b860 con 0x7f5e300c8c70 2023-10-06T05:28:10.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2d59a700 1 -- 172.21.15.29:0/882485456 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2400bbe0 con 0x7f5e300c8c70 2023-10-06T05:28:10.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 -- 172.21.15.29:0/882485456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 msgr2=0x7f5e300cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 --2- 172.21.15.29:0/882485456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 0x7f5e300cb3f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5e240098e0 tx=0x7f5e240091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 -- 172.21.15.29:0/882485456 shutdown_connections 2023-10-06T05:28:10.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 --2- 172.21.15.29:0/882485456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 0x7f5e300cb3f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 -- 172.21.15.29:0/882485456 >> 172.21.15.29:0/882485456 conn(0x7f5e3006c6c0 msgr2=0x7f5e3006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 -- 172.21.15.29:0/882485456 shutdown_connections 2023-10-06T05:28:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.179+0000 7f5e2f59e700 1 -- 172.21.15.29:0/882485456 wait complete. 2023-10-06T05:28:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2f59e700 1 Processor -- start 2023-10-06T05:28:10.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2f59e700 1 -- start start 2023-10-06T05:28:10.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2f59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e3006a370 0x7f5e301597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 0x7f5e30150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e300cb020 0x7f5e30155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3015a600 con 0x7f5e300c8c70 2023-10-06T05:28:10.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2f59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30154dd0 con 0x7f5e3006a370 2023-10-06T05:28:10.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3015a040 con 0x7f5e300cb020 2023-10-06T05:28:10.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 0x7f5e30150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 0x7f5e30150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49426/0 (socket says 172.21.15.29:49426) 2023-10-06T05:28:10.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2dd9b700 1 -- 172.21.15.29:0/4051692930 learned_addr learned my addr 172.21.15.29:0/4051692930 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:10.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2ed9d700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e300cb020 0x7f5e30155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2e59c700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e3006a370 0x7f5e301597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2dd9b700 1 -- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e300cb020 msgr2=0x7f5e30155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2dd9b700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e300cb020 0x7f5e30155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2dd9b700 1 -- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e3006a370 msgr2=0x7f5e301597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2dd9b700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e3006a370 0x7f5e301597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2dd9b700 1 -- 172.21.15.29:0/4051692930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e24009420 con 0x7f5e300c8c70 2023-10-06T05:28:10.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.183+0000 7f5e2e59c700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e3006a370 0x7f5e301597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:10.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e2dd9b700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 0x7f5e30150cc0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5e30068f20 tx=0x7f5e24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:10.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e1e7fc700 1 -- 172.21.15.29:0/4051692930 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2400bbe0 con 0x7f5e300c8c70 2023-10-06T05:28:10.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e1e7fc700 1 -- 172.21.15.29:0/4051692930 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e24011420 con 0x7f5e300c8c70 2023-10-06T05:28:10.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e1e7fc700 1 -- 172.21.15.29:0/4051692930 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240117c0 con 0x7f5e300c8c70 2023-10-06T05:28:10.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3015a320 con 0x7f5e300c8c70 2023-10-06T05:28:10.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e30155350 con 0x7f5e300c8c70 2023-10-06T05:28:10.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e300c7880 con 0x7f5e300c8c70 2023-10-06T05:28:10.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e1e7fc700 1 -- 172.21.15.29:0/4051692930 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5e24011b30 con 0x7f5e300c8c70 2023-10-06T05:28:10.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e1e7fc700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e10060550 0x7f5e10062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e1e7fc700 1 -- 172.21.15.29:0/4051692930 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5e2407e070 con 0x7f5e300c8c70 2023-10-06T05:28:10.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.187+0000 7f5e2e59c700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e10060550 0x7f5e10062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.191+0000 7f5e2e59c700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e10060550 0x7f5e10062a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007fd0 tx=0x7f5e28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:10.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.199+0000 7f5e1e7fc700 1 -- 172.21.15.29:0/4051692930 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e240adbe0 con 0x7f5e300c8c70 2023-10-06T05:28:10.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.359+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e3004be00 con 0x7f5e300c8c70 2023-10-06T05:28:10.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.359+0000 7f5e1e7fc700 1 -- 172.21.15.29:0/4051692930 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e240150a0 con 0x7f5e300c8c70 2023-10-06T05:28:10.366 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:28:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e10060550 msgr2=0x7f5e10062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e10060550 0x7f5e10062a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007fd0 tx=0x7f5e28009040 comp rx=0 tx=0).stop 2023-10-06T05:28:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 msgr2=0x7f5e30150cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 0x7f5e30150cc0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5e30068f20 tx=0x7f5e24017000 comp rx=0 tx=0).stop 2023-10-06T05:28:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 shutdown_connections 2023-10-06T05:28:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e300cb020 0x7f5e30155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300c8c70 0x7f5e30150cc0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e10060550 0x7f5e10062a00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 --2- 172.21.15.29:0/4051692930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e3006a370 0x7f5e301597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 >> 172.21.15.29:0/4051692930 conn(0x7f5e3006c6c0 msgr2=0x7f5e3006a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 shutdown_connections 2023-10-06T05:28:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.363+0000 7f5e2f59e700 1 -- 172.21.15.29:0/4051692930 wait complete. 2023-10-06T05:28:10.386 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T05:28:10.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.527+0000 7f9a3759e700 1 Processor -- start 2023-10-06T05:28:10.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.527+0000 7f9a3759e700 1 -- start start 2023-10-06T05:28:10.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a38158cd0 0x7f9a38067710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9a380cb0b0 0x7f9a3806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a38068de0 con 0x7f9a38067c50 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a380681d0 con 0x7f9a380cb0b0 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380684b0 con 0x7f9a38158cd0 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a36d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9a38067c50 0x7f9a3815c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43658/0 (socket says 172.21.15.29:43658) 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a36d9d700 1 -- 172.21.15.29:0/511407286 learned_addr learned my addr 172.21.15.29:0/511407286 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a35d9b700 1 --2- 172.21.15.29:0/511407286 >> v2:172.21.15.173:3300/0 conn(0x7f9a380cb0b0 0x7f9a3806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3659c700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a38158cd0 0x7f9a38067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347935291 0 0) 0x7f9a38068de0 con 0x7f9a38067c50 2023-10-06T05:28:10.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a20003570 con 0x7f9a38067c50 2023-10-06T05:28:10.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 36719533 0 0) 0x7f9a20003570 con 0x7f9a38067c50 2023-10-06T05:28:10.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a38158cd0 msgr2=0x7f9a38067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:10.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a38158cd0 0x7f9a38067710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 >> v2:172.21.15.173:3300/0 conn(0x7f9a380cb0b0 msgr2=0x7f9a3806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 --2- 172.21.15.29:0/511407286 >> v2:172.21.15.173:3300/0 conn(0x7f9a380cb0b0 0x7f9a3806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38068790 con 0x7f9a38067c50 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f9a300017f0 con 0x7f9a38067c50 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 >> v1:172.21.15.29:6789/0 conn(0x7f9a38067c50 legacy=0x7f9a3815c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a38158cd0 0x7f9a20003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a20003fe0 0x7f9a20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a20004d50 0x7f9a200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380681d0 con 0x7f9a20003fe0 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380684b0 con 0x7f9a20004d50 2023-10-06T05:28:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2000ba90 con 0x7f9a38158cd0 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a35d9b700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a20003fe0 0x7f9a20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a3659c700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a38158cd0 0x7f9a20003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a36d9d700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a20004d50 0x7f9a200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a35d9b700 1 -- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a38158cd0 msgr2=0x7f9a20003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a35d9b700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a38158cd0 0x7f9a20003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a35d9b700 1 -- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a20004d50 msgr2=0x7f9a200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a35d9b700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a20004d50 0x7f9a200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.531+0000 7f9a35d9b700 1 -- 172.21.15.29:0/511407286 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20003570 con 0x7f9a20003fe0 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a35d9b700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a20003fe0 0x7f9a20004810 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009c00 tx=0x7f9a280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d0b0652696ff18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800e6b0 con 0x7f9a20003fe0 2023-10-06T05:28:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2800e810 con 0x7f9a20003fe0 2023-10-06T05:28:10.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3559a700 1 -- 172.21.15.29:0/511407286 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800ebd0 con 0x7f9a20003fe0 2023-10-06T05:28:10.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3759e700 1 -- 172.21.15.29:0/511407286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a20003fe0 msgr2=0x7f9a20004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3759e700 1 --2- 172.21.15.29:0/511407286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a20003fe0 0x7f9a20004810 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009c00 tx=0x7f9a280091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a36d9d700 1 -- 172.21.15.29:0/511407286 reap_dead start 2023-10-06T05:28:10.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3759e700 1 -- 172.21.15.29:0/511407286 shutdown_connections 2023-10-06T05:28:10.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3759e700 1 -- 172.21.15.29:0/511407286 >> 172.21.15.29:0/511407286 conn(0x7f9a3806aaf0 msgr2=0x7f9a3806aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:10.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3759e700 1 -- 172.21.15.29:0/511407286 shutdown_connections 2023-10-06T05:28:10.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3759e700 1 -- 172.21.15.29:0/511407286 wait complete. 2023-10-06T05:28:10.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3759e700 1 Processor -- start 2023-10-06T05:28:10.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.535+0000 7f9a3759e700 1 -- start start 2023-10-06T05:28:10.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a20003fe0 0x7f9a380c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3814d390 0x7f9a3814df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a3814d7e0 0x7f9a3814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3815aa40 con 0x7f9a3814d7e0 2023-10-06T05:28:10.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3815a760 con 0x7f9a20003fe0 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380c5160 con 0x7f9a3814d390 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a36d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a3814d7e0 0x7f9a3814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a36d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a3814d7e0 0x7f9a3814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49452/0 (socket says 172.21.15.29:49452) 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a36d9d700 1 -- 172.21.15.29:0/666728412 learned_addr learned my addr 172.21.15.29:0/666728412 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a35d9b700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3814d390 0x7f9a3814df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3659c700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a20003fe0 0x7f9a380c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a36d9d700 1 -- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3814d390 msgr2=0x7f9a3814df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a36d9d700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3814d390 0x7f9a3814df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a36d9d700 1 -- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a20003fe0 msgr2=0x7f9a380c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a36d9d700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a20003fe0 0x7f9a380c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a36d9d700 1 -- 172.21.15.29:0/666728412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380c5440 con 0x7f9a3814d7e0 2023-10-06T05:28:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a36d9d700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a3814d7e0 0x7f9a3814e4b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9a3806c020 tx=0x7f9a30002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a267fc700 1 -- 172.21.15.29:0/666728412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3000ada0 con 0x7f9a3814d7e0 2023-10-06T05:28:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a267fc700 1 -- 172.21.15.29:0/666728412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a300133f0 con 0x7f9a3814d7e0 2023-10-06T05:28:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a380c5720 con 0x7f9a3814d7e0 2023-10-06T05:28:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a267fc700 1 -- 172.21.15.29:0/666728412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a300137b0 con 0x7f9a3814d7e0 2023-10-06T05:28:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3814eb90 con 0x7f9a3814d7e0 2023-10-06T05:28:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.539+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a380c6180 con 0x7f9a3814d7e0 2023-10-06T05:28:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.543+0000 7f9a267fc700 1 -- 172.21.15.29:0/666728412 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9a30013b60 con 0x7f9a3814d7e0 2023-10-06T05:28:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.543+0000 7f9a267fc700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9a18060580 0x7f9a18062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.543+0000 7f9a267fc700 1 -- 172.21.15.29:0/666728412 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9a3007ceb0 con 0x7f9a3814d7e0 2023-10-06T05:28:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.543+0000 7f9a3659c700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9a18060580 0x7f9a18062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.543+0000 7f9a3659c700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9a18060580 0x7f9a18062a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c006f00 tx=0x7f9a2c0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:10.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.547+0000 7f9a267fc700 1 -- 172.21.15.29:0/666728412 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9a3004d5f0 con 0x7f9a3814d7e0 2023-10-06T05:28:10.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.711+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9a380c5910 con 0x7f9a3814d7e0 2023-10-06T05:28:10.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.711+0000 7f9a267fc700 1 -- 172.21.15.29:0/666728412 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9a30050c10 con 0x7f9a3814d7e0 2023-10-06T05:28:10.719 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:10.719 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-06T05:28:10.719 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:10.719 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-06T05:28:10.719 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-06T05:28:10.719 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:10.720 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:28:10.720 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 2, 2023-10-06T05:28:10.720 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": "rbd" 2023-10-06T05:28:10.720 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:10.720 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-06T05:28:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9a18060580 msgr2=0x7f9a18062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9a18060580 0x7f9a18062a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c006f00 tx=0x7f9a2c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a3814d7e0 msgr2=0x7f9a3814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a3814d7e0 0x7f9a3814e4b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9a3806c020 tx=0x7f9a30002210 comp rx=0 tx=0).stop 2023-10-06T05:28:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 shutdown_connections 2023-10-06T05:28:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a3814d7e0 0x7f9a3814e4b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a3814d390 0x7f9a3814df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9a18060580 0x7f9a18062a30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 --2- 172.21.15.29:0/666728412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a20003fe0 0x7f9a380c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 >> 172.21.15.29:0/666728412 conn(0x7f9a3806aaf0 msgr2=0x7f9a3806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:10.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 shutdown_connections 2023-10-06T05:28:10.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.715+0000 7f9a3759e700 1 -- 172.21.15.29:0/666728412 wait complete. 2023-10-06T05:28:10.733 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T05:28:10.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T05:28:10.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44759e700 1 Processor -- start 2023-10-06T05:28:10.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44759e700 1 -- start start 2023-10-06T05:28:10.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc448156870 0x7fc44815b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4480c8af0 0x7fc4480ab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44806b540 con 0x7fc44806a370 2023-10-06T05:28:10.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44815b650 con 0x7fc4480c8af0 2023-10-06T05:28:10.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44806a930 con 0x7fc448156870 2023-10-06T05:28:10.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc446d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4480c8af0 0x7fc4480ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc445d9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc44806a370 0x7fc4480c83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43674/0 (socket says 172.21.15.29:43674) 2023-10-06T05:28:10.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc445d9b700 1 -- 172.21.15.29:0/814900645 learned_addr learned my addr 172.21.15.29:0/814900645 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:10.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44659c700 1 --2- 172.21.15.29:0/814900645 >> v2:172.21.15.173:3300/0 conn(0x7fc448156870 0x7fc44815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44559a700 1 -- 172.21.15.29:0/814900645 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585217217 0 0) 0x7fc44806b540 con 0x7fc44806a370 2023-10-06T05:28:10.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44559a700 1 -- 172.21.15.29:0/814900645 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc434003570 con 0x7fc44806a370 2023-10-06T05:28:10.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc446d9d700 1 -- 172.21.15.29:0/814900645 >> v2:172.21.15.173:3300/0 conn(0x7fc448156870 msgr2=0x7fc44815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:10.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc446d9d700 1 --2- 172.21.15.29:0/814900645 >> v2:172.21.15.173:3300/0 conn(0x7fc448156870 0x7fc44815b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc446d9d700 1 -- 172.21.15.29:0/814900645 >> v1:172.21.15.29:6789/0 conn(0x7fc44806a370 legacy=0x7fc4480c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc446d9d700 1 -- 172.21.15.29:0/814900645 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44806ac10 con 0x7fc4480c8af0 2023-10-06T05:28:10.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc446d9d700 1 --2- 172.21.15.29:0/814900645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4480c8af0 0x7fc4480ab700 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc44806a060 tx=0x7fc440009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabc0e0c35904871 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:10.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.847+0000 7fc44559a700 1 -- 172.21.15.29:0/814900645 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44000e070 con 0x7fc4480c8af0 2023-10-06T05:28:10.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44559a700 1 -- 172.21.15.29:0/814900645 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44000bab0 con 0x7fc4480c8af0 2023-10-06T05:28:10.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44559a700 1 -- 172.21.15.29:0/814900645 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44000be70 con 0x7fc4480c8af0 2023-10-06T05:28:10.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 -- 172.21.15.29:0/814900645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4480c8af0 msgr2=0x7fc4480ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 --2- 172.21.15.29:0/814900645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4480c8af0 0x7fc4480ab700 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc44806a060 tx=0x7fc440009780 comp rx=0 tx=0).stop 2023-10-06T05:28:10.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 -- 172.21.15.29:0/814900645 shutdown_connections 2023-10-06T05:28:10.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 --2- 172.21.15.29:0/814900645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4480c8af0 0x7fc4480ab700 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 --2- 172.21.15.29:0/814900645 >> v2:172.21.15.173:3300/0 conn(0x7fc448156870 0x7fc44815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 -- 172.21.15.29:0/814900645 >> 172.21.15.29:0/814900645 conn(0x7fc44806c6c0 msgr2=0x7fc44806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:10.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 -- 172.21.15.29:0/814900645 shutdown_connections 2023-10-06T05:28:10.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 -- 172.21.15.29:0/814900645 wait complete. 2023-10-06T05:28:10.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 Processor -- start 2023-10-06T05:28:10.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 -- start start 2023-10-06T05:28:10.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc44806a370 0x7fc4481671f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480c8af0 0x7fc448154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc448156870 0x7fc4480afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc448167730 con 0x7fc448156870 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480ae800 con 0x7fc4480c8af0 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480aeae0 con 0x7fc44806a370 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc446d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc448156870 0x7fc4480afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc446d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc448156870 0x7fc4480afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49468/0 (socket says 172.21.15.29:49468) 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc446d9d700 1 -- 172.21.15.29:0/4173212510 learned_addr learned my addr 172.21.15.29:0/4173212510 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc445d9b700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480c8af0 0x7fc448154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.851+0000 7fc44659c700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc44806a370 0x7fc4481671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc446d9d700 1 -- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc44806a370 msgr2=0x7fc4481671f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc446d9d700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc44806a370 0x7fc4481671f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc446d9d700 1 -- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480c8af0 msgr2=0x7fc448154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:10.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc446d9d700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480c8af0 0x7fc448154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:10.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc446d9d700 1 -- 172.21.15.29:0/4173212510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc440009a20 con 0x7fc448156870 2023-10-06T05:28:10.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc446d9d700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc448156870 0x7fc4480afb80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc4400099f0 tx=0x7fc440019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:10.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc43e7fc700 1 -- 172.21.15.29:0/4173212510 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440012d00 con 0x7fc448156870 2023-10-06T05:28:10.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc43e7fc700 1 -- 172.21.15.29:0/4173212510 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc440012e60 con 0x7fc448156870 2023-10-06T05:28:10.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4480aedc0 con 0x7fc448156870 2023-10-06T05:28:10.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc43e7fc700 1 -- 172.21.15.29:0/4173212510 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4400276c0 con 0x7fc448156870 2023-10-06T05:28:10.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4480af380 con 0x7fc448156870 2023-10-06T05:28:10.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44804be00 con 0x7fc448156870 2023-10-06T05:28:10.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.855+0000 7fc43e7fc700 1 -- 172.21.15.29:0/4173212510 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc440024070 con 0x7fc448156870 2023-10-06T05:28:10.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.859+0000 7fc43e7fc700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc428060550 0x7fc428062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:10.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.859+0000 7fc43e7fc700 1 -- 172.21.15.29:0/4173212510 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc44007eb70 con 0x7fc448156870 2023-10-06T05:28:10.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.859+0000 7fc44659c700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc428060550 0x7fc428062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:10.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.859+0000 7fc44659c700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc428060550 0x7fc428062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc4480c1c10 tx=0x7fc4380091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:10.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:10.867+0000 7fc43e7fc700 1 -- 172.21.15.29:0/4173212510 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc44004f350 con 0x7fc448156870 2023-10-06T05:28:11.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:11.031+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc44806aef0 con 0x7fc448156870 2023-10-06T05:28:12.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.026+0000 7fc43e7fc700 1 -- 172.21.15.29:0/4173212510 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc44002c0b0 con 0x7fc448156870 2023-10-06T05:28:12.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.034+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc428060550 msgr2=0x7fc428062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:12.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.034+0000 7fc44759e700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc428060550 0x7fc428062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc4480c1c10 tx=0x7fc4380091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.034+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc448156870 msgr2=0x7fc4480afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:12.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.034+0000 7fc44759e700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc448156870 0x7fc4480afb80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc4400099f0 tx=0x7fc440019000 comp rx=0 tx=0).stop 2023-10-06T05:28:12.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.038+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 shutdown_connections 2023-10-06T05:28:12.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.038+0000 7fc44759e700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc448156870 0x7fc4480afb80 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.038+0000 7fc44759e700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc428060550 0x7fc428062a00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.038+0000 7fc44759e700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480c8af0 0x7fc448154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.038+0000 7fc44759e700 1 --2- 172.21.15.29:0/4173212510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc44806a370 0x7fc4481671f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.038+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 >> 172.21.15.29:0/4173212510 conn(0x7fc44806c6c0 msgr2=0x7fc4480c1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:12.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.038+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 shutdown_connections 2023-10-06T05:28:12.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.038+0000 7fc44759e700 1 -- 172.21.15.29:0/4173212510 wait complete. 2023-10-06T05:28:12.049 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-06T05:28:12.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T05:28:12.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.170+0000 7f3729c67700 1 Processor -- start 2023-10-06T05:28:12.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.170+0000 7f3729c67700 1 -- start start 2023-10-06T05:28:12.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3724158f10 0x7f37240ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:12.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f372415d730 0x7f372406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:12.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372406cc00 0x7f37240cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:12.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372406a600 con 0x7f372415d730 2023-10-06T05:28:12.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372406d080 con 0x7f3724158f10 2023-10-06T05:28:12.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240cacd0 con 0x7f372406cc00 2023-10-06T05:28:12.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3723fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f372415d730 0x7f372406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:12.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3723fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f372415d730 0x7f372406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49484/0 (socket says 172.21.15.29:49484) 2023-10-06T05:28:12.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3723fff700 1 -- 172.21.15.29:0/3572679247 learned_addr learned my addr 172.21.15.29:0/3572679247 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729466700 1 --2- 172.21.15.29:0/3572679247 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372406cc00 0x7f37240cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3728c65700 1 --2- 172.21.15.29:0/3572679247 >> v2:172.21.15.173:3300/0 conn(0x7f3724158f10 0x7f37240ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3723fff700 1 -- 172.21.15.29:0/3572679247 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372406cc00 msgr2=0x7f37240cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3723fff700 1 --2- 172.21.15.29:0/3572679247 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372406cc00 0x7f37240cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3723fff700 1 -- 172.21.15.29:0/3572679247 >> v2:172.21.15.173:3300/0 conn(0x7f3724158f10 msgr2=0x7f37240ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3723fff700 1 --2- 172.21.15.29:0/3572679247 >> v2:172.21.15.173:3300/0 conn(0x7f3724158f10 0x7f37240ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3723fff700 1 -- 172.21.15.29:0/3572679247 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240cafb0 con 0x7f372415d730 2023-10-06T05:28:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3723fff700 1 --2- 172.21.15.29:0/3572679247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372415d730 0x7f372406c6c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f37240d0f30 tx=0x7f3714009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9028761a63ca8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:12.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f37237fe700 1 -- 172.21.15.29:0/3572679247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400b820 con 0x7f372415d730 2023-10-06T05:28:12.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f37237fe700 1 -- 172.21.15.29:0/3572679247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371400b980 con 0x7f372415d730 2023-10-06T05:28:12.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f37237fe700 1 -- 172.21.15.29:0/3572679247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400bd20 con 0x7f372415d730 2023-10-06T05:28:12.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 -- 172.21.15.29:0/3572679247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372415d730 msgr2=0x7f372406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:12.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 --2- 172.21.15.29:0/3572679247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372415d730 0x7f372406c6c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f37240d0f30 tx=0x7f3714009250 comp rx=0 tx=0).stop 2023-10-06T05:28:12.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 -- 172.21.15.29:0/3572679247 shutdown_connections 2023-10-06T05:28:12.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 --2- 172.21.15.29:0/3572679247 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372406cc00 0x7f37240cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 --2- 172.21.15.29:0/3572679247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372415d730 0x7f372406c6c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 --2- 172.21.15.29:0/3572679247 >> v2:172.21.15.173:3300/0 conn(0x7f3724158f10 0x7f37240ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 -- 172.21.15.29:0/3572679247 >> 172.21.15.29:0/3572679247 conn(0x7f3724062b60 msgr2=0x7f3724062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:12.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 -- 172.21.15.29:0/3572679247 shutdown_connections 2023-10-06T05:28:12.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.174+0000 7f3729c67700 1 -- 172.21.15.29:0/3572679247 wait complete. 2023-10-06T05:28:12.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3729c67700 1 Processor -- start 2023-10-06T05:28:12.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3729c67700 1 -- start start 2023-10-06T05:28:12.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3729c67700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372406cc00 0x7f372416d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:12.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3729c67700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3724158f10 0x7f37240c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3729c67700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372415d730 0x7f37240b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3729c67700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240c6480 con 0x7f372406cc00 2023-10-06T05:28:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3729c67700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240c5180 con 0x7f3724158f10 2023-10-06T05:28:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3729c67700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240c5460 con 0x7f372415d730 2023-10-06T05:28:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3728c65700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372406cc00 0x7f372416d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3723fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3724158f10 0x7f37240c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3728c65700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372406cc00 0x7f372416d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49488/0 (socket says 172.21.15.29:49488) 2023-10-06T05:28:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3728c65700 1 -- 172.21.15.29:0/2710398665 learned_addr learned my addr 172.21.15.29:0/2710398665 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3729466700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372415d730 0x7f37240b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:12.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3728c65700 1 -- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372415d730 msgr2=0x7f37240b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:12.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3728c65700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372415d730 0x7f37240b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3728c65700 1 -- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3724158f10 msgr2=0x7f37240c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3728c65700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3724158f10 0x7f37240c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3728c65700 1 -- 172.21.15.29:0/2710398665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140094f0 con 0x7f372406cc00 2023-10-06T05:28:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.178+0000 7f3723fff700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3724158f10 0x7f37240c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.182+0000 7f3728c65700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372406cc00 0x7f372416d710 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f370c00d890 tx=0x7f370c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.182+0000 7f3720ff9700 1 -- 172.21.15.29:0/2710398665 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c0125f0 con 0x7f372406cc00 2023-10-06T05:28:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.182+0000 7f3720ff9700 1 -- 172.21.15.29:0/2710398665 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c012750 con 0x7f372406cc00 2023-10-06T05:28:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.182+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37240c5740 con 0x7f372406cc00 2023-10-06T05:28:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.182+0000 7f3720ff9700 1 -- 172.21.15.29:0/2710398665 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c012af0 con 0x7f372406cc00 2023-10-06T05:28:12.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.182+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37240b46d0 con 0x7f372406cc00 2023-10-06T05:28:12.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.182+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37240c5bc0 con 0x7f372406cc00 2023-10-06T05:28:12.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.182+0000 7f3720ff9700 1 -- 172.21.15.29:0/2710398665 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f370c01e460 con 0x7f372406cc00 2023-10-06T05:28:12.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.186+0000 7f3720ff9700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060550 0x7f3704062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:12.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.186+0000 7f3720ff9700 1 -- 172.21.15.29:0/2710398665 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f370c07ccd0 con 0x7f372406cc00 2023-10-06T05:28:12.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.186+0000 7f3723fff700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060550 0x7f3704062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:12.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.186+0000 7f3723fff700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060550 0x7f3704062a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f37240d0f30 tx=0x7f3714017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:12.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.190+0000 7f3720ff9700 1 -- 172.21.15.29:0/2710398665 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f370c04d340 con 0x7f372406cc00 2023-10-06T05:28:12.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:12.350+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f372404be00 con 0x7f372406cc00 2023-10-06T05:28:13.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.042+0000 7f3720ff9700 1 -- 172.21.15.29:0/2710398665 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7f370c050960 con 0x7f372406cc00 2023-10-06T05:28:13.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060550 msgr2=0x7f3704062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:13.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060550 0x7f3704062a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f37240d0f30 tx=0x7f3714017000 comp rx=0 tx=0).stop 2023-10-06T05:28:13.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372406cc00 msgr2=0x7f372416d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:13.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372406cc00 0x7f372416d710 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f370c00d890 tx=0x7f370c008040 comp rx=0 tx=0).stop 2023-10-06T05:28:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 shutdown_connections 2023-10-06T05:28:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f372415d730 0x7f37240b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3704060550 0x7f3704062a00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3724158f10 0x7f37240c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 --2- 172.21.15.29:0/2710398665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f372406cc00 0x7f372416d710 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.062+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 >> 172.21.15.29:0/2710398665 conn(0x7f3724062b60 msgr2=0x7f3724158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:13.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.066+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 shutdown_connections 2023-10-06T05:28:13.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.066+0000 7f3729c67700 1 -- 172.21.15.29:0/2710398665 wait complete. 2023-10-06T05:28:13.074 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-06T05:28:13.086 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T05:28:13.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.190+0000 7f52deac9700 1 Processor -- start 2023-10-06T05:28:13.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.190+0000 7f52deac9700 1 -- start start 2023-10-06T05:28:13.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52d8155ac0 0x7f52d80c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:13.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52d80cb8c0 0x7f52d80c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:13.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d80c9ed0 con 0x7f52d80c9ab0 2023-10-06T05:28:13.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80c8ce0 con 0x7f52d8155ac0 2023-10-06T05:28:13.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80c8060 con 0x7f52d80cb8c0 2023-10-06T05:28:13.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52ddac7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52d8155ac0 0x7f52d80c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:13.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52de2c8700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f52d80c9ab0 0x7f52d8159760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:42032/0 (socket says 172.21.15.29:42032) 2023-10-06T05:28:13.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52ddac7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52d8155ac0 0x7f52d80c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49492/0 (socket says 172.21.15.29:49492) 2023-10-06T05:28:13.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52de2c8700 1 -- 172.21.15.29:0/1950339251 learned_addr learned my addr 172.21.15.29:0/1950339251 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:13.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dd2c6700 1 --2- 172.21.15.29:0/1950339251 >> v2:172.21.15.173:3300/0 conn(0x7f52d80cb8c0 0x7f52d80c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:13.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dcac5700 1 -- 172.21.15.29:0/1950339251 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965658474 0 0) 0x7f52d80c9ed0 con 0x7f52d80c9ab0 2023-10-06T05:28:13.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dcac5700 1 -- 172.21.15.29:0/1950339251 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c4003570 con 0x7f52d80c9ab0 2023-10-06T05:28:13.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dd2c6700 1 -- 172.21.15.29:0/1950339251 >> v2:172.21.15.29:3300/0 conn(0x7f52d8155ac0 msgr2=0x7f52d80c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:13.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dd2c6700 1 --2- 172.21.15.29:0/1950339251 >> v2:172.21.15.29:3300/0 conn(0x7f52d8155ac0 0x7f52d80c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dd2c6700 1 -- 172.21.15.29:0/1950339251 >> v1:172.21.15.173:6789/0 conn(0x7f52d80c9ab0 legacy=0x7f52d8159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:13.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dd2c6700 1 -- 172.21.15.29:0/1950339251 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80c8340 con 0x7f52d80cb8c0 2023-10-06T05:28:13.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52ddac7700 1 --2- 172.21.15.29:0/1950339251 >> v2:172.21.15.29:3300/0 conn(0x7f52d8155ac0 0x7f52d80c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:13.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dd2c6700 1 --2- 172.21.15.29:0/1950339251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d80cb8c0 0x7f52d80c9570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f52d806ac20 tx=0x7f52c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2968878375902449 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:13.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dcac5700 1 -- 172.21.15.29:0/1950339251 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8011630 con 0x7f52d80cb8c0 2023-10-06T05:28:13.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dcac5700 1 -- 172.21.15.29:0/1950339251 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c80117b0 con 0x7f52d80cb8c0 2023-10-06T05:28:13.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52dcac5700 1 -- 172.21.15.29:0/1950339251 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8011b70 con 0x7f52d80cb8c0 2023-10-06T05:28:13.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 -- 172.21.15.29:0/1950339251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d80cb8c0 msgr2=0x7f52d80c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:13.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 --2- 172.21.15.29:0/1950339251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d80cb8c0 0x7f52d80c9570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f52d806ac20 tx=0x7f52c80091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 -- 172.21.15.29:0/1950339251 shutdown_connections 2023-10-06T05:28:13.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 --2- 172.21.15.29:0/1950339251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d80cb8c0 0x7f52d80c9570 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 --2- 172.21.15.29:0/1950339251 >> v2:172.21.15.29:3300/0 conn(0x7f52d8155ac0 0x7f52d80c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.194+0000 7f52deac9700 1 -- 172.21.15.29:0/1950339251 >> 172.21.15.29:0/1950339251 conn(0x7f52d806ba30 msgr2=0x7f52d8095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:13.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 -- 172.21.15.29:0/1950339251 shutdown_connections 2023-10-06T05:28:13.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 -- 172.21.15.29:0/1950339251 wait complete. 2023-10-06T05:28:13.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 Processor -- start 2023-10-06T05:28:13.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 -- start start 2023-10-06T05:28:13.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d80c9ab0 0x7f52d80c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:13.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cb8c0 0x7f52d814cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:13.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52d8155ac0 0x7f52d8152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:13.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d81534b0 con 0x7f52d80cb8c0 2023-10-06T05:28:13.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80c5b80 con 0x7f52d80c9ab0 2023-10-06T05:28:13.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52deac9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80c6550 con 0x7f52d8155ac0 2023-10-06T05:28:13.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52dd2c6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cb8c0 0x7f52d814cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:13.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52dd2c6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cb8c0 0x7f52d814cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49508/0 (socket says 172.21.15.29:49508) 2023-10-06T05:28:13.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52dd2c6700 1 -- 172.21.15.29:0/4025799153 learned_addr learned my addr 172.21.15.29:0/4025799153 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:13.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.198+0000 7f52de2c8700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52d8155ac0 0x7f52d8152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:13.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52ddac7700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d80c9ab0 0x7f52d80c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:13.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52de2c8700 1 -- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d80c9ab0 msgr2=0x7f52d80c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:13.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52de2c8700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d80c9ab0 0x7f52d80c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52de2c8700 1 -- 172.21.15.29:0/4025799153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cb8c0 msgr2=0x7f52d814cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:13.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52de2c8700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cb8c0 0x7f52d814cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:13.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52de2c8700 1 -- 172.21.15.29:0/4025799153 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40093c0 con 0x7f52d8155ac0 2023-10-06T05:28:13.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52dd2c6700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cb8c0 0x7f52d814cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:13.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52de2c8700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52d8155ac0 0x7f52d8152a60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52d000cbf0 tx=0x7f52d0001a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:13.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52cdffb700 1 -- 172.21.15.29:0/4025799153 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000a8d0 con 0x7f52d8155ac0 2023-10-06T05:28:13.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52cdffb700 1 -- 172.21.15.29:0/4025799153 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d000aa30 con 0x7f52d8155ac0 2023-10-06T05:28:13.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c8009420 con 0x7f52d8155ac0 2023-10-06T05:28:13.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52cdffb700 1 -- 172.21.15.29:0/4025799153 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000adb0 con 0x7f52d8155ac0 2023-10-06T05:28:13.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d80c5530 con 0x7f52d8155ac0 2023-10-06T05:28:13.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.202+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d804be00 con 0x7f52d8155ac0 2023-10-06T05:28:13.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.206+0000 7f52cdffb700 1 -- 172.21.15.29:0/4025799153 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f52d0007300 con 0x7f52d8155ac0 2023-10-06T05:28:13.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.206+0000 7f52cdffb700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f52bc060550 0x7f52bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:13.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.206+0000 7f52cdffb700 1 -- 172.21.15.29:0/4025799153 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f52d007cbe0 con 0x7f52d8155ac0 2023-10-06T05:28:13.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.206+0000 7f52ddac7700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f52bc060550 0x7f52bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:13.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.206+0000 7f52ddac7700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f52bc060550 0x7f52bc062a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009390 tx=0x7f52d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:13.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.218+0000 7f52cdffb700 1 -- 172.21.15.29:0/4025799153 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f52d004d150 con 0x7f52d8155ac0 2023-10-06T05:28:13.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:13.418+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f52d80c5cc0 con 0x7f52d8155ac0 2023-10-06T05:28:14.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.050+0000 7f52cdffb700 1 -- 172.21.15.29:0/4025799153 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v25) v1 ==== 173+0+0 (secure 0 0 0) 0x7f52d0050770 con 0x7f52d8155ac0 2023-10-06T05:28:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f52bc060550 msgr2=0x7f52bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f52bc060550 0x7f52bc062a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009390 tx=0x7f52d4008040 comp rx=0 tx=0).stop 2023-10-06T05:28:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52d8155ac0 msgr2=0x7f52d8152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52d8155ac0 0x7f52d8152a60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52d000cbf0 tx=0x7f52d0001a20 comp rx=0 tx=0).stop 2023-10-06T05:28:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 shutdown_connections 2023-10-06T05:28:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52d8155ac0 0x7f52d8152a60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cb8c0 0x7f52d814cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f52bc060550 0x7f52bc062a00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 --2- 172.21.15.29:0/4025799153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d80c9ab0 0x7f52d80c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.062+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 >> 172.21.15.29:0/4025799153 conn(0x7f52d806ba30 msgr2=0x7f52d80c2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:14.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.066+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 shutdown_connections 2023-10-06T05:28:14.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.066+0000 7f52deac9700 1 -- 172.21.15.29:0/4025799153 wait complete. 2023-10-06T05:28:14.078 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 9 and data pool 10 2023-10-06T05:28:14.096 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:28:14.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.186+0000 7f39a2ba1700 1 Processor -- start 2023-10-06T05:28:14.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.186+0000 7f39a2ba1700 1 -- start start 2023-10-06T05:28:14.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f399c158cb0 0x7f399c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c06b740 0x7f399c0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c0c2980 con 0x7f399c06b2c0 2023-10-06T05:28:14.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c0c77c0 con 0x7f399c158cb0 2023-10-06T05:28:14.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0c6bb0 con 0x7f399c06b740 2023-10-06T05:28:14.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a1b9f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f399c158cb0 0x7f399c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a23a0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c06b740 0x7f399c0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a1b9f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f399c158cb0 0x7f399c0c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:60162/0 (socket says 172.21.15.29:60162) 2023-10-06T05:28:14.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a23a0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c06b740 0x7f399c0c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:59986/0 (socket says 172.21.15.29:59986) 2023-10-06T05:28:14.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a1b9f700 1 -- 172.21.15.29:0/1728551443 learned_addr learned my addr 172.21.15.29:0/1728551443 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:14.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a139e700 1 --1- 172.21.15.29:0/1728551443 >> v1:172.21.15.173:6789/0 conn(0x7f399c06b2c0 0x7f399c0c9cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:42034/0 (socket says 172.21.15.29:42034) 2023-10-06T05:28:14.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a23a0700 1 -- 172.21.15.29:0/1728551443 >> v2:172.21.15.173:3300/0 conn(0x7f399c158cb0 msgr2=0x7f399c0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:14.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a23a0700 1 --2- 172.21.15.29:0/1728551443 >> v2:172.21.15.173:3300/0 conn(0x7f399c158cb0 0x7f399c0c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a23a0700 1 -- 172.21.15.29:0/1728551443 >> v1:172.21.15.173:6789/0 conn(0x7f399c06b2c0 legacy=0x7f399c0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a23a0700 1 -- 172.21.15.29:0/1728551443 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c0c6e90 con 0x7f399c06b740 2023-10-06T05:28:14.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a23a0700 1 --2- 172.21.15.29:0/1728551443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c06b740 0x7f399c0c7c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39980098e0 tx=0x7f39980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9855f317843fb318 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:14.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a0b9d700 1 -- 172.21.15.29:0/1728551443 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800b640 con 0x7f399c06b740 2023-10-06T05:28:14.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a0b9d700 1 -- 172.21.15.29:0/1728551443 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399800b7a0 con 0x7f399c06b740 2023-10-06T05:28:14.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a0b9d700 1 -- 172.21.15.29:0/1728551443 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800bb40 con 0x7f399c06b740 2023-10-06T05:28:14.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1728551443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c06b740 msgr2=0x7f399c0c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 --2- 172.21.15.29:0/1728551443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c06b740 0x7f399c0c7c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39980098e0 tx=0x7f39980091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1728551443 shutdown_connections 2023-10-06T05:28:14.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 --2- 172.21.15.29:0/1728551443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c06b740 0x7f399c0c7c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 --2- 172.21.15.29:0/1728551443 >> v2:172.21.15.173:3300/0 conn(0x7f399c158cb0 0x7f399c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1728551443 >> 172.21.15.29:0/1728551443 conn(0x7f399c0670a0 msgr2=0x7f399c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:14.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1728551443 shutdown_connections 2023-10-06T05:28:14.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.190+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1728551443 wait complete. 2023-10-06T05:28:14.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 Processor -- start 2023-10-06T05:28:14.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 -- start start 2023-10-06T05:28:14.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f399c06b2c0 0x7f399c0c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399c158cb0 0x7f399c155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c15d7f0 0x7f399c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c15c750 con 0x7f399c06b2c0 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c15ca30 con 0x7f399c158cb0 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c15cd10 con 0x7f399c15d7f0 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a1b9f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f399c06b2c0 0x7f399c0c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a1b9f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f399c06b2c0 0x7f399c0c32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49520/0 (socket says 172.21.15.29:49520) 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a1b9f700 1 -- 172.21.15.29:0/1614668585 learned_addr learned my addr 172.21.15.29:0/1614668585 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a139e700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399c158cb0 0x7f399c155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a23a0700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c15d7f0 0x7f399c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a1b9f700 1 -- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c15d7f0 msgr2=0x7f399c0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a1b9f700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c15d7f0 0x7f399c0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a1b9f700 1 -- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399c158cb0 msgr2=0x7f399c155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a1b9f700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399c158cb0 0x7f399c155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a1b9f700 1 -- 172.21.15.29:0/1614668585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998009420 con 0x7f399c06b2c0 2023-10-06T05:28:14.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a1b9f700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f399c06b2c0 0x7f399c0c32b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3994009e30 tx=0x7f399400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:14.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f3991ffb700 1 -- 172.21.15.29:0/1614668585 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940092e0 con 0x7f399c06b2c0 2023-10-06T05:28:14.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f3991ffb700 1 -- 172.21.15.29:0/1614668585 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399400f040 con 0x7f399c06b2c0 2023-10-06T05:28:14.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c15cff0 con 0x7f399c06b2c0 2023-10-06T05:28:14.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f3991ffb700 1 -- 172.21.15.29:0/1614668585 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399400caa0 con 0x7f399c06b2c0 2023-10-06T05:28:14.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.194+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c0c37f0 con 0x7f399c06b2c0 2023-10-06T05:28:14.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.198+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c0adb30 con 0x7f399c06b2c0 2023-10-06T05:28:14.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.198+0000 7f3991ffb700 1 -- 172.21.15.29:0/1614668585 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3994014480 con 0x7f399c06b2c0 2023-10-06T05:28:14.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.198+0000 7f3991ffb700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3980060550 0x7f3980062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.198+0000 7f3991ffb700 1 -- 172.21.15.29:0/1614668585 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f399407cde0 con 0x7f399c06b2c0 2023-10-06T05:28:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.198+0000 7f39a139e700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3980060550 0x7f3980062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.202+0000 7f39a139e700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3980060550 0x7f3980062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f399c068540 tx=0x7f398c007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:14.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.206+0000 7f3991ffb700 1 -- 172.21.15.29:0/1614668585 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f399c0adb30 con 0x7f399c06b2c0 2023-10-06T05:28:14.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.370+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f399c0adb30 con 0x7f399c06b2c0 2023-10-06T05:28:14.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f3991ffb700 1 -- 172.21.15.29:0/1614668585 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16881 (secure 0 0 0) 0x7f399c0adb30 con 0x7f399c06b2c0 2023-10-06T05:28:14.380 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:14.381 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":61,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:28:13.424622+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:28:11.073066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T05:28:12.396583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3980060550 msgr2=0x7f3980062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3980060550 0x7f3980062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f399c068540 tx=0x7f398c007eb0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f399c06b2c0 msgr2=0x7f399c0c32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f399c06b2c0 0x7f399c0c32b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3994009e30 tx=0x7f399400b040 comp rx=0 tx=0).stop 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 shutdown_connections 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f399c15d7f0 0x7f399c0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3980060550 0x7f3980062a00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f399c158cb0 0x7f399c155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 --2- 172.21.15.29:0/1614668585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f399c06b2c0 0x7f399c0c32b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 >> 172.21.15.29:0/1614668585 conn(0x7f399c0670a0 msgr2=0x7f399c0c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:14.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 shutdown_connections 2023-10-06T05:28:14.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.374+0000 7f39a2ba1700 1 -- 172.21.15.29:0/1614668585 wait complete. 2023-10-06T05:28:14.395 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:28:14.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 Processor -- start 2023-10-06T05:28:14.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 -- start start 2023-10-06T05:28:14.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda80af5c0 0x7fdda80af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdda8161950 0x7fdda806a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdda806a9a0 0x7fdda806e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda8160f40 con 0x7fdda8161950 2023-10-06T05:28:14.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda81614c0 con 0x7fdda806a9a0 2023-10-06T05:28:14.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda806d420 con 0x7fdda80af5c0 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdda8161950 0x7fdda806a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdda8161950 0x7fdda806a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48878/0 (socket says 172.21.15.29:48878) 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda7fff700 1 -- 172.21.15.29:0/3691793723 learned_addr learned my addr 172.21.15.29:0/3691793723 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddad392700 1 --2- 172.21.15.29:0/3691793723 >> v2:172.21.15.173:3300/0 conn(0x7fdda806a9a0 0x7fdda806e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddacb91700 1 --2- 172.21.15.29:0/3691793723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda80af5c0 0x7fdda80af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda7fff700 1 -- 172.21.15.29:0/3691793723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda80af5c0 msgr2=0x7fdda80af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda7fff700 1 --2- 172.21.15.29:0/3691793723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda80af5c0 0x7fdda80af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda7fff700 1 -- 172.21.15.29:0/3691793723 >> v2:172.21.15.173:3300/0 conn(0x7fdda806a9a0 msgr2=0x7fdda806e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda7fff700 1 --2- 172.21.15.29:0/3691793723 >> v2:172.21.15.173:3300/0 conn(0x7fdda806a9a0 0x7fdda806e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda7fff700 1 -- 172.21.15.29:0/3691793723 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda806af20 con 0x7fdda8161950 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddad392700 1 --2- 172.21.15.29:0/3691793723 >> v2:172.21.15.173:3300/0 conn(0x7fdda806a9a0 0x7fdda806e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:28:14.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddacb91700 1 --2- 172.21.15.29:0/3691793723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda80af5c0 0x7fdda80af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:28:14.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda7fff700 1 --2- 172.21.15.29:0/3691793723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 0x7fdda806a460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdda80644c0 tx=0x7fdd9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8a15ed09255bae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:14.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda77fe700 1 -- 172.21.15.29:0/3691793723 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00b860 con 0x7fdda8161950 2023-10-06T05:28:14.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda77fe700 1 -- 172.21.15.29:0/3691793723 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c00b9c0 con 0x7fdda8161950 2023-10-06T05:28:14.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fdda77fe700 1 -- 172.21.15.29:0/3691793723 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00bd60 con 0x7fdda8161950 2023-10-06T05:28:14.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 -- 172.21.15.29:0/3691793723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 msgr2=0x7fdda806a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 --2- 172.21.15.29:0/3691793723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 0x7fdda806a460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdda80644c0 tx=0x7fdd9c009250 comp rx=0 tx=0).stop 2023-10-06T05:28:14.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 -- 172.21.15.29:0/3691793723 shutdown_connections 2023-10-06T05:28:14.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 --2- 172.21.15.29:0/3691793723 >> v2:172.21.15.173:3300/0 conn(0x7fdda806a9a0 0x7fdda806e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 --2- 172.21.15.29:0/3691793723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 0x7fdda806a460 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 --2- 172.21.15.29:0/3691793723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda80af5c0 0x7fdda80af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 -- 172.21.15.29:0/3691793723 >> 172.21.15.29:0/3691793723 conn(0x7fdda8067b70 msgr2=0x7fdda806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:14.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 -- 172.21.15.29:0/3691793723 shutdown_connections 2023-10-06T05:28:14.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.494+0000 7fddaedf5700 1 -- 172.21.15.29:0/3691793723 wait complete. 2023-10-06T05:28:14.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.498+0000 7fddaedf5700 1 Processor -- start 2023-10-06T05:28:14.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.498+0000 7fddaedf5700 1 -- start start 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddaedf5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda806a9a0 0x7fdda80a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddaedf5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdda80af5c0 0x7fdda816dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddaedf5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 0x7fdda80ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddaedf5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda816e240 con 0x7fdda8161950 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddaedf5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda816d2c0 con 0x7fdda80af5c0 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddaedf5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda816d870 con 0x7fdda806a9a0 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddad392700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 0x7fdda80ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fdda7fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdda80af5c0 0x7fdda816dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddad392700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 0x7fdda80ac500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48894/0 (socket says 172.21.15.29:48894) 2023-10-06T05:28:14.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddacb91700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda806a9a0 0x7fdda80a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddad392700 1 -- 172.21.15.29:0/452982521 learned_addr learned my addr 172.21.15.29:0/452982521 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddad392700 1 -- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda806a9a0 msgr2=0x7fdda80a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddad392700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda806a9a0 0x7fdda80a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddad392700 1 -- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdda80af5c0 msgr2=0x7fdda816dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddad392700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdda80af5c0 0x7fdda816dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddad392700 1 -- 172.21.15.29:0/452982521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0094f0 con 0x7fdda8161950 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddad392700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 0x7fdda80ac500 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdda000cf90 tx=0x7fdda0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fdda4ff9700 1 -- 172.21.15.29:0/452982521 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda000ae00 con 0x7fdda8161950 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fdda4ff9700 1 -- 172.21.15.29:0/452982521 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda0015440 con 0x7fdda8161950 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda81598e0 con 0x7fdda8161950 2023-10-06T05:28:14.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fdda4ff9700 1 -- 172.21.15.29:0/452982521 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda0015800 con 0x7fdda8161950 2023-10-06T05:28:14.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.502+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda80a6510 con 0x7fdda8161950 2023-10-06T05:28:14.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.506+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda80a6700 con 0x7fdda8161950 2023-10-06T05:28:14.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.506+0000 7fdda4ff9700 1 -- 172.21.15.29:0/452982521 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdda000d440 con 0x7fdda8161950 2023-10-06T05:28:14.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.506+0000 7fdda4ff9700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdd94060550 0x7fdd94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.506+0000 7fdda4ff9700 1 -- 172.21.15.29:0/452982521 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdda007d0e0 con 0x7fdda8161950 2023-10-06T05:28:14.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.506+0000 7fddacb91700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdd94060550 0x7fdd94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.506+0000 7fddacb91700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdd94060550 0x7fdd94062a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdda815f840 tx=0x7fdd98006f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:14.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.514+0000 7fdda4ff9700 1 -- 172.21.15.29:0/452982521 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdda004d4d0 con 0x7fdda8161950 2023-10-06T05:28:14.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-06T05:28:14.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T05:28:14.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-06T05:28:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.678+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdda804be00 con 0x7fdda8161950 2023-10-06T05:28:14.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.678+0000 7fdda4ff9700 1 -- 172.21.15.29:0/452982521 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16881 (secure 0 0 0) 0x7fdda001a090 con 0x7fdda8161950 2023-10-06T05:28:14.688 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:14.688 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":61,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:28:13.424622+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:28:11.073066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T05:28:12.396583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:28:14.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdd94060550 msgr2=0x7fdd94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdd94060550 0x7fdd94062a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdda815f840 tx=0x7fdd98006f90 comp rx=0 tx=0).stop 2023-10-06T05:28:14.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 msgr2=0x7fdda80ac500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 0x7fdda80ac500 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdda000cf90 tx=0x7fdda0007870 comp rx=0 tx=0).stop 2023-10-06T05:28:14.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 shutdown_connections 2023-10-06T05:28:14.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda8161950 0x7fdda80ac500 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdd94060550 0x7fdd94062a00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdda80af5c0 0x7fdda816dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 --2- 172.21.15.29:0/452982521 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdda806a9a0 0x7fdda80a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 >> 172.21.15.29:0/452982521 conn(0x7fdda8067b70 msgr2=0x7fdda815be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:14.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 shutdown_connections 2023-10-06T05:28:14.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.682+0000 7fddaedf5700 1 -- 172.21.15.29:0/452982521 wait complete. 2023-10-06T05:28:14.703 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T05:28:14.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.806+0000 7f7e59fda700 1 Processor -- start 2023-10-06T05:28:14.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.806+0000 7f7e59fda700 1 -- start start 2023-10-06T05:28:14.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.806+0000 7f7e59fda700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7e5415c0c0 0x7f7e540ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.806+0000 7f7e59fda700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7e5415c490 0x7f7e540ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.806+0000 7f7e59fda700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e540caf20 con 0x7f7e5406a610 2023-10-06T05:28:14.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.806+0000 7f7e59fda700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5406b2b0 con 0x7f7e5415c0c0 2023-10-06T05:28:14.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.806+0000 7f7e59fda700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5406b590 con 0x7f7e5415c490 2023-10-06T05:28:14.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e58fd8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7e5415c0c0 0x7f7e540ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e597d9700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7e5406a610 0x7f7e5406aa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59334/0 (socket says 172.21.15.29:59334) 2023-10-06T05:28:14.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e597d9700 1 -- 172.21.15.29:0/2322120529 learned_addr learned my addr 172.21.15.29:0/2322120529 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:14.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e53fff700 1 --2- 172.21.15.29:0/2322120529 >> v2:172.21.15.173:3300/0 conn(0x7f7e5415c490 0x7f7e540ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e58fd8700 1 -- 172.21.15.29:0/2322120529 >> v2:172.21.15.173:3300/0 conn(0x7f7e5415c490 msgr2=0x7f7e540ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:14.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e58fd8700 1 --2- 172.21.15.29:0/2322120529 >> v2:172.21.15.173:3300/0 conn(0x7f7e5415c490 0x7f7e540ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e58fd8700 1 -- 172.21.15.29:0/2322120529 >> v1:172.21.15.29:6789/0 conn(0x7f7e5406a610 legacy=0x7f7e5406aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e58fd8700 1 -- 172.21.15.29:0/2322120529 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5406b870 con 0x7f7e5415c0c0 2023-10-06T05:28:14.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e537fe700 1 -- 172.21.15.29:0/2322120529 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416453455 0 0) 0x7f7e540caf20 con 0x7f7e5406a610 2023-10-06T05:28:14.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e58fd8700 1 --2- 172.21.15.29:0/2322120529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 0x7f7e540ce2d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7e540b5fc0 tx=0x7f7e440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ee6139d2ab2e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:14.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e537fe700 1 -- 172.21.15.29:0/2322120529 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44011630 con 0x7f7e5415c0c0 2023-10-06T05:28:14.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e537fe700 1 -- 172.21.15.29:0/2322120529 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e44011790 con 0x7f7e5415c0c0 2023-10-06T05:28:14.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e537fe700 1 -- 172.21.15.29:0/2322120529 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44011b30 con 0x7f7e5415c0c0 2023-10-06T05:28:14.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e59fda700 1 -- 172.21.15.29:0/2322120529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 msgr2=0x7f7e540ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e59fda700 1 --2- 172.21.15.29:0/2322120529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 0x7f7e540ce2d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7e540b5fc0 tx=0x7f7e440091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e59fda700 1 -- 172.21.15.29:0/2322120529 shutdown_connections 2023-10-06T05:28:14.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e59fda700 1 --2- 172.21.15.29:0/2322120529 >> v2:172.21.15.173:3300/0 conn(0x7f7e5415c490 0x7f7e540ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e59fda700 1 --2- 172.21.15.29:0/2322120529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 0x7f7e540ce2d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e59fda700 1 -- 172.21.15.29:0/2322120529 >> 172.21.15.29:0/2322120529 conn(0x7f7e5406c6c0 msgr2=0x7f7e5406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:14.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e59fda700 1 -- 172.21.15.29:0/2322120529 shutdown_connections 2023-10-06T05:28:14.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.810+0000 7f7e59fda700 1 -- 172.21.15.29:0/2322120529 wait complete. 2023-10-06T05:28:14.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e59fda700 1 Processor -- start 2023-10-06T05:28:14.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e59fda700 1 -- start start 2023-10-06T05:28:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e59fda700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e5406a610 0x7f7e541540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e59fda700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 0x7f7e540b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e59fda700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e5415c490 0x7f7e54156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e59fda700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540b57e0 con 0x7f7e5415c0c0 2023-10-06T05:28:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e59fda700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540c72b0 con 0x7f7e5406a610 2023-10-06T05:28:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e59fda700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54154620 con 0x7f7e5415c490 2023-10-06T05:28:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e53fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 0x7f7e540b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e53fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 0x7f7e540b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48904/0 (socket says 172.21.15.29:48904) 2023-10-06T05:28:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e53fff700 1 -- 172.21.15.29:0/2007237455 learned_addr learned my addr 172.21.15.29:0/2007237455 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e58fd8700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e5406a610 0x7f7e541540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e597d9700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e5415c490 0x7f7e54156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e53fff700 1 -- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e5415c490 msgr2=0x7f7e54156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e53fff700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e5415c490 0x7f7e54156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e53fff700 1 -- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e5406a610 msgr2=0x7f7e541540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e53fff700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e5406a610 0x7f7e541540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e53fff700 1 -- 172.21.15.29:0/2007237455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e44009420 con 0x7f7e5415c0c0 2023-10-06T05:28:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.814+0000 7f7e53fff700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 0x7f7e540b47d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00e990 tx=0x7f7e3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.818+0000 7f7e50ff9700 1 -- 172.21.15.29:0/2007237455 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c013680 con 0x7f7e5415c0c0 2023-10-06T05:28:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.818+0000 7f7e50ff9700 1 -- 172.21.15.29:0/2007237455 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c0137e0 con 0x7f7e5415c0c0 2023-10-06T05:28:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.818+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e540b5220 con 0x7f7e5415c0c0 2023-10-06T05:28:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.818+0000 7f7e50ff9700 1 -- 172.21.15.29:0/2007237455 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c013ba0 con 0x7f7e5415c0c0 2023-10-06T05:28:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.818+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e540c6f40 con 0x7f7e5415c0c0 2023-10-06T05:28:14.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.818+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e540c7440 con 0x7f7e5415c0c0 2023-10-06T05:28:14.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.818+0000 7f7e50ff9700 1 -- 172.21.15.29:0/2007237455 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7e3c00c460 con 0x7f7e5415c0c0 2023-10-06T05:28:14.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.822+0000 7f7e50ff9700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7e34060580 0x7f7e34062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.822+0000 7f7e50ff9700 1 -- 172.21.15.29:0/2007237455 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7e3c07c9c0 con 0x7f7e5415c0c0 2023-10-06T05:28:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.822+0000 7f7e58fd8700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7e34060580 0x7f7e34062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.822+0000 7f7e58fd8700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7e34060580 0x7f7e34062a30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e440093f0 tx=0x7f7e44017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:14.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:14.826+0000 7f7e50ff9700 1 -- 172.21.15.29:0/2007237455 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7e3c04cdb0 con 0x7f7e5415c0c0 2023-10-06T05:28:15.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.018+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7e5404be00 con 0x7f7e5415c0c0 2023-10-06T05:28:15.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.078+0000 7f7e50ff9700 1 -- 172.21.15.29:0/2007237455 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7e3c0170b0 con 0x7f7e5415c0c0 2023-10-06T05:28:15.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7e34060580 msgr2=0x7f7e34062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:15.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7e34060580 0x7f7e34062a30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e440093f0 tx=0x7f7e44017000 comp rx=0 tx=0).stop 2023-10-06T05:28:15.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 msgr2=0x7f7e540b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:15.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 0x7f7e540b47d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00e990 tx=0x7f7e3c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 shutdown_connections 2023-10-06T05:28:15.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e5415c490 0x7f7e54156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5415c0c0 0x7f7e540b47d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7e34060580 0x7f7e34062a30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 --2- 172.21.15.29:0/2007237455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e5406a610 0x7f7e541540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 >> 172.21.15.29:0/2007237455 conn(0x7f7e5406c6c0 msgr2=0x7f7e540cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:15.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 shutdown_connections 2023-10-06T05:28:15.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.082+0000 7f7e59fda700 1 -- 172.21.15.29:0/2007237455 wait complete. 2023-10-06T05:28:15.107 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T05:28:15.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f779c98e700 1 Processor -- start 2023-10-06T05:28:15.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f779c98e700 1 -- start start 2023-10-06T05:28:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f779c98e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f77981559d0 0x7f77980c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f779c98e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 0x7f77980c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f779c98e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77981596e0 con 0x7f7798155da0 2023-10-06T05:28:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f779c98e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779815a520 con 0x7f77981559d0 2023-10-06T05:28:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f779c98e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980ae800 con 0x7f77980cb590 2023-10-06T05:28:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f7796ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7798155da0 0x7f77980cae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59342/0 (socket says 172.21.15.29:59342) 2023-10-06T05:28:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f7796ffd700 1 -- 172.21.15.29:0/349792505 learned_addr learned my addr 172.21.15.29:0/349792505 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f77977fe700 1 --2- 172.21.15.29:0/349792505 >> v2:172.21.15.173:3300/0 conn(0x7f77981559d0 0x7f77980c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:15.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f7797fff700 1 --2- 172.21.15.29:0/349792505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 0x7f77980c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f77967fc700 1 -- 172.21.15.29:0/349792505 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293746151 0 0) 0x7f77981596e0 con 0x7f7798155da0 2023-10-06T05:28:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.218+0000 7f77967fc700 1 -- 172.21.15.29:0/349792505 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7780003570 con 0x7f7798155da0 2023-10-06T05:28:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f77977fe700 1 -- 172.21.15.29:0/349792505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 msgr2=0x7f77980c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f77977fe700 1 --2- 172.21.15.29:0/349792505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 0x7f77980c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f77977fe700 1 -- 172.21.15.29:0/349792505 >> v1:172.21.15.29:6789/0 conn(0x7f7798155da0 legacy=0x7f77980cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f77977fe700 1 -- 172.21.15.29:0/349792505 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798159910 con 0x7f77981559d0 2023-10-06T05:28:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f7797fff700 1 --2- 172.21.15.29:0/349792505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 0x7f77980c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:15.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f77977fe700 1 --2- 172.21.15.29:0/349792505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77981559d0 0x7f77980c8470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f77880098e0 tx=0x7f77880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ed0bb5738344f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:15.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f77967fc700 1 -- 172.21.15.29:0/349792505 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800f6b0 con 0x7f77981559d0 2023-10-06T05:28:15.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f77967fc700 1 -- 172.21.15.29:0/349792505 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778800f810 con 0x7f77981559d0 2023-10-06T05:28:15.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f77967fc700 1 -- 172.21.15.29:0/349792505 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800fbb0 con 0x7f77981559d0 2023-10-06T05:28:15.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f779c98e700 1 -- 172.21.15.29:0/349792505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77981559d0 msgr2=0x7f77980c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:15.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f779c98e700 1 --2- 172.21.15.29:0/349792505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77981559d0 0x7f77980c8470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f77880098e0 tx=0x7f77880091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f779c98e700 1 -- 172.21.15.29:0/349792505 shutdown_connections 2023-10-06T05:28:15.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f779c98e700 1 --2- 172.21.15.29:0/349792505 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 0x7f77980c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f779c98e700 1 --2- 172.21.15.29:0/349792505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77981559d0 0x7f77980c8470 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f779c98e700 1 -- 172.21.15.29:0/349792505 >> 172.21.15.29:0/349792505 conn(0x7f779806c6c0 msgr2=0x7f779806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:15.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f779c98e700 1 -- 172.21.15.29:0/349792505 shutdown_connections 2023-10-06T05:28:15.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.222+0000 7f779c98e700 1 -- 172.21.15.29:0/349792505 wait complete. 2023-10-06T05:28:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f779c98e700 1 Processor -- start 2023-10-06T05:28:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f779c98e700 1 -- start start 2023-10-06T05:28:15.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f779c98e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 0x7f779814dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:15.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f779c98e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77981559d0 0x7f77980c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:15.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f779c98e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7798155da0 0x7f77980c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:15.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f779c98e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77981518f0 con 0x7f7798155da0 2023-10-06T05:28:15.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f779c98e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7798164cb0 con 0x7f77981559d0 2023-10-06T05:28:15.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f779c98e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c2f80 con 0x7f77980cb590 2023-10-06T05:28:15.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f7797fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7798155da0 0x7f77980c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:15.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.226+0000 7f7797fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7798155da0 0x7f77980c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48920/0 (socket says 172.21.15.29:48920) 2023-10-06T05:28:15.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f7797fff700 1 -- 172.21.15.29:0/1329428921 learned_addr learned my addr 172.21.15.29:0/1329428921 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:15.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f7796ffd700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77981559d0 0x7f77980c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:15.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f77977fe700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 0x7f779814dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:15.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f7797fff700 1 -- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 msgr2=0x7f779814dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:15.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f7797fff700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 0x7f779814dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f7797fff700 1 -- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77981559d0 msgr2=0x7f77980c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:15.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f7797fff700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77981559d0 0x7f77980c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:15.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f7797fff700 1 -- 172.21.15.29:0/1329428921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790009a20 con 0x7f7798155da0 2023-10-06T05:28:15.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f7797fff700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7798155da0 0x7f77980c5580 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7790009f60 tx=0x7f779000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:15.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f777f7fe700 1 -- 172.21.15.29:0/1329428921 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000cb70 con 0x7f7798155da0 2023-10-06T05:28:15.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f777f7fe700 1 -- 172.21.15.29:0/1329428921 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779000f040 con 0x7f7798155da0 2023-10-06T05:28:15.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7788009420 con 0x7f7798155da0 2023-10-06T05:28:15.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f777f7fe700 1 -- 172.21.15.29:0/1329428921 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790014480 con 0x7f7798155da0 2023-10-06T05:28:15.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7798151330 con 0x7f7798155da0 2023-10-06T05:28:15.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77980c2d50 con 0x7f7798155da0 2023-10-06T05:28:15.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.230+0000 7f777f7fe700 1 -- 172.21.15.29:0/1329428921 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7790003020 con 0x7f7798155da0 2023-10-06T05:28:15.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.234+0000 7f777f7fe700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7784060550 0x7f7784062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:15.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.234+0000 7f777f7fe700 1 -- 172.21.15.29:0/1329428921 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f779007da60 con 0x7f7798155da0 2023-10-06T05:28:15.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.234+0000 7f77977fe700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7784060550 0x7f7784062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:15.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.234+0000 7f77977fe700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7784060550 0x7f7784062a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f77880093f0 tx=0x7f7788019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.238+0000 7f777f7fe700 1 -- 172.21.15.29:0/1329428921 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f779004df50 con 0x7f7798155da0 2023-10-06T05:28:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:15.438+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f77980c2d50 con 0x7f7798155da0 2023-10-06T05:28:16.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.090+0000 7f777f7fe700 1 -- 172.21.15.29:0/1329428921 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7f77980c2d50 con 0x7f7798155da0 2023-10-06T05:28:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7784060550 msgr2=0x7f7784062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7784060550 0x7f7784062a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f77880093f0 tx=0x7f7788019000 comp rx=0 tx=0).stop 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7798155da0 msgr2=0x7f77980c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7798155da0 0x7f77980c5580 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7790009f60 tx=0x7f779000b040 comp rx=0 tx=0).stop 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 shutdown_connections 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7798155da0 0x7f77980c5580 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7784060550 0x7f7784062a00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77981559d0 0x7f77980c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 --2- 172.21.15.29:0/1329428921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77980cb590 0x7f779814dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 >> 172.21.15.29:0/1329428921 conn(0x7f779806c6c0 msgr2=0x7f77981581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 shutdown_connections 2023-10-06T05:28:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.094+0000 7f779c98e700 1 -- 172.21.15.29:0/1329428921 wait complete. 2023-10-06T05:28:16.117 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:28:16.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfd5047700 1 Processor -- start 2023-10-06T05:28:16.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfd5047700 1 -- start start 2023-10-06T05:28:16.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfd5047700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbfd00af5c0 0x7fbfd00af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfd5047700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd0161950 0x7fbfd006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfd5047700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd01614c0 con 0x7fbfd006a9a0 2023-10-06T05:28:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfd5047700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd0160f40 con 0x7fbfd00af5c0 2023-10-06T05:28:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfd5047700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd006d420 con 0x7fbfd0161950 2023-10-06T05:28:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfc659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd0161950 0x7fbfd006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfced9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbfd00af5c0 0x7fbfd00af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfc659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd0161950 0x7fbfd006a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:42830/0 (socket says 172.21.15.29:42830) 2023-10-06T05:28:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfced9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbfd00af5c0 0x7fbfd00af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:50820/0 (socket says 172.21.15.29:50820) 2023-10-06T05:28:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfcf59e700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fbfd006a9a0 0x7fbfd006e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:38860/0 (socket says 172.21.15.29:38860) 2023-10-06T05:28:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfc659c700 1 -- 172.21.15.29:0/3158151025 learned_addr learned my addr 172.21.15.29:0/3158151025 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfced9d700 1 -- 172.21.15.29:0/3158151025 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd0161950 msgr2=0x7fbfd006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfced9d700 1 --2- 172.21.15.29:0/3158151025 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd0161950 0x7fbfd006a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfced9d700 1 -- 172.21.15.29:0/3158151025 >> v1:172.21.15.173:6789/0 conn(0x7fbfd006a9a0 legacy=0x7fbfd006e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfce59c700 1 -- 172.21.15.29:0/3158151025 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051603479 0 0) 0x7fbfd01614c0 con 0x7fbfd006a9a0 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfced9d700 1 -- 172.21.15.29:0/3158151025 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd006af20 con 0x7fbfd00af5c0 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfc659c700 1 --2- 172.21.15.29:0/3158151025 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd0161950 0x7fbfd006a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfced9d700 1 --2- 172.21.15.29:0/3158151025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd00af5c0 0x7fbfd00af990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009e60 tx=0x7fbfc0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f824b5ae03985ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfce59c700 1 -- 172.21.15.29:0/3158151025 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000e070 con 0x7fbfd00af5c0 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfce59c700 1 -- 172.21.15.29:0/3158151025 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc000bb60 con 0x7fbfd00af5c0 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfce59c700 1 -- 172.21.15.29:0/3158151025 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0012430 con 0x7fbfd00af5c0 2023-10-06T05:28:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfd5047700 1 -- 172.21.15.29:0/3158151025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd00af5c0 msgr2=0x7fbfd00af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.230+0000 7fbfd5047700 1 --2- 172.21.15.29:0/3158151025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd00af5c0 0x7fbfd00af990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009e60 tx=0x7fbfc0009780 comp rx=0 tx=0).stop 2023-10-06T05:28:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 -- 172.21.15.29:0/3158151025 shutdown_connections 2023-10-06T05:28:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 --2- 172.21.15.29:0/3158151025 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd0161950 0x7fbfd006a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 --2- 172.21.15.29:0/3158151025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd00af5c0 0x7fbfd00af990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 -- 172.21.15.29:0/3158151025 >> 172.21.15.29:0/3158151025 conn(0x7fbfd0067b70 msgr2=0x7fbfd006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 -- 172.21.15.29:0/3158151025 shutdown_connections 2023-10-06T05:28:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 -- 172.21.15.29:0/3158151025 wait complete. 2023-10-06T05:28:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 Processor -- start 2023-10-06T05:28:16.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 -- start start 2023-10-06T05:28:16.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd006a9a0 0x7fbfd01478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd00af5c0 0x7fbfd015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfd0161950 0x7fbfd015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd0147e10 con 0x7fbfd0161950 2023-10-06T05:28:16.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd014af30 con 0x7fbfd006a9a0 2023-10-06T05:28:16.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfd5047700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd014a320 con 0x7fbfd00af5c0 2023-10-06T05:28:16.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfcf59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfd0161950 0x7fbfd015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfced9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd006a9a0 0x7fbfd01478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfcf59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfd0161950 0x7fbfd015abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48932/0 (socket says 172.21.15.29:48932) 2023-10-06T05:28:16.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfcf59e700 1 -- 172.21.15.29:0/2640645152 learned_addr learned my addr 172.21.15.29:0/2640645152 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:16.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.234+0000 7fbfc659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd00af5c0 0x7fbfd015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfced9d700 1 -- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd00af5c0 msgr2=0x7fbfd015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfced9d700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd00af5c0 0x7fbfd015a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfced9d700 1 -- 172.21.15.29:0/2640645152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfd0161950 msgr2=0x7fbfd015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfced9d700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfd0161950 0x7fbfd015abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfced9d700 1 -- 172.21.15.29:0/2640645152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb80094f0 con 0x7fbfd006a9a0 2023-10-06T05:28:16.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfced9d700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd006a9a0 0x7fbfd01478d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0016000 tx=0x7fbfc0019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:16.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfc77fe700 1 -- 172.21.15.29:0/2640645152 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0012c80 con 0x7fbfd006a9a0 2023-10-06T05:28:16.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfc77fe700 1 -- 172.21.15.29:0/2640645152 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc0012e00 con 0x7fbfd006a9a0 2023-10-06T05:28:16.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc0009a20 con 0x7fbfd006a9a0 2023-10-06T05:28:16.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfc77fe700 1 -- 172.21.15.29:0/2640645152 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00276c0 con 0x7fbfd006a9a0 2023-10-06T05:28:16.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd014a8e0 con 0x7fbfd006a9a0 2023-10-06T05:28:16.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd004be00 con 0x7fbfd006a9a0 2023-10-06T05:28:16.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.238+0000 7fbfc77fe700 1 -- 172.21.15.29:0/2640645152 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbfc0024070 con 0x7fbfd006a9a0 2023-10-06T05:28:16.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.242+0000 7fbfc77fe700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.242+0000 7fbfc77fe700 1 -- 172.21.15.29:0/2640645152 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbfc007f490 con 0x7fbfd006a9a0 2023-10-06T05:28:16.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.242+0000 7fbfc659c700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.242+0000 7fbfc659c700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00aafd0 tx=0x7fbfb8009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:16.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.250+0000 7fbfc77fe700 1 -- 172.21.15.29:0/2640645152 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbfc004f880 con 0x7fbfd006a9a0 2023-10-06T05:28:16.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.446+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfd006b200 con 0x7fbfd006a9a0 2023-10-06T05:28:16.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfc77fe700 1 -- 172.21.15.29:0/2640645152 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fbfc002c090 con 0x7fbfd006a9a0 2023-10-06T05:28:16.456 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:16.456 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:28:16.079422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5901":{"gid":5901,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1584172634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1584172634},{"type":"v1","addr":"172.21.15.29:6835","nonce":1584172634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:28:16.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 msgr2=0x7fbfb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00aafd0 tx=0x7fbfb8009250 comp rx=0 tx=0).stop 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd006a9a0 msgr2=0x7fbfd01478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd006a9a0 0x7fbfd01478d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0016000 tx=0x7fbfc0019000 comp rx=0 tx=0).stop 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 shutdown_connections 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfd0161950 0x7fbfd015abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfd00af5c0 0x7fbfd015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 --2- 172.21.15.29:0/2640645152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd006a9a0 0x7fbfd01478d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 >> 172.21.15.29:0/2640645152 conn(0x7fbfd0067b70 msgr2=0x7fbfd0159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 shutdown_connections 2023-10-06T05:28:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.450+0000 7fbfd5047700 1 -- 172.21.15.29:0/2640645152 wait complete. 2023-10-06T05:28:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2023-10-06T05:28:16.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:28:16.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30de8f4700 1 Processor -- start 2023-10-06T05:28:16.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30de8f4700 1 -- start start 2023-10-06T05:28:16.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30de8f4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d806bb40 0x7f30d80c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30de8f4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f30d80c8d00 0x7f30d8158330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30de8f4700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d806b6b0 con 0x7f30d8156b10 2023-10-06T05:28:16.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30de8f4700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d80c9180 con 0x7f30d80c8d00 2023-10-06T05:28:16.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30de8f4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80c7080 con 0x7f30d806bb40 2023-10-06T05:28:16.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30dd0f1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d806bb40 0x7f30d80c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30dd0f1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d806bb40 0x7f30d80c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:42842/0 (socket says 172.21.15.29:42842) 2023-10-06T05:28:16.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30dd0f1700 1 -- 172.21.15.29:0/347328043 learned_addr learned my addr 172.21.15.29:0/347328043 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:16.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.570+0000 7f30de0f3700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f30d80c8d00 0x7f30d8158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dd0f1700 1 -- 172.21.15.29:0/347328043 >> v2:172.21.15.173:3300/0 conn(0x7f30d80c8d00 msgr2=0x7f30d8158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:16.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dd0f1700 1 --2- 172.21.15.29:0/347328043 >> v2:172.21.15.173:3300/0 conn(0x7f30d80c8d00 0x7f30d8158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dd0f1700 1 -- 172.21.15.29:0/347328043 >> v1:172.21.15.173:6789/0 conn(0x7f30d8156b10 legacy=0x7f30d8157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dd0f1700 1 -- 172.21.15.29:0/347328043 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d806aaa0 con 0x7f30d806bb40 2023-10-06T05:28:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dd0f1700 1 --2- 172.21.15.29:0/347328043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d806bb40 0x7f30d80c87c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30c80099b0 tx=0x7f30c8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7376bfeb248a799c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dc8f0700 1 -- 172.21.15.29:0/347328043 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8009ea0 con 0x7f30d806bb40 2023-10-06T05:28:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dc8f0700 1 -- 172.21.15.29:0/347328043 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c800b860 con 0x7f30d806bb40 2023-10-06T05:28:16.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dc8f0700 1 -- 172.21.15.29:0/347328043 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800bc00 con 0x7f30d806bb40 2023-10-06T05:28:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 -- 172.21.15.29:0/347328043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d806bb40 msgr2=0x7f30d80c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 --2- 172.21.15.29:0/347328043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d806bb40 0x7f30d80c87c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30c80099b0 tx=0x7f30c8009250 comp rx=0 tx=0).stop 2023-10-06T05:28:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 -- 172.21.15.29:0/347328043 shutdown_connections 2023-10-06T05:28:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 --2- 172.21.15.29:0/347328043 >> v2:172.21.15.173:3300/0 conn(0x7f30d80c8d00 0x7f30d8158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 --2- 172.21.15.29:0/347328043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d806bb40 0x7f30d80c87c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 -- 172.21.15.29:0/347328043 >> 172.21.15.29:0/347328043 conn(0x7f30d80670a0 msgr2=0x7f30d80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 -- 172.21.15.29:0/347328043 shutdown_connections 2023-10-06T05:28:16.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 -- 172.21.15.29:0/347328043 wait complete. 2023-10-06T05:28:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 Processor -- start 2023-10-06T05:28:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 -- start start 2023-10-06T05:28:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30d806bb40 0x7f30d8144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d80c8d00 0x7f30d81445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d8156b10 0x7f30d80b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d8147520 con 0x7f30d806bb40 2023-10-06T05:28:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d8144b10 con 0x7f30d8156b10 2023-10-06T05:28:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30de8f4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d8144d50 con 0x7f30d80c8d00 2023-10-06T05:28:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dd8f2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30d806bb40 0x7f30d8144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dd8f2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30d806bb40 0x7f30d8144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48946/0 (socket says 172.21.15.29:48946) 2023-10-06T05:28:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dd8f2700 1 -- 172.21.15.29:0/1179286574 learned_addr learned my addr 172.21.15.29:0/1179286574 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:16.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.574+0000 7f30dd0f1700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d80c8d00 0x7f30d81445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30de0f3700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d8156b10 0x7f30d80b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30dd8f2700 1 -- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d80c8d00 msgr2=0x7f30d81445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30dd8f2700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d80c8d00 0x7f30d81445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30dd8f2700 1 -- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d8156b10 msgr2=0x7f30d80b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30dd8f2700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d8156b10 0x7f30d80b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30dd8f2700 1 -- 172.21.15.29:0/1179286574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c80094f0 con 0x7f30d806bb40 2023-10-06T05:28:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30de0f3700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d8156b10 0x7f30d80b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30dd8f2700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30d806bb40 0x7f30d8144090 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c5c0 tx=0x7f30d400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30cdffb700 1 -- 172.21.15.29:0/1179286574 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4011590 con 0x7f30d806bb40 2023-10-06T05:28:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30cdffb700 1 -- 172.21.15.29:0/1179286574 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d4011710 con 0x7f30d806bb40 2023-10-06T05:28:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d8145030 con 0x7f30d806bb40 2023-10-06T05:28:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30cdffb700 1 -- 172.21.15.29:0/1179286574 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4011ad0 con 0x7f30d806bb40 2023-10-06T05:28:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d81455f0 con 0x7f30d806bb40 2023-10-06T05:28:16.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d804be00 con 0x7f30d806bb40 2023-10-06T05:28:16.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.578+0000 7f30cdffb700 1 -- 172.21.15.29:0/1179286574 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f30d401b3b0 con 0x7f30d806bb40 2023-10-06T05:28:16.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.582+0000 7f30cdffb700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f30bc060550 0x7f30bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.582+0000 7f30cdffb700 1 -- 172.21.15.29:0/1179286574 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f30d407be80 con 0x7f30d806bb40 2023-10-06T05:28:16.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.582+0000 7f30dd0f1700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f30bc060550 0x7f30bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.582+0000 7f30dd0f1700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f30bc060550 0x7f30bc062a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30c80099b0 tx=0x7f30c8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:16.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.590+0000 7f30cdffb700 1 -- 172.21.15.29:0/1179286574 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f30d404c310 con 0x7f30d806bb40 2023-10-06T05:28:16.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.754+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30d80c92c0 con 0x7f30d806bb40 2023-10-06T05:28:16.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.754+0000 7f30cdffb700 1 -- 172.21.15.29:0/1179286574 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16868 (secure 0 0 0) 0x7f30d4017020 con 0x7f30d806bb40 2023-10-06T05:28:16.763 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:16.763 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":62,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:28:15.063830+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:28:11.073066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T05:28:12.396583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f30bc060550 msgr2=0x7f30bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f30bc060550 0x7f30bc062a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30c80099b0 tx=0x7f30c8017000 comp rx=0 tx=0).stop 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30d806bb40 msgr2=0x7f30d8144090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30d806bb40 0x7f30d8144090 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c5c0 tx=0x7f30d400c8d0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 shutdown_connections 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f30bc060550 0x7f30bc062a00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30d8156b10 0x7f30d80b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30d80c8d00 0x7f30d81445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 --2- 172.21.15.29:0/1179286574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30d806bb40 0x7f30d8144090 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 >> 172.21.15.29:0/1179286574 conn(0x7f30d80670a0 msgr2=0x7f30d80c2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:16.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 shutdown_connections 2023-10-06T05:28:16.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.758+0000 7f30de8f4700 1 -- 172.21.15.29:0/1179286574 wait complete. 2023-10-06T05:28:16.779 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T05:28:16.779 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:28:16.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496398e700 1 Processor -- start 2023-10-06T05:28:16.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496398e700 1 -- start start 2023-10-06T05:28:16.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496398e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c0af5c0 0x7f495c0af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496398e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f495c161950 0x7f495c06a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496398e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495c1614c0 con 0x7f495c06a9a0 2023-10-06T05:28:16.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496398e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495c160f40 con 0x7f495c161950 2023-10-06T05:28:16.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496398e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495c06d420 con 0x7f495c0af5c0 2023-10-06T05:28:16.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f4961f2b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f495c06a9a0 0x7f495c06e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59354/0 (socket says 172.21.15.29:59354) 2023-10-06T05:28:16.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f4961f2b700 1 -- 172.21.15.29:0/1764243895 learned_addr learned my addr 172.21.15.29:0/1764243895 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:16.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496172a700 1 --2- 172.21.15.29:0/1764243895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c0af5c0 0x7f495c0af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f4960f29700 1 --2- 172.21.15.29:0/1764243895 >> v2:172.21.15.173:3300/0 conn(0x7f495c161950 0x7f495c06a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f4953fff700 1 -- 172.21.15.29:0/1764243895 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318364634 0 0) 0x7f495c1614c0 con 0x7f495c06a9a0 2023-10-06T05:28:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f4953fff700 1 -- 172.21.15.29:0/1764243895 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4944003570 con 0x7f495c06a9a0 2023-10-06T05:28:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496172a700 1 -- 172.21.15.29:0/1764243895 >> v2:172.21.15.173:3300/0 conn(0x7f495c161950 msgr2=0x7f495c06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496172a700 1 --2- 172.21.15.29:0/1764243895 >> v2:172.21.15.173:3300/0 conn(0x7f495c161950 0x7f495c06a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496172a700 1 -- 172.21.15.29:0/1764243895 >> v1:172.21.15.29:6789/0 conn(0x7f495c06a9a0 legacy=0x7f495c06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496172a700 1 -- 172.21.15.29:0/1764243895 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c06af20 con 0x7f495c0af5c0 2023-10-06T05:28:16.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f4960f29700 1 --2- 172.21.15.29:0/1764243895 >> v2:172.21.15.173:3300/0 conn(0x7f495c161950 0x7f495c06a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f496172a700 1 --2- 172.21.15.29:0/1764243895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c0af5c0 0x7f495c0af990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f49580098e0 tx=0x7f49580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4019c5cdbb4708 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f4953fff700 1 -- 172.21.15.29:0/1764243895 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958011630 con 0x7f495c0af5c0 2023-10-06T05:28:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f4953fff700 1 -- 172.21.15.29:0/1764243895 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4958011790 con 0x7f495c0af5c0 2023-10-06T05:28:16.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.874+0000 7f4953fff700 1 -- 172.21.15.29:0/1764243895 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958011b30 con 0x7f495c0af5c0 2023-10-06T05:28:16.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 -- 172.21.15.29:0/1764243895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c0af5c0 msgr2=0x7f495c0af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 --2- 172.21.15.29:0/1764243895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c0af5c0 0x7f495c0af990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f49580098e0 tx=0x7f49580091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 -- 172.21.15.29:0/1764243895 shutdown_connections 2023-10-06T05:28:16.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 --2- 172.21.15.29:0/1764243895 >> v2:172.21.15.173:3300/0 conn(0x7f495c161950 0x7f495c06a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 --2- 172.21.15.29:0/1764243895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c0af5c0 0x7f495c0af990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 -- 172.21.15.29:0/1764243895 >> 172.21.15.29:0/1764243895 conn(0x7f495c067b70 msgr2=0x7f495c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:16.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 -- 172.21.15.29:0/1764243895 shutdown_connections 2023-10-06T05:28:16.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 -- 172.21.15.29:0/1764243895 wait complete. 2023-10-06T05:28:16.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 Processor -- start 2023-10-06T05:28:16.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.878+0000 7f496398e700 1 -- start start 2023-10-06T05:28:16.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f496398e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c06a9a0 0x7f495c1708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f496398e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f495c0af5c0 0x7f495c158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f496398e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c161950 0x7f495c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f496398e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c156de0 con 0x7f495c0af5c0 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f496398e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c1717e0 con 0x7f495c161950 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f496398e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495c157360 con 0x7f495c06a9a0 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4960f29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f495c0af5c0 0x7f495c158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4960f29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f495c0af5c0 0x7f495c158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48948/0 (socket says 172.21.15.29:48948) 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4960f29700 1 -- 172.21.15.29:0/811782195 learned_addr learned my addr 172.21.15.29:0/811782195 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f496172a700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c06a9a0 0x7f495c1708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4961f2b700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c161950 0x7f495c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4960f29700 1 -- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c06a9a0 msgr2=0x7f495c1708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4960f29700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c06a9a0 0x7f495c1708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4960f29700 1 -- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c161950 msgr2=0x7f495c1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4960f29700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c161950 0x7f495c1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4960f29700 1 -- 172.21.15.29:0/811782195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4954009a20 con 0x7f495c0af5c0 2023-10-06T05:28:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f4960f29700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f495c0af5c0 0x7f495c158c60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f495400c170 tx=0x7f495400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f49517fa700 1 -- 172.21.15.29:0/811782195 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495400cd60 con 0x7f495c0af5c0 2023-10-06T05:28:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f49517fa700 1 -- 172.21.15.29:0/811782195 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495400f040 con 0x7f495c0af5c0 2023-10-06T05:28:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4958009420 con 0x7f495c0af5c0 2023-10-06T05:28:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f49517fa700 1 -- 172.21.15.29:0/811782195 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954014690 con 0x7f495c0af5c0 2023-10-06T05:28:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.882+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495c156ff0 con 0x7f495c0af5c0 2023-10-06T05:28:16.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.886+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495c1574f0 con 0x7f495c0af5c0 2023-10-06T05:28:16.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.886+0000 7f49517fa700 1 -- 172.21.15.29:0/811782195 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4954014a00 con 0x7f495c0af5c0 2023-10-06T05:28:16.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.886+0000 7f49517fa700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4948060550 0x7f4948062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:16.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.886+0000 7f49517fa700 1 -- 172.21.15.29:0/811782195 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f495407d890 con 0x7f495c0af5c0 2023-10-06T05:28:16.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.886+0000 7f496172a700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4948060550 0x7f4948062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:16.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.886+0000 7f496172a700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4948060550 0x7f4948062a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f49580091e0 tx=0x7f4958017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:16.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:16.894+0000 7f49517fa700 1 -- 172.21.15.29:0/811782195 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f495404dc80 con 0x7f495c0af5c0 2023-10-06T05:28:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.054+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f495c04be00 con 0x7f4948060550 2023-10-06T05:28:17.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.070+0000 7f49517fa700 1 -- 172.21.15.29:0/811782195 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298783 (secure 0 0 0) 0x7f495c04be00 con 0x7f4948060550 2023-10-06T05:28:17.085 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4948060550 msgr2=0x7f4948062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4948060550 0x7f4948062a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f49580091e0 tx=0x7f4958017000 comp rx=0 tx=0).stop 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f495c0af5c0 msgr2=0x7f495c158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f495c0af5c0 0x7f495c158c60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f495400c170 tx=0x7f495400b040 comp rx=0 tx=0).stop 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 shutdown_connections 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4948060550 0x7f4948062a00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c161950 0x7f495c1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f495c0af5c0 0x7f495c158c60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 --2- 172.21.15.29:0/811782195 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f495c06a9a0 0x7f495c1708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 >> 172.21.15.29:0/811782195 conn(0x7f495c067b70 msgr2=0x7f495c15a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:17.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 shutdown_connections 2023-10-06T05:28:17.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.078+0000 7f496398e700 1 -- 172.21.15.29:0/811782195 wait complete. 2023-10-06T05:28:17.090 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:28:17.102 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-10-06T05:28:16.704640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2405444,"kb_used_data":6660,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752569276,"statfs":{"total":773094113280,"available":770630938624,"internally_reserved":0,"allocated":6819840,"data_stored":3596390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.672408"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039383+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045765+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:28.332126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045833+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:48.239335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045693+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.146829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042007+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:41.861218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042342+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:00.722691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041437+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:54.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041340+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:18.672888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039539+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.034613+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038322+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:11.664428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039946+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038319+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:41.587049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039701+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036537+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.034812+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:22.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.037297+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039332+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:51.497697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.046660+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038826+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036501+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041413+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042572+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:01.326653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039014+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041535+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008337+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:28:09.008337+0000","last_peered":"2023-10-06T05:28:09.008337+0000","last_clean":"2023-10-06T05:28:09.008337+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:28:09.008337+0000","last_undegraded":"2023-10-06T05:28:09.008337+0000","last_fullsized":"2023-10-06T05:28:09.008337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.009902+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:28:09.009902+0000","last_peered":"2023-10-06T05:28:09.009902+0000","last_clean":"2023-10-06T05:28:09.009902+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:28:09.009902+0000","last_undegraded":"2023-10-06T05:28:09.009902+0000","last_fullsized":"2023-10-06T05:28:09.009902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045862+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008107+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:28:09.008107+0000","last_peered":"2023-10-06T05:28:09.008107+0000","last_clean":"2023-10-06T05:28:09.008107+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:28:09.008107+0000","last_undegraded":"2023-10-06T05:28:09.008107+0000","last_fullsized":"2023-10-06T05:28:09.008107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038218+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:05.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255070+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:28:09.255070+0000","last_peered":"2023-10-06T05:28:09.255070+0000","last_clean":"2023-10-06T05:28:09.255070+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:28:09.255070+0000","last_undegraded":"2023-10-06T05:28:09.255070+0000","last_fullsized":"2023-10-06T05:28:09.255070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045721+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:17.948472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.009845+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:28:09.009845+0000","last_peered":"2023-10-06T05:28:09.009845+0000","last_clean":"2023-10-06T05:28:09.009845+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:28:09.009845+0000","last_undegraded":"2023-10-06T05:28:09.009845+0000","last_fullsized":"2023-10-06T05:28:09.009845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.037974+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:18.738449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255697+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:28:09.255697+0000","last_peered":"2023-10-06T05:28:09.255697+0000","last_clean":"2023-10-06T05:28:09.255697+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:28:09.255697+0000","last_undegraded":"2023-10-06T05:28:09.255697+0000","last_fullsized":"2023-10-06T05:28:09.255697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036475+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008099+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:28:09.008099+0000","last_peered":"2023-10-06T05:28:09.008099+0000","last_clean":"2023-10-06T05:28:09.008099+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:28:09.008099+0000","last_undegraded":"2023-10-06T05:28:09.008099+0000","last_fullsized":"2023-10-06T05:28:09.008099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036203+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255630+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:28:09.255630+0000","last_peered":"2023-10-06T05:28:09.255630+0000","last_clean":"2023-10-06T05:28:09.255630+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:28:09.255630+0000","last_undegraded":"2023-10-06T05:28:09.255630+0000","last_fullsized":"2023-10-06T05:28:09.255630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042450+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:22.242931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008989+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:28:09.008989+0000","last_peered":"2023-10-06T05:28:09.008989+0000","last_clean":"2023-10-06T05:28:09.008989+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:28:09.008989+0000","last_undegraded":"2023-10-06T05:28:09.008989+0000","last_fullsized":"2023-10-06T05:28:09.008989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":894634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.84799999999999998,"15min":0.83999999999999997},"min":{"1min":0.64100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.165},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.63300000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.86699999999999999,"15min":0.86299999999999999},"min":{"1min":0.59599999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1879999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.89900000000000002,"15min":0.90300000000000002},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1910000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.1220000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.143,"5min":1.276,"15min":1.276},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.052},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.0229999999999999,"15min":1.03},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.256,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.121,"15min":1.1160000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.2869999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.23}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.246,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.208,"15min":1.2110000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.373,"5min":1.385,"15min":1.385},"last":1.2689999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.139,"15min":1.147},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4299999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.367},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1819999999999999,"15min":1.1910000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.349,"5min":1.425,"15min":1.425},"last":1.3140000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85099999999999998},"min":{"1min":0.63600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":0.96599999999999997,"15min":0.95199999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.97499999999999998,"15min":0.96499999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.95799999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.84299999999999997,"15min":0.81999999999999995},"min":{"1min":0.70399999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.753},{"interface":"front","average":{"1min":1,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57899999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.081}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91200000000000003,"15min":0.91700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.079,"15min":1.069},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.107}]},{"osd":4,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.67400000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0669999999999999,"15min":1.079},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3129999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1299999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0940000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0629999999999999,"15min":1.0580000000000001},"min":{"1min":0.72999999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.3}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2410000000000001,"5min":1.367,"15min":1.367},"last":1.266},{"interface":"front","average":{"1min":1.119,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.85499999999999998,"15min":0.84699999999999998},"min":{"1min":0.58499999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93300000000000005,"15min":0.93100000000000005},"min":{"1min":0.58899999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.95599999999999996,"15min":0.95099999999999996},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.71399999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2210000000000001,"5min":1.54,"15min":1.54},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.93300000000000005,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.879,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.48,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2509999999999999,"5min":1.419,"15min":1.419},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4670000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.109,"15min":1.123},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.397,"5min":1.508,"15min":1.508},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0940000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.329,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.153},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4319999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.24,"15min":1.2490000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.593,"5min":1.732,"15min":1.732},"last":0.879}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.79400000000000004,"15min":0.77900000000000003},"min":{"1min":0.53100000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.284,"15min":1.284},"last":1.105},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95899999999999996,"15min":0.96499999999999997},"min":{"1min":0.55700000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2270000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0780000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.141},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.99199999999999999,"15min":1.004},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.147,"5min":1.335,"15min":1.335},"last":1.179}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.72299999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.423,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.72899999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1919999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.234}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2490000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.96999999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2230000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.046,"15min":1.0469999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3280000000000001,"5min":1.458,"15min":1.458},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0029999999999999,"15min":1.0009999999999999},"min":{"1min":0.71799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2010000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.498,"5min":1.548,"15min":1.548},"last":1.2789999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1419999999999999,"15min":1.139},"min":{"1min":0.89400000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.3799999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.01},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.125,"15min":1.123},"min":{"1min":0.91700000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.345,"5min":1.415,"15min":1.415},"last":1.2030000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":696320,"data_stored":298108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0389999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.315,"15min":0.315},"max":{"1min":0.997,"5min":1.379,"15min":1.379},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.389,"15min":1.389},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.117,"15min":1.117},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0269999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.85499999999999998,"15min":0.84799999999999998},"min":{"1min":0.65600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3520000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.85599999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":0.875}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1220000000000001},"min":{"1min":0.749,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.454,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.367,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.079,"15min":1.0820000000000001},"min":{"1min":0.73899999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2969999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.77600000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.462,"5min":1.968,"15min":1.968},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1579999999999999,"15min":1.159},"min":{"1min":0.85899999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.48,"5min":1.762,"15min":1.762},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.171,"15min":1.175},"min":{"1min":0.79800000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.393,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.208}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.624},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.89700000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.94099999999999995,"15min":0.94399999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.872,"15min":0.88300000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.89300000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2110000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.1060000000000001,"15min":1.1359999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3109999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.872},{"interface":"front","average":{"1min":1.147,"5min":1.236,"15min":1.2509999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6020000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.4890000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1919999999999999,"15min":1.206},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.431,"5min":1.829,"15min":1.829},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1850000000000001,"15min":1.1990000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.714,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2729999999999999,"15min":1.2849999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.226,"15min":1.2390000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.659,"5min":1.708,"15min":1.708},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2729999999999999,"15min":1.2889999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.845,"5min":1.972,"15min":1.972},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.371,"15min":1.3899999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":2.04,"15min":2.04},"last":1.5429999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":696320,"data_stored":298108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.74199999999999999,"15min":0.752},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.012,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78900000000000003,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0940000000000001,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.89900000000000002,"15min":0.91600000000000004},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.093,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0309999999999999,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3200000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.153,"15min":1.171},"min":{"1min":0.83499999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.2829999999999999,"5min":1.899,"15min":1.899},"last":1.048}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1799999999999999,"15min":1.2070000000000001},"min":{"1min":0.752,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3480000000000001,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.218,"15min":1.24},"min":{"1min":0.89200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5720000000000001,"5min":2.02,"15min":2.02},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4950000000000001,"5min":1.804,"15min":1.804},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.2150000000000001,"15min":1.228},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.415,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.3680000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.133},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.2030000000000001,"15min":1.204},"min":{"1min":0.90300000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.29}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302644,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069196,"statfs":{"total":96636764160,"available":96326856704,"internally_reserved":0,"allocated":1290240,"data_stored":888476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95799999999999996,"5min":1.006,"15min":1.006},"last":1.119},{"interface":"front","average":{"1min":0.755,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.91400000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.60899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.71399999999999997}]},{"osd":3,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.89400000000000002,"15min":0.89200000000000002},"min":{"1min":0.59499999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1020000000000001,"5min":1.204,"15min":1.204},"last":1.0069999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.026,"15min":1.0189999999999999},"min":{"1min":0.76200000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.026,"15min":1.024},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.05}]},{"osd":5,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0700000000000001,"15min":1.0620000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.159},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1699999999999999,"15min":1.1619999999999999},"min":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.518}]},{"osd":6,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2490000000000001,"15min":1.2509999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.226,"15min":1.2210000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.083}]},{"osd":7,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.2789999999999999},"min":{"1min":0.97499999999999998,"5min":0.88,"15min":0.88},"max":{"1min":1.6579999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.25,"15min":1.25},"min":{"1min":1.016,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.6040000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.3839999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:28:17.112 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:28:17.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.214+0000 7f9d9a87d700 1 Processor -- start 2023-10-06T05:28:17.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.214+0000 7f9d9a87d700 1 -- start start 2023-10-06T05:28:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9a87d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9d94152f20 0x7f9d94159830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9a87d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d940c9e00 con 0x7f9d9406dde0 2023-10-06T05:28:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9a87d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d941567d0 con 0x7f9d94152b50 2023-10-06T05:28:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9a87d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d94159d70 con 0x7f9d94152f20 2023-10-06T05:28:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9907a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9d9406dde0 0x7f9d94068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59370/0 (socket says 172.21.15.29:59370) 2023-10-06T05:28:17.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9907a700 1 -- 172.21.15.29:0/3764324998 learned_addr learned my addr 172.21.15.29:0/3764324998 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:17.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9a07c700 1 --2- 172.21.15.29:0/3764324998 >> v2:172.21.15.29:3300/0 conn(0x7f9d94152f20 0x7f9d94159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d98879700 1 -- 172.21.15.29:0/3764324998 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539192231 0 0) 0x7f9d940c9e00 con 0x7f9d9406dde0 2023-10-06T05:28:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d98879700 1 -- 172.21.15.29:0/3764324998 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d80004680 con 0x7f9d9406dde0 2023-10-06T05:28:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d98879700 1 -- 172.21.15.29:0/3764324998 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856347532 0 0) 0x7f9d941567d0 con 0x7f9d94152b50 2023-10-06T05:28:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d98879700 1 -- 172.21.15.29:0/3764324998 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d940c9e00 con 0x7f9d94152b50 2023-10-06T05:28:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d98879700 1 -- 172.21.15.29:0/3764324998 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4273767031 0 0) 0x7f9d80004680 con 0x7f9d9406dde0 2023-10-06T05:28:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9a07c700 1 -- 172.21.15.29:0/3764324998 >> v1:172.21.15.173:6789/0 conn(0x7f9d94152b50 legacy=0x7f9d9406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9a07c700 1 -- 172.21.15.29:0/3764324998 >> v1:172.21.15.29:6789/0 conn(0x7f9d9406dde0 legacy=0x7f9d94068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9a07c700 1 -- 172.21.15.29:0/3764324998 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94155bc0 con 0x7f9d94152f20 2023-10-06T05:28:17.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d9a07c700 1 --2- 172.21.15.29:0/3764324998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152f20 0x7f9d94159830 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009e60 tx=0x7f9d8c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6531899b9cc168 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:17.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d98879700 1 -- 172.21.15.29:0/3764324998 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c00e070 con 0x7f9d94152f20 2023-10-06T05:28:17.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d98879700 1 -- 172.21.15.29:0/3764324998 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c00b7a0 con 0x7f9d94152f20 2023-10-06T05:28:17.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.218+0000 7f9d98879700 1 -- 172.21.15.29:0/3764324998 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84001470 con 0x7f9d94152f20 2023-10-06T05:28:17.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.222+0000 7f9d9a87d700 1 -- 172.21.15.29:0/3764324998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152f20 msgr2=0x7f9d94159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.222+0000 7f9d9a87d700 1 --2- 172.21.15.29:0/3764324998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152f20 0x7f9d94159830 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009e60 tx=0x7f9d8c009780 comp rx=0 tx=0).stop 2023-10-06T05:28:17.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.222+0000 7f9d9a87d700 1 -- 172.21.15.29:0/3764324998 shutdown_connections 2023-10-06T05:28:17.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.222+0000 7f9d9a87d700 1 --2- 172.21.15.29:0/3764324998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152f20 0x7f9d94159830 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.222+0000 7f9d9a87d700 1 -- 172.21.15.29:0/3764324998 >> 172.21.15.29:0/3764324998 conn(0x7f9d9406aaf0 msgr2=0x7f9d9406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:17.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.222+0000 7f9d9a87d700 1 -- 172.21.15.29:0/3764324998 shutdown_connections 2023-10-06T05:28:17.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.222+0000 7f9d9a87d700 1 -- 172.21.15.29:0/3764324998 wait complete. 2023-10-06T05:28:17.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.222+0000 7f9d9a87d700 1 Processor -- start 2023-10-06T05:28:17.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.222+0000 7f9d9a87d700 1 -- start start 2023-10-06T05:28:17.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9a87d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d9406dde0 0x7f9d940b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9a87d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152b50 0x7f9d940b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9a87d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d94152f20 0x7f9d9414d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9a87d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d94154e40 con 0x7f9d94152b50 2023-10-06T05:28:17.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9a87d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d94153ce0 con 0x7f9d94152f20 2023-10-06T05:28:17.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9a87d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d94153fc0 con 0x7f9d9406dde0 2023-10-06T05:28:17.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9907a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152b50 0x7f9d940b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9907a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152b50 0x7f9d940b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48954/0 (socket says 172.21.15.29:48954) 2023-10-06T05:28:17.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9907a700 1 -- 172.21.15.29:0/4017775811 learned_addr learned my addr 172.21.15.29:0/4017775811 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:17.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9907a700 1 -- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d9406dde0 msgr2=0x7f9d940b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9907a700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d9406dde0 0x7f9d940b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9907a700 1 -- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d94152f20 msgr2=0x7f9d9414d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9907a700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d94152f20 0x7f9d9414d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9907a700 1 -- 172.21.15.29:0/4017775811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c009a20 con 0x7f9d94152b50 2023-10-06T05:28:17.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9907a700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152b50 0x7f9d940b1a20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400eda0 tx=0x7f9d84001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:17.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d89ffb700 1 -- 172.21.15.29:0/4017775811 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84007e90 con 0x7f9d94152b50 2023-10-06T05:28:17.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d89ffb700 1 -- 172.21.15.29:0/4017775811 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8400ee80 con 0x7f9d94152b50 2023-10-06T05:28:17.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d941542a0 con 0x7f9d94152b50 2023-10-06T05:28:17.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d89ffb700 1 -- 172.21.15.29:0/4017775811 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84007150 con 0x7f9d94152b50 2023-10-06T05:28:17.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9414db90 con 0x7f9d94152b50 2023-10-06T05:28:17.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.226+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d94154a80 con 0x7f9d94152b50 2023-10-06T05:28:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.230+0000 7f9d89ffb700 1 -- 172.21.15.29:0/4017775811 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9d84007540 con 0x7f9d94152b50 2023-10-06T05:28:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.230+0000 7f9d89ffb700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9d78060550 0x7f9d78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.230+0000 7f9d89ffb700 1 -- 172.21.15.29:0/4017775811 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9d8407f1d0 con 0x7f9d94152b50 2023-10-06T05:28:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.230+0000 7f9d9987b700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9d78060550 0x7f9d78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.230+0000 7f9d9987b700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9d78060550 0x7f9d78062a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9d940c8080 tx=0x7f9d900079d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:17.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.238+0000 7f9d89ffb700 1 -- 172.21.15.29:0/4017775811 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9d8404f660 con 0x7f9d94152b50 2023-10-06T05:28:17.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.394+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d94155ed0 con 0x7f9d78060550 2023-10-06T05:28:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.414+0000 7f9d89ffb700 1 -- 172.21.15.29:0/4017775811 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298783 (secure 0 0 0) 0x7f9d94155ed0 con 0x7f9d78060550 2023-10-06T05:28:17.425 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9d78060550 msgr2=0x7f9d78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9d78060550 0x7f9d78062a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9d940c8080 tx=0x7f9d900079d0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152b50 msgr2=0x7f9d940b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152b50 0x7f9d940b1a20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400eda0 tx=0x7f9d84001b30 comp rx=0 tx=0).stop 2023-10-06T05:28:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 shutdown_connections 2023-10-06T05:28:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9d78060550 0x7f9d78062a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d94152f20 0x7f9d9414d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d94152b50 0x7f9d940b1a20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 --2- 172.21.15.29:0/4017775811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d9406dde0 0x7f9d940b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 >> 172.21.15.29:0/4017775811 conn(0x7f9d9406aaf0 msgr2=0x7f9d940caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 shutdown_connections 2023-10-06T05:28:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.418+0000 7f9d9a87d700 1 -- 172.21.15.29:0/4017775811 wait complete. 2023-10-06T05:28:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:28:17.441 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-10-06T05:28:16.704640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2405444,"kb_used_data":6660,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752569276,"statfs":{"total":773094113280,"available":770630938624,"internally_reserved":0,"allocated":6819840,"data_stored":3596390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.672408"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039383+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045765+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:28.332126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045833+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:48.239335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045693+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.146829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042007+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:41.861218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042342+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:00.722691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041437+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:54.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041340+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:18.672888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039539+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.034613+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038322+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:11.664428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039946+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038319+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:41.587049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039701+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036537+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.034812+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:22.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.037297+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039332+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:51.497697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.046660+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038826+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036501+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041413+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042572+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:01.326653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039014+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041535+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008337+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:28:09.008337+0000","last_peered":"2023-10-06T05:28:09.008337+0000","last_clean":"2023-10-06T05:28:09.008337+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:28:09.008337+0000","last_undegraded":"2023-10-06T05:28:09.008337+0000","last_fullsized":"2023-10-06T05:28:09.008337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.009902+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:28:09.009902+0000","last_peered":"2023-10-06T05:28:09.009902+0000","last_clean":"2023-10-06T05:28:09.009902+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:28:09.009902+0000","last_undegraded":"2023-10-06T05:28:09.009902+0000","last_fullsized":"2023-10-06T05:28:09.009902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045862+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008107+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:28:09.008107+0000","last_peered":"2023-10-06T05:28:09.008107+0000","last_clean":"2023-10-06T05:28:09.008107+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:28:09.008107+0000","last_undegraded":"2023-10-06T05:28:09.008107+0000","last_fullsized":"2023-10-06T05:28:09.008107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038218+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:05.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255070+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:28:09.255070+0000","last_peered":"2023-10-06T05:28:09.255070+0000","last_clean":"2023-10-06T05:28:09.255070+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:28:09.255070+0000","last_undegraded":"2023-10-06T05:28:09.255070+0000","last_fullsized":"2023-10-06T05:28:09.255070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045721+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:17.948472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.009845+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:28:09.009845+0000","last_peered":"2023-10-06T05:28:09.009845+0000","last_clean":"2023-10-06T05:28:09.009845+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:28:09.009845+0000","last_undegraded":"2023-10-06T05:28:09.009845+0000","last_fullsized":"2023-10-06T05:28:09.009845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.037974+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:18.738449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255697+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:28:09.255697+0000","last_peered":"2023-10-06T05:28:09.255697+0000","last_clean":"2023-10-06T05:28:09.255697+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:28:09.255697+0000","last_undegraded":"2023-10-06T05:28:09.255697+0000","last_fullsized":"2023-10-06T05:28:09.255697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036475+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008099+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:28:09.008099+0000","last_peered":"2023-10-06T05:28:09.008099+0000","last_clean":"2023-10-06T05:28:09.008099+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:28:09.008099+0000","last_undegraded":"2023-10-06T05:28:09.008099+0000","last_fullsized":"2023-10-06T05:28:09.008099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036203+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255630+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:28:09.255630+0000","last_peered":"2023-10-06T05:28:09.255630+0000","last_clean":"2023-10-06T05:28:09.255630+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:28:09.255630+0000","last_undegraded":"2023-10-06T05:28:09.255630+0000","last_fullsized":"2023-10-06T05:28:09.255630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042450+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:22.242931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008989+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:28:09.008989+0000","last_peered":"2023-10-06T05:28:09.008989+0000","last_clean":"2023-10-06T05:28:09.008989+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:28:09.008989+0000","last_undegraded":"2023-10-06T05:28:09.008989+0000","last_fullsized":"2023-10-06T05:28:09.008989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":894634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.84799999999999998,"15min":0.83999999999999997},"min":{"1min":0.64100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.165},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.63300000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.86699999999999999,"15min":0.86299999999999999},"min":{"1min":0.59599999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1879999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.89900000000000002,"15min":0.90300000000000002},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1910000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.1220000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.143,"5min":1.276,"15min":1.276},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.052},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.0229999999999999,"15min":1.03},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.256,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.121,"15min":1.1160000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.2869999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.23}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.246,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.208,"15min":1.2110000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.373,"5min":1.385,"15min":1.385},"last":1.2689999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.139,"15min":1.147},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4299999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.367},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1819999999999999,"15min":1.1910000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.349,"5min":1.425,"15min":1.425},"last":1.3140000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85099999999999998},"min":{"1min":0.63600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":0.96599999999999997,"15min":0.95199999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.97499999999999998,"15min":0.96499999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.95799999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.84299999999999997,"15min":0.81999999999999995},"min":{"1min":0.70399999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.753},{"interface":"front","average":{"1min":1,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57899999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.081}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91200000000000003,"15min":0.91700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.079,"15min":1.069},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.107}]},{"osd":4,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.67400000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0669999999999999,"15min":1.079},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3129999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1299999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0940000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0629999999999999,"15min":1.0580000000000001},"min":{"1min":0.72999999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.3}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2410000000000001,"5min":1.367,"15min":1.367},"last":1.266},{"interface":"front","average":{"1min":1.119,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.85499999999999998,"15min":0.84699999999999998},"min":{"1min":0.58499999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93300000000000005,"15min":0.93100000000000005},"min":{"1min":0.58899999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.95599999999999996,"15min":0.95099999999999996},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.71399999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2210000000000001,"5min":1.54,"15min":1.54},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.93300000000000005,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.879,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.48,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2509999999999999,"5min":1.419,"15min":1.419},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4670000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.109,"15min":1.123},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.397,"5min":1.508,"15min":1.508},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0940000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.329,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.153},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4319999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.24,"15min":1.2490000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.593,"5min":1.732,"15min":1.732},"last":0.879}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.79400000000000004,"15min":0.77900000000000003},"min":{"1min":0.53100000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.284,"15min":1.284},"last":1.105},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95899999999999996,"15min":0.96499999999999997},"min":{"1min":0.55700000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2270000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0780000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.141},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.99199999999999999,"15min":1.004},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.147,"5min":1.335,"15min":1.335},"last":1.179}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.72299999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.423,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.72899999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1919999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.234}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2490000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.96999999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2230000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.046,"15min":1.0469999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3280000000000001,"5min":1.458,"15min":1.458},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0029999999999999,"15min":1.0009999999999999},"min":{"1min":0.71799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2010000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.498,"5min":1.548,"15min":1.548},"last":1.2789999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1419999999999999,"15min":1.139},"min":{"1min":0.89400000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.3799999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.01},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.125,"15min":1.123},"min":{"1min":0.91700000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.345,"5min":1.415,"15min":1.415},"last":1.2030000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":696320,"data_stored":298108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0389999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.315,"15min":0.315},"max":{"1min":0.997,"5min":1.379,"15min":1.379},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.389,"15min":1.389},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.117,"15min":1.117},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0269999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.85499999999999998,"15min":0.84799999999999998},"min":{"1min":0.65600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3520000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.85599999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":0.875}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1220000000000001},"min":{"1min":0.749,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.454,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.367,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.079,"15min":1.0820000000000001},"min":{"1min":0.73899999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2969999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.77600000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.462,"5min":1.968,"15min":1.968},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1579999999999999,"15min":1.159},"min":{"1min":0.85899999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.48,"5min":1.762,"15min":1.762},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.171,"15min":1.175},"min":{"1min":0.79800000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.393,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.208}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.624},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.89700000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.94099999999999995,"15min":0.94399999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.872,"15min":0.88300000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.89300000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2110000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.1060000000000001,"15min":1.1359999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3109999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.872},{"interface":"front","average":{"1min":1.147,"5min":1.236,"15min":1.2509999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6020000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.4890000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1919999999999999,"15min":1.206},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.431,"5min":1.829,"15min":1.829},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1850000000000001,"15min":1.1990000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.714,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2729999999999999,"15min":1.2849999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.226,"15min":1.2390000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.659,"5min":1.708,"15min":1.708},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2729999999999999,"15min":1.2889999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.845,"5min":1.972,"15min":1.972},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.371,"15min":1.3899999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":2.04,"15min":2.04},"last":1.5429999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":696320,"data_stored":298108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.74199999999999999,"15min":0.752},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.012,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78900000000000003,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0940000000000001,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.89900000000000002,"15min":0.91600000000000004},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.093,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0309999999999999,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3200000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.153,"15min":1.171},"min":{"1min":0.83499999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.2829999999999999,"5min":1.899,"15min":1.899},"last":1.048}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1799999999999999,"15min":1.2070000000000001},"min":{"1min":0.752,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3480000000000001,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.218,"15min":1.24},"min":{"1min":0.89200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5720000000000001,"5min":2.02,"15min":2.02},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4950000000000001,"5min":1.804,"15min":1.804},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.2150000000000001,"15min":1.228},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.415,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.3680000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.133},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.2030000000000001,"15min":1.204},"min":{"1min":0.90300000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.29}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302644,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069196,"statfs":{"total":96636764160,"available":96326856704,"internally_reserved":0,"allocated":1290240,"data_stored":888476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95799999999999996,"5min":1.006,"15min":1.006},"last":1.119},{"interface":"front","average":{"1min":0.755,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.91400000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.60899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.71399999999999997}]},{"osd":3,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.89400000000000002,"15min":0.89200000000000002},"min":{"1min":0.59499999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1020000000000001,"5min":1.204,"15min":1.204},"last":1.0069999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.026,"15min":1.0189999999999999},"min":{"1min":0.76200000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.026,"15min":1.024},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.05}]},{"osd":5,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0700000000000001,"15min":1.0620000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.159},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1699999999999999,"15min":1.1619999999999999},"min":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.518}]},{"osd":6,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2490000000000001,"15min":1.2509999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.226,"15min":1.2210000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.083}]},{"osd":7,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.2789999999999999},"min":{"1min":0.97499999999999998,"5min":0.88,"15min":0.88},"max":{"1min":1.6579999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.25,"15min":1.25},"min":{"1min":1.016,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.6040000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.3839999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:28:17.447 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:28:17.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 Processor -- start 2023-10-06T05:28:17.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 -- start start 2023-10-06T05:28:17.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fab6c0cc9a0 0x7fab6c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fab6c158870 0x7fab6c158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0ca870 0x7fab6c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0cb5f0 con 0x7fab6c158870 2023-10-06T05:28:17.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0cb8d0 con 0x7fab6c0cc9a0 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0cbbb0 con 0x7fab6c0ca870 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab716c1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fab6c158870 0x7fab6c158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab716c1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fab6c158870 0x7fab6c158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48968/0 (socket says 172.21.15.29:48968) 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab716c1700 1 -- 172.21.15.29:0/2526459635 learned_addr learned my addr 172.21.15.29:0/2526459635 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab71ec2700 1 --2- 172.21.15.29:0/2526459635 >> v2:172.21.15.173:3300/0 conn(0x7fab6c0cc9a0 0x7fab6c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab726c3700 1 --2- 172.21.15.29:0/2526459635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0ca870 0x7fab6c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab716c1700 1 -- 172.21.15.29:0/2526459635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0ca870 msgr2=0x7fab6c0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab716c1700 1 --2- 172.21.15.29:0/2526459635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0ca870 0x7fab6c0cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab716c1700 1 -- 172.21.15.29:0/2526459635 >> v2:172.21.15.173:3300/0 conn(0x7fab6c0cc9a0 msgr2=0x7fab6c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab716c1700 1 --2- 172.21.15.29:0/2526459635 >> v2:172.21.15.173:3300/0 conn(0x7fab6c0cc9a0 0x7fab6c0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab716c1700 1 -- 172.21.15.29:0/2526459635 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0cbe90 con 0x7fab6c158870 2023-10-06T05:28:17.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab716c1700 1 --2- 172.21.15.29:0/2526459635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c158870 0x7fab6c158cc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fab6c069400 tx=0x7fab64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2899c59cec932354 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab70ec0700 1 -- 172.21.15.29:0/2526459635 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400e070 con 0x7fab6c158870 2023-10-06T05:28:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab70ec0700 1 -- 172.21.15.29:0/2526459635 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400ba20 con 0x7fab6c158870 2023-10-06T05:28:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab70ec0700 1 -- 172.21.15.29:0/2526459635 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640092e0 con 0x7fab6c158870 2023-10-06T05:28:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 -- 172.21.15.29:0/2526459635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c158870 msgr2=0x7fab6c158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 --2- 172.21.15.29:0/2526459635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c158870 0x7fab6c158cc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fab6c069400 tx=0x7fab64009840 comp rx=0 tx=0).stop 2023-10-06T05:28:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 -- 172.21.15.29:0/2526459635 shutdown_connections 2023-10-06T05:28:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 --2- 172.21.15.29:0/2526459635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0ca870 0x7fab6c0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 --2- 172.21.15.29:0/2526459635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c158870 0x7fab6c158cc0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 --2- 172.21.15.29:0/2526459635 >> v2:172.21.15.173:3300/0 conn(0x7fab6c0cc9a0 0x7fab6c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 -- 172.21.15.29:0/2526459635 >> 172.21.15.29:0/2526459635 conn(0x7fab6c067b30 msgr2=0x7fab6c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:17.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 -- 172.21.15.29:0/2526459635 shutdown_connections 2023-10-06T05:28:17.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.546+0000 7fab72ec4700 1 -- 172.21.15.29:0/2526459635 wait complete. 2023-10-06T05:28:17.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 Processor -- start 2023-10-06T05:28:17.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 -- start start 2023-10-06T05:28:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c0ca870 0x7fab6c153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0cc9a0 0x7fab6c15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab6c158870 0x7fab6c15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c154450 con 0x7fab6c0ca870 2023-10-06T05:28:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c15d240 con 0x7fab6c158870 2023-10-06T05:28:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c15d520 con 0x7fab6c0cc9a0 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab71ec2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c0ca870 0x7fab6c153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab71ec2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c0ca870 0x7fab6c153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48982/0 (socket says 172.21.15.29:48982) 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab71ec2700 1 -- 172.21.15.29:0/4210931601 learned_addr learned my addr 172.21.15.29:0/4210931601 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab716c1700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0cc9a0 0x7fab6c15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab726c3700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab6c158870 0x7fab6c15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab71ec2700 1 -- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0cc9a0 msgr2=0x7fab6c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab71ec2700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0cc9a0 0x7fab6c15c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab71ec2700 1 -- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab6c158870 msgr2=0x7fab6c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab71ec2700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab6c158870 0x7fab6c15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab71ec2700 1 -- 172.21.15.29:0/4210931601 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64009ae0 con 0x7fab6c0ca870 2023-10-06T05:28:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab71ec2700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c0ca870 0x7fab6c153f10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fab6000ec80 tx=0x7fab600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:17.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab5dffb700 1 -- 172.21.15.29:0/4210931601 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000c850 con 0x7fab6c0ca870 2023-10-06T05:28:17.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab5dffb700 1 -- 172.21.15.29:0/4210931601 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6000c9b0 con 0x7fab6c0ca870 2023-10-06T05:28:17.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab5dffb700 1 -- 172.21.15.29:0/4210931601 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000cd50 con 0x7fab6c0ca870 2023-10-06T05:28:17.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c15d800 con 0x7fab6c0ca870 2023-10-06T05:28:17.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.550+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c158f40 con 0x7fab6c0ca870 2023-10-06T05:28:17.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.554+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c04be00 con 0x7fab6c0ca870 2023-10-06T05:28:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.554+0000 7fab5dffb700 1 -- 172.21.15.29:0/4210931601 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fab60013680 con 0x7fab6c0ca870 2023-10-06T05:28:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.554+0000 7fab5dffb700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fab50060550 0x7fab50062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.554+0000 7fab5dffb700 1 -- 172.21.15.29:0/4210931601 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fab6007cb50 con 0x7fab6c0ca870 2023-10-06T05:28:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.554+0000 7fab716c1700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fab50060550 0x7fab50062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.558+0000 7fab716c1700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fab50060550 0x7fab50062a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab64009880 tx=0x7fab64018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.562+0000 7fab5dffb700 1 -- 172.21.15.29:0/4210931601 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fab6004cfe0 con 0x7fab6c0ca870 2023-10-06T05:28:17.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.722+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab6c0cc170 con 0x7fab50060550 2023-10-06T05:28:17.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.734+0000 7fab5dffb700 1 -- 172.21.15.29:0/4210931601 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298783 (secure 0 0 0) 0x7fab6c0cc170 con 0x7fab50060550 2023-10-06T05:28:17.747 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fab50060550 msgr2=0x7fab50062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fab50060550 0x7fab50062a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab64009880 tx=0x7fab64018000 comp rx=0 tx=0).stop 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c0ca870 msgr2=0x7fab6c153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c0ca870 0x7fab6c153f10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fab6000ec80 tx=0x7fab600091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 shutdown_connections 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fab50060550 0x7fab50062a00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab6c158870 0x7fab6c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fab6c0cc9a0 0x7fab6c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 --2- 172.21.15.29:0/4210931601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab6c0ca870 0x7fab6c153f10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 >> 172.21.15.29:0/4210931601 conn(0x7fab6c067b30 msgr2=0x7fab6c154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 shutdown_connections 2023-10-06T05:28:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.742+0000 7fab72ec4700 1 -- 172.21.15.29:0/4210931601 wait complete. 2023-10-06T05:28:17.753 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:28:17.765 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-10-06T05:28:16.704640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2405444,"kb_used_data":6660,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752569276,"statfs":{"total":773094113280,"available":770630938624,"internally_reserved":0,"allocated":6819840,"data_stored":3596390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.672408"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039383+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045765+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:28.332126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045833+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:48.239335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045693+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.146829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042007+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:41.861218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042342+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:00.722691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041437+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:54.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041340+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:18.672888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039539+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.034613+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038322+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:11.664428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039946+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038319+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:41.587049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039701+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036537+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.034812+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:22.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.037297+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039332+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:51.497697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.046660+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038826+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036501+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041413+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042572+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:01.326653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039014+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041535+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008337+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:28:09.008337+0000","last_peered":"2023-10-06T05:28:09.008337+0000","last_clean":"2023-10-06T05:28:09.008337+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:28:09.008337+0000","last_undegraded":"2023-10-06T05:28:09.008337+0000","last_fullsized":"2023-10-06T05:28:09.008337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.009902+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:28:09.009902+0000","last_peered":"2023-10-06T05:28:09.009902+0000","last_clean":"2023-10-06T05:28:09.009902+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:28:09.009902+0000","last_undegraded":"2023-10-06T05:28:09.009902+0000","last_fullsized":"2023-10-06T05:28:09.009902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045862+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008107+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:28:09.008107+0000","last_peered":"2023-10-06T05:28:09.008107+0000","last_clean":"2023-10-06T05:28:09.008107+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:28:09.008107+0000","last_undegraded":"2023-10-06T05:28:09.008107+0000","last_fullsized":"2023-10-06T05:28:09.008107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038218+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:05.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255070+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:28:09.255070+0000","last_peered":"2023-10-06T05:28:09.255070+0000","last_clean":"2023-10-06T05:28:09.255070+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:28:09.255070+0000","last_undegraded":"2023-10-06T05:28:09.255070+0000","last_fullsized":"2023-10-06T05:28:09.255070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045721+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:17.948472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.009845+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:28:09.009845+0000","last_peered":"2023-10-06T05:28:09.009845+0000","last_clean":"2023-10-06T05:28:09.009845+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:28:09.009845+0000","last_undegraded":"2023-10-06T05:28:09.009845+0000","last_fullsized":"2023-10-06T05:28:09.009845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.037974+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:18.738449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255697+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:28:09.255697+0000","last_peered":"2023-10-06T05:28:09.255697+0000","last_clean":"2023-10-06T05:28:09.255697+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:28:09.255697+0000","last_undegraded":"2023-10-06T05:28:09.255697+0000","last_fullsized":"2023-10-06T05:28:09.255697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036475+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008099+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:28:09.008099+0000","last_peered":"2023-10-06T05:28:09.008099+0000","last_clean":"2023-10-06T05:28:09.008099+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:28:09.008099+0000","last_undegraded":"2023-10-06T05:28:09.008099+0000","last_fullsized":"2023-10-06T05:28:09.008099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036203+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255630+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:28:09.255630+0000","last_peered":"2023-10-06T05:28:09.255630+0000","last_clean":"2023-10-06T05:28:09.255630+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:28:09.255630+0000","last_undegraded":"2023-10-06T05:28:09.255630+0000","last_fullsized":"2023-10-06T05:28:09.255630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042450+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:22.242931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008989+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:28:09.008989+0000","last_peered":"2023-10-06T05:28:09.008989+0000","last_clean":"2023-10-06T05:28:09.008989+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:28:09.008989+0000","last_undegraded":"2023-10-06T05:28:09.008989+0000","last_fullsized":"2023-10-06T05:28:09.008989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":894634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.84799999999999998,"15min":0.83999999999999997},"min":{"1min":0.64100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.165},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.63300000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.86699999999999999,"15min":0.86299999999999999},"min":{"1min":0.59599999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1879999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.89900000000000002,"15min":0.90300000000000002},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1910000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.1220000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.143,"5min":1.276,"15min":1.276},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.052},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.0229999999999999,"15min":1.03},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.256,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.121,"15min":1.1160000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.2869999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.23}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.246,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.208,"15min":1.2110000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.373,"5min":1.385,"15min":1.385},"last":1.2689999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.139,"15min":1.147},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4299999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.367},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1819999999999999,"15min":1.1910000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.349,"5min":1.425,"15min":1.425},"last":1.3140000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85099999999999998},"min":{"1min":0.63600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":0.96599999999999997,"15min":0.95199999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.97499999999999998,"15min":0.96499999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.95799999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.84299999999999997,"15min":0.81999999999999995},"min":{"1min":0.70399999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.753},{"interface":"front","average":{"1min":1,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57899999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.081}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91200000000000003,"15min":0.91700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.079,"15min":1.069},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.107}]},{"osd":4,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.67400000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0669999999999999,"15min":1.079},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3129999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1299999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0940000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0629999999999999,"15min":1.0580000000000001},"min":{"1min":0.72999999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.3}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2410000000000001,"5min":1.367,"15min":1.367},"last":1.266},{"interface":"front","average":{"1min":1.119,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.85499999999999998,"15min":0.84699999999999998},"min":{"1min":0.58499999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93300000000000005,"15min":0.93100000000000005},"min":{"1min":0.58899999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.95599999999999996,"15min":0.95099999999999996},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.71399999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2210000000000001,"5min":1.54,"15min":1.54},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.93300000000000005,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.879,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.48,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2509999999999999,"5min":1.419,"15min":1.419},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4670000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.109,"15min":1.123},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.397,"5min":1.508,"15min":1.508},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0940000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.329,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.153},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4319999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.24,"15min":1.2490000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.593,"5min":1.732,"15min":1.732},"last":0.879}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.79400000000000004,"15min":0.77900000000000003},"min":{"1min":0.53100000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.284,"15min":1.284},"last":1.105},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95899999999999996,"15min":0.96499999999999997},"min":{"1min":0.55700000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2270000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0780000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.141},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.99199999999999999,"15min":1.004},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.147,"5min":1.335,"15min":1.335},"last":1.179}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.72299999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.423,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.72899999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1919999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.234}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2490000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.96999999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2230000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.046,"15min":1.0469999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3280000000000001,"5min":1.458,"15min":1.458},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0029999999999999,"15min":1.0009999999999999},"min":{"1min":0.71799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2010000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.498,"5min":1.548,"15min":1.548},"last":1.2789999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1419999999999999,"15min":1.139},"min":{"1min":0.89400000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.3799999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.01},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.125,"15min":1.123},"min":{"1min":0.91700000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.345,"5min":1.415,"15min":1.415},"last":1.2030000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":696320,"data_stored":298108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0389999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.315,"15min":0.315},"max":{"1min":0.997,"5min":1.379,"15min":1.379},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.389,"15min":1.389},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.117,"15min":1.117},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0269999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.85499999999999998,"15min":0.84799999999999998},"min":{"1min":0.65600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3520000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.85599999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":0.875}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1220000000000001},"min":{"1min":0.749,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.454,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.367,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.079,"15min":1.0820000000000001},"min":{"1min":0.73899999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2969999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.77600000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.462,"5min":1.968,"15min":1.968},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1579999999999999,"15min":1.159},"min":{"1min":0.85899999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.48,"5min":1.762,"15min":1.762},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.171,"15min":1.175},"min":{"1min":0.79800000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.393,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.208}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.624},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.89700000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.94099999999999995,"15min":0.94399999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.872,"15min":0.88300000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.89300000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2110000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.1060000000000001,"15min":1.1359999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3109999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.872},{"interface":"front","average":{"1min":1.147,"5min":1.236,"15min":1.2509999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6020000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.4890000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1919999999999999,"15min":1.206},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.431,"5min":1.829,"15min":1.829},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1850000000000001,"15min":1.1990000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.714,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2729999999999999,"15min":1.2849999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.226,"15min":1.2390000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.659,"5min":1.708,"15min":1.708},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2729999999999999,"15min":1.2889999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.845,"5min":1.972,"15min":1.972},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.371,"15min":1.3899999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":2.04,"15min":2.04},"last":1.5429999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":696320,"data_stored":298108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.74199999999999999,"15min":0.752},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.012,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78900000000000003,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0940000000000001,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.89900000000000002,"15min":0.91600000000000004},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.093,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0309999999999999,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3200000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.153,"15min":1.171},"min":{"1min":0.83499999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.2829999999999999,"5min":1.899,"15min":1.899},"last":1.048}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1799999999999999,"15min":1.2070000000000001},"min":{"1min":0.752,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3480000000000001,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.218,"15min":1.24},"min":{"1min":0.89200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5720000000000001,"5min":2.02,"15min":2.02},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4950000000000001,"5min":1.804,"15min":1.804},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.2150000000000001,"15min":1.228},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.415,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.3680000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.133},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.2030000000000001,"15min":1.204},"min":{"1min":0.90300000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.29}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302644,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069196,"statfs":{"total":96636764160,"available":96326856704,"internally_reserved":0,"allocated":1290240,"data_stored":888476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95799999999999996,"5min":1.006,"15min":1.006},"last":1.119},{"interface":"front","average":{"1min":0.755,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.91400000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.60899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.71399999999999997}]},{"osd":3,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.89400000000000002,"15min":0.89200000000000002},"min":{"1min":0.59499999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1020000000000001,"5min":1.204,"15min":1.204},"last":1.0069999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.026,"15min":1.0189999999999999},"min":{"1min":0.76200000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.026,"15min":1.024},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.05}]},{"osd":5,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0700000000000001,"15min":1.0620000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.159},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1699999999999999,"15min":1.1619999999999999},"min":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.518}]},{"osd":6,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2490000000000001,"15min":1.2509999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.226,"15min":1.2210000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.083}]},{"osd":7,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.2789999999999999},"min":{"1min":0.97499999999999998,"5min":0.88,"15min":0.88},"max":{"1min":1.6579999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.25,"15min":1.25},"min":{"1min":1.016,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.6040000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.3839999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:28:17.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-10-06T05:28:17.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-10-06T05:28:17.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-10-06T05:28:17.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-10-06T05:28:17.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-10-06T05:28:17.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-10-06T05:28:17.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-10-06T05:28:17.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-10-06T05:28:17.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-10-06T05:28:17.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-10-06T05:28:17.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-10-06T05:28:17.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-10-06T05:28:17.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-10-06T05:28:17.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-10-06T05:28:17.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-10-06T05:28:17.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-10-06T05:28:17.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-10-06T05:28:17.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-10-06T05:28:17.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-10-06T05:28:17.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-10-06T05:28:17.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-10-06T05:28:17.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-10-06T05:28:17.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-10-06T05:28:17.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-10-06T05:28:17.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-10-06T05:28:17.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-06T05:28:17.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.039383+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T05:28:17.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-06T05:28:17.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-06T05:28:17.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.045765+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:20:28.332126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:28:17.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-06T05:28:17.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-06T05:28:17.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.045833+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:37:48.239335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:28:17.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-06T05:28:17.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-06T05:28:17.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.045693+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:50:59.146829+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:28:17.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-10-06T05:28:17.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-06T05:28:17.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.042007+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:46:41.861218+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:28:17.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-10-06T05:28:17.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-06T05:28:17.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.042342+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:13:00.722691+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:28:17.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-10-06T05:28:17.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-06T05:28:17.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.041437+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:50:54.895130+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:28:17.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-10-06T05:28:17.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-06T05:28:17.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.041340+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:41:18.672888+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:28:17.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-10-06T05:28:17.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-06T05:28:17.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.039539+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:28:17.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-10-06T05:28:17.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-06T05:28:17.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.034613+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T05:28:17.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-10-06T05:28:17.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-06T05:28:17.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.038322+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:00:11.664428+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:28:17.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-06T05:28:17.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-06T05:28:17.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.039946+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T05:28:17.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-06T05:28:17.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-06T05:28:17.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.038319+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:39:41.587049+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:28:17.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-06T05:28:17.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-06T05:28:17.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.039701+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:28:17.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-10-06T05:28:17.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-06T05:28:17.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.036537+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:28:17.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-10-06T05:28:17.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-06T05:28:17.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.034812+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:30:22.306444+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T05:28:17.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-06T05:28:17.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-06T05:28:17.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.037297+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:28:17.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-10-06T05:28:17.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-06T05:28:17.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.039332+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:23:51.497697+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:28:17.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-06T05:28:17.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-06T05:28:17.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.046660+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:28:17.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-10-06T05:28:17.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-06T05:28:17.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.038826+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T05:28:17.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-10-06T05:28:17.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-06T05:28:17.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.036501+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:28:17.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-06T05:28:17.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.041413+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.042572+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:51:01.326653+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-06T05:28:17.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.039014+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T05:28:17.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-10-06T05:28:17.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-06T05:28:17.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.041535+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:28:17.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-06T05:28:17.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-06T05:28:17.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.045862+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:28:17.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.038218+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:28:05.684897+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.045721+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:14:17.948472+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-06T05:28:17.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.037974+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:29:18.738449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:28:17.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-10-06T05:28:17.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-06T05:28:17.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.036475+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:28:17.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-06T05:28:17.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-06T05:28:17.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.036203+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:28:17.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-10-06T05:28:17.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:28:13.030030+0000', 'last_change': '2023-10-06T05:28:13.030030+0000', 'last_active': '2023-10-06T05:28:13.030030+0000', 'last_peered': '2023-10-06T05:28:13.030030+0000', 'last_clean': '2023-10-06T05:28:13.030030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:13.030030+0000', 'last_undegraded': '2023-10-06T05:28:13.030030+0000', 'last_fullsized': '2023-10-06T05:28:13.030030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:13.030030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:28:17.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-06T05:28:17.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:28:12.017113+0000', 'last_change': '2023-10-06T05:28:12.042450+0000', 'last_active': '2023-10-06T05:28:12.017113+0000', 'last_peered': '2023-10-06T05:28:12.017113+0000', 'last_clean': '2023-10-06T05:28:12.017113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:28:12.017113+0000', 'last_undegraded': '2023-10-06T05:28:12.017113+0000', 'last_fullsized': '2023-10-06T05:28:12.017113+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'last_clean_scrub_stamp': '2023-10-06T05:28:12.017113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:29:22.242931+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:28:17.799 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T05:28:17.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.902+0000 7f1b3ea55700 1 Processor -- start 2023-10-06T05:28:17.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.902+0000 7f1b3ea55700 1 -- start start 2023-10-06T05:28:17.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.902+0000 7f1b3ea55700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af990 0x7f1b3806a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.902+0000 7f1b3ea55700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b381614c0 con 0x7f1b380af5c0 2023-10-06T05:28:17.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.902+0000 7f1b3ea55700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3806d420 con 0x7f1b3806a9a0 2023-10-06T05:28:17.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.902+0000 7f1b3ea55700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38160f40 con 0x7f1b380af990 2023-10-06T05:28:17.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b37fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1b380af5c0 0x7f1b38161950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59374/0 (socket says 172.21.15.29:59374) 2023-10-06T05:28:17.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b37fff700 1 -- 172.21.15.29:0/4183660221 learned_addr learned my addr 172.21.15.29:0/4183660221 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:17.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b377fe700 1 --2- 172.21.15.29:0/4183660221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af990 0x7f1b3806a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b36ffd700 1 -- 172.21.15.29:0/4183660221 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216233209 0 0) 0x7f1b381614c0 con 0x7f1b380af5c0 2023-10-06T05:28:17.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b36ffd700 1 -- 172.21.15.29:0/4183660221 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b24003570 con 0x7f1b380af5c0 2023-10-06T05:28:17.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b377fe700 1 -- 172.21.15.29:0/4183660221 >> v1:172.21.15.173:6789/0 conn(0x7f1b3806a9a0 legacy=0x7f1b3815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b377fe700 1 -- 172.21.15.29:0/4183660221 >> v1:172.21.15.29:6789/0 conn(0x7f1b380af5c0 legacy=0x7f1b38161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b377fe700 1 -- 172.21.15.29:0/4183660221 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3806af20 con 0x7f1b380af990 2023-10-06T05:28:17.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b377fe700 1 --2- 172.21.15.29:0/4183660221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af990 0x7f1b3806a460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009910 tx=0x7f1b200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ec2b00be45f6573 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:17.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b36ffd700 1 -- 172.21.15.29:0/4183660221 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2000b680 con 0x7f1b380af990 2023-10-06T05:28:17.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b36ffd700 1 -- 172.21.15.29:0/4183660221 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2000b7e0 con 0x7f1b380af990 2023-10-06T05:28:17.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b36ffd700 1 -- 172.21.15.29:0/4183660221 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2000bba0 con 0x7f1b380af990 2023-10-06T05:28:17.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b3ea55700 1 -- 172.21.15.29:0/4183660221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af990 msgr2=0x7f1b3806a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b3ea55700 1 --2- 172.21.15.29:0/4183660221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af990 0x7f1b3806a460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009910 tx=0x7f1b200091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b3ea55700 1 -- 172.21.15.29:0/4183660221 shutdown_connections 2023-10-06T05:28:17.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b3ea55700 1 --2- 172.21.15.29:0/4183660221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af990 0x7f1b3806a460 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b3ea55700 1 -- 172.21.15.29:0/4183660221 >> 172.21.15.29:0/4183660221 conn(0x7f1b38067b70 msgr2=0x7f1b3806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:17.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b3ea55700 1 -- 172.21.15.29:0/4183660221 shutdown_connections 2023-10-06T05:28:17.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b3ea55700 1 -- 172.21.15.29:0/4183660221 wait complete. 2023-10-06T05:28:17.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.906+0000 7f1b3ea55700 1 Processor -- start 2023-10-06T05:28:17.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3ea55700 1 -- start start 2023-10-06T05:28:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3ea55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b3806a9a0 0x7f1b381489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3ea55700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af5c0 0x7f1b38145f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3ea55700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b380af990 0x7f1b38144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3ea55700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38147470 con 0x7f1b3806a9a0 2023-10-06T05:28:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3ea55700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38146860 con 0x7f1b380af990 2023-10-06T05:28:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3ea55700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38146b40 con 0x7f1b380af5c0 2023-10-06T05:28:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b37fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b3806a9a0 0x7f1b381489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b37fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b3806a9a0 0x7f1b381489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48988/0 (socket says 172.21.15.29:48988) 2023-10-06T05:28:17.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b37fff700 1 -- 172.21.15.29:0/2621707381 learned_addr learned my addr 172.21.15.29:0/2621707381 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3cff2700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b380af990 0x7f1b38144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b377fe700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af5c0 0x7f1b38145f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b37fff700 1 -- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af5c0 msgr2=0x7f1b38145f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b37fff700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af5c0 0x7f1b38145f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b37fff700 1 -- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b380af990 msgr2=0x7f1b38144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b37fff700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b380af990 0x7f1b38144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b37fff700 1 -- 172.21.15.29:0/2621707381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b20009420 con 0x7f1b3806a9a0 2023-10-06T05:28:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3cff2700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b380af990 0x7f1b38144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:17.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b37fff700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b3806a9a0 0x7f1b381489e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c7c0 tx=0x7f1b28007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:17.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b2ffff700 1 -- 172.21.15.29:0/2621707381 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28005b30 con 0x7f1b3806a9a0 2023-10-06T05:28:17.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b38146e20 con 0x7f1b3806a9a0 2023-10-06T05:28:17.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b2ffff700 1 -- 172.21.15.29:0/2621707381 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28005c90 con 0x7f1b3806a9a0 2023-10-06T05:28:17.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b2ffff700 1 -- 172.21.15.29:0/2621707381 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28007340 con 0x7f1b3806a9a0 2023-10-06T05:28:17.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.910+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b38148f20 con 0x7f1b3806a9a0 2023-10-06T05:28:17.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.914+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3804be00 con 0x7f1b3806a9a0 2023-10-06T05:28:17.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.914+0000 7f1b2ffff700 1 -- 172.21.15.29:0/2621707381 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1b2801b400 con 0x7f1b3806a9a0 2023-10-06T05:28:17.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.914+0000 7f1b2ffff700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1b18060550 0x7f1b18062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:17.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.914+0000 7f1b2ffff700 1 -- 172.21.15.29:0/2621707381 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1b2807c5c0 con 0x7f1b3806a9a0 2023-10-06T05:28:17.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.914+0000 7f1b377fe700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1b18060550 0x7f1b18062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:17.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.918+0000 7f1b377fe700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1b18060550 0x7f1b18062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1b200093f0 tx=0x7f1b20017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:17.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:17.922+0000 7f1b2ffff700 1 -- 172.21.15.29:0/2621707381 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1b2804c9b0 con 0x7f1b3806a9a0 2023-10-06T05:28:18.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.142+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1b3806b200 con 0x7f1b3806a9a0 2023-10-06T05:28:18.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.142+0000 7f1b2ffff700 1 -- 172.21.15.29:0/2621707381 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1274 (secure 0 0 0) 0x7f1b2804ffd0 con 0x7f1b3806a9a0 2023-10-06T05:28:18.151 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:18.151 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":181,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1696569927,"num_in_osds":8,"osd_in_since":1696569918,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2463174656,"bytes_avail":770630938624,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":27,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5901}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-06T05:28:04.701165+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T05:28:18.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1b18060550 msgr2=0x7f1b18062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:18.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1b18060550 0x7f1b18062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1b200093f0 tx=0x7f1b20017000 comp rx=0 tx=0).stop 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b3806a9a0 msgr2=0x7f1b381489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b3806a9a0 0x7f1b381489e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c7c0 tx=0x7f1b28007e00 comp rx=0 tx=0).stop 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 shutdown_connections 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1b18060550 0x7f1b18062a00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b380af990 0x7f1b38144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b380af5c0 0x7f1b38145f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 --2- 172.21.15.29:0/2621707381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b3806a9a0 0x7f1b381489e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 >> 172.21.15.29:0/2621707381 conn(0x7f1b38067b70 msgr2=0x7f1b380c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 shutdown_connections 2023-10-06T05:28:18.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.146+0000 7f1b3ea55700 1 -- 172.21.15.29:0/2621707381 wait complete. 2023-10-06T05:28:18.172 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T05:28:18.172 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:28:18.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.270+0000 7f1bde71f700 1 Processor -- start 2023-10-06T05:28:18.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.270+0000 7f1bde71f700 1 -- start start 2023-10-06T05:28:18.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80ab220 0x7f1bd8156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:18.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1bd80c68b0 0x7f1bd80c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:18.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd806a5b0 con 0x7f1bd81569f0 2023-10-06T05:28:18.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd80c7290 con 0x7f1bd80c68b0 2023-10-06T05:28:18.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd815b0a0 con 0x7f1bd80ab220 2023-10-06T05:28:18.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bddf1e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1bd80c68b0 0x7f1bd80c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:18.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bddf1e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1bd80c68b0 0x7f1bd80c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48990/0 (socket says 172.21.15.29:48990) 2023-10-06T05:28:18.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bdd71d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1bd81569f0 0x7f1bd815a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59382/0 (socket says 172.21.15.29:59382) 2023-10-06T05:28:18.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bddf1e700 1 -- 172.21.15.29:0/1109124520 learned_addr learned my addr 172.21.15.29:0/1109124520 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:18.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bdcf1c700 1 --2- 172.21.15.29:0/1109124520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80ab220 0x7f1bd8156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:18.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bddf1e700 1 -- 172.21.15.29:0/1109124520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80ab220 msgr2=0x7f1bd8156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:18.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bddf1e700 1 --2- 172.21.15.29:0/1109124520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80ab220 0x7f1bd8156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bddf1e700 1 -- 172.21.15.29:0/1109124520 >> v1:172.21.15.29:6789/0 conn(0x7f1bd81569f0 legacy=0x7f1bd815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:18.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bddf1e700 1 -- 172.21.15.29:0/1109124520 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd815b380 con 0x7f1bd80c68b0 2023-10-06T05:28:18.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bddf1e700 1 --2- 172.21.15.29:0/1109124520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd80c68b0 0x7f1bd80c6d50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00099b0 tx=0x7f1bd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dac370a53f2faaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:18.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bcbfff700 1 -- 172.21.15.29:0/1109124520 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000b860 con 0x7f1bd80c68b0 2023-10-06T05:28:18.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bcbfff700 1 -- 172.21.15.29:0/1109124520 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd000b9c0 con 0x7f1bd80c68b0 2023-10-06T05:28:18.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bcbfff700 1 -- 172.21.15.29:0/1109124520 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000bd60 con 0x7f1bd80c68b0 2023-10-06T05:28:18.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 -- 172.21.15.29:0/1109124520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd80c68b0 msgr2=0x7f1bd80c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:18.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 --2- 172.21.15.29:0/1109124520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd80c68b0 0x7f1bd80c6d50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00099b0 tx=0x7f1bd0009250 comp rx=0 tx=0).stop 2023-10-06T05:28:18.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 -- 172.21.15.29:0/1109124520 shutdown_connections 2023-10-06T05:28:18.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 --2- 172.21.15.29:0/1109124520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd80c68b0 0x7f1bd80c6d50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 --2- 172.21.15.29:0/1109124520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80ab220 0x7f1bd8156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 -- 172.21.15.29:0/1109124520 >> 172.21.15.29:0/1109124520 conn(0x7f1bd80670a0 msgr2=0x7f1bd80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:18.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 -- 172.21.15.29:0/1109124520 shutdown_connections 2023-10-06T05:28:18.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.274+0000 7f1bde71f700 1 -- 172.21.15.29:0/1109124520 wait complete. 2023-10-06T05:28:18.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 Processor -- start 2023-10-06T05:28:18.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 -- start start 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd80ab220 0x7f1bd80c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80c68b0 0x7f1bd80ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd81569f0 0x7f1bd8147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80afc40 con 0x7f1bd81569f0 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80aedb0 con 0x7f1bd80ab220 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80af030 con 0x7f1bd80c68b0 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bddf1e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd81569f0 0x7f1bd8147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bddf1e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd81569f0 0x7f1bd8147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48994/0 (socket says 172.21.15.29:48994) 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bddf1e700 1 -- 172.21.15.29:0/3769649090 learned_addr learned my addr 172.21.15.29:0/3769649090 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bdd71d700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd80ab220 0x7f1bd80c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bdcf1c700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80c68b0 0x7f1bd80ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bddf1e700 1 -- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80c68b0 msgr2=0x7f1bd80ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bddf1e700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80c68b0 0x7f1bd80ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bddf1e700 1 -- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd80ab220 msgr2=0x7f1bd80c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bddf1e700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd80ab220 0x7f1bd80c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bddf1e700 1 -- 172.21.15.29:0/3769649090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00094f0 con 0x7f1bd81569f0 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bdd71d700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd80ab220 0x7f1bd80c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bddf1e700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd81569f0 0x7f1bd8147a20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1bd806df30 tx=0x7f1bd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bc97fa700 1 -- 172.21.15.29:0/3769649090 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd001a630 con 0x7f1bd81569f0 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bc97fa700 1 -- 172.21.15.29:0/3769649090 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd001a7b0 con 0x7f1bd81569f0 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd80af310 con 0x7f1bd81569f0 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bc97fa700 1 -- 172.21.15.29:0/3769649090 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd001ab70 con 0x7f1bd81569f0 2023-10-06T05:28:18.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.278+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd80af8d0 con 0x7f1bd81569f0 2023-10-06T05:28:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.282+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd80afdb0 con 0x7f1bd81569f0 2023-10-06T05:28:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.282+0000 7f1bc97fa700 1 -- 172.21.15.29:0/3769649090 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1bd002d440 con 0x7f1bd81569f0 2023-10-06T05:28:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.282+0000 7f1bc97fa700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1bbc060580 0x7f1bbc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:18.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.282+0000 7f1bc97fa700 1 -- 172.21.15.29:0/3769649090 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1bd007e4b0 con 0x7f1bd81569f0 2023-10-06T05:28:18.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.282+0000 7f1bdd71d700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1bbc060580 0x7f1bbc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:18.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.282+0000 7f1bdd71d700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1bbc060580 0x7f1bbc062a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4007fd0 tx=0x7f1bd4007e10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:18.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.290+0000 7f1bc97fa700 1 -- 172.21.15.29:0/3769649090 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1bd004e940 con 0x7f1bd81569f0 2023-10-06T05:28:18.454 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:28:18.446+0000 7f5c42ea2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:28:18.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.454+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bd804be00 con 0x7f1bbc060580 2023-10-06T05:28:18.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.466+0000 7f1bc97fa700 1 -- 172.21.15.29:0/3769649090 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298783 (secure 0 0 0) 0x7f1bd804be00 con 0x7f1bbc060580 2023-10-06T05:28:18.478 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:18.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1bbc060580 msgr2=0x7f1bbc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:18.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1bbc060580 0x7f1bbc062a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4007fd0 tx=0x7f1bd4007e10 comp rx=0 tx=0).stop 2023-10-06T05:28:18.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd81569f0 msgr2=0x7f1bd8147a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd81569f0 0x7f1bd8147a20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1bd806df30 tx=0x7f1bd0017000 comp rx=0 tx=0).stop 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 shutdown_connections 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bd81569f0 0x7f1bd8147a20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80c68b0 0x7f1bd80ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1bbc060580 0x7f1bbc062a30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 --2- 172.21.15.29:0/3769649090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd80ab220 0x7f1bd80c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 >> 172.21.15.29:0/3769649090 conn(0x7f1bd80670a0 msgr2=0x7f1bd80ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 shutdown_connections 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:18.474+0000 7f1bde71f700 1 -- 172.21.15.29:0/3769649090 wait complete. 2023-10-06T05:28:18.481 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:28:18.494 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-10-06T05:28:16.704640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2405444,"kb_used_data":6660,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752569276,"statfs":{"total":773094113280,"available":770630938624,"internally_reserved":0,"allocated":6819840,"data_stored":3596390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.672408"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039383+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045765+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:28.332126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045833+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:48.239335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045693+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.146829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042007+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:41.861218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042342+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:00.722691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041437+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:54.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041340+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:18.672888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039539+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.034613+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038322+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:11.664428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039946+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038319+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:41.587049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039701+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036537+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:16.124317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.034812+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:22.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.037297+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039332+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:51.497697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.046660+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038826+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036501+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041413+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:34.151938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042572+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:01.326653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.039014+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:11:05.898756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.041535+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008337+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:28:09.008337+0000","last_peered":"2023-10-06T05:28:09.008337+0000","last_clean":"2023-10-06T05:28:09.008337+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:28:09.008337+0000","last_undegraded":"2023-10-06T05:28:09.008337+0000","last_fullsized":"2023-10-06T05:28:09.008337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.009902+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:28:09.009902+0000","last_peered":"2023-10-06T05:28:09.009902+0000","last_clean":"2023-10-06T05:28:09.009902+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:28:09.009902+0000","last_undegraded":"2023-10-06T05:28:09.009902+0000","last_fullsized":"2023-10-06T05:28:09.009902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045862+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:05.396119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008107+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:28:09.008107+0000","last_peered":"2023-10-06T05:28:09.008107+0000","last_clean":"2023-10-06T05:28:09.008107+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:28:09.008107+0000","last_undegraded":"2023-10-06T05:28:09.008107+0000","last_fullsized":"2023-10-06T05:28:09.008107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.038218+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:05.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255070+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:28:09.255070+0000","last_peered":"2023-10-06T05:28:09.255070+0000","last_clean":"2023-10-06T05:28:09.255070+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:28:09.255070+0000","last_undegraded":"2023-10-06T05:28:09.255070+0000","last_fullsized":"2023-10-06T05:28:09.255070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.045721+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:17.948472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.009845+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:28:09.009845+0000","last_peered":"2023-10-06T05:28:09.009845+0000","last_clean":"2023-10-06T05:28:09.009845+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:28:09.009845+0000","last_undegraded":"2023-10-06T05:28:09.009845+0000","last_fullsized":"2023-10-06T05:28:09.009845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.037974+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:18.738449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255697+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:28:09.255697+0000","last_peered":"2023-10-06T05:28:09.255697+0000","last_clean":"2023-10-06T05:28:09.255697+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:28:09.255697+0000","last_undegraded":"2023-10-06T05:28:09.255697+0000","last_fullsized":"2023-10-06T05:28:09.255697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036475+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:23.962657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008099+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:28:09.008099+0000","last_peered":"2023-10-06T05:28:09.008099+0000","last_clean":"2023-10-06T05:28:09.008099+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:28:09.008099+0000","last_undegraded":"2023-10-06T05:28:09.008099+0000","last_fullsized":"2023-10-06T05:28:09.008099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.036203+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:04:12.196916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.255630+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:28:09.255630+0000","last_peered":"2023-10-06T05:28:09.255630+0000","last_clean":"2023-10-06T05:28:09.255630+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:28:09.255630+0000","last_undegraded":"2023-10-06T05:28:09.255630+0000","last_fullsized":"2023-10-06T05:28:09.255630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:28:13.030030+0000","last_change":"2023-10-06T05:28:13.030030+0000","last_active":"2023-10-06T05:28:13.030030+0000","last_peered":"2023-10-06T05:28:13.030030+0000","last_clean":"2023-10-06T05:28:13.030030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:13.030030+0000","last_undegraded":"2023-10-06T05:28:13.030030+0000","last_fullsized":"2023-10-06T05:28:13.030030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:28:12.017113+0000","last_change":"2023-10-06T05:28:12.042450+0000","last_active":"2023-10-06T05:28:12.017113+0000","last_peered":"2023-10-06T05:28:12.017113+0000","last_clean":"2023-10-06T05:28:12.017113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:28:12.017113+0000","last_undegraded":"2023-10-06T05:28:12.017113+0000","last_fullsized":"2023-10-06T05:28:12.017113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:22.242931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T05:28:09.008989+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:28:09.008989+0000","last_peered":"2023-10-06T05:28:09.008989+0000","last_clean":"2023-10-06T05:28:09.008989+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:28:09.008989+0000","last_undegraded":"2023-10-06T05:28:09.008989+0000","last_fullsized":"2023-10-06T05:28:09.008989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":894634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.84799999999999998,"15min":0.83999999999999997},"min":{"1min":0.64100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.165},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.63300000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.86699999999999999,"15min":0.86299999999999999},"min":{"1min":0.59599999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1879999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.89900000000000002,"15min":0.90300000000000002},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1910000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.1220000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.143,"5min":1.276,"15min":1.276},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.052},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.0229999999999999,"15min":1.03},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.256,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.121,"15min":1.1160000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.2869999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.23}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.246,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.208,"15min":1.2110000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.373,"5min":1.385,"15min":1.385},"last":1.2689999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.139,"15min":1.147},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4299999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.367},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1819999999999999,"15min":1.1910000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.349,"5min":1.425,"15min":1.425},"last":1.3140000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85099999999999998},"min":{"1min":0.63600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":0.96599999999999997,"15min":0.95199999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.97499999999999998,"15min":0.96499999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.95799999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.84299999999999997,"15min":0.81999999999999995},"min":{"1min":0.70399999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.753},{"interface":"front","average":{"1min":1,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57899999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.081}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91200000000000003,"15min":0.91700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.079,"15min":1.069},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.107}]},{"osd":4,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.67400000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0669999999999999,"15min":1.079},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3129999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1299999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0940000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0629999999999999,"15min":1.0580000000000001},"min":{"1min":0.72999999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.3}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2410000000000001,"5min":1.367,"15min":1.367},"last":1.266},{"interface":"front","average":{"1min":1.119,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.85499999999999998,"15min":0.84699999999999998},"min":{"1min":0.58499999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93300000000000005,"15min":0.93100000000000005},"min":{"1min":0.58899999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.95599999999999996,"15min":0.95099999999999996},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.71399999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2210000000000001,"5min":1.54,"15min":1.54},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.93300000000000005,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.879,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.48,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2509999999999999,"5min":1.419,"15min":1.419},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4670000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.109,"15min":1.123},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.397,"5min":1.508,"15min":1.508},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0940000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.329,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.153},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4319999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.24,"15min":1.2490000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.593,"5min":1.732,"15min":1.732},"last":0.879}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.79400000000000004,"15min":0.77900000000000003},"min":{"1min":0.53100000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.284,"15min":1.284},"last":1.105},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95899999999999996,"15min":0.96499999999999997},"min":{"1min":0.55700000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2270000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0780000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.141},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.99199999999999999,"15min":1.004},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.147,"5min":1.335,"15min":1.335},"last":1.179}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.72299999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.423,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.72899999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1919999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.234}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2490000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.96999999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2230000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.046,"15min":1.0469999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3280000000000001,"5min":1.458,"15min":1.458},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0029999999999999,"15min":1.0009999999999999},"min":{"1min":0.71799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2010000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.498,"5min":1.548,"15min":1.548},"last":1.2789999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1419999999999999,"15min":1.139},"min":{"1min":0.89400000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.3799999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.01},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.125,"15min":1.123},"min":{"1min":0.91700000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.345,"5min":1.415,"15min":1.415},"last":1.2030000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":696320,"data_stored":298108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0389999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.315,"15min":0.315},"max":{"1min":0.997,"5min":1.379,"15min":1.379},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.389,"15min":1.389},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.117,"15min":1.117},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0269999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.85499999999999998,"15min":0.84799999999999998},"min":{"1min":0.65600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3520000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.85599999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":0.875}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1220000000000001},"min":{"1min":0.749,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.454,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.367,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.079,"15min":1.0820000000000001},"min":{"1min":0.73899999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2969999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.77600000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.462,"5min":1.968,"15min":1.968},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1579999999999999,"15min":1.159},"min":{"1min":0.85899999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.48,"5min":1.762,"15min":1.762},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.171,"15min":1.175},"min":{"1min":0.79800000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.393,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.208}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":304266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.624},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.89700000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.94099999999999995,"15min":0.94399999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.872,"15min":0.88300000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.89300000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2110000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.1060000000000001,"15min":1.1359999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3109999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.872},{"interface":"front","average":{"1min":1.147,"5min":1.236,"15min":1.2509999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6020000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.4890000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1919999999999999,"15min":1.206},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.431,"5min":1.829,"15min":1.829},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1850000000000001,"15min":1.1990000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.714,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2729999999999999,"15min":1.2849999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.226,"15min":1.2390000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.659,"5min":1.708,"15min":1.708},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2729999999999999,"15min":1.2889999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.845,"5min":1.972,"15min":1.972},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.371,"15min":1.3899999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":2.04,"15min":2.04},"last":1.5429999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302064,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069776,"statfs":{"total":96636764160,"available":96327450624,"internally_reserved":0,"allocated":696320,"data_stored":298108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.74199999999999999,"15min":0.752},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.012,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78900000000000003,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0940000000000001,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.89900000000000002,"15min":0.91600000000000004},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.093,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0309999999999999,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3200000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.212},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.153,"15min":1.171},"min":{"1min":0.83499999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.2829999999999999,"5min":1.899,"15min":1.899},"last":1.048}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1799999999999999,"15min":1.2070000000000001},"min":{"1min":0.752,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3480000000000001,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.218,"15min":1.24},"min":{"1min":0.89200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5720000000000001,"5min":2.02,"15min":2.02},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4950000000000001,"5min":1.804,"15min":1.804},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.2150000000000001,"15min":1.228},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.415,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.1599999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.3680000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.133},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.2030000000000001,"15min":1.204},"min":{"1min":0.90300000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.29}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302644,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069196,"statfs":{"total":96636764160,"available":96326856704,"internally_reserved":0,"allocated":1290240,"data_stored":888476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95799999999999996,"5min":1.006,"15min":1.006},"last":1.119},{"interface":"front","average":{"1min":0.755,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.91400000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.60899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.71399999999999997}]},{"osd":3,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.89400000000000002,"15min":0.89200000000000002},"min":{"1min":0.59499999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1020000000000001,"5min":1.204,"15min":1.204},"last":1.0069999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.026,"15min":1.0189999999999999},"min":{"1min":0.76200000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.026,"15min":1.024},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.05}]},{"osd":5,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0700000000000001,"15min":1.0620000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.159},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1699999999999999,"15min":1.1619999999999999},"min":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.518}]},{"osd":6,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2490000000000001,"15min":1.2509999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.226,"15min":1.2210000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.083}]},{"osd":7,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.2789999999999999},"min":{"1min":0.97499999999999998,"5min":0.88,"15min":0.88},"max":{"1min":1.6579999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.25,"15min":1.25},"min":{"1min":1.016,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.6040000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.3839999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:28:21.502 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:28:21.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbdef59e700 1 Processor -- start 2023-10-06T05:28:21.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbdef59e700 1 -- start start 2023-10-06T05:28:21.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbdef59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbdf006c8f0 0x7fbdf006ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbdef59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00caf80 con 0x7fbdf00c8b50 2023-10-06T05:28:21.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbdef59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00c7660 con 0x7fbdf00c9e80 2023-10-06T05:28:21.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbdef59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00cb7e0 con 0x7fbdf006c8f0 2023-10-06T05:28:21.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbdeed9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbdf00c8b50 0x7fbdf015f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59388/0 (socket says 172.21.15.29:59388) 2023-10-06T05:28:21.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbdeed9d700 1 -- 172.21.15.29:0/2568542349 learned_addr learned my addr 172.21.15.29:0/2568542349 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbdee59c700 1 --2- 172.21.15.29:0/2568542349 >> v2:172.21.15.173:3300/0 conn(0x7fbdf006c8f0 0x7fbdf006ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412802265 0 0) 0x7fbdf00caf80 con 0x7fbdf00c8b50 2023-10-06T05:28:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbddc003570 con 0x7fbdf00c8b50 2023-10-06T05:28:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232720042 0 0) 0x7fbdf00c7660 con 0x7fbdf00c9e80 2023-10-06T05:28:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf00caf80 con 0x7fbdf00c9e80 2023-10-06T05:28:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 37465586 0 0) 0x7fbddc003570 con 0x7fbdf00c8b50 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 >> v2:172.21.15.173:3300/0 conn(0x7fbdf006c8f0 msgr2=0x7fbdf006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 --2- 172.21.15.29:0/2568542349 >> v2:172.21.15.173:3300/0 conn(0x7fbdf006c8f0 0x7fbdf006ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 >> v1:172.21.15.173:6789/0 conn(0x7fbdf00c9e80 legacy=0x7fbdf01555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf00ca450 con 0x7fbdf00c8b50 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fbde0001470 con 0x7fbdf00c8b50 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 >> v1:172.21.15.29:6789/0 conn(0x7fbdf00c8b50 legacy=0x7fbdf015f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.602+0000 7fbded59a700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbddc003c40 0x7fbddc004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbded59a700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbddc004810 0x7fbddc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbded59a700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbddc005210 0x7fbddc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00cb7e0 con 0x7fbddc005210 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc00c130 con 0x7fbddc003c40 2023-10-06T05:28:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc00e4d0 con 0x7fbddc004810 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdeed9d700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbddc005210 0x7fbddc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdee59c700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbddc003c40 0x7fbddc004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdedd9b700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbddc004810 0x7fbddc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdeed9d700 1 -- 172.21.15.29:0/2568542349 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbddc004810 msgr2=0x7fbddc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdeed9d700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbddc004810 0x7fbddc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdeed9d700 1 -- 172.21.15.29:0/2568542349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbddc003c40 msgr2=0x7fbddc004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdeed9d700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbddc003c40 0x7fbddc004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdeed9d700 1 -- 172.21.15.29:0/2568542349 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc003570 con 0x7fbddc005210 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdeed9d700 1 -- 172.21.15.29:0/2568542349 reap_dead start 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdeed9d700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbddc005210 0x7fbddc00ba60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c210 tx=0x7fbde0001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef84505f7163e1ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde000caa0 con 0x7fbddc005210 2023-10-06T05:28:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde000cc60 con 0x7fbddc005210 2023-10-06T05:28:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbded59a700 1 -- 172.21.15.29:0/2568542349 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0005920 con 0x7fbddc005210 2023-10-06T05:28:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdef59e700 1 -- 172.21.15.29:0/2568542349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbddc005210 msgr2=0x7fbddc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdef59e700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbddc005210 0x7fbddc00ba60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c210 tx=0x7fbde0001d40 comp rx=0 tx=0).stop 2023-10-06T05:28:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdef59e700 1 -- 172.21.15.29:0/2568542349 shutdown_connections 2023-10-06T05:28:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdef59e700 1 --2- 172.21.15.29:0/2568542349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbddc005210 0x7fbddc00ba60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdef59e700 1 -- 172.21.15.29:0/2568542349 >> 172.21.15.29:0/2568542349 conn(0x7fbdf00670a0 msgr2=0x7fbdf00674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdef59e700 1 -- 172.21.15.29:0/2568542349 shutdown_connections 2023-10-06T05:28:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdef59e700 1 -- 172.21.15.29:0/2568542349 wait complete. 2023-10-06T05:28:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.606+0000 7fbdef59e700 1 Processor -- start 2023-10-06T05:28:21.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdef59e700 1 -- start start 2023-10-06T05:28:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdef59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbddc005210 0x7fbdf014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdef59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf014b8f0 0x7fbdf01502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdef59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdf0149330 0x7fbdf014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdef59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf014fe10 con 0x7fbdf0149330 2023-10-06T05:28:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdef59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf01507e0 con 0x7fbdf014b8f0 2023-10-06T05:28:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdef59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf014f200 con 0x7fbddc005210 2023-10-06T05:28:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdeed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdf0149330 0x7fbdf014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdedd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf014b8f0 0x7fbdf01502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdeed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdf0149330 0x7fbdf014c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49012/0 (socket says 172.21.15.29:49012) 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdedd9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf014b8f0 0x7fbdf01502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:50966/0 (socket says 172.21.15.29:50966) 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdeed9d700 1 -- 172.21.15.29:0/1452819584 learned_addr learned my addr 172.21.15.29:0/1452819584 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdee59c700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbddc005210 0x7fbdf014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdeed9d700 1 -- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbddc005210 msgr2=0x7fbdf014eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdeed9d700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbddc005210 0x7fbdf014eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdeed9d700 1 -- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf014b8f0 msgr2=0x7fbdf01502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdeed9d700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf014b8f0 0x7fbdf01502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdeed9d700 1 -- 172.21.15.29:0/1452819584 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf014f4e0 con 0x7fbdf0149330 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdedd9b700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf014b8f0 0x7fbdf01502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:21.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdeed9d700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdf0149330 0x7fbdf014c000 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00c5980 tx=0x7fbde0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbde67fc700 1 -- 172.21.15.29:0/1452819584 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0020070 con 0x7fbdf0149330 2023-10-06T05:28:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbde67fc700 1 -- 172.21.15.29:0/1452819584 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde000caa0 con 0x7fbdf0149330 2023-10-06T05:28:21.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf014f7c0 con 0x7fbdf0149330 2023-10-06T05:28:21.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbde67fc700 1 -- 172.21.15.29:0/1452819584 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00070d0 con 0x7fbdf0149330 2023-10-06T05:28:21.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.610+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf014bd40 con 0x7fbdf0149330 2023-10-06T05:28:21.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.614+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf014ff80 con 0x7fbdf0149330 2023-10-06T05:28:21.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.614+0000 7fbde67fc700 1 -- 172.21.15.29:0/1452819584 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbde00074c0 con 0x7fbdf0149330 2023-10-06T05:28:21.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.614+0000 7fbde67fc700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbdd0060550 0x7fbdd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.614+0000 7fbde67fc700 1 -- 172.21.15.29:0/1452819584 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fbde007d780 con 0x7fbdf0149330 2023-10-06T05:28:21.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.614+0000 7fbdee59c700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbdd0060550 0x7fbdd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.614+0000 7fbdee59c700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbdd0060550 0x7fbdd0062a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbde8006f00 tx=0x7fbde80091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:21.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.618+0000 7fbde67fc700 1 -- 172.21.15.29:0/1452819584 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbde004db80 con 0x7fbdf0149330 2023-10-06T05:28:21.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.778+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdf014ff50 con 0x7fbdd0060550 2023-10-06T05:28:21.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.798+0000 7fbde67fc700 1 -- 172.21.15.29:0/1452819584 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309662 (secure 0 0 0) 0x7fbdf014ff50 con 0x7fbdd0060550 2023-10-06T05:28:21.809 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:21.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbdd0060550 msgr2=0x7fbdd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbdd0060550 0x7fbdd0062a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbde8006f00 tx=0x7fbde80091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdf0149330 msgr2=0x7fbdf014c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdf0149330 0x7fbdf014c000 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00c5980 tx=0x7fbde0013000 comp rx=0 tx=0).stop 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 shutdown_connections 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdf0149330 0x7fbdf014c000 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbdd0060550 0x7fbdd0062a00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbdf014b8f0 0x7fbdf01502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 --2- 172.21.15.29:0/1452819584 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbddc005210 0x7fbdf014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 >> 172.21.15.29:0/1452819584 conn(0x7fbdf00670a0 msgr2=0x7fbdf00c1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 shutdown_connections 2023-10-06T05:28:21.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.802+0000 7fbdef59e700 1 -- 172.21.15.29:0/1452819584 wait complete. 2023-10-06T05:28:21.813 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:28:21.826 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2023-10-06T05:28:21.468326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2405832,"kb_used_data":7048,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752568888,"statfs":{"total":773094113280,"available":770630541312,"internally_reserved":0,"allocated":7217152,"data_stored":3782396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.419418"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084047+0000","last_change":"2023-10-06T05:28:14.072524+0000","last_active":"2023-10-06T05:28:14.084047+0000","last_peered":"2023-10-06T05:28:14.084047+0000","last_clean":"2023-10-06T05:28:14.084047+0000","last_became_active":"2023-10-06T05:28:14.072148+0000","last_became_peered":"2023-10-06T05:28:14.072148+0000","last_unstale":"2023-10-06T05:28:14.084047+0000","last_undegraded":"2023-10-06T05:28:14.084047+0000","last_fullsized":"2023-10-06T05:28:14.084047+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:42.874135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086780+0000","last_change":"2023-10-06T05:28:14.074034+0000","last_active":"2023-10-06T05:28:14.086780+0000","last_peered":"2023-10-06T05:28:14.086780+0000","last_clean":"2023-10-06T05:28:14.086780+0000","last_became_active":"2023-10-06T05:28:14.073766+0000","last_became_peered":"2023-10-06T05:28:14.073766+0000","last_unstale":"2023-10-06T05:28:14.086780+0000","last_undegraded":"2023-10-06T05:28:14.086780+0000","last_fullsized":"2023-10-06T05:28:14.086780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:55.908047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.090414+0000","last_change":"2023-10-06T05:28:14.085459+0000","last_active":"2023-10-06T05:28:14.090414+0000","last_peered":"2023-10-06T05:28:14.090414+0000","last_clean":"2023-10-06T05:28:14.090414+0000","last_became_active":"2023-10-06T05:28:14.083618+0000","last_became_peered":"2023-10-06T05:28:14.083618+0000","last_unstale":"2023-10-06T05:28:14.090414+0000","last_undegraded":"2023-10-06T05:28:14.090414+0000","last_fullsized":"2023-10-06T05:28:14.090414+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:01.735608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086945+0000","last_change":"2023-10-06T05:28:14.077711+0000","last_active":"2023-10-06T05:28:14.086945+0000","last_peered":"2023-10-06T05:28:14.086945+0000","last_clean":"2023-10-06T05:28:14.086945+0000","last_became_active":"2023-10-06T05:28:14.077442+0000","last_became_peered":"2023-10-06T05:28:14.077442+0000","last_unstale":"2023-10-06T05:28:14.086945+0000","last_undegraded":"2023-10-06T05:28:14.086945+0000","last_fullsized":"2023-10-06T05:28:14.086945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:02.339571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084084+0000","last_change":"2023-10-06T05:28:14.071469+0000","last_active":"2023-10-06T05:28:14.084084+0000","last_peered":"2023-10-06T05:28:14.084084+0000","last_clean":"2023-10-06T05:28:14.084084+0000","last_became_active":"2023-10-06T05:28:14.065855+0000","last_became_peered":"2023-10-06T05:28:14.065855+0000","last_unstale":"2023-10-06T05:28:14.084084+0000","last_undegraded":"2023-10-06T05:28:14.084084+0000","last_fullsized":"2023-10-06T05:28:14.084084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:05.141589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.090542+0000","last_change":"2023-10-06T05:28:14.089912+0000","last_active":"2023-10-06T05:28:14.090542+0000","last_peered":"2023-10-06T05:28:14.090542+0000","last_clean":"2023-10-06T05:28:14.090542+0000","last_became_active":"2023-10-06T05:28:14.089615+0000","last_became_peered":"2023-10-06T05:28:14.089615+0000","last_unstale":"2023-10-06T05:28:14.090542+0000","last_undegraded":"2023-10-06T05:28:14.090542+0000","last_fullsized":"2023-10-06T05:28:14.090542+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:48.250126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084997+0000","last_change":"2023-10-06T05:28:14.083322+0000","last_active":"2023-10-06T05:28:14.084997+0000","last_peered":"2023-10-06T05:28:14.084997+0000","last_clean":"2023-10-06T05:28:14.084997+0000","last_became_active":"2023-10-06T05:28:14.082865+0000","last_became_peered":"2023-10-06T05:28:14.082865+0000","last_unstale":"2023-10-06T05:28:14.084997+0000","last_undegraded":"2023-10-06T05:28:14.084997+0000","last_fullsized":"2023-10-06T05:28:14.084997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:43:18.220491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087653+0000","last_change":"2023-10-06T05:28:14.083606+0000","last_active":"2023-10-06T05:28:14.087653+0000","last_peered":"2023-10-06T05:28:14.087653+0000","last_clean":"2023-10-06T05:28:14.087653+0000","last_became_active":"2023-10-06T05:28:14.083316+0000","last_became_peered":"2023-10-06T05:28:14.083316+0000","last_unstale":"2023-10-06T05:28:14.087653+0000","last_undegraded":"2023-10-06T05:28:14.087653+0000","last_fullsized":"2023-10-06T05:28:14.087653+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:18.203377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.092570+0000","last_change":"2023-10-06T05:28:14.087035+0000","last_active":"2023-10-06T05:28:14.092570+0000","last_peered":"2023-10-06T05:28:14.092570+0000","last_clean":"2023-10-06T05:28:14.092570+0000","last_became_active":"2023-10-06T05:28:14.086677+0000","last_became_peered":"2023-10-06T05:28:14.086677+0000","last_unstale":"2023-10-06T05:28:14.092570+0000","last_undegraded":"2023-10-06T05:28:14.092570+0000","last_fullsized":"2023-10-06T05:28:14.092570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:54.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.092587+0000","last_change":"2023-10-06T05:28:14.088587+0000","last_active":"2023-10-06T05:28:14.092587+0000","last_peered":"2023-10-06T05:28:14.092587+0000","last_clean":"2023-10-06T05:28:14.092587+0000","last_became_active":"2023-10-06T05:28:14.088213+0000","last_became_peered":"2023-10-06T05:28:14.088213+0000","last_unstale":"2023-10-06T05:28:14.092587+0000","last_undegraded":"2023-10-06T05:28:14.092587+0000","last_fullsized":"2023-10-06T05:28:14.092587+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:06.610537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086518+0000","last_change":"2023-10-06T05:28:14.074270+0000","last_active":"2023-10-06T05:28:14.086518+0000","last_peered":"2023-10-06T05:28:14.086518+0000","last_clean":"2023-10-06T05:28:14.086518+0000","last_became_active":"2023-10-06T05:28:14.073851+0000","last_became_peered":"2023-10-06T05:28:14.073851+0000","last_unstale":"2023-10-06T05:28:14.086518+0000","last_undegraded":"2023-10-06T05:28:14.086518+0000","last_fullsized":"2023-10-06T05:28:14.086518+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:01.362283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.088936+0000","last_change":"2023-10-06T05:28:14.083570+0000","last_active":"2023-10-06T05:28:14.088936+0000","last_peered":"2023-10-06T05:28:14.088936+0000","last_clean":"2023-10-06T05:28:14.088936+0000","last_became_active":"2023-10-06T05:28:14.083249+0000","last_became_peered":"2023-10-06T05:28:14.083249+0000","last_unstale":"2023-10-06T05:28:14.088936+0000","last_undegraded":"2023-10-06T05:28:14.088936+0000","last_fullsized":"2023-10-06T05:28:14.088936+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:13.960023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.075627+0000","last_change":"2023-10-06T05:28:14.067340+0000","last_active":"2023-10-06T05:28:14.075627+0000","last_peered":"2023-10-06T05:28:14.075627+0000","last_clean":"2023-10-06T05:28:14.075627+0000","last_became_active":"2023-10-06T05:28:14.067030+0000","last_became_peered":"2023-10-06T05:28:14.067030+0000","last_unstale":"2023-10-06T05:28:14.075627+0000","last_undegraded":"2023-10-06T05:28:14.075627+0000","last_fullsized":"2023-10-06T05:28:14.075627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:06.610537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.090352+0000","last_change":"2023-10-06T05:28:14.085339+0000","last_active":"2023-10-06T05:28:14.090352+0000","last_peered":"2023-10-06T05:28:14.090352+0000","last_clean":"2023-10-06T05:28:14.090352+0000","last_became_active":"2023-10-06T05:28:14.085015+0000","last_became_peered":"2023-10-06T05:28:14.085015+0000","last_unstale":"2023-10-06T05:28:14.090352+0000","last_undegraded":"2023-10-06T05:28:14.090352+0000","last_fullsized":"2023-10-06T05:28:14.090352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:01.362283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.089875+0000","last_change":"2023-10-06T05:28:14.080409+0000","last_active":"2023-10-06T05:28:14.089875+0000","last_peered":"2023-10-06T05:28:14.089875+0000","last_clean":"2023-10-06T05:28:14.089875+0000","last_became_active":"2023-10-06T05:28:14.079224+0000","last_became_peered":"2023-10-06T05:28:14.079224+0000","last_unstale":"2023-10-06T05:28:14.089875+0000","last_undegraded":"2023-10-06T05:28:14.089875+0000","last_fullsized":"2023-10-06T05:28:14.089875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:54.358207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.079892+0000","last_change":"2023-10-06T05:28:14.075802+0000","last_active":"2023-10-06T05:28:14.079892+0000","last_peered":"2023-10-06T05:28:14.079892+0000","last_clean":"2023-10-06T05:28:14.079892+0000","last_became_active":"2023-10-06T05:28:14.075244+0000","last_became_peered":"2023-10-06T05:28:14.075244+0000","last_unstale":"2023-10-06T05:28:14.079892+0000","last_undegraded":"2023-10-06T05:28:14.079892+0000","last_fullsized":"2023-10-06T05:28:14.079892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:20.692557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.081884+0000","last_change":"2023-10-06T05:28:14.070336+0000","last_active":"2023-10-06T05:28:14.081884+0000","last_peered":"2023-10-06T05:28:14.081884+0000","last_clean":"2023-10-06T05:28:14.081884+0000","last_became_active":"2023-10-06T05:28:14.068943+0000","last_became_peered":"2023-10-06T05:28:14.068943+0000","last_unstale":"2023-10-06T05:28:14.081884+0000","last_undegraded":"2023-10-06T05:28:14.081884+0000","last_fullsized":"2023-10-06T05:28:14.081884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:49.252252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086860+0000","last_change":"2023-10-06T05:28:14.077042+0000","last_active":"2023-10-06T05:28:14.086860+0000","last_peered":"2023-10-06T05:28:14.086860+0000","last_clean":"2023-10-06T05:28:14.086860+0000","last_became_active":"2023-10-06T05:28:14.076681+0000","last_became_peered":"2023-10-06T05:28:14.076681+0000","last_unstale":"2023-10-06T05:28:14.086860+0000","last_undegraded":"2023-10-06T05:28:14.086860+0000","last_fullsized":"2023-10-06T05:28:14.086860+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:55.243926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086839+0000","last_change":"2023-10-06T05:28:14.077423+0000","last_active":"2023-10-06T05:28:14.086839+0000","last_peered":"2023-10-06T05:28:14.086839+0000","last_clean":"2023-10-06T05:28:14.086839+0000","last_became_active":"2023-10-06T05:28:14.077115+0000","last_became_peered":"2023-10-06T05:28:14.077115+0000","last_unstale":"2023-10-06T05:28:14.086839+0000","last_undegraded":"2023-10-06T05:28:14.086839+0000","last_fullsized":"2023-10-06T05:28:14.086839+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:19.751366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.076535+0000","last_change":"2023-10-06T05:28:14.071648+0000","last_active":"2023-10-06T05:28:14.076535+0000","last_peered":"2023-10-06T05:28:14.076535+0000","last_clean":"2023-10-06T05:28:14.076535+0000","last_became_active":"2023-10-06T05:28:14.071202+0000","last_became_peered":"2023-10-06T05:28:14.071202+0000","last_unstale":"2023-10-06T05:28:14.076535+0000","last_undegraded":"2023-10-06T05:28:14.076535+0000","last_fullsized":"2023-10-06T05:28:14.076535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:19.842268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.080489+0000","last_change":"2023-10-06T05:28:14.075765+0000","last_active":"2023-10-06T05:28:14.080489+0000","last_peered":"2023-10-06T05:28:14.080489+0000","last_clean":"2023-10-06T05:28:14.080489+0000","last_became_active":"2023-10-06T05:28:14.075384+0000","last_became_peered":"2023-10-06T05:28:14.075384+0000","last_unstale":"2023-10-06T05:28:14.080489+0000","last_undegraded":"2023-10-06T05:28:14.080489+0000","last_fullsized":"2023-10-06T05:28:14.080489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:48.250126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087384+0000","last_change":"2023-10-06T05:28:14.085189+0000","last_active":"2023-10-06T05:28:14.087384+0000","last_peered":"2023-10-06T05:28:14.087384+0000","last_clean":"2023-10-06T05:28:14.087384+0000","last_became_active":"2023-10-06T05:28:14.084654+0000","last_became_peered":"2023-10-06T05:28:14.084654+0000","last_unstale":"2023-10-06T05:28:14.087384+0000","last_undegraded":"2023-10-06T05:28:14.087384+0000","last_fullsized":"2023-10-06T05:28:14.087384+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:45.045993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087019+0000","last_change":"2023-10-06T05:28:14.079421+0000","last_active":"2023-10-06T05:28:14.087019+0000","last_peered":"2023-10-06T05:28:14.087019+0000","last_clean":"2023-10-06T05:28:14.087019+0000","last_became_active":"2023-10-06T05:28:14.079112+0000","last_became_peered":"2023-10-06T05:28:14.079112+0000","last_unstale":"2023-10-06T05:28:14.087019+0000","last_undegraded":"2023-10-06T05:28:14.087019+0000","last_fullsized":"2023-10-06T05:28:14.087019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:46:38.473090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.090093+0000","last_change":"2023-10-06T05:28:14.084706+0000","last_active":"2023-10-06T05:28:14.090093+0000","last_peered":"2023-10-06T05:28:14.090093+0000","last_clean":"2023-10-06T05:28:14.090093+0000","last_became_active":"2023-10-06T05:28:14.083531+0000","last_became_peered":"2023-10-06T05:28:14.083531+0000","last_unstale":"2023-10-06T05:28:14.090093+0000","last_undegraded":"2023-10-06T05:28:14.090093+0000","last_fullsized":"2023-10-06T05:28:14.090093+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:55.243926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.075332+0000","last_change":"2023-10-06T05:28:14.068915+0000","last_active":"2023-10-06T05:28:14.075332+0000","last_peered":"2023-10-06T05:28:14.075332+0000","last_clean":"2023-10-06T05:28:14.075332+0000","last_became_active":"2023-10-06T05:28:14.068625+0000","last_became_peered":"2023-10-06T05:28:14.068625+0000","last_unstale":"2023-10-06T05:28:14.075332+0000","last_undegraded":"2023-10-06T05:28:14.075332+0000","last_fullsized":"2023-10-06T05:28:14.075332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:28:18.556062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.074941+0000","last_change":"2023-10-06T05:28:14.065626+0000","last_active":"2023-10-06T05:28:14.074941+0000","last_peered":"2023-10-06T05:28:14.074941+0000","last_clean":"2023-10-06T05:28:14.074941+0000","last_became_active":"2023-10-06T05:28:14.065315+0000","last_became_peered":"2023-10-06T05:28:14.065315+0000","last_unstale":"2023-10-06T05:28:14.074941+0000","last_undegraded":"2023-10-06T05:28:14.074941+0000","last_fullsized":"2023-10-06T05:28:14.074941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:58.465391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.079792+0000","last_change":"2023-10-06T05:28:14.067225+0000","last_active":"2023-10-06T05:28:14.079792+0000","last_peered":"2023-10-06T05:28:14.079792+0000","last_clean":"2023-10-06T05:28:14.079792+0000","last_became_active":"2023-10-06T05:28:14.066865+0000","last_became_peered":"2023-10-06T05:28:14.066865+0000","last_unstale":"2023-10-06T05:28:14.079792+0000","last_undegraded":"2023-10-06T05:28:14.079792+0000","last_fullsized":"2023-10-06T05:28:14.079792+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:54.358207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084264+0000","last_change":"2023-10-06T05:28:14.077071+0000","last_active":"2023-10-06T05:28:14.084264+0000","last_peered":"2023-10-06T05:28:14.084264+0000","last_clean":"2023-10-06T05:28:14.084264+0000","last_became_active":"2023-10-06T05:28:14.076729+0000","last_became_peered":"2023-10-06T05:28:14.076729+0000","last_unstale":"2023-10-06T05:28:14.084264+0000","last_undegraded":"2023-10-06T05:28:14.084264+0000","last_fullsized":"2023-10-06T05:28:14.084264+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:06.409036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.090006+0000","last_change":"2023-10-06T05:28:14.082651+0000","last_active":"2023-10-06T05:28:14.090006+0000","last_peered":"2023-10-06T05:28:14.090006+0000","last_clean":"2023-10-06T05:28:14.090006+0000","last_became_active":"2023-10-06T05:28:14.082287+0000","last_became_peered":"2023-10-06T05:28:14.082287+0000","last_unstale":"2023-10-06T05:28:14.090006+0000","last_undegraded":"2023-10-06T05:28:14.090006+0000","last_fullsized":"2023-10-06T05:28:14.090006+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:02.339571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.082165+0000","last_change":"2023-10-06T05:28:14.078933+0000","last_active":"2023-10-06T05:28:14.082165+0000","last_peered":"2023-10-06T05:28:14.082165+0000","last_clean":"2023-10-06T05:28:14.082165+0000","last_became_active":"2023-10-06T05:28:14.078622+0000","last_became_peered":"2023-10-06T05:28:14.078622+0000","last_unstale":"2023-10-06T05:28:14.082165+0000","last_undegraded":"2023-10-06T05:28:14.082165+0000","last_fullsized":"2023-10-06T05:28:14.082165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:28.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.079674+0000","last_change":"2023-10-06T05:28:14.069099+0000","last_active":"2023-10-06T05:28:14.079674+0000","last_peered":"2023-10-06T05:28:14.079674+0000","last_clean":"2023-10-06T05:28:14.079674+0000","last_became_active":"2023-10-06T05:28:14.067926+0000","last_became_peered":"2023-10-06T05:28:14.067926+0000","last_unstale":"2023-10-06T05:28:14.079674+0000","last_undegraded":"2023-10-06T05:28:14.079674+0000","last_fullsized":"2023-10-06T05:28:14.079674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:28:18.556062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.083282+0000","last_change":"2023-10-06T05:28:14.077518+0000","last_active":"2023-10-06T05:28:14.083282+0000","last_peered":"2023-10-06T05:28:14.083282+0000","last_clean":"2023-10-06T05:28:14.083282+0000","last_became_active":"2023-10-06T05:28:14.076992+0000","last_became_peered":"2023-10-06T05:28:14.076992+0000","last_unstale":"2023-10-06T05:28:14.083282+0000","last_undegraded":"2023-10-06T05:28:14.083282+0000","last_fullsized":"2023-10-06T05:28:14.083282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:28.035347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087210+0000","last_change":"2023-10-06T05:28:14.083316+0000","last_active":"2023-10-06T05:28:14.087210+0000","last_peered":"2023-10-06T05:28:14.087210+0000","last_clean":"2023-10-06T05:28:14.087210+0000","last_became_active":"2023-10-06T05:28:14.082950+0000","last_became_peered":"2023-10-06T05:28:14.082950+0000","last_unstale":"2023-10-06T05:28:14.087210+0000","last_undegraded":"2023-10-06T05:28:14.087210+0000","last_fullsized":"2023-10-06T05:28:14.087210+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:18.961390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.089462+0000","last_change":"2023-10-06T05:28:13.072415+0000","last_active":"2023-10-06T05:28:14.089462+0000","last_peered":"2023-10-06T05:28:14.089462+0000","last_clean":"2023-10-06T05:28:14.089462+0000","last_became_active":"2023-10-06T05:28:13.072061+0000","last_became_peered":"2023-10-06T05:28:13.072061+0000","last_unstale":"2023-10-06T05:28:14.089462+0000","last_undegraded":"2023-10-06T05:28:14.089462+0000","last_fullsized":"2023-10-06T05:28:14.089462+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:46.307237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.079812+0000","last_change":"2023-10-06T05:28:14.067349+0000","last_active":"2023-10-06T05:28:14.079812+0000","last_peered":"2023-10-06T05:28:14.079812+0000","last_clean":"2023-10-06T05:28:14.079812+0000","last_became_active":"2023-10-06T05:28:14.066441+0000","last_became_peered":"2023-10-06T05:28:14.066441+0000","last_unstale":"2023-10-06T05:28:14.079812+0000","last_undegraded":"2023-10-06T05:28:14.079812+0000","last_fullsized":"2023-10-06T05:28:14.079812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:54.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.089534+0000","last_change":"2023-10-06T05:28:13.067005+0000","last_active":"2023-10-06T05:28:14.089534+0000","last_peered":"2023-10-06T05:28:14.089534+0000","last_clean":"2023-10-06T05:28:14.089534+0000","last_became_active":"2023-10-06T05:28:13.066585+0000","last_became_peered":"2023-10-06T05:28:13.066585+0000","last_unstale":"2023-10-06T05:28:14.089534+0000","last_undegraded":"2023-10-06T05:28:14.089534+0000","last_fullsized":"2023-10-06T05:28:14.089534+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:41.861218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.083249+0000","last_change":"2023-10-06T05:28:14.078749+0000","last_active":"2023-10-06T05:28:14.083249+0000","last_peered":"2023-10-06T05:28:14.083249+0000","last_clean":"2023-10-06T05:28:14.083249+0000","last_became_active":"2023-10-06T05:28:14.078210+0000","last_became_peered":"2023-10-06T05:28:14.078210+0000","last_unstale":"2023-10-06T05:28:14.083249+0000","last_undegraded":"2023-10-06T05:28:14.083249+0000","last_fullsized":"2023-10-06T05:28:14.083249+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:18.203377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.092312+0000","last_change":"2023-10-06T05:28:13.067329+0000","last_active":"2023-10-06T05:28:14.092312+0000","last_peered":"2023-10-06T05:28:14.092312+0000","last_clean":"2023-10-06T05:28:14.092312+0000","last_became_active":"2023-10-06T05:28:13.066996+0000","last_became_peered":"2023-10-06T05:28:13.066996+0000","last_unstale":"2023-10-06T05:28:14.092312+0000","last_undegraded":"2023-10-06T05:28:14.092312+0000","last_fullsized":"2023-10-06T05:28:14.092312+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:01.326653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.090430+0000","last_change":"2023-10-06T05:28:14.085694+0000","last_active":"2023-10-06T05:28:14.090430+0000","last_peered":"2023-10-06T05:28:14.090430+0000","last_clean":"2023-10-06T05:28:14.090430+0000","last_became_active":"2023-10-06T05:28:14.085343+0000","last_became_peered":"2023-10-06T05:28:14.085343+0000","last_unstale":"2023-10-06T05:28:14.090430+0000","last_undegraded":"2023-10-06T05:28:14.090430+0000","last_fullsized":"2023-10-06T05:28:14.090430+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:28:18.556062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.089333+0000","last_change":"2023-10-06T05:28:13.068351+0000","last_active":"2023-10-06T05:28:14.089333+0000","last_peered":"2023-10-06T05:28:14.089333+0000","last_clean":"2023-10-06T05:28:14.089333+0000","last_became_active":"2023-10-06T05:28:13.067994+0000","last_became_peered":"2023-10-06T05:28:13.067994+0000","last_unstale":"2023-10-06T05:28:14.089333+0000","last_undegraded":"2023-10-06T05:28:14.089333+0000","last_fullsized":"2023-10-06T05:28:14.089333+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:00.722691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.077960+0000","last_change":"2023-10-06T05:28:14.068453+0000","last_active":"2023-10-06T05:28:14.077960+0000","last_peered":"2023-10-06T05:28:14.077960+0000","last_clean":"2023-10-06T05:28:14.077960+0000","last_became_active":"2023-10-06T05:28:14.068102+0000","last_became_peered":"2023-10-06T05:28:14.068102+0000","last_unstale":"2023-10-06T05:28:14.077960+0000","last_undegraded":"2023-10-06T05:28:14.077960+0000","last_fullsized":"2023-10-06T05:28:14.077960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:16.598046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086967+0000","last_change":"2023-10-06T05:28:13.060168+0000","last_active":"2023-10-06T05:28:14.086967+0000","last_peered":"2023-10-06T05:28:14.086967+0000","last_clean":"2023-10-06T05:28:14.086967+0000","last_became_active":"2023-10-06T05:28:13.059716+0000","last_became_peered":"2023-10-06T05:28:13.059716+0000","last_unstale":"2023-10-06T05:28:14.086967+0000","last_undegraded":"2023-10-06T05:28:14.086967+0000","last_fullsized":"2023-10-06T05:28:14.086967+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:57.452474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.072100+0000","last_change":"2023-10-06T05:28:14.064889+0000","last_active":"2023-10-06T05:28:14.072100+0000","last_peered":"2023-10-06T05:28:14.072100+0000","last_clean":"2023-10-06T05:28:14.072100+0000","last_became_active":"2023-10-06T05:28:14.064610+0000","last_became_peered":"2023-10-06T05:28:14.064610+0000","last_unstale":"2023-10-06T05:28:14.072100+0000","last_undegraded":"2023-10-06T05:28:14.072100+0000","last_fullsized":"2023-10-06T05:28:14.072100+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:23.319361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086857+0000","last_change":"2023-10-06T05:28:13.062474+0000","last_active":"2023-10-06T05:28:14.086857+0000","last_peered":"2023-10-06T05:28:14.086857+0000","last_clean":"2023-10-06T05:28:14.086857+0000","last_became_active":"2023-10-06T05:28:13.062174+0000","last_became_peered":"2023-10-06T05:28:13.062174+0000","last_unstale":"2023-10-06T05:28:14.086857+0000","last_undegraded":"2023-10-06T05:28:14.086857+0000","last_fullsized":"2023-10-06T05:28:14.086857+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:53.345290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086940+0000","last_change":"2023-10-06T05:28:14.081441+0000","last_active":"2023-10-06T05:28:14.086940+0000","last_peered":"2023-10-06T05:28:14.086940+0000","last_clean":"2023-10-06T05:28:14.086940+0000","last_became_active":"2023-10-06T05:28:14.081139+0000","last_became_peered":"2023-10-06T05:28:14.081139+0000","last_unstale":"2023-10-06T05:28:14.086940+0000","last_undegraded":"2023-10-06T05:28:14.086940+0000","last_fullsized":"2023-10-06T05:28:14.086940+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:56.148986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.069624+0000","last_change":"2023-10-06T05:28:13.066629+0000","last_active":"2023-10-06T05:28:14.069624+0000","last_peered":"2023-10-06T05:28:14.069624+0000","last_clean":"2023-10-06T05:28:14.069624+0000","last_became_active":"2023-10-06T05:28:13.058989+0000","last_became_peered":"2023-10-06T05:28:13.058989+0000","last_unstale":"2023-10-06T05:28:14.069624+0000","last_undegraded":"2023-10-06T05:28:14.069624+0000","last_fullsized":"2023-10-06T05:28:14.069624+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:00.349366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.077747+0000","last_change":"2023-10-06T05:28:14.072199+0000","last_active":"2023-10-06T05:28:14.077747+0000","last_peered":"2023-10-06T05:28:14.077747+0000","last_clean":"2023-10-06T05:28:14.077747+0000","last_became_active":"2023-10-06T05:28:14.071854+0000","last_became_peered":"2023-10-06T05:28:14.071854+0000","last_unstale":"2023-10-06T05:28:14.077747+0000","last_undegraded":"2023-10-06T05:28:14.077747+0000","last_fullsized":"2023-10-06T05:28:14.077747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:13.201451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.059985+0000","last_change":"2023-10-06T05:28:13.071253+0000","last_active":"2023-10-06T05:28:14.059985+0000","last_peered":"2023-10-06T05:28:14.059985+0000","last_clean":"2023-10-06T05:28:14.059985+0000","last_became_active":"2023-10-06T05:28:13.069426+0000","last_became_peered":"2023-10-06T05:28:13.069426+0000","last_unstale":"2023-10-06T05:28:14.059985+0000","last_undegraded":"2023-10-06T05:28:14.059985+0000","last_fullsized":"2023-10-06T05:28:14.059985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:48.482233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084189+0000","last_change":"2023-10-06T05:28:14.074216+0000","last_active":"2023-10-06T05:28:14.084189+0000","last_peered":"2023-10-06T05:28:14.084189+0000","last_clean":"2023-10-06T05:28:14.084189+0000","last_became_active":"2023-10-06T05:28:14.073903+0000","last_became_peered":"2023-10-06T05:28:14.073903+0000","last_unstale":"2023-10-06T05:28:14.084189+0000","last_undegraded":"2023-10-06T05:28:14.084189+0000","last_fullsized":"2023-10-06T05:28:14.084189+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:18.961390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.071391+0000","last_change":"2023-10-06T05:28:13.071452+0000","last_active":"2023-10-06T05:28:14.071391+0000","last_peered":"2023-10-06T05:28:14.071391+0000","last_clean":"2023-10-06T05:28:14.071391+0000","last_became_active":"2023-10-06T05:28:13.071132+0000","last_became_peered":"2023-10-06T05:28:13.071132+0000","last_unstale":"2023-10-06T05:28:14.071391+0000","last_undegraded":"2023-10-06T05:28:14.071391+0000","last_fullsized":"2023-10-06T05:28:14.071391+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:13.347424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.077683+0000","last_change":"2023-10-06T05:28:14.072866+0000","last_active":"2023-10-06T05:28:14.077683+0000","last_peered":"2023-10-06T05:28:14.077683+0000","last_clean":"2023-10-06T05:28:14.077683+0000","last_became_active":"2023-10-06T05:28:14.072601+0000","last_became_peered":"2023-10-06T05:28:14.072601+0000","last_unstale":"2023-10-06T05:28:14.077683+0000","last_undegraded":"2023-10-06T05:28:14.077683+0000","last_fullsized":"2023-10-06T05:28:14.077683+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:34.756662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.057129+0000","last_change":"2023-10-06T05:28:13.066376+0000","last_active":"2023-10-06T05:28:14.057129+0000","last_peered":"2023-10-06T05:28:14.057129+0000","last_clean":"2023-10-06T05:28:14.057129+0000","last_became_active":"2023-10-06T05:28:13.066039+0000","last_became_peered":"2023-10-06T05:28:13.066039+0000","last_unstale":"2023-10-06T05:28:14.057129+0000","last_undegraded":"2023-10-06T05:28:14.057129+0000","last_fullsized":"2023-10-06T05:28:14.057129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:37.288751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084248+0000","last_change":"2023-10-06T05:28:14.073294+0000","last_active":"2023-10-06T05:28:14.084248+0000","last_peered":"2023-10-06T05:28:14.084248+0000","last_clean":"2023-10-06T05:28:14.084248+0000","last_became_active":"2023-10-06T05:28:14.072941+0000","last_became_peered":"2023-10-06T05:28:14.072941+0000","last_unstale":"2023-10-06T05:28:14.084248+0000","last_undegraded":"2023-10-06T05:28:14.084248+0000","last_fullsized":"2023-10-06T05:28:14.084248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:52.510614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087090+0000","last_change":"2023-10-06T05:28:13.070775+0000","last_active":"2023-10-06T05:28:14.087090+0000","last_peered":"2023-10-06T05:28:14.087090+0000","last_clean":"2023-10-06T05:28:14.087090+0000","last_became_active":"2023-10-06T05:28:13.070467+0000","last_became_peered":"2023-10-06T05:28:13.070467+0000","last_unstale":"2023-10-06T05:28:14.087090+0000","last_undegraded":"2023-10-06T05:28:14.087090+0000","last_fullsized":"2023-10-06T05:28:14.087090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:18.738449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086897+0000","last_change":"2023-10-06T05:28:14.074919+0000","last_active":"2023-10-06T05:28:14.086897+0000","last_peered":"2023-10-06T05:28:14.086897+0000","last_clean":"2023-10-06T05:28:14.086897+0000","last_became_active":"2023-10-06T05:28:14.074612+0000","last_became_peered":"2023-10-06T05:28:14.074612+0000","last_unstale":"2023-10-06T05:28:14.086897+0000","last_undegraded":"2023-10-06T05:28:14.086897+0000","last_fullsized":"2023-10-06T05:28:14.086897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:42.874135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.092343+0000","last_change":"2023-10-06T05:28:13.066159+0000","last_active":"2023-10-06T05:28:14.092343+0000","last_peered":"2023-10-06T05:28:14.092343+0000","last_clean":"2023-10-06T05:28:14.092343+0000","last_became_active":"2023-10-06T05:28:13.065450+0000","last_became_peered":"2023-10-06T05:28:13.065450+0000","last_unstale":"2023-10-06T05:28:14.092343+0000","last_undegraded":"2023-10-06T05:28:14.092343+0000","last_fullsized":"2023-10-06T05:28:14.092343+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:41.587049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.089253+0000","last_change":"2023-10-06T05:28:14.081118+0000","last_active":"2023-10-06T05:28:14.089253+0000","last_peered":"2023-10-06T05:28:14.089253+0000","last_clean":"2023-10-06T05:28:14.089253+0000","last_became_active":"2023-10-06T05:28:14.080780+0000","last_became_peered":"2023-10-06T05:28:14.080780+0000","last_unstale":"2023-10-06T05:28:14.089253+0000","last_undegraded":"2023-10-06T05:28:14.089253+0000","last_fullsized":"2023-10-06T05:28:14.089253+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:13.960023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087115+0000","last_change":"2023-10-06T05:28:13.066651+0000","last_active":"2023-10-06T05:28:14.087115+0000","last_peered":"2023-10-06T05:28:14.087115+0000","last_clean":"2023-10-06T05:28:14.087115+0000","last_became_active":"2023-10-06T05:28:13.064793+0000","last_became_peered":"2023-10-06T05:28:13.064793+0000","last_unstale":"2023-10-06T05:28:14.087115+0000","last_undegraded":"2023-10-06T05:28:14.087115+0000","last_fullsized":"2023-10-06T05:28:14.087115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:51.497697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.075001+0000","last_change":"2023-10-06T05:28:14.067259+0000","last_active":"2023-10-06T05:28:14.075001+0000","last_peered":"2023-10-06T05:28:14.075001+0000","last_clean":"2023-10-06T05:28:14.075001+0000","last_became_active":"2023-10-06T05:28:14.066955+0000","last_became_peered":"2023-10-06T05:28:14.066955+0000","last_unstale":"2023-10-06T05:28:14.075001+0000","last_undegraded":"2023-10-06T05:28:14.075001+0000","last_fullsized":"2023-10-06T05:28:14.075001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:54.358207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.057011+0000","last_change":"2023-10-06T05:28:13.069436+0000","last_active":"2023-10-06T05:28:14.057011+0000","last_peered":"2023-10-06T05:28:14.057011+0000","last_clean":"2023-10-06T05:28:14.057011+0000","last_became_active":"2023-10-06T05:28:13.069124+0000","last_became_peered":"2023-10-06T05:28:13.069124+0000","last_unstale":"2023-10-06T05:28:14.057011+0000","last_undegraded":"2023-10-06T05:28:14.057011+0000","last_fullsized":"2023-10-06T05:28:14.057011+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:37.288751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084353+0000","last_change":"2023-10-06T05:28:14.071870+0000","last_active":"2023-10-06T05:28:14.084353+0000","last_peered":"2023-10-06T05:28:14.084353+0000","last_clean":"2023-10-06T05:28:14.084353+0000","last_became_active":"2023-10-06T05:28:14.071599+0000","last_became_peered":"2023-10-06T05:28:14.071599+0000","last_unstale":"2023-10-06T05:28:14.084353+0000","last_undegraded":"2023-10-06T05:28:14.084353+0000","last_fullsized":"2023-10-06T05:28:14.084353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:06.697814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.064969+0000","last_change":"2023-10-06T05:28:13.070039+0000","last_active":"2023-10-06T05:28:14.064969+0000","last_peered":"2023-10-06T05:28:14.064969+0000","last_clean":"2023-10-06T05:28:14.064969+0000","last_became_active":"2023-10-06T05:28:13.068835+0000","last_became_peered":"2023-10-06T05:28:13.068835+0000","last_unstale":"2023-10-06T05:28:14.064969+0000","last_undegraded":"2023-10-06T05:28:14.064969+0000","last_fullsized":"2023-10-06T05:28:14.064969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:22.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087073+0000","last_change":"2023-10-06T05:28:14.079685+0000","last_active":"2023-10-06T05:28:14.087073+0000","last_peered":"2023-10-06T05:28:14.087073+0000","last_clean":"2023-10-06T05:28:14.087073+0000","last_became_active":"2023-10-06T05:28:14.079407+0000","last_became_peered":"2023-10-06T05:28:14.079407+0000","last_unstale":"2023-10-06T05:28:14.087073+0000","last_undegraded":"2023-10-06T05:28:14.087073+0000","last_fullsized":"2023-10-06T05:28:14.087073+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:35.164855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087986+0000","last_change":"2023-10-06T05:28:13.067179+0000","last_active":"2023-10-06T05:28:14.087986+0000","last_peered":"2023-10-06T05:28:14.087986+0000","last_clean":"2023-10-06T05:28:14.087986+0000","last_became_active":"2023-10-06T05:28:13.066804+0000","last_became_peered":"2023-10-06T05:28:13.066804+0000","last_unstale":"2023-10-06T05:28:14.087986+0000","last_undegraded":"2023-10-06T05:28:14.087986+0000","last_fullsized":"2023-10-06T05:28:14.087986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:04.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.088444+0000","last_change":"2023-10-06T05:28:14.087484+0000","last_active":"2023-10-06T05:28:14.088444+0000","last_peered":"2023-10-06T05:28:14.088444+0000","last_clean":"2023-10-06T05:28:14.088444+0000","last_became_active":"2023-10-06T05:28:14.087190+0000","last_became_peered":"2023-10-06T05:28:14.087190+0000","last_unstale":"2023-10-06T05:28:14.088444+0000","last_undegraded":"2023-10-06T05:28:14.088444+0000","last_fullsized":"2023-10-06T05:28:14.088444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:11.871161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.083307+0000","last_change":"2023-10-06T05:28:13.069648+0000","last_active":"2023-10-06T05:28:14.083307+0000","last_peered":"2023-10-06T05:28:14.083307+0000","last_clean":"2023-10-06T05:28:14.083307+0000","last_became_active":"2023-10-06T05:28:13.069320+0000","last_became_peered":"2023-10-06T05:28:13.069320+0000","last_unstale":"2023-10-06T05:28:14.083307+0000","last_undegraded":"2023-10-06T05:28:14.083307+0000","last_fullsized":"2023-10-06T05:28:14.083307+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:04.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.078786+0000","last_change":"2023-10-06T05:28:14.074296+0000","last_active":"2023-10-06T05:28:14.078786+0000","last_peered":"2023-10-06T05:28:14.078786+0000","last_clean":"2023-10-06T05:28:14.078786+0000","last_became_active":"2023-10-06T05:28:14.073866+0000","last_became_peered":"2023-10-06T05:28:14.073866+0000","last_unstale":"2023-10-06T05:28:14.078786+0000","last_undegraded":"2023-10-06T05:28:14.078786+0000","last_fullsized":"2023-10-06T05:28:14.078786+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:07.050499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.054821+0000","last_change":"2023-10-06T05:28:13.067210+0000","last_active":"2023-10-06T05:28:14.054821+0000","last_peered":"2023-10-06T05:28:14.054821+0000","last_clean":"2023-10-06T05:28:14.054821+0000","last_became_active":"2023-10-06T05:28:13.066888+0000","last_became_peered":"2023-10-06T05:28:13.066888+0000","last_unstale":"2023-10-06T05:28:14.054821+0000","last_undegraded":"2023-10-06T05:28:14.054821+0000","last_fullsized":"2023-10-06T05:28:14.054821+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:55.136068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.075069+0000","last_change":"2023-10-06T05:28:14.068418+0000","last_active":"2023-10-06T05:28:14.075069+0000","last_peered":"2023-10-06T05:28:14.075069+0000","last_clean":"2023-10-06T05:28:14.075069+0000","last_became_active":"2023-10-06T05:28:14.068094+0000","last_became_peered":"2023-10-06T05:28:14.068094+0000","last_unstale":"2023-10-06T05:28:14.075069+0000","last_undegraded":"2023-10-06T05:28:14.075069+0000","last_fullsized":"2023-10-06T05:28:14.075069+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:01.362283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.081115+0000","last_change":"2023-10-06T05:28:13.067169+0000","last_active":"2023-10-06T05:28:14.081115+0000","last_peered":"2023-10-06T05:28:14.081115+0000","last_clean":"2023-10-06T05:28:14.081115+0000","last_became_active":"2023-10-06T05:28:13.066824+0000","last_became_peered":"2023-10-06T05:28:13.066824+0000","last_unstale":"2023-10-06T05:28:14.081115+0000","last_undegraded":"2023-10-06T05:28:14.081115+0000","last_fullsized":"2023-10-06T05:28:14.081115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:53.165487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086894+0000","last_change":"2023-10-06T05:28:14.080402+0000","last_active":"2023-10-06T05:28:14.086894+0000","last_peered":"2023-10-06T05:28:14.086894+0000","last_clean":"2023-10-06T05:28:14.086894+0000","last_became_active":"2023-10-06T05:28:14.079924+0000","last_became_peered":"2023-10-06T05:28:14.079924+0000","last_unstale":"2023-10-06T05:28:14.086894+0000","last_undegraded":"2023-10-06T05:28:14.086894+0000","last_fullsized":"2023-10-06T05:28:14.086894+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:45.660735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.070699+0000","last_change":"2023-10-06T05:28:13.068746+0000","last_active":"2023-10-06T05:28:14.070699+0000","last_peered":"2023-10-06T05:28:14.070699+0000","last_clean":"2023-10-06T05:28:14.070699+0000","last_became_active":"2023-10-06T05:28:13.068354+0000","last_became_peered":"2023-10-06T05:28:13.068354+0000","last_unstale":"2023-10-06T05:28:14.070699+0000","last_undegraded":"2023-10-06T05:28:14.070699+0000","last_fullsized":"2023-10-06T05:28:14.070699+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:30.733210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087114+0000","last_change":"2023-10-06T05:28:14.081507+0000","last_active":"2023-10-06T05:28:14.087114+0000","last_peered":"2023-10-06T05:28:14.087114+0000","last_clean":"2023-10-06T05:28:14.087114+0000","last_became_active":"2023-10-06T05:28:14.081152+0000","last_became_peered":"2023-10-06T05:28:14.081152+0000","last_unstale":"2023-10-06T05:28:14.087114+0000","last_undegraded":"2023-10-06T05:28:14.087114+0000","last_fullsized":"2023-10-06T05:28:14.087114+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.159746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.071077+0000","last_change":"2023-10-06T05:28:13.069497+0000","last_active":"2023-10-06T05:28:14.071077+0000","last_peered":"2023-10-06T05:28:14.071077+0000","last_clean":"2023-10-06T05:28:14.071077+0000","last_became_active":"2023-10-06T05:28:13.069168+0000","last_became_peered":"2023-10-06T05:28:13.069168+0000","last_unstale":"2023-10-06T05:28:14.071077+0000","last_undegraded":"2023-10-06T05:28:14.071077+0000","last_fullsized":"2023-10-06T05:28:14.071077+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:04.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086837+0000","last_change":"2023-10-06T05:28:14.078882+0000","last_active":"2023-10-06T05:28:14.086837+0000","last_peered":"2023-10-06T05:28:14.086837+0000","last_clean":"2023-10-06T05:28:14.086837+0000","last_became_active":"2023-10-06T05:28:14.078579+0000","last_became_peered":"2023-10-06T05:28:14.078579+0000","last_unstale":"2023-10-06T05:28:14.086837+0000","last_undegraded":"2023-10-06T05:28:14.086837+0000","last_fullsized":"2023-10-06T05:28:14.086837+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:58.465391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.072013+0000","last_change":"2023-10-06T05:28:13.069399+0000","last_active":"2023-10-06T05:28:14.072013+0000","last_peered":"2023-10-06T05:28:14.072013+0000","last_clean":"2023-10-06T05:28:14.072013+0000","last_became_active":"2023-10-06T05:28:13.069056+0000","last_became_peered":"2023-10-06T05:28:13.069056+0000","last_unstale":"2023-10-06T05:28:14.072013+0000","last_undegraded":"2023-10-06T05:28:14.072013+0000","last_fullsized":"2023-10-06T05:28:14.072013+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:53.165487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.081971+0000","last_change":"2023-10-06T05:28:14.069919+0000","last_active":"2023-10-06T05:28:14.081971+0000","last_peered":"2023-10-06T05:28:14.081971+0000","last_clean":"2023-10-06T05:28:14.081971+0000","last_became_active":"2023-10-06T05:28:14.068753+0000","last_became_peered":"2023-10-06T05:28:14.068753+0000","last_unstale":"2023-10-06T05:28:14.081971+0000","last_undegraded":"2023-10-06T05:28:14.081971+0000","last_fullsized":"2023-10-06T05:28:14.081971+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:29.345043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.069523+0000","last_change":"2023-10-06T05:28:13.066192+0000","last_active":"2023-10-06T05:28:14.069523+0000","last_peered":"2023-10-06T05:28:14.069523+0000","last_clean":"2023-10-06T05:28:14.069523+0000","last_became_active":"2023-10-06T05:28:13.064488+0000","last_became_peered":"2023-10-06T05:28:13.064488+0000","last_unstale":"2023-10-06T05:28:14.069523+0000","last_undegraded":"2023-10-06T05:28:14.069523+0000","last_fullsized":"2023-10-06T05:28:14.069523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:05.597620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.078978+0000","last_change":"2023-10-06T05:28:14.075925+0000","last_active":"2023-10-06T05:28:14.078978+0000","last_peered":"2023-10-06T05:28:14.078978+0000","last_clean":"2023-10-06T05:28:14.078978+0000","last_became_active":"2023-10-06T05:28:14.075590+0000","last_became_peered":"2023-10-06T05:28:14.075590+0000","last_unstale":"2023-10-06T05:28:14.078978+0000","last_undegraded":"2023-10-06T05:28:14.078978+0000","last_fullsized":"2023-10-06T05:28:14.078978+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:50.181430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.067448+0000","last_change":"2023-10-06T05:28:13.068457+0000","last_active":"2023-10-06T05:28:14.067448+0000","last_peered":"2023-10-06T05:28:14.067448+0000","last_clean":"2023-10-06T05:28:14.067448+0000","last_became_active":"2023-10-06T05:28:13.068147+0000","last_became_peered":"2023-10-06T05:28:13.068147+0000","last_unstale":"2023-10-06T05:28:14.067448+0000","last_undegraded":"2023-10-06T05:28:14.067448+0000","last_fullsized":"2023-10-06T05:28:14.067448+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:11.664428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084271+0000","last_change":"2023-10-06T05:28:14.074265+0000","last_active":"2023-10-06T05:28:14.084271+0000","last_peered":"2023-10-06T05:28:14.084271+0000","last_clean":"2023-10-06T05:28:14.084271+0000","last_became_active":"2023-10-06T05:28:14.073067+0000","last_became_peered":"2023-10-06T05:28:14.073067+0000","last_unstale":"2023-10-06T05:28:14.084271+0000","last_undegraded":"2023-10-06T05:28:14.084271+0000","last_fullsized":"2023-10-06T05:28:14.084271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:23.319361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.057353+0000","last_change":"2023-10-06T05:28:13.055360+0000","last_active":"2023-10-06T05:28:14.057353+0000","last_peered":"2023-10-06T05:28:14.057353+0000","last_clean":"2023-10-06T05:28:14.057353+0000","last_became_active":"2023-10-06T05:28:13.055004+0000","last_became_peered":"2023-10-06T05:28:13.055004+0000","last_unstale":"2023-10-06T05:28:14.057353+0000","last_undegraded":"2023-10-06T05:28:14.057353+0000","last_fullsized":"2023-10-06T05:28:14.057353+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:28:17.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.065532+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:28:14.065532+0000","last_peered":"2023-10-06T05:28:14.065532+0000","last_clean":"2023-10-06T05:28:14.065532+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:28:14.065532+0000","last_undegraded":"2023-10-06T05:28:14.065532+0000","last_fullsized":"2023-10-06T05:28:14.065532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.055121+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:28:14.055121+0000","last_peered":"2023-10-06T05:28:14.055121+0000","last_clean":"2023-10-06T05:28:14.055121+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:28:14.055121+0000","last_undegraded":"2023-10-06T05:28:14.055121+0000","last_fullsized":"2023-10-06T05:28:14.055121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.081875+0000","last_change":"2023-10-06T05:28:14.077330+0000","last_active":"2023-10-06T05:28:14.081875+0000","last_peered":"2023-10-06T05:28:14.081875+0000","last_clean":"2023-10-06T05:28:14.081875+0000","last_became_active":"2023-10-06T05:28:14.076666+0000","last_became_peered":"2023-10-06T05:28:14.076666+0000","last_unstale":"2023-10-06T05:28:14.081875+0000","last_undegraded":"2023-10-06T05:28:14.081875+0000","last_fullsized":"2023-10-06T05:28:14.081875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:13.960023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086811+0000","last_change":"2023-10-06T05:28:13.064822+0000","last_active":"2023-10-06T05:28:14.086811+0000","last_peered":"2023-10-06T05:28:14.086811+0000","last_clean":"2023-10-06T05:28:14.086811+0000","last_became_active":"2023-10-06T05:28:13.064520+0000","last_became_peered":"2023-10-06T05:28:13.064520+0000","last_unstale":"2023-10-06T05:28:14.086811+0000","last_undegraded":"2023-10-06T05:28:14.086811+0000","last_fullsized":"2023-10-06T05:28:14.086811+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:22.242931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.065445+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:28:14.065445+0000","last_peered":"2023-10-06T05:28:14.065445+0000","last_clean":"2023-10-06T05:28:14.065445+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:28:14.065445+0000","last_undegraded":"2023-10-06T05:28:14.065445+0000","last_fullsized":"2023-10-06T05:28:14.065445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.075101+0000","last_change":"2023-10-06T05:28:14.068221+0000","last_active":"2023-10-06T05:28:14.075101+0000","last_peered":"2023-10-06T05:28:14.075101+0000","last_clean":"2023-10-06T05:28:14.075101+0000","last_became_active":"2023-10-06T05:28:14.067899+0000","last_became_peered":"2023-10-06T05:28:14.067899+0000","last_unstale":"2023-10-06T05:28:14.075101+0000","last_undegraded":"2023-10-06T05:28:14.075101+0000","last_fullsized":"2023-10-06T05:28:14.075101+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:55.243926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.057105+0000","last_change":"2023-10-06T05:28:13.070130+0000","last_active":"2023-10-06T05:28:14.057105+0000","last_peered":"2023-10-06T05:28:14.057105+0000","last_clean":"2023-10-06T05:28:14.057105+0000","last_became_active":"2023-10-06T05:28:13.069842+0000","last_became_peered":"2023-10-06T05:28:13.069842+0000","last_unstale":"2023-10-06T05:28:14.057105+0000","last_undegraded":"2023-10-06T05:28:14.057105+0000","last_fullsized":"2023-10-06T05:28:14.057105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:22.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.051546+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:28:14.051546+0000","last_peered":"2023-10-06T05:28:14.051546+0000","last_clean":"2023-10-06T05:28:14.051546+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:28:14.051546+0000","last_undegraded":"2023-10-06T05:28:14.051546+0000","last_fullsized":"2023-10-06T05:28:14.051546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084374+0000","last_change":"2023-10-06T05:28:14.076360+0000","last_active":"2023-10-06T05:28:14.084374+0000","last_peered":"2023-10-06T05:28:14.084374+0000","last_clean":"2023-10-06T05:28:14.084374+0000","last_became_active":"2023-10-06T05:28:14.075903+0000","last_became_peered":"2023-10-06T05:28:14.075903+0000","last_unstale":"2023-10-06T05:28:14.084374+0000","last_undegraded":"2023-10-06T05:28:14.084374+0000","last_fullsized":"2023-10-06T05:28:14.084374+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:42.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.076473+0000","last_change":"2023-10-06T05:28:13.064891+0000","last_active":"2023-10-06T05:28:14.076473+0000","last_peered":"2023-10-06T05:28:14.076473+0000","last_clean":"2023-10-06T05:28:14.076473+0000","last_became_active":"2023-10-06T05:28:13.064573+0000","last_became_peered":"2023-10-06T05:28:13.064573+0000","last_unstale":"2023-10-06T05:28:14.076473+0000","last_undegraded":"2023-10-06T05:28:14.076473+0000","last_fullsized":"2023-10-06T05:28:14.076473+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:54.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.057157+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:28:14.057157+0000","last_peered":"2023-10-06T05:28:14.057157+0000","last_clean":"2023-10-06T05:28:14.057157+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:28:14.057157+0000","last_undegraded":"2023-10-06T05:28:14.057157+0000","last_fullsized":"2023-10-06T05:28:14.057157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.089947+0000","last_change":"2023-10-06T05:28:14.082250+0000","last_active":"2023-10-06T05:28:14.089947+0000","last_peered":"2023-10-06T05:28:14.089947+0000","last_clean":"2023-10-06T05:28:14.089947+0000","last_became_active":"2023-10-06T05:28:14.081856+0000","last_became_peered":"2023-10-06T05:28:14.081856+0000","last_unstale":"2023-10-06T05:28:14.089947+0000","last_undegraded":"2023-10-06T05:28:14.089947+0000","last_fullsized":"2023-10-06T05:28:14.089947+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:46:42.874135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.083930+0000","last_change":"2023-10-06T05:28:13.067851+0000","last_active":"2023-10-06T05:28:14.083930+0000","last_peered":"2023-10-06T05:28:14.083930+0000","last_clean":"2023-10-06T05:28:14.083930+0000","last_became_active":"2023-10-06T05:28:13.067580+0000","last_became_peered":"2023-10-06T05:28:13.067580+0000","last_unstale":"2023-10-06T05:28:14.083930+0000","last_undegraded":"2023-10-06T05:28:14.083930+0000","last_fullsized":"2023-10-06T05:28:14.083930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:44.647817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.070805+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:28:14.070805+0000","last_peered":"2023-10-06T05:28:14.070805+0000","last_clean":"2023-10-06T05:28:14.070805+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:28:14.070805+0000","last_undegraded":"2023-10-06T05:28:14.070805+0000","last_fullsized":"2023-10-06T05:28:14.070805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.084124+0000","last_change":"2023-10-06T05:28:14.071513+0000","last_active":"2023-10-06T05:28:14.084124+0000","last_peered":"2023-10-06T05:28:14.084124+0000","last_clean":"2023-10-06T05:28:14.084124+0000","last_became_active":"2023-10-06T05:28:14.071182+0000","last_became_peered":"2023-10-06T05:28:14.071182+0000","last_unstale":"2023-10-06T05:28:14.084124+0000","last_undegraded":"2023-10-06T05:28:14.084124+0000","last_fullsized":"2023-10-06T05:28:14.084124+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:14.360341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086760+0000","last_change":"2023-10-06T05:28:13.066659+0000","last_active":"2023-10-06T05:28:14.086760+0000","last_peered":"2023-10-06T05:28:14.086760+0000","last_clean":"2023-10-06T05:28:14.086760+0000","last_became_active":"2023-10-06T05:28:13.066061+0000","last_became_peered":"2023-10-06T05:28:13.066061+0000","last_unstale":"2023-10-06T05:28:14.086760+0000","last_undegraded":"2023-10-06T05:28:14.086760+0000","last_fullsized":"2023-10-06T05:28:14.086760+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:30.733210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.067446+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:28:14.067446+0000","last_peered":"2023-10-06T05:28:14.067446+0000","last_clean":"2023-10-06T05:28:14.067446+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:28:14.067446+0000","last_undegraded":"2023-10-06T05:28:14.067446+0000","last_fullsized":"2023-10-06T05:28:14.067446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.070074+0000","last_change":"2023-10-06T05:28:14.065196+0000","last_active":"2023-10-06T05:28:14.070074+0000","last_peered":"2023-10-06T05:28:14.070074+0000","last_clean":"2023-10-06T05:28:14.070074+0000","last_became_active":"2023-10-06T05:28:14.064324+0000","last_became_peered":"2023-10-06T05:28:14.064324+0000","last_unstale":"2023-10-06T05:28:14.070074+0000","last_undegraded":"2023-10-06T05:28:14.070074+0000","last_fullsized":"2023-10-06T05:28:14.070074+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:06.610537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.087006+0000","last_change":"2023-10-06T05:28:13.071434+0000","last_active":"2023-10-06T05:28:14.087006+0000","last_peered":"2023-10-06T05:28:14.087006+0000","last_clean":"2023-10-06T05:28:14.087006+0000","last_became_active":"2023-10-06T05:28:13.071140+0000","last_became_peered":"2023-10-06T05:28:13.071140+0000","last_unstale":"2023-10-06T05:28:14.087006+0000","last_undegraded":"2023-10-06T05:28:14.087006+0000","last_fullsized":"2023-10-06T05:28:14.087006+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:05.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.069111+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:28:14.069111+0000","last_peered":"2023-10-06T05:28:14.069111+0000","last_clean":"2023-10-06T05:28:14.069111+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:28:14.069111+0000","last_undegraded":"2023-10-06T05:28:14.069111+0000","last_fullsized":"2023-10-06T05:28:14.069111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.086872+0000","last_change":"2023-10-06T05:28:14.080191+0000","last_active":"2023-10-06T05:28:14.086872+0000","last_peered":"2023-10-06T05:28:14.086872+0000","last_clean":"2023-10-06T05:28:14.086872+0000","last_became_active":"2023-10-06T05:28:14.079522+0000","last_became_peered":"2023-10-06T05:28:14.079522+0000","last_unstale":"2023-10-06T05:28:14.086872+0000","last_undegraded":"2023-10-06T05:28:14.086872+0000","last_fullsized":"2023-10-06T05:28:14.086872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:13.030030+0000","last_clean_scrub_stamp":"2023-10-06T05:28:13.030030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.301669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.070922+0000","last_change":"2023-10-06T05:28:13.059510+0000","last_active":"2023-10-06T05:28:14.070922+0000","last_peered":"2023-10-06T05:28:14.070922+0000","last_clean":"2023-10-06T05:28:14.070922+0000","last_became_active":"2023-10-06T05:28:13.059186+0000","last_became_peered":"2023-10-06T05:28:13.059186+0000","last_unstale":"2023-10-06T05:28:14.070922+0000","last_undegraded":"2023-10-06T05:28:14.070922+0000","last_fullsized":"2023-10-06T05:28:14.070922+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:28:12.017113+0000","last_clean_scrub_stamp":"2023-10-06T05:28:12.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:23:54.231009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T05:28:14.061592+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:28:14.061592+0000","last_peered":"2023-10-06T05:28:14.061592+0000","last_clean":"2023-10-06T05:28:14.061592+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:28:14.061592+0000","last_undegraded":"2023-10-06T05:28:14.061592+0000","last_fullsized":"2023-10-06T05:28:14.061592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302708,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069132,"statfs":{"total":96636764160,"available":96326791168,"internally_reserved":0,"allocated":1355776,"data_stored":915747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.84799999999999998,"15min":0.83999999999999997},"min":{"1min":0.64100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.63300000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.86699999999999999,"15min":0.86299999999999999},"min":{"1min":0.59599999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1879999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.873},{"interface":"front","average":{"1min":0.873,"5min":0.89900000000000002,"15min":0.90300000000000002},"min":{"1min":0.53500000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1910000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.143,"5min":1.276,"15min":1.276},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.754}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.0229999999999999,"15min":1.03},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.256,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.95399999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93700000000000006,"15min":0.93300000000000005},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.121,"15min":1.1160000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.2869999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.0049999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.246,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.208,"15min":1.2110000000000001},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.373,"5min":1.385,"15min":1.385},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.139,"15min":1.147},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4299999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1819999999999999,"15min":1.1910000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.349,"5min":1.425,"15min":1.425},"last":1.0920000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298020,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073820,"statfs":{"total":96636764160,"available":96331591680,"internally_reserved":0,"allocated":749568,"data_stored":324665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85099999999999998},"min":{"1min":0.63600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":0.96599999999999997,"15min":0.95199999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.97499999999999998,"15min":0.96499999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.83799999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.84299999999999997,"15min":0.81999999999999995},"min":{"1min":0.70399999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.64900000000000002},{"interface":"front","average":{"1min":1,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57899999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.94199999999999995}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91200000000000003,"15min":0.91700000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.135,"5min":1.079,"15min":1.069},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0309999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.96399999999999997,"15min":0.95999999999999996},"min":{"1min":0.67400000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.0669999999999999,"15min":1.079},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3129999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.996}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0940000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.0629999999999999,"15min":1.0580000000000001},"min":{"1min":0.72999999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.075}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2410000000000001,"5min":1.367,"15min":1.367},"last":0.873},{"interface":"front","average":{"1min":1.119,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.103}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298020,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073820,"statfs":{"total":96636764160,"available":96331591680,"internally_reserved":0,"allocated":749568,"data_stored":324653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.85499999999999998,"15min":0.84699999999999998},"min":{"1min":0.58499999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.93300000000000005,"15min":0.93100000000000005},"min":{"1min":0.58899999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.2470000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.95599999999999996,"15min":0.95099999999999996},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96499999999999997,"15min":0.95799999999999996},"min":{"1min":0.71399999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2210000000000001,"5min":1.54,"15min":1.54},"last":1.2909999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.93300000000000005,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.879,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.48,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3540000000000001}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2509999999999999,"5min":1.419,"15min":1.419},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4670000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.3240000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.109,"15min":1.123},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.397,"5min":1.508,"15min":1.508},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0940000000000001,"15min":1.0980000000000001},"min":{"1min":0.753,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.329,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.151}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.153},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4319999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.24,"15min":1.2490000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.593,"5min":1.732,"15min":1.732},"last":1.4990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073812,"statfs":{"total":96636764160,"available":96331583488,"internally_reserved":0,"allocated":757760,"data_stored":326167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.79400000000000004,"15min":0.77900000000000003},"min":{"1min":0.53100000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.284,"15min":1.284},"last":1.161},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.95899999999999996,"15min":0.96499999999999997},"min":{"1min":0.55700000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2270000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1890000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.101},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.99199999999999999,"15min":1.004},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.147,"5min":1.335,"15min":1.335},"last":1.03}]},{"osd":2,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.72299999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.423,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":0.97599999999999998},"min":{"1min":0.72899999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1919999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.2410000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2490000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.96999999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.2729999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2230000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.046,"15min":1.0469999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3280000000000001,"5min":1.458,"15min":1.458},"last":1.333}]},{"osd":6,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0029999999999999,"15min":1.0009999999999999},"min":{"1min":0.71799999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2010000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.429},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.498,"5min":1.548,"15min":1.548},"last":1.3120000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:27:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1419999999999999,"15min":1.139},"min":{"1min":0.89400000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.3799999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.407},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.125,"15min":1.123},"min":{"1min":0.91700000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.345,"5min":1.415,"15min":1.415},"last":1.3720000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":745472,"data_stored":324631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0389999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.315,"15min":0.315},"max":{"1min":0.997,"5min":1.379,"15min":1.379},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.389,"15min":1.389},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.117,"15min":1.117},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0269999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.85499999999999998,"15min":0.84799999999999998},"min":{"1min":0.65600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3149999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3520000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.117,"15min":1.1259999999999999},"min":{"1min":0.85599999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":1.22}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1220000000000001},"min":{"1min":0.749,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.454,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.325},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.367,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0229999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.079,"15min":1.0820000000000001},"min":{"1min":0.73899999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2969999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.77600000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.462,"5min":1.968,"15min":1.968},"last":1.292}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1579999999999999,"15min":1.159},"min":{"1min":0.85899999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.48,"5min":1.762,"15min":1.762},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.171,"15min":1.175},"min":{"1min":0.79800000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.393,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2669999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":745472,"data_stored":324631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.94199999999999995}]},{"osd":1,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.94099999999999995,"15min":0.94399999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.872,"15min":0.88300000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.629}]},{"osd":3,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.89300000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2110000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.80600000000000005}]},{"osd":4,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.1060000000000001,"15min":1.1359999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3109999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.236,"15min":1.2509999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.6020000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1040000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1919999999999999,"15min":1.206},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.431,"5min":1.829,"15min":1.829},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1850000000000001,"15min":1.1990000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.714,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.01}]},{"osd":6,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2729999999999999,"15min":1.2849999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.171},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.226,"15min":1.2390000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.659,"5min":1.708,"15min":1.708},"last":1.042}]},{"osd":7,"last update":"Fri Oct 6 05:27:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2729999999999999,"15min":1.2889999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.845,"5min":1.972,"15min":1.972},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.371,"15min":1.3899999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":2.04,"15min":2.04},"last":1.2170000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302140,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069700,"statfs":{"total":96636764160,"available":96327372800,"internally_reserved":0,"allocated":774144,"data_stored":326903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.74199999999999999,"15min":0.752},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.75600000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.012,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78900000000000003,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0940000000000001,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.89900000000000002,"15min":0.91600000000000004},"min":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.093,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.0309999999999999,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3200000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.153,"15min":1.171},"min":{"1min":0.83499999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.2829999999999999,"5min":1.899,"15min":1.899},"last":1.091}]},{"osd":5,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1799999999999999,"15min":1.2070000000000001},"min":{"1min":0.752,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3480000000000001,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.218,"15min":1.24},"min":{"1min":0.89200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5720000000000001,"5min":2.02,"15min":2.02},"last":1.23}]},{"osd":6,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4950000000000001,"5min":1.804,"15min":1.804},"last":1.28},{"interface":"front","average":{"1min":1.137,"5min":1.2150000000000001,"15min":1.228},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.415,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.2050000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:27:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.3680000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.2030000000000001,"15min":1.204},"min":{"1min":0.90300000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.147}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302692,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069148,"statfs":{"total":96636764160,"available":96326807552,"internally_reserved":0,"allocated":1339392,"data_stored":914999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95799999999999996,"5min":1.006,"15min":1.006},"last":0.748},{"interface":"front","average":{"1min":0.755,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.876},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.60899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.89400000000000002,"15min":0.89200000000000002},"min":{"1min":0.59499999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1020000000000001,"5min":1.204,"15min":1.204},"last":0.94299999999999995}]},{"osd":4,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.026,"15min":1.0189999999999999},"min":{"1min":0.76200000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.026,"15min":1.024},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.034}]},{"osd":5,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0700000000000001,"15min":1.0620000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1699999999999999,"15min":1.1619999999999999},"min":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2490000000000001,"15min":1.2509999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.004},{"interface":"front","average":{"1min":1.254,"5min":1.226,"15min":1.2210000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Oct 6 05:27:31 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2809999999999999,"15min":1.2789999999999999},"min":{"1min":0.97499999999999998,"5min":0.88,"15min":0.88},"max":{"1min":1.6579999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.25,"15min":1.25},"min":{"1min":1.016,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.6040000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.103}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:28:21.833 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T05:28:21.833 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T05:28:21.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd33b9700 1 Processor -- start 2023-10-06T05:28:21.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd33b9700 1 -- start start 2023-10-06T05:28:21.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd33b9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 0x7fbfcc159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd33b9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbfcc06b810 0x7fbfcc0cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd33b9700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfcc06b380 con 0x7fbfcc158c30 2023-10-06T05:28:21.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd33b9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc06bc70 con 0x7fbfcc06b810 2023-10-06T05:28:21.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd33b9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc06a770 con 0x7fbfcc15d890 2023-10-06T05:28:21.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd1956700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbfcc06b810 0x7fbfcc0cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd1956700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbfcc06b810 0x7fbfcc0cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49024/0 (socket says 172.21.15.29:49024) 2023-10-06T05:28:21.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd1956700 1 -- 172.21.15.29:0/965154041 learned_addr learned my addr 172.21.15.29:0/965154041 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:21.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd0954700 1 --2- 172.21.15.29:0/965154041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 0x7fbfcc159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd1956700 1 -- 172.21.15.29:0/965154041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 msgr2=0x7fbfcc159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:21.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd1956700 1 --2- 172.21.15.29:0/965154041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 0x7fbfcc159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd1956700 1 -- 172.21.15.29:0/965154041 >> v1:172.21.15.173:6789/0 conn(0x7fbfcc158c30 legacy=0x7fbfcc0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd1956700 1 -- 172.21.15.29:0/965154041 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc06aa50 con 0x7fbfcc06b810 2023-10-06T05:28:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfd1956700 1 --2- 172.21.15.29:0/965154041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 0x7fbfcc0cfd60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009f20 tx=0x7fbfc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab23a5ee36397d88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.950+0000 7fbfc3fff700 1 -- 172.21.15.29:0/965154041 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400e070 con 0x7fbfcc06b810 2023-10-06T05:28:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfc3fff700 1 -- 172.21.15.29:0/965154041 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc400ba80 con 0x7fbfcc06b810 2023-10-06T05:28:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfc3fff700 1 -- 172.21.15.29:0/965154041 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40092e0 con 0x7fbfcc06b810 2023-10-06T05:28:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 -- 172.21.15.29:0/965154041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 msgr2=0x7fbfcc0cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 --2- 172.21.15.29:0/965154041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 0x7fbfcc0cfd60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009f20 tx=0x7fbfc4009840 comp rx=0 tx=0).stop 2023-10-06T05:28:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 -- 172.21.15.29:0/965154041 shutdown_connections 2023-10-06T05:28:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 --2- 172.21.15.29:0/965154041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 0x7fbfcc159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 --2- 172.21.15.29:0/965154041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 0x7fbfcc0cfd60 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 -- 172.21.15.29:0/965154041 >> 172.21.15.29:0/965154041 conn(0x7fbfcc0670a0 msgr2=0x7fbfcc0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:21.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 -- 172.21.15.29:0/965154041 shutdown_connections 2023-10-06T05:28:21.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 -- 172.21.15.29:0/965154041 wait complete. 2023-10-06T05:28:21.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 Processor -- start 2023-10-06T05:28:21.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.954+0000 7fbfd33b9700 1 -- start start 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd33b9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 0x7fbfcc15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd33b9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc158c30 0x7fbfcc156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd33b9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 0x7fbfcc157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd33b9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc1691b0 con 0x7fbfcc06b810 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd33b9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0c86d0 con 0x7fbfcc158c30 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd33b9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0c89b0 con 0x7fbfcc15d890 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1155700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 0x7fbfcc15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1155700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 0x7fbfcc15cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49028/0 (socket says 172.21.15.29:49028) 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1155700 1 -- 172.21.15.29:0/633022617 learned_addr learned my addr 172.21.15.29:0/633022617 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:21.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd0954700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc158c30 0x7fbfcc156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1956700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 0x7fbfcc157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1155700 1 -- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 msgr2=0x7fbfcc157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1155700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 0x7fbfcc157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1155700 1 -- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc158c30 msgr2=0x7fbfcc156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1155700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc158c30 0x7fbfcc156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1155700 1 -- 172.21.15.29:0/633022617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4009ae0 con 0x7fbfcc06b810 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd1155700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 0x7fbfcc15cde0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c590 tx=0x7fbfbc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfc17fa700 1 -- 172.21.15.29:0/633022617 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc011590 con 0x7fbfcc06b810 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfc17fa700 1 -- 172.21.15.29:0/633022617 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc011710 con 0x7fbfcc06b810 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfc17fa700 1 -- 172.21.15.29:0/633022617 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc011ad0 con 0x7fbfcc06b810 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfcc0c8c90 con 0x7fbfcc06b810 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc15d320 con 0x7fbfcc06b810 2023-10-06T05:28:21.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.958+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfcc071120 con 0x7fbfcc06b810 2023-10-06T05:28:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.962+0000 7fbfc17fa700 1 -- 172.21.15.29:0/633022617 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbfbc01b3b0 con 0x7fbfcc06b810 2023-10-06T05:28:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.962+0000 7fbfc17fa700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.962+0000 7fbfc17fa700 1 -- 172.21.15.29:0/633022617 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fbfbc07bf20 con 0x7fbfcc06b810 2023-10-06T05:28:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.962+0000 7fbfd0954700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:21.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.962+0000 7fbfd0954700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0b5260 tx=0x7fbfc8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:21.970+0000 7fbfc17fa700 1 -- 172.21.15.29:0/633022617 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbfbc04c280 con 0x7fbfcc06b810 2023-10-06T05:28:22.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.194+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbfcc06ad30 con 0x7fbfcc06b810 2023-10-06T05:28:22.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.202+0000 7fbfc17fa700 1 -- 172.21.15.29:0/633022617 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbfbc0170e0 con 0x7fbfcc06b810 2023-10-06T05:28:22.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 msgr2=0x7fbfb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:22.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0b5260 tx=0x7fbfc8008040 comp rx=0 tx=0).stop 2023-10-06T05:28:22.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 msgr2=0x7fbfcc15cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:22.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 0x7fbfcc15cde0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c590 tx=0x7fbfbc00c8a0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 shutdown_connections 2023-10-06T05:28:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfcc15d890 0x7fbfcc157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbfb0060550 0x7fbfb0062a00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc158c30 0x7fbfcc156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 --2- 172.21.15.29:0/633022617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfcc06b810 0x7fbfcc15cde0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 >> 172.21.15.29:0/633022617 conn(0x7fbfcc0670a0 msgr2=0x7fbfcc06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 shutdown_connections 2023-10-06T05:28:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.206+0000 7fbfd33b9700 1 -- 172.21.15.29:0/633022617 wait complete. 2023-10-06T05:28:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2023-10-06T05:28:22.231 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:28:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.330+0000 7f7fcb59e700 1 Processor -- start 2023-10-06T05:28:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.330+0000 7f7fcb59e700 1 -- start start 2023-10-06T05:28:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.330+0000 7f7fcb59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc159fe0 0x7f7fcc06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.330+0000 7f7fcb59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0cee50 con 0x7f7fcc158c00 2023-10-06T05:28:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fcb59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc06b250 con 0x7f7fcc0cfb60 2023-10-06T05:28:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fcb59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc15a430 con 0x7f7fcc159fe0 2023-10-06T05:28:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fca59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7fcc158c00 0x7f7fcc0ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59396/0 (socket says 172.21.15.29:59396) 2023-10-06T05:28:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fca59c700 1 -- 172.21.15.29:0/3582284638 learned_addr learned my addr 172.21.15.29:0/3582284638 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc3fff700 1 --2- 172.21.15.29:0/3582284638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc159fe0 0x7f7fcc06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:22.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc9d9b700 1 -- 172.21.15.29:0/3582284638 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194372583 0 0) 0x7f7fbc001110 con 0x7f7fcc158c00 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc9d9b700 1 -- 172.21.15.29:0/3582284638 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb8003570 con 0x7f7fcc158c00 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc9d9b700 1 -- 172.21.15.29:0/3582284638 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884308739 0 0) 0x7f7fcc06b250 con 0x7f7fcc0cfb60 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc9d9b700 1 -- 172.21.15.29:0/3582284638 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fbc001110 con 0x7f7fcc0cfb60 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc3fff700 1 -- 172.21.15.29:0/3582284638 >> v1:172.21.15.173:6789/0 conn(0x7f7fcc0cfb60 legacy=0x7f7fcc0cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc9d9b700 1 -- 172.21.15.29:0/3582284638 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1525580118 0 0) 0x7f7fb8003570 con 0x7f7fcc158c00 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc3fff700 1 -- 172.21.15.29:0/3582284638 >> v1:172.21.15.29:6789/0 conn(0x7f7fcc158c00 legacy=0x7f7fcc0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc3fff700 1 -- 172.21.15.29:0/3582284638 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc06a640 con 0x7f7fcc159fe0 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc3fff700 1 --2- 172.21.15.29:0/3582284638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc159fe0 0x7f7fcc06b6e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009940 tx=0x7f7fb40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=345813b6b38d10e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc9d9b700 1 -- 172.21.15.29:0/3582284638 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc001600 con 0x7f7fcc159fe0 2023-10-06T05:28:22.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc9d9b700 1 -- 172.21.15.29:0/3582284638 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4011420 con 0x7f7fcc159fe0 2023-10-06T05:28:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fc9d9b700 1 -- 172.21.15.29:0/3582284638 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40117c0 con 0x7f7fcc159fe0 2023-10-06T05:28:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fcb59e700 1 -- 172.21.15.29:0/3582284638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc159fe0 msgr2=0x7f7fcc06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fcb59e700 1 --2- 172.21.15.29:0/3582284638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc159fe0 0x7f7fcc06b6e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009940 tx=0x7f7fb40091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fcb59e700 1 -- 172.21.15.29:0/3582284638 shutdown_connections 2023-10-06T05:28:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fcb59e700 1 --2- 172.21.15.29:0/3582284638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc159fe0 0x7f7fcc06b6e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fcb59e700 1 -- 172.21.15.29:0/3582284638 >> 172.21.15.29:0/3582284638 conn(0x7f7fcc0670a0 msgr2=0x7f7fcc067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fcb59e700 1 -- 172.21.15.29:0/3582284638 shutdown_connections 2023-10-06T05:28:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.334+0000 7f7fcb59e700 1 -- 172.21.15.29:0/3582284638 wait complete. 2023-10-06T05:28:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcb59e700 1 Processor -- start 2023-10-06T05:28:22.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcb59e700 1 -- start start 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcb59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc0cfb60 0x7f7fcc149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcb59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fcc158c00 0x7f7fcc152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcb59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc159fe0 0x7f7fcc153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcb59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0b5470 con 0x7f7fcc159fe0 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcb59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0b43d0 con 0x7f7fcc158c00 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcb59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0b46b0 con 0x7f7fcc0cfb60 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc159fe0 0x7f7fcc153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fca59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc0cfb60 0x7f7fcc149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc159fe0 0x7f7fcc153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49032/0 (socket says 172.21.15.29:49032) 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcad9d700 1 -- 172.21.15.29:0/49486841 learned_addr learned my addr 172.21.15.29:0/49486841 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:22.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fc3fff700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fcc158c00 0x7f7fcc152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcad9d700 1 -- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc0cfb60 msgr2=0x7f7fcc149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcad9d700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc0cfb60 0x7f7fcc149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcad9d700 1 -- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fcc158c00 msgr2=0x7f7fcc152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcad9d700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fcc158c00 0x7f7fcc152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.338+0000 7f7fcad9d700 1 -- 172.21.15.29:0/49486841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4009420 con 0x7f7fcc159fe0 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.342+0000 7f7fcad9d700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc159fe0 0x7f7fcc153200 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400c910 tx=0x7f7fc40027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.342+0000 7f7fc27fc700 1 -- 172.21.15.29:0/49486841 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4012630 con 0x7f7fcc159fe0 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.342+0000 7f7fc27fc700 1 -- 172.21.15.29:0/49486841 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc40127b0 con 0x7f7fcc159fe0 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.342+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc0b4990 con 0x7f7fcc159fe0 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.342+0000 7f7fc27fc700 1 -- 172.21.15.29:0/49486841 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4012b70 con 0x7f7fcc159fe0 2023-10-06T05:28:22.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.342+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc0b4f50 con 0x7f7fcc159fe0 2023-10-06T05:28:22.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.342+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc0b5170 con 0x7f7fcc159fe0 2023-10-06T05:28:22.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.346+0000 7f7fc27fc700 1 -- 172.21.15.29:0/49486841 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7fc401b400 con 0x7f7fcc159fe0 2023-10-06T05:28:22.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.346+0000 7f7fc27fc700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fac060580 0x7f7fac062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:22.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.346+0000 7f7fc27fc700 1 -- 172.21.15.29:0/49486841 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f7fc407cc90 con 0x7f7fcc159fe0 2023-10-06T05:28:22.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.346+0000 7f7fca59c700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fac060580 0x7f7fac062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:22.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.346+0000 7f7fca59c700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fac060580 0x7f7fac062a30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc001370 tx=0x7f7fbc0010a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:22.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.354+0000 7f7fc27fc700 1 -- 172.21.15.29:0/49486841 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7fc404d090 con 0x7f7fcc159fe0 2023-10-06T05:28:22.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.554+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fcc04be00 con 0x7f7fcc159fe0 2023-10-06T05:28:22.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.554+0000 7f7fc27fc700 1 -- 172.21.15.29:0/49486841 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f7fc4016090 con 0x7f7fcc159fe0 2023-10-06T05:28:22.563 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:22.563 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:28:16.079422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5901":{"gid":5901,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1584172634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1584172634},{"type":"v1","addr":"172.21.15.29:6835","nonce":1584172634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:28:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fac060580 msgr2=0x7f7fac062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fac060580 0x7f7fac062a30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc001370 tx=0x7f7fbc0010a0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc159fe0 msgr2=0x7f7fcc153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc159fe0 0x7f7fcc153200 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400c910 tx=0x7f7fc40027a0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 shutdown_connections 2023-10-06T05:28:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc159fe0 0x7f7fcc153200 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fac060580 0x7f7fac062a30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fcc158c00 0x7f7fcc152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 --2- 172.21.15.29:0/49486841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fcc0cfb60 0x7f7fcc149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 >> 172.21.15.29:0/49486841 conn(0x7f7fcc0670a0 msgr2=0x7f7fcc14a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 shutdown_connections 2023-10-06T05:28:22.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:22.558+0000 7f7fcb59e700 1 -- 172.21.15.29:0/49486841 wait complete. 2023-10-06T05:28:22.568 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2023-10-06T05:28:22.980 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:28:13.425370+0000', 'modified': '2023-10-06T05:28:16.079422+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5901}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5901': {'gid': 5901, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/1584172634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 1584172634}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 1584172634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:28:22.980 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T05:28:22.980 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T05:28:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.094+0000 7fc59f59e700 1 Processor -- start 2023-10-06T05:28:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.094+0000 7fc59f59e700 1 -- start start 2023-10-06T05:28:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc5a00abd00 0x7fc5a0161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a006b310 0x7fc5a006b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a0160d40 con 0x7fc5a00ac0d0 2023-10-06T05:28:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a0161cd0 con 0x7fc5a00abd00 2023-10-06T05:28:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a0161300 con 0x7fc5a006b310 2023-10-06T05:28:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59e59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc5a00abd00 0x7fc5a0161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59e59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc5a00abd00 0x7fc5a0161790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49048/0 (socket says 172.21.15.29:49048) 2023-10-06T05:28:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59e59c700 1 -- 172.21.15.29:0/3073408391 learned_addr learned my addr 172.21.15.29:0/3073408391 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/3073408391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a006b310 0x7fc5a006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59e59c700 1 -- 172.21.15.29:0/3073408391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a006b310 msgr2=0x7fc5a006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59e59c700 1 --2- 172.21.15.29:0/3073408391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a006b310 0x7fc5a006b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59e59c700 1 -- 172.21.15.29:0/3073408391 >> v1:172.21.15.173:6789/0 conn(0x7fc5a00ac0d0 legacy=0x7fc5a006c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59e59c700 1 -- 172.21.15.29:0/3073408391 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a006bca0 con 0x7fc5a00abd00 2023-10-06T05:28:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59e59c700 1 --2- 172.21.15.29:0/3073408391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a00abd00 0x7fc5a0161790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc5900099b0 tx=0x7fc590009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5a8b2e1168dcf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59dd9b700 1 -- 172.21.15.29:0/3073408391 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590009ea0 con 0x7fc5a00abd00 2023-10-06T05:28:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59dd9b700 1 -- 172.21.15.29:0/3073408391 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59000b860 con 0x7fc5a00abd00 2023-10-06T05:28:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59dd9b700 1 -- 172.21.15.29:0/3073408391 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000bc00 con 0x7fc5a00abd00 2023-10-06T05:28:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 -- 172.21.15.29:0/3073408391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a00abd00 msgr2=0x7fc5a0161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 --2- 172.21.15.29:0/3073408391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a00abd00 0x7fc5a0161790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc5900099b0 tx=0x7fc590009250 comp rx=0 tx=0).stop 2023-10-06T05:28:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 -- 172.21.15.29:0/3073408391 shutdown_connections 2023-10-06T05:28:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 --2- 172.21.15.29:0/3073408391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a006b310 0x7fc5a006b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 --2- 172.21.15.29:0/3073408391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a00abd00 0x7fc5a0161790 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 -- 172.21.15.29:0/3073408391 >> 172.21.15.29:0/3073408391 conn(0x7fc5a00c9540 msgr2=0x7fc5a00c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 -- 172.21.15.29:0/3073408391 shutdown_connections 2023-10-06T05:28:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.098+0000 7fc59f59e700 1 -- 172.21.15.29:0/3073408391 wait complete. 2023-10-06T05:28:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59f59e700 1 Processor -- start 2023-10-06T05:28:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59f59e700 1 -- start start 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a006b310 0x7fc5a00b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a00ac0d0 0x7fc5a00c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59f59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5a00af880 0x7fc5a00ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00c1cf0 con 0x7fc5a006b310 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59f59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00b0b50 con 0x7fc5a00af880 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00b0e30 con 0x7fc5a00ac0d0 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a006b310 0x7fc5a00b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a006b310 0x7fc5a00b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49050/0 (socket says 172.21.15.29:49050) 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59e59c700 1 -- 172.21.15.29:0/540430793 learned_addr learned my addr 172.21.15.29:0/540430793 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:23.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc597fff700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a00ac0d0 0x7fc5a00c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5a00af880 0x7fc5a00ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59e59c700 1 -- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a00ac0d0 msgr2=0x7fc5a00c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59e59c700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a00ac0d0 0x7fc5a00c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59e59c700 1 -- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5a00af880 msgr2=0x7fc5a00ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59e59c700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5a00af880 0x7fc5a00ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59e59c700 1 -- 172.21.15.29:0/540430793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900094f0 con 0x7fc5a006b310 2023-10-06T05:28:23.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5a00af880 0x7fc5a00ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:23.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59e59c700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a006b310 0x7fc5a00b0300 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00cc7a0 tx=0x7fc590017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc5967fc700 1 -- 172.21.15.29:0/540430793 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000bbe0 con 0x7fc5a006b310 2023-10-06T05:28:23.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc5967fc700 1 -- 172.21.15.29:0/540430793 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590000cc0 con 0x7fc5a006b310 2023-10-06T05:28:23.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.102+0000 7fc59f59e700 1 -- 172.21.15.29:0/540430793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a00c16a0 con 0x7fc5a006b310 2023-10-06T05:28:23.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.106+0000 7fc5967fc700 1 -- 172.21.15.29:0/540430793 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590011650 con 0x7fc5a006b310 2023-10-06T05:28:23.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.106+0000 7fc59f59e700 1 -- 172.21.15.29:0/540430793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a00b0840 con 0x7fc5a006b310 2023-10-06T05:28:23.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.106+0000 7fc5967fc700 1 -- 172.21.15.29:0/540430793 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc590011a80 con 0x7fc5a006b310 2023-10-06T05:28:23.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.106+0000 7fc5967fc700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc584060580 0x7fc584062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.106+0000 7fc5967fc700 1 -- 172.21.15.29:0/540430793 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fc59007e210 con 0x7fc5a006b310 2023-10-06T05:28:23.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.106+0000 7fc597fff700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc584060580 0x7fc584062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc597fff700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc584060580 0x7fc584062a30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00c3550 tx=0x7fc588007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc5a6ab0740 1 Processor -- start 2023-10-06T05:28:23.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc5a6ab0740 1 -- start start 2023-10-06T05:28:23.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2710ae0 0x298d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x298db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x275b790 0x298e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x28bbf30 con 0x275b790 2023-10-06T05:28:23.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x28b7ed0 con 0x2710ae0 2023-10-06T05:28:23.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x287e0b0 con 0x2710710 2023-10-06T05:28:23.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2710ae0 0x298d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc59ed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x275b790 0x298e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc597fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x298db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc59ed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x275b790 0x298e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49064/0 (socket says 172.21.15.29:49064) 2023-10-06T05:28:23.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2710ae0 0x298d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:51008/0 (socket says 172.21.15.29:51008) 2023-10-06T05:28:23.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc59ed9d700 1 -- 172.21.15.29:0/2720691305 learned_addr learned my addr 172.21.15.29:0/2720691305 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:23.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc59ed9d700 1 -- 172.21.15.29:0/2720691305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 msgr2=0x298db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/2720691305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x298db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc59ed9d700 1 -- 172.21.15.29:0/2720691305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2710ae0 msgr2=0x298d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.110+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/2720691305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2710ae0 0x298d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc59ed9d700 1 -- 172.21.15.29:0/2720691305 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x275c9e0 con 0x275b790 2023-10-06T05:28:23.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc597fff700 1 --2- 172.21.15.29:0/2720691305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x298db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:23.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc59e59c700 1 --2- 172.21.15.29:0/2720691305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2710ae0 0x298d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:23.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/2720691305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x275b790 0x298e0b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc598007610 tx=0x7fc59800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24406f7c73ad97f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc58f7fe700 1 -- 172.21.15.29:0/2720691305 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59800e030 con 0x275b790 2023-10-06T05:28:23.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc58f7fe700 1 -- 172.21.15.29:0/2720691305 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598009db0 con 0x275b790 2023-10-06T05:28:23.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc58f7fe700 1 -- 172.21.15.29:0/2720691305 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598015830 con 0x275b790 2023-10-06T05:28:23.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2720691305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x275b790 msgr2=0x298e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/2720691305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x275b790 0x298e0b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc598007610 tx=0x7fc59800b040 comp rx=0 tx=0).stop 2023-10-06T05:28:23.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2720691305 shutdown_connections 2023-10-06T05:28:23.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/2720691305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x275b790 0x298e0b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/2720691305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x298db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/2720691305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2710ae0 0x298d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2720691305 >> 172.21.15.29:0/2720691305 conn(0x2710eb0 msgr2=0x294a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:23.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2720691305 shutdown_connections 2023-10-06T05:28:23.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2720691305 wait complete. 2023-10-06T05:28:23.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 -- start start 2023-10-06T05:28:23.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.114+0000 7fc5a6ab0740 1 Processor -- start 2023-10-06T05:28:23.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x2991c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2992180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x2947c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x287dd50 con 0x2710ae0 2023-10-06T05:28:23.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2856970 con 0x275b790 2023-10-06T05:28:23.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x26e7060 con 0x2710710 2023-10-06T05:28:23.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 10 client.0 _ll_register_callbacks cb 0x285ab80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:28:23.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc597fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2992180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc597fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2992180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49072/0 (socket says 172.21.15.29:49072) 2023-10-06T05:28:23.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc597fff700 1 -- 172.21.15.29:0/3059414603 learned_addr learned my addr 172.21.15.29:0/3059414603 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:23.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x2947c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc59e59c700 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x2991c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc597fff700 1 -- 172.21.15.29:0/3059414603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 msgr2=0x2991c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc597fff700 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x2991c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc597fff700 1 -- 172.21.15.29:0/3059414603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 msgr2=0x2947c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc597fff700 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x2947c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc597fff700 1 -- 172.21.15.29:0/3059414603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a0160d40 con 0x2710ae0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc597fff700 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2992180 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc588014800 tx=0x7fc588015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6b4e59541d2549 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc58cff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc58cff9700 1 -- 172.21.15.29:0/3059414603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588021400 con 0x2710ae0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc58cff9700 1 -- 172.21.15.29:0/3059414603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fc58801c040 con 0x2710ae0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/3059414603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2856cc0 con 0x2710ae0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc58cff9700 1 -- 172.21.15.29:0/3059414603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc588021770 con 0x2710ae0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 10 client.6066 fetch_fsmap learned FSMap version 27 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/3059414603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x7fc5a00b0840 con 0x2710ae0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc58cff9700 1 -- 172.21.15.29:0/3059414603 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2856cc0 con 0x2710ae0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc58cff9700 1 -- 172.21.15.29:0/3059414603 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc5880218d0 con 0x2710ae0 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 10 client.6066 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T05:28:23.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 10 client.6066 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:28:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 20 client.6066 populate_metadata read hostname 'smithi029' 2023-10-06T05:28:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x29491d0 0x299cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 4 client.6066 mds_command: new command op to 5901 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:28:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.118+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/3059414603 --> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x285a3e0 con 0x29491d0 2023-10-06T05:28:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc59e59c700 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x29491d0 0x299cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc59e59c700 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x29491d0 0x299cde0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71b6abdbd8c0fe7b server_cookie=bc0ab6f3d6ba8c9b in_seq=0 out_seq=0 2023-10-06T05:28:23.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc58cff9700 10 client.6066 ms_handle_connect on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc58cff9700 1 -- 172.21.15.29:0/3059414603 <== mds.0 v2:172.21.15.29:6834/1584172634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x285a3e0 con 0x29491d0 2023-10-06T05:28:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc58cff9700 10 client.6066 handle_command_reply: tid=0 2023-10-06T05:28:23.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 client.6066 shutdown 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/3059414603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 msgr2=0x2992180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2992180 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc588014800 tx=0x7fc588015000 comp rx=0 tx=0).stop 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/3059414603 shutdown_connections 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x29491d0 0x299cde0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x2947c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc58cff9700 0 client.6066 ms_handle_reset on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2992180 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/3059414603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x2991c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/3059414603 >> 172.21.15.29:0/3059414603 conn(0x2710eb0 msgr2=0x29711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/3059414603 shutdown_connections 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/3059414603 wait complete. 2023-10-06T05:28:23.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.122+0000 7fc5a6ab0740 20 client.6066 trim_cache size 0 max 16384 2023-10-06T05:28:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc5a6ab0740 1 Processor -- start 2023-10-06T05:28:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc5a6ab0740 1 -- start start 2023-10-06T05:28:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29426b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2942bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x296ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x27897c0 con 0x2710ae0 2023-10-06T05:28:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2880920 con 0x275b790 2023-10-06T05:28:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x28be400 con 0x2710710 2023-10-06T05:28:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc597fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2942bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc597fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2942bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49086/0 (socket says 172.21.15.29:49086) 2023-10-06T05:28:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc597fff700 1 -- 172.21.15.29:0/2731494939 learned_addr learned my addr 172.21.15.29:0/2731494939 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc59e59c700 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.142+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x296ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc597fff700 1 -- 172.21.15.29:0/2731494939 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 msgr2=0x29426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc597fff700 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc597fff700 1 -- 172.21.15.29:0/2731494939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 msgr2=0x296ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc597fff700 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x296ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc597fff700 1 -- 172.21.15.29:0/2731494939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00cd340 con 0x2710ae0 2023-10-06T05:28:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x296ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc597fff700 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2942bf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc588002c10 tx=0x7fc588022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead73d2f868ac141 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc58ffff700 1 -- 172.21.15.29:0/2731494939 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588002e50 con 0x2710ae0 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc58ffff700 1 -- 172.21.15.29:0/2731494939 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588014bc0 con 0x2710ae0 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc58ffff700 1 -- 172.21.15.29:0/2731494939 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58802a3f0 con 0x2710ae0 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2731494939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 msgr2=0x2942bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2942bf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc588002c10 tx=0x7fc588022000 comp rx=0 tx=0).stop 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2731494939 shutdown_connections 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x296ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x2942bf0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/2731494939 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2731494939 >> 172.21.15.29:0/2731494939 conn(0x2710eb0 msgr2=0x2990650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2731494939 shutdown_connections 2023-10-06T05:28:23.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/2731494939 wait complete. 2023-10-06T05:28:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 -- start start 2023-10-06T05:28:23.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 Processor -- start 2023-10-06T05:28:23.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x299bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x299c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x28be290 con 0x2710ae0 2023-10-06T05:28:23.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x28bc810 con 0x275b790 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2998390 con 0x2710710 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc5a6ab0740 10 client.0 _ll_register_callbacks cb 0x2883110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc597fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x299bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29e6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:43076/0 (socket says 172.21.15.29:43076) 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc59e59c700 1 -- 172.21.15.29:0/4130825894 learned_addr learned my addr 172.21.15.29:0/4130825894 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.146+0000 7fc59ed9d700 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x299c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc59e59c700 1 -- 172.21.15.29:0/4130825894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 msgr2=0x299c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc59e59c700 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x299c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc59e59c700 1 -- 172.21.15.29:0/4130825894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 msgr2=0x299bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc59e59c700 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x299bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc59e59c700 1 -- 172.21.15.29:0/4130825894 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a00b0840 con 0x2710710 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc59e59c700 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29e6a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5900521c0 tx=0x7fc59001e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ccf1afa8eacff3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 10 client.0 ms_handle_connect on v2:172.21.15.173:3301/0 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 1 -- 172.21.15.29:0/4130825894 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590059210 con 0x2710710 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 1 -- 172.21.15.29:0/4130825894 <== mon.2 v2:172.21.15.173:3301/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fc59006b070 con 0x2710710 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/4130825894 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc598009db0 con 0x2710710 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 1 -- 172.21.15.29:0/4130825894 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc590011d30 con 0x2710710 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 10 client.5519 fetch_fsmap learned FSMap version 27 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/4130825894 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x7fc598007340 con 0x2710710 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 1 -- 172.21.15.29:0/4130825894 <== mon.2 v2:172.21.15.173:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598009db0 con 0x2710710 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 1 -- 172.21.15.29:0/4130825894 <== mon.2 v2:172.21.15.173:3301/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc59006c280 con 0x2710710 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 10 client.5519 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T05:28:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 10 client.5519 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:28:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 20 client.5519 populate_metadata read hostname 'smithi029' 2023-10-06T05:28:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x29ee0c0 0x29f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 4 client.5519 mds_command: new command op to 5901 tid=0[{"prefix": "status"}] 2023-10-06T05:28:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/4130825894 --> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] -- command(tid 0: {"prefix": "status"}) v1 -- 0x288c410 con 0x29ee0c0 2023-10-06T05:28:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc597fff700 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x29ee0c0 0x29f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc597fff700 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x29ee0c0 0x29f04a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f09c42c586370e server_cookie=86389c13c43d6d5b in_seq=0 out_seq=0 2023-10-06T05:28:23.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 10 client.5519 ms_handle_connect on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:23.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 1 -- 172.21.15.29:0/4130825894 <== mds.0 v2:172.21.15.29:6834/1584172634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x288c410 con 0x29ee0c0 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 10 client.5519 handle_command_reply: tid=0 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 client.5519 shutdown 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/4130825894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 msgr2=0x29e6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29e6a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5900521c0 tx=0x7fc59001e040 comp rx=0 tx=0).stop 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/4130825894 shutdown_connections 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x29ee0c0 0x29f04a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x275b790 0x299c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2710ae0 0x299bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 --2- 172.21.15.29:0/4130825894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2710710 0x29e6a40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc58cff9700 0 client.5519 ms_handle_reset on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.150+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/4130825894 >> 172.21.15.29:0/4130825894 conn(0x2710eb0 msgr2=0x29495a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:23.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/4130825894 shutdown_connections 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc5a6ab0740 1 -- 172.21.15.29:0/4130825894 wait complete. 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc5a6ab0740 20 client.5519 trim_cache size 0 max 16384 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "bd99696d-d9bf-47c8-93f5-f978334ae590", 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5901, 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-06T05:28:23.164 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 9.1118496990000004, 2023-10-06T05:28:23.165 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2023-10-06T05:28:23.165 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 64, 2023-10-06T05:28:23.165 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 62, 2023-10-06T05:28:23.165 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 15.339900822000001 2023-10-06T05:28:23.165 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 -- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc584060580 msgr2=0x7fc584062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc584060580 0x7fc584062a30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00c3550 tx=0x7fc588007ec0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 -- 172.21.15.29:0/540430793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a006b310 msgr2=0x7fc5a00b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a006b310 0x7fc5a00b0300 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00cc7a0 tx=0x7fc590017000 comp rx=0 tx=0).stop 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 -- 172.21.15.29:0/540430793 shutdown_connections 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc584060580 0x7fc584062a30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5a00af880 0x7fc5a00ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5a00ac0d0 0x7fc5a00c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 --2- 172.21.15.29:0/540430793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5a006b310 0x7fc5a00b0300 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 -- 172.21.15.29:0/540430793 >> 172.21.15.29:0/540430793 conn(0x7fc5a00c9540 msgr2=0x7fc5a015c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:23.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 -- 172.21.15.29:0/540430793 shutdown_connections 2023-10-06T05:28:23.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.154+0000 7fc59f59e700 1 -- 172.21.15.29:0/540430793 wait complete. 2023-10-06T05:28:23.178 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:28:23.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.282+0000 7f115cf8a700 1 Processor -- start 2023-10-06T05:28:23.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.282+0000 7f115cf8a700 1 -- start start 2023-10-06T05:28:23.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.282+0000 7f115cf8a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11581556a0 0x7f1158155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.282+0000 7f115cf8a700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1158156fa0 0x7f115806b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.282+0000 7f115cf8a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11581566c0 con 0x7f1158156b50 2023-10-06T05:28:23.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11581599c0 con 0x7f11581556a0 2023-10-06T05:28:23.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11580c7b40 con 0x7f1158156fa0 2023-10-06T05:28:23.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f1156ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1158156b50 0x7f11580c6ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59398/0 (socket says 172.21.15.29:59398) 2023-10-06T05:28:23.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f1156ffd700 1 -- 172.21.15.29:0/3740450539 learned_addr learned my addr 172.21.15.29:0/3740450539 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:23.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11577fe700 1 --2- 172.21.15.29:0/3740450539 >> v2:172.21.15.29:3300/0 conn(0x7f11581556a0 0x7f1158155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f1157fff700 1 --2- 172.21.15.29:0/3740450539 >> v2:172.21.15.173:3300/0 conn(0x7f1158156fa0 0x7f115806b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11567fc700 1 -- 172.21.15.29:0/3740450539 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369367212 0 0) 0x7f11581566c0 con 0x7f1158156b50 2023-10-06T05:28:23.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11567fc700 1 -- 172.21.15.29:0/3740450539 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1140003570 con 0x7f1158156b50 2023-10-06T05:28:23.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11577fe700 1 -- 172.21.15.29:0/3740450539 >> v2:172.21.15.173:3300/0 conn(0x7f1158156fa0 msgr2=0x7f115806b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:23.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11577fe700 1 --2- 172.21.15.29:0/3740450539 >> v2:172.21.15.173:3300/0 conn(0x7f1158156fa0 0x7f115806b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11577fe700 1 -- 172.21.15.29:0/3740450539 >> v1:172.21.15.29:6789/0 conn(0x7f1158156b50 legacy=0x7f11580c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11577fe700 1 -- 172.21.15.29:0/3740450539 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11580c7e20 con 0x7f11581556a0 2023-10-06T05:28:23.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11577fe700 1 --2- 172.21.15.29:0/3740450539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11581556a0 0x7f1158155a70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f115806b490 tx=0x7f114c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9c21e7e87eea82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11567fc700 1 -- 172.21.15.29:0/3740450539 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c011630 con 0x7f11581556a0 2023-10-06T05:28:23.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11567fc700 1 -- 172.21.15.29:0/3740450539 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c0117b0 con 0x7f11581556a0 2023-10-06T05:28:23.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f11567fc700 1 -- 172.21.15.29:0/3740450539 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c011b70 con 0x7f11581556a0 2023-10-06T05:28:23.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 -- 172.21.15.29:0/3740450539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11581556a0 msgr2=0x7f1158155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 --2- 172.21.15.29:0/3740450539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11581556a0 0x7f1158155a70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f115806b490 tx=0x7f114c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 -- 172.21.15.29:0/3740450539 shutdown_connections 2023-10-06T05:28:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 --2- 172.21.15.29:0/3740450539 >> v2:172.21.15.173:3300/0 conn(0x7f1158156fa0 0x7f115806b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 --2- 172.21.15.29:0/3740450539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11581556a0 0x7f1158155a70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 -- 172.21.15.29:0/3740450539 >> 172.21.15.29:0/3740450539 conn(0x7f115806d7d0 msgr2=0x7f115806dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 -- 172.21.15.29:0/3740450539 shutdown_connections 2023-10-06T05:28:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.286+0000 7f115cf8a700 1 -- 172.21.15.29:0/3740450539 wait complete. 2023-10-06T05:28:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 Processor -- start 2023-10-06T05:28:23.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 -- start start 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11581556a0 0x7f11580c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158156b50 0x7f115814d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1158156fa0 0x7f11580cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11580c4340 con 0x7f1158156fa0 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11580cc1f0 con 0x7f1158156b50 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11580cb8c0 con 0x7f11581556a0 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1157fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1158156fa0 0x7f11580cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1157fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1158156fa0 0x7f11580cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49114/0 (socket says 172.21.15.29:49114) 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1157fff700 1 -- 172.21.15.29:0/2895625658 learned_addr learned my addr 172.21.15.29:0/2895625658 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1156ffd700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158156b50 0x7f115814d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f11577fe700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11581556a0 0x7f11580c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1157fff700 1 -- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11581556a0 msgr2=0x7f11580c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1157fff700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11581556a0 0x7f11580c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1157fff700 1 -- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158156b50 msgr2=0x7f115814d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1157fff700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158156b50 0x7f115814d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1157fff700 1 -- 172.21.15.29:0/2895625658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c009420 con 0x7f1158156fa0 2023-10-06T05:28:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f11577fe700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11581556a0 0x7f11580c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:28:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1156ffd700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158156b50 0x7f115814d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:28:23.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f1157fff700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1158156fa0 0x7f11580cc680 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f115000ea50 tx=0x7f11500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f113f7fe700 1 -- 172.21.15.29:0/2895625658 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000c920 con 0x7f1158156fa0 2023-10-06T05:28:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f113f7fe700 1 -- 172.21.15.29:0/2895625658 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115000caa0 con 0x7f1158156fa0 2023-10-06T05:28:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f113f7fe700 1 -- 172.21.15.29:0/2895625658 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000ce60 con 0x7f1158156fa0 2023-10-06T05:28:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11580cbba0 con 0x7f1158156fa0 2023-10-06T05:28:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.290+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11580c09f0 con 0x7f1158156fa0 2023-10-06T05:28:23.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.294+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11580cc3a0 con 0x7f1158156fa0 2023-10-06T05:28:23.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.294+0000 7f113f7fe700 1 -- 172.21.15.29:0/2895625658 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1150013680 con 0x7f1158156fa0 2023-10-06T05:28:23.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.294+0000 7f113f7fe700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1144060550 0x7f1144062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:23.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.294+0000 7f113f7fe700 1 -- 172.21.15.29:0/2895625658 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f115007ceb0 con 0x7f1158156fa0 2023-10-06T05:28:23.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.294+0000 7f11577fe700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1144060550 0x7f1144062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:23.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.294+0000 7f11577fe700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1144060550 0x7f1144062a00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f115806b490 tx=0x7f114c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:23.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.302+0000 7f113f7fe700 1 -- 172.21.15.29:0/2895625658 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f11580cc3a0 con 0x7f1158156fa0 2023-10-06T05:28:23.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.498+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11580cc360 con 0x7f1158156fa0 2023-10-06T05:28:23.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.498+0000 7f113f7fe700 1 -- 172.21.15.29:0/2895625658 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1150050ca0 con 0x7f1158156fa0 2023-10-06T05:28:23.507 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:28:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1144060550 msgr2=0x7f1144062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1144060550 0x7f1144062a00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f115806b490 tx=0x7f114c017000 comp rx=0 tx=0).stop 2023-10-06T05:28:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1158156fa0 msgr2=0x7f11580cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1158156fa0 0x7f11580cc680 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f115000ea50 tx=0x7f11500091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 shutdown_connections 2023-10-06T05:28:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1158156fa0 0x7f11580cc680 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1144060550 0x7f1144062a00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158156b50 0x7f115814d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 --2- 172.21.15.29:0/2895625658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11581556a0 0x7f11580c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 >> 172.21.15.29:0/2895625658 conn(0x7f115806d7d0 msgr2=0x7f11580c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 shutdown_connections 2023-10-06T05:28:23.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:23.502+0000 7f115cf8a700 1 -- 172.21.15.29:0/2895625658 wait complete. 2023-10-06T05:28:23.521 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:28:23.521 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:28:23.521 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:28:23.521 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T05:28:23.521 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:23.521 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:28:23.521 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:28:23.521 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:28:23.522 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:28:23.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:23.522 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:28:23.527 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:28:23.527 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:28:23.527 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:28:23.527 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:23.527 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:28:23.527 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:23.527 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:28:23.527 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42424sec preferred_lft 42424sec 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:28:23.528 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::38dc:3fff:fed0:feb0/64 scope link 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:28:23.529 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c88:ceff:fe77:b613/64 scope link 2023-10-06T05:28:23.530 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:23.530 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:28:23.530 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether aa:ad:a4:57:7d:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:28:23.530 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a8ad:a4ff:fe57:7d6d/64 scope link 2023-10-06T05:28:23.530 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:23.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:23.530 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:28:23.544 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:28:23.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:23.545 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:28:23.600 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:28:23.600 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:28:23.600 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:28:23.600 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:28:23.600 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:28:23.600 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:28:23.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:23.601 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:28:23.601 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:28:23.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:28:23.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:28:23.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:28:23.601 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:28:23.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:23.643 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:28:23.649 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T05:28:23.649 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:28:23.649 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:28:23.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:23.649 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-06T05:28:23.712 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T05:28:23.712 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:28:23.712 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:23.719 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:28:23.719 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:28:23.719 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:23.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:28:23.784 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:28:23.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:28:23.799 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:28:23.800 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:28:23.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:23.801 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:28:23.808 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:28:23.808 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T05:28:23.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:28:23.822 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:28:23.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:28:23.833 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:28:23.834 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:28:23.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:23.835 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:28:23.896 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2023-10-06T05:28:23.890+0000 7f3cebba1380 -1 init, newargv = 0x55e2473300f0 newargc=15 2023-10-06T05:28:23.896 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[45877]: starting ceph client 2023-10-06T05:28:23.905 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[45877]: starting fuse 2023-10-06T05:28:24.983 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:28:25.002 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:28:25.003 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:28:25.013 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:28:25.014 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:28:25.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:25.014 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:28:25.063 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:28:25.063 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:28:25.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:28:25.063 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:28:25.063 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:28:25.063 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:28:25.064 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2023-10-06T05:28:25.065 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:28:25.143 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.45877.asok 2023-10-06T05:28:25.329 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45877.asok 2023-10-06T05:28:25.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:25.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45877.asok status 2023-10-06T05:28:25.430 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:28:25.430 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:28:25.430 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:28:25.430 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:28:25.430 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2023-10-06T05:28:25.430 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:28:25.430 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "45877", 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6087, 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 6087 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:25.431 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3739341470 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3739341470 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.6087 192.168.0.1:0/3739341470", 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/3739341470", 2023-10-06T05:28:25.432 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:28:25.433 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 27, 2023-10-06T05:28:25.433 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 64, 2023-10-06T05:28:25.433 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:28:25.433 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:28:25.433 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:28:25.433 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:28:25.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:25.439 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:28:25.439 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:25.447 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:28:25.447 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:25.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:25.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:25.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:25.508 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T05:28:25.611 INFO:teuthology.orchestra.run.smithi029.stderr:6+0 records in 2023-10-06T05:28:25.612 INFO:teuthology.orchestra.run.smithi029.stderr:6+0 records out 2023-10-06T05:28:25.612 INFO:teuthology.orchestra.run.smithi029.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0857694 s, 73.4 MB/s 2023-10-06T05:28:25.613 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:28:25.613 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:28:25.613 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:25.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[45877]: fuse finished with error 0 and tester_r 0 2023-10-06T05:28:25.629 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:28:25.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:28:25.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:25.689 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:28:25.695 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:28:25.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.806+0000 7f31c63db700 1 Processor -- start 2023-10-06T05:28:25.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.806+0000 7f31c63db700 1 -- start start 2023-10-06T05:28:25.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.806+0000 7f31c63db700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31c00cb880 0x7f31c00cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:25.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.806+0000 7f31c63db700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f31c00ae6d0 0x7f31c00aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:25.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.806+0000 7f31c63db700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c00c9e50 con 0x7f31c0158ff0 2023-10-06T05:28:25.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.806+0000 7f31c63db700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00ca9f0 con 0x7f31c00cb880 2023-10-06T05:28:25.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.806+0000 7f31c63db700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00cc210 con 0x7f31c00ae6d0 2023-10-06T05:28:25.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c4bd8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31c00cb880 0x7f31c00cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:25.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c4bd8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31c00cb880 0x7f31c00cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39466/0 (socket says 172.21.15.29:39466) 2023-10-06T05:28:25.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c4bd8700 1 -- 172.21.15.29:0/448853688 learned_addr learned my addr 172.21.15.29:0/448853688 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:25.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c53d9700 1 --1- 172.21.15.29:0/448853688 >> v1:172.21.15.29:6789/0 conn(0x7f31c0158ff0 0x7f31c00ca2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51706/0 (socket says 172.21.15.29:51706) 2023-10-06T05:28:25.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c5bda700 1 --2- 172.21.15.29:0/448853688 >> v2:172.21.15.173:3300/0 conn(0x7f31c00ae6d0 0x7f31c00aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:25.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c4bd8700 1 -- 172.21.15.29:0/448853688 >> v2:172.21.15.173:3300/0 conn(0x7f31c00ae6d0 msgr2=0x7f31c00aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:25.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c4bd8700 1 --2- 172.21.15.29:0/448853688 >> v2:172.21.15.173:3300/0 conn(0x7f31c00ae6d0 0x7f31c00aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:25.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c4bd8700 1 -- 172.21.15.29:0/448853688 >> v1:172.21.15.29:6789/0 conn(0x7f31c0158ff0 legacy=0x7f31c00ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:25.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c4bd8700 1 -- 172.21.15.29:0/448853688 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c006b5f0 con 0x7f31c00cb880 2023-10-06T05:28:25.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c4bd8700 1 --2- 172.21.15.29:0/448853688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00cb880 0x7f31c00cbcd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f31c00c2900 tx=0x7f31b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e50594501100c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:25.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31b7fff700 1 -- 172.21.15.29:0/448853688 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b000b860 con 0x7f31c00cb880 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31b7fff700 1 -- 172.21.15.29:0/448853688 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b000b9c0 con 0x7f31c00cb880 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31b7fff700 1 -- 172.21.15.29:0/448853688 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b000bd60 con 0x7f31c00cb880 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c63db700 1 -- 172.21.15.29:0/448853688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00cb880 msgr2=0x7f31c00cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c63db700 1 --2- 172.21.15.29:0/448853688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00cb880 0x7f31c00cbcd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f31c00c2900 tx=0x7f31b0009250 comp rx=0 tx=0).stop 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c63db700 1 -- 172.21.15.29:0/448853688 shutdown_connections 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c63db700 1 --2- 172.21.15.29:0/448853688 >> v2:172.21.15.173:3300/0 conn(0x7f31c00ae6d0 0x7f31c00aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c63db700 1 --2- 172.21.15.29:0/448853688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00cb880 0x7f31c00cbcd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c63db700 1 -- 172.21.15.29:0/448853688 >> 172.21.15.29:0/448853688 conn(0x7f31c00670a0 msgr2=0x7f31c0067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c63db700 1 -- 172.21.15.29:0/448853688 shutdown_connections 2023-10-06T05:28:25.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.810+0000 7f31c63db700 1 -- 172.21.15.29:0/448853688 wait complete. 2023-10-06T05:28:25.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 Processor -- start 2023-10-06T05:28:25.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 -- start start 2023-10-06T05:28:25.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00ae6d0 0x7f31c00c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:25.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31c00cb880 0x7f31c00c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:25.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31c0158ff0 0x7f31c0147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:25.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0147260 con 0x7f31c00ae6d0 2023-10-06T05:28:25.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01476f0 con 0x7f31c0158ff0 2023-10-06T05:28:25.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00c3600 con 0x7f31c00cb880 2023-10-06T05:28:25.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c53d9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00ae6d0 0x7f31c00c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:25.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c53d9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00ae6d0 0x7f31c00c0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39468/0 (socket says 172.21.15.29:39468) 2023-10-06T05:28:25.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c53d9700 1 -- 172.21.15.29:0/2208597341 learned_addr learned my addr 172.21.15.29:0/2208597341 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:25.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c5bda700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31c0158ff0 0x7f31c0147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:25.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c4bd8700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31c00cb880 0x7f31c00c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:25.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c53d9700 1 -- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31c00cb880 msgr2=0x7f31c00c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:25.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c53d9700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31c00cb880 0x7f31c00c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:25.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c53d9700 1 -- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31c0158ff0 msgr2=0x7f31c0147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:25.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c53d9700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31c0158ff0 0x7f31c0147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:25.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c53d9700 1 -- 172.21.15.29:0/2208597341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00094f0 con 0x7f31c00ae6d0 2023-10-06T05:28:25.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c53d9700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00ae6d0 0x7f31c00c0d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c4c0 tx=0x7f31bc00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:25.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31b57fa700 1 -- 172.21.15.29:0/2208597341 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00cea0 con 0x7f31c00ae6d0 2023-10-06T05:28:25.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31b57fa700 1 -- 172.21.15.29:0/2208597341 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc005a70 con 0x7f31c00ae6d0 2023-10-06T05:28:25.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c00c19e0 con 0x7f31c00ae6d0 2023-10-06T05:28:25.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31b57fa700 1 -- 172.21.15.29:0/2208597341 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc005e10 con 0x7f31c00ae6d0 2023-10-06T05:28:25.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.814+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c00c2280 con 0x7f31c00ae6d0 2023-10-06T05:28:25.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.818+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c00691f0 con 0x7f31c00ae6d0 2023-10-06T05:28:25.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.818+0000 7f31b57fa700 1 -- 172.21.15.29:0/2208597341 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f31bc0072e0 con 0x7f31c00ae6d0 2023-10-06T05:28:25.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.818+0000 7f31b57fa700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a4060550 0x7f31a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:25.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.818+0000 7f31b57fa700 1 -- 172.21.15.29:0/2208597341 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f31bc07c1f0 con 0x7f31c00ae6d0 2023-10-06T05:28:25.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.818+0000 7f31c4bd8700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a4060550 0x7f31a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:25.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.822+0000 7f31c4bd8700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a4060550 0x7f31a4062a00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f31c00c2900 tx=0x7f31b0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:25.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:25.822+0000 7f31b57fa700 1 -- 172.21.15.29:0/2208597341 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f31bc04c5d0 con 0x7f31c00ae6d0 2023-10-06T05:28:26.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.018+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31c0069b50 con 0x7f31c00ae6d0 2023-10-06T05:28:26.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31b57fa700 1 -- 172.21.15.29:0/2208597341 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f31bc017090 con 0x7f31c00ae6d0 2023-10-06T05:28:26.024 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:26.025 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:28:16.079422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5901":{"gid":5901,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1584172634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1584172634},{"type":"v1","addr":"172.21.15.29:6835","nonce":1584172634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:28:26.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a4060550 msgr2=0x7f31a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a4060550 0x7f31a4062a00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f31c00c2900 tx=0x7f31b0017000 comp rx=0 tx=0).stop 2023-10-06T05:28:26.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00ae6d0 msgr2=0x7f31c00c0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00ae6d0 0x7f31c00c0d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c4c0 tx=0x7f31bc00c7d0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 shutdown_connections 2023-10-06T05:28:26.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f31a4060550 0x7f31a4062a00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31c0158ff0 0x7f31c0147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31c00cb880 0x7f31c00c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 --2- 172.21.15.29:0/2208597341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31c00ae6d0 0x7f31c00c0d80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 >> 172.21.15.29:0/2208597341 conn(0x7f31c00670a0 msgr2=0x7f31c00c83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:26.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 shutdown_connections 2023-10-06T05:28:26.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.022+0000 7f31c63db700 1 -- 172.21.15.29:0/2208597341 wait complete. 2023-10-06T05:28:26.029 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2023-10-06T05:28:26.040 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T05:28:26.167 INFO:teuthology.orchestra.run.smithi029.stdout:{"message":"","return_code":0} 2023-10-06T05:28:26.167 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T05:28:26.167 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:28:26.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f324e1e5700 1 Processor -- start 2023-10-06T05:28:26.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f324e1e5700 1 -- start start 2023-10-06T05:28:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f324e1e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f324815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f324e1e5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f324806a500 0x7f324806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f324e1e5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32480c5a10 con 0x7f32481592b0 2023-10-06T05:28:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f324e1e5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480cbb90 con 0x7f324806a500 2023-10-06T05:28:26.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f324e1e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324806a990 con 0x7f3248158ee0 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f3247fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f32481592b0 0x7f32480cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51710/0 (socket says 172.21.15.29:51710) 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f3247fff700 1 -- 172.21.15.29:0/1314086626 learned_addr learned my addr 172.21.15.29:0/1314086626 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f3246ffd700 1 --2- 172.21.15.29:0/1314086626 >> v2:172.21.15.173:3300/0 conn(0x7f324806a500 0x7f324806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f32477fe700 1 --2- 172.21.15.29:0/1314086626 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f324815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f32467fc700 1 -- 172.21.15.29:0/1314086626 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969676244 0 0) 0x7f32480c5a10 con 0x7f32481592b0 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f32467fc700 1 -- 172.21.15.29:0/1314086626 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3234003570 con 0x7f32481592b0 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f3246ffd700 1 -- 172.21.15.29:0/1314086626 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 msgr2=0x7f324815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f3246ffd700 1 --2- 172.21.15.29:0/1314086626 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f324815d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f3246ffd700 1 -- 172.21.15.29:0/1314086626 >> v1:172.21.15.29:6789/0 conn(0x7f32481592b0 legacy=0x7f32480cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.270+0000 7f3246ffd700 1 -- 172.21.15.29:0/1314086626 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324806ac70 con 0x7f324806a500 2023-10-06T05:28:26.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f3246ffd700 1 --2- 172.21.15.29:0/1314086626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 0x7f324806c6c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3230009e60 tx=0x7f3230009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e087a8aa52a04a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f32467fc700 1 -- 172.21.15.29:0/1314086626 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323000e070 con 0x7f324806a500 2023-10-06T05:28:26.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f32467fc700 1 -- 172.21.15.29:0/1314086626 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323000bab0 con 0x7f324806a500 2023-10-06T05:28:26.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f32467fc700 1 -- 172.21.15.29:0/1314086626 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323000be70 con 0x7f324806a500 2023-10-06T05:28:26.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 -- 172.21.15.29:0/1314086626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 msgr2=0x7f324806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 --2- 172.21.15.29:0/1314086626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 0x7f324806c6c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3230009e60 tx=0x7f3230009780 comp rx=0 tx=0).stop 2023-10-06T05:28:26.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 -- 172.21.15.29:0/1314086626 shutdown_connections 2023-10-06T05:28:26.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 --2- 172.21.15.29:0/1314086626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 0x7f324806c6c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 --2- 172.21.15.29:0/1314086626 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f324815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 -- 172.21.15.29:0/1314086626 >> 172.21.15.29:0/1314086626 conn(0x7f3248062b60 msgr2=0x7f3248062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:26.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 -- 172.21.15.29:0/1314086626 shutdown_connections 2023-10-06T05:28:26.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 -- 172.21.15.29:0/1314086626 wait complete. 2023-10-06T05:28:26.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 Processor -- start 2023-10-06T05:28:26.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.274+0000 7f324e1e5700 1 -- start start 2023-10-06T05:28:26.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f324e1e5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 0x7f32480b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f324e1e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f32480c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f324e1e5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32481592b0 0x7f32480b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f324e1e5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3248153560 con 0x7f32481592b0 2023-10-06T05:28:26.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f324e1e5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324816a160 con 0x7f324806a500 2023-10-06T05:28:26.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f324e1e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3248169590 con 0x7f3248158ee0 2023-10-06T05:28:26.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f3247fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32481592b0 0x7f32480b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f3246ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f32480c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f32477fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 0x7f32480b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f3247fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32481592b0 0x7f32480b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39482/0 (socket says 172.21.15.29:39482) 2023-10-06T05:28:26.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f3246ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f32480c7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:34558/0 (socket says 172.21.15.29:34558) 2023-10-06T05:28:26.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f3247fff700 1 -- 172.21.15.29:0/1830600142 learned_addr learned my addr 172.21.15.29:0/1830600142 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:26.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f32477fe700 1 -- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 msgr2=0x7f32480c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f32477fe700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f32480c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f32477fe700 1 -- 172.21.15.29:0/1830600142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32481592b0 msgr2=0x7f32480b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f32477fe700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32481592b0 0x7f32480b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f32477fe700 1 -- 172.21.15.29:0/1830600142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3230009a20 con 0x7f324806a500 2023-10-06T05:28:26.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f3247fff700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32481592b0 0x7f32480b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:26.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f3246ffd700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f32480c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:26.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f32477fe700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 0x7f32480b23b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f323800ea50 tx=0x7f32380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f323f7fe700 1 -- 172.21.15.29:0/1830600142 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323800ee90 con 0x7f324806a500 2023-10-06T05:28:26.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f323f7fe700 1 -- 172.21.15.29:0/1830600142 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323800c7f0 con 0x7f324806a500 2023-10-06T05:28:26.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3248169830 con 0x7f324806a500 2023-10-06T05:28:26.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f323f7fe700 1 -- 172.21.15.29:0/1830600142 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323800cb90 con 0x7f324806a500 2023-10-06T05:28:26.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3248169df0 con 0x7f324806a500 2023-10-06T05:28:26.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.278+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324804be00 con 0x7f324806a500 2023-10-06T05:28:26.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.282+0000 7f323f7fe700 1 -- 172.21.15.29:0/1830600142 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3238005a00 con 0x7f324806a500 2023-10-06T05:28:26.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.282+0000 7f323f7fe700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3228060550 0x7f3228062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.282+0000 7f323f7fe700 1 -- 172.21.15.29:0/1830600142 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f323807cfe0 con 0x7f324806a500 2023-10-06T05:28:26.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.282+0000 7f3246ffd700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3228060550 0x7f3228062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.282+0000 7f3246ffd700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3228060550 0x7f3228062a00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f32300097c0 tx=0x7f3230019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.290+0000 7f323f7fe700 1 -- 172.21.15.29:0/1830600142 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f323804d380 con 0x7f324806a500 2023-10-06T05:28:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.490+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32480c57f0 con 0x7f324806a500 2023-10-06T05:28:26.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.490+0000 7f323f7fe700 1 -- 172.21.15.29:0/1830600142 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f3238021090 con 0x7f324806a500 2023-10-06T05:28:26.495 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:26.495 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:28:16.079422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5901":{"gid":5901,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1584172634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1584172634},{"type":"v1","addr":"172.21.15.29:6835","nonce":1584172634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:28:26.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3228060550 msgr2=0x7f3228062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3228060550 0x7f3228062a00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f32300097c0 tx=0x7f3230019000 comp rx=0 tx=0).stop 2023-10-06T05:28:26.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 msgr2=0x7f32480b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 0x7f32480b23b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f323800ea50 tx=0x7f32380091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 shutdown_connections 2023-10-06T05:28:26.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32481592b0 0x7f32480b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3248158ee0 0x7f32480c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3228060550 0x7f3228062a00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 --2- 172.21.15.29:0/1830600142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f324806a500 0x7f32480b23b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 >> 172.21.15.29:0/1830600142 conn(0x7f3248062b60 msgr2=0x7f3248157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:26.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 shutdown_connections 2023-10-06T05:28:26.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.494+0000 7f324e1e5700 1 -- 172.21.15.29:0/1830600142 wait complete. 2023-10-06T05:28:26.500 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2023-10-06T05:28:26.515 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2023-10-06T05:28:26.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.542+0000 7fcfe290de80 1 Processor -- start 2023-10-06T05:28:26.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.542+0000 7fcfe290de80 1 -- start start 2023-10-06T05:28:26.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d03326d80 0x564d03311330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564d033af900 0x564d03311870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d0332a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d03228840 con 0x564d033b5830 2023-10-06T05:28:26.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d032284e0 con 0x564d03326d80 2023-10-06T05:28:26.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d0321f270 con 0x564d033af900 2023-10-06T05:28:26.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0c45700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d0332a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0444700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d03326d80 0x564d03311330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfdfc43700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564d033af900 0x564d03311870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0444700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d03326d80 0x564d03311330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:52388/0 (socket says 172.21.15.29:52388) 2023-10-06T05:28:26.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0444700 1 -- 172.21.15.29:0/1650550549 learned_addr learned my addr 172.21.15.29:0/1650550549 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:26.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0c45700 1 -- 172.21.15.29:0/1650550549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564d033af900 msgr2=0x564d03311870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:26.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0c45700 1 --2- 172.21.15.29:0/1650550549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564d033af900 0x564d03311870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0c45700 1 -- 172.21.15.29:0/1650550549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d03326d80 msgr2=0x564d03311330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:26.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0c45700 1 --2- 172.21.15.29:0/1650550549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d03326d80 0x564d03311330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0c45700 1 -- 172.21.15.29:0/1650550549 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc800a0e0 con 0x564d033b5830 2023-10-06T05:28:26.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0444700 1 --2- 172.21.15.29:0/1650550549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d03326d80 0x564d03311330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:26.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe0c45700 1 --2- 172.21.15.29:0/1650550549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d0332a560 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8006f90 tx=0x7fcfd8006800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb5f8fa3f02eb89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfdec41700 1 -- 172.21.15.29:0/1650550549 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800bbf0 con 0x564d033b5830 2023-10-06T05:28:26.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfdec41700 1 -- 172.21.15.29:0/1650550549 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd800bd70 con 0x564d033b5830 2023-10-06T05:28:26.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfdec41700 1 -- 172.21.15.29:0/1650550549 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800e6c0 con 0x564d033b5830 2023-10-06T05:28:26.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 -- 172.21.15.29:0/1650550549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 msgr2=0x564d0332a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 --2- 172.21.15.29:0/1650550549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d0332a560 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8006f90 tx=0x7fcfd8006800 comp rx=0 tx=0).stop 2023-10-06T05:28:26.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 -- 172.21.15.29:0/1650550549 shutdown_connections 2023-10-06T05:28:26.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 --2- 172.21.15.29:0/1650550549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d0332a560 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 --2- 172.21.15.29:0/1650550549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564d033af900 0x564d03311870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 --2- 172.21.15.29:0/1650550549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d03326d80 0x564d03311330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 -- 172.21.15.29:0/1650550549 >> 172.21.15.29:0/1650550549 conn(0x564d0332ccd0 msgr2=0x564d0330f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:26.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 -- 172.21.15.29:0/1650550549 shutdown_connections 2023-10-06T05:28:26.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 -- 172.21.15.29:0/1650550549 wait complete. 2023-10-06T05:28:26.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 Processor -- start 2023-10-06T05:28:26.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.546+0000 7fcfe290de80 1 -- start start 2023-10-06T05:28:26.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe290de80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564d03326d80 0x564d033c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe290de80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d033af900 0x564d033c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe290de80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d033b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe290de80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d033b1000 con 0x564d033b5830 2023-10-06T05:28:26.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe290de80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d033b12e0 con 0x564d033af900 2023-10-06T05:28:26.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe290de80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d033b15c0 con 0x564d03326d80 2023-10-06T05:28:26.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0c45700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d033b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0c45700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d033b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39510/0 (socket says 172.21.15.29:39510) 2023-10-06T05:28:26.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0444700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564d03326d80 0x564d033c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfdfc43700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d033af900 0x564d033c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0c45700 1 -- 172.21.15.29:0/1761539525 learned_addr learned my addr 172.21.15.29:0/1761539525 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0c45700 1 -- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564d03326d80 msgr2=0x564d033c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0c45700 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x564d03326d80 0x564d033c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0c45700 1 -- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d033af900 msgr2=0x564d033c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0c45700 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d033af900 0x564d033c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0c45700 1 -- 172.21.15.29:0/1761539525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0009580 con 0x564d033b5830 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe0c45700 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d033b3e60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800b8b0 tx=0x7fcfd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfdd43e700 1 -- 172.21.15.29:0/1761539525 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80064a0 con 0x564d033b5830 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfdd43e700 1 -- 172.21.15.29:0/1761539525 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8017660 con 0x564d033b5830 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd8006ae0 con 0x564d033b5830 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfdd43e700 1 -- 172.21.15.29:0/1761539525 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8017a20 con 0x564d033b5830 2023-10-06T05:28:26.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.550+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d03237250 con 0x564d033b5830 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfdd43e700 1 -- 172.21.15.29:0/1761539525 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcfd800d3d0 con 0x564d033b5830 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfdd43e700 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcfc005eeb0 0x7fcfc0061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfdd43e700 1 -- 172.21.15.29:0/1761539525 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fcfd807ce20 con 0x564d033b5830 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfe290de80 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x564d033b43a0 0x564d033b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:1 9.13 9:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64) v8 -- 0x564d033b25e0 con 0x564d033b43a0 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfe0444700 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcfc005eeb0 0x7fcfc0061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfdfc43700 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x564d033b43a0 0x564d033b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfe0444700 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcfc005eeb0 0x7fcfc0061360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0005e80 tx=0x7fcfd000c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfdfc43700 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x564d033b43a0 0x564d033b20a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.554+0000 7fcfdfc43700 1 -- 172.21.15.29:0/1761539525 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7fcfc8023040 con 0x564d033b43a0 2023-10-06T05:28:26.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x564d033b43a0 msgr2=0x564d033b20a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x564d033b43a0 0x564d033b20a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcfc005eeb0 msgr2=0x7fcfc0061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcfc005eeb0 0x7fcfc0061360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0005e80 tx=0x7fcfd000c040 comp rx=0 tx=0).stop 2023-10-06T05:28:26.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 msgr2=0x564d033b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 --2- 172.21.15.29:0/1761539525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d033b5830 0x564d033b3e60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800b8b0 tx=0x7fcfd8017000 comp rx=0 tx=0).stop 2023-10-06T05:28:26.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe0c45700 1 -- 172.21.15.29:0/1761539525 reap_dead start 2023-10-06T05:28:26.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 shutdown_connections 2023-10-06T05:28:26.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 >> 172.21.15.29:0/1761539525 conn(0x564d0332ccd0 msgr2=0x564d03310610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:26.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 shutdown_connections 2023-10-06T05:28:26.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.558+0000 7fcfe290de80 1 -- 172.21.15.29:0/1761539525 wait complete. 2023-10-06T05:28:26.566 INFO:teuthology.orchestra.run.smithi029.stdout:����� 2023-10-06T05:28:26.566 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:28:26.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 Processor -- start 2023-10-06T05:28:26.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 -- start start 2023-10-06T05:28:26.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f65f40c6540 0x7f65f40c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f65f40ca1f0 0x7f65f40c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f40c2980 con 0x7f65f41605e0 2023-10-06T05:28:26.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40c69c0 con 0x7f65f40ca1f0 2023-10-06T05:28:26.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40ca630 con 0x7f65f40c6540 2023-10-06T05:28:26.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f3fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f65f41605e0 0x7f65f406b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51718/0 (socket says 172.21.15.29:51718) 2023-10-06T05:28:26.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f3fff700 1 -- 172.21.15.29:0/3558626481 learned_addr learned my addr 172.21.15.29:0/3558626481 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:28:26.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f8ad2700 1 --2- 172.21.15.29:0/3558626481 >> v2:172.21.15.29:3300/0 conn(0x7f65f40ca1f0 0x7f65f40c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f37fe700 1 --2- 172.21.15.29:0/3558626481 >> v2:172.21.15.173:3300/0 conn(0x7f65f40c6540 0x7f65f40c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f2ffd700 1 -- 172.21.15.29:0/3558626481 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975783743 0 0) 0x7f65f40c2980 con 0x7f65f41605e0 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f2ffd700 1 -- 172.21.15.29:0/3558626481 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d4003570 con 0x7f65f41605e0 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f8ad2700 1 -- 172.21.15.29:0/3558626481 >> v2:172.21.15.173:3300/0 conn(0x7f65f40c6540 msgr2=0x7f65f40c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f8ad2700 1 --2- 172.21.15.29:0/3558626481 >> v2:172.21.15.173:3300/0 conn(0x7f65f40c6540 0x7f65f40c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f8ad2700 1 -- 172.21.15.29:0/3558626481 >> v1:172.21.15.29:6789/0 conn(0x7f65f41605e0 legacy=0x7f65f406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f8ad2700 1 -- 172.21.15.29:0/3558626481 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f40c6bb0 con 0x7f65f40ca1f0 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f8ad2700 1 --2- 172.21.15.29:0/3558626481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 0x7f65f40c7c50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f65f40c5980 tx=0x7f65ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a7cd09766dca25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f2ffd700 1 -- 172.21.15.29:0/3558626481 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec011630 con 0x7f65f40ca1f0 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f2ffd700 1 -- 172.21.15.29:0/3558626481 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec0117b0 con 0x7f65f40ca1f0 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f2ffd700 1 -- 172.21.15.29:0/3558626481 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec011b70 con 0x7f65f40ca1f0 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 -- 172.21.15.29:0/3558626481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 msgr2=0x7f65f40c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 --2- 172.21.15.29:0/3558626481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 0x7f65f40c7c50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f65f40c5980 tx=0x7f65ec0091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 -- 172.21.15.29:0/3558626481 shutdown_connections 2023-10-06T05:28:26.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 --2- 172.21.15.29:0/3558626481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 0x7f65f40c7c50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 --2- 172.21.15.29:0/3558626481 >> v2:172.21.15.173:3300/0 conn(0x7f65f40c6540 0x7f65f40c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 -- 172.21.15.29:0/3558626481 >> 172.21.15.29:0/3558626481 conn(0x7f65f40670a0 msgr2=0x7f65f40674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:26.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 -- 172.21.15.29:0/3558626481 shutdown_connections 2023-10-06T05:28:26.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.722+0000 7f65f92d3700 1 -- 172.21.15.29:0/3558626481 wait complete. 2023-10-06T05:28:26.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 Processor -- start 2023-10-06T05:28:26.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 -- start start 2023-10-06T05:28:26.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f40c6540 0x7f65f40c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 0x7f65f4150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65f41605e0 0x7f65f4161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40c21a0 con 0x7f65f40ca1f0 2023-10-06T05:28:26.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40c17d0 con 0x7f65f40c6540 2023-10-06T05:28:26.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40c0bc0 con 0x7f65f41605e0 2023-10-06T05:28:26.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 0x7f65f4150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 0x7f65f4150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39526/0 (socket says 172.21.15.29:39526) 2023-10-06T05:28:26.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f37fe700 1 -- 172.21.15.29:0/3577401944 learned_addr learned my addr 172.21.15.29:0/3577401944 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:26.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f8ad2700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65f41605e0 0x7f65f4161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f37fe700 1 -- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65f41605e0 msgr2=0x7f65f4161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f37fe700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65f41605e0 0x7f65f4161fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f3fff700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f40c6540 0x7f65f40c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f37fe700 1 -- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f40c6540 msgr2=0x7f65f40c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f37fe700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f40c6540 0x7f65f40c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f37fe700 1 -- 172.21.15.29:0/3577401944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec009420 con 0x7f65f40ca1f0 2023-10-06T05:28:26.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f3fff700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f40c6540 0x7f65f40c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:28:26.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f37fe700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 0x7f65f4150ef0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009ef0 tx=0x7f65dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65ebfff700 1 -- 172.21.15.29:0/3577401944 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00cc50 con 0x7f65f40ca1f0 2023-10-06T05:28:26.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65ebfff700 1 -- 172.21.15.29:0/3577401944 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc00f040 con 0x7f65f40ca1f0 2023-10-06T05:28:26.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65ebfff700 1 -- 172.21.15.29:0/3577401944 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc014480 con 0x7f65f40ca1f0 2023-10-06T05:28:26.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f40c0ea0 con 0x7f65f40ca1f0 2023-10-06T05:28:26.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.726+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f40c1460 con 0x7f65f40ca1f0 2023-10-06T05:28:26.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.730+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f40c1960 con 0x7f65f40ca1f0 2023-10-06T05:28:26.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.730+0000 7f65ebfff700 1 -- 172.21.15.29:0/3577401944 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f65dc0147f0 con 0x7f65f40ca1f0 2023-10-06T05:28:26.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.730+0000 7f65ebfff700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d8060550 0x7f65d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:26.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.730+0000 7f65ebfff700 1 -- 172.21.15.29:0/3577401944 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f65dc07d780 con 0x7f65f40ca1f0 2023-10-06T05:28:26.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.730+0000 7f65f3fff700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d8060550 0x7f65d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:26.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.730+0000 7f65f3fff700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d8060550 0x7f65d8062a00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65e4007fd0 tx=0x7f65e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:26.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.734+0000 7f65ebfff700 1 -- 172.21.15.29:0/3577401944 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f65dc04db80 con 0x7f65f40ca1f0 2023-10-06T05:28:26.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f65f404be00 con 0x7f65f40ca1f0 2023-10-06T05:28:26.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65ebfff700 1 -- 172.21.15.29:0/3577401944 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f65dc0511a0 con 0x7f65f40ca1f0 2023-10-06T05:28:26.933 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:28:26.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d8060550 msgr2=0x7f65d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d8060550 0x7f65d8062a00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65e4007fd0 tx=0x7f65e4009040 comp rx=0 tx=0).stop 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 msgr2=0x7f65f4150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 0x7f65f4150ef0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009ef0 tx=0x7f65dc00b040 comp rx=0 tx=0).stop 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 shutdown_connections 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65f41605e0 0x7f65f4161fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65f40ca1f0 0x7f65f4150ef0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f65d8060550 0x7f65d8062a00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 --2- 172.21.15.29:0/3577401944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f40c6540 0x7f65f40c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 >> 172.21.15.29:0/3577401944 conn(0x7f65f40670a0 msgr2=0x7f65f40c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 shutdown_connections 2023-10-06T05:28:26.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:26.930+0000 7f65f92d3700 1 -- 172.21.15.29:0/3577401944 wait complete. 2023-10-06T05:28:26.947 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:28:26.947 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:28:26.947 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:28:26.947 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T05:28:26.947 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:26.947 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:28:26.947 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:28:26.948 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:28:26.948 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:28:26.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:26.948 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:28:26.953 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:28:26.953 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:26.954 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42421sec preferred_lft 42421sec 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:28:26.955 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::38dc:3fff:fed0:feb0/64 scope link 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c88:ceff:fe77:b613/64 scope link 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether aa:ad:a4:57:7d:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a8ad:a4ff:fe57:7d6d/64 scope link 2023-10-06T05:28:26.956 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:28:26.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:26.957 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:28:26.969 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:28:26.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:26.970 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:28:27.020 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:28:27.020 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:28:27.020 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:28:27.020 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:28:27.020 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:28:27.020 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:28:27.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:27.021 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:28:27.021 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:28:27.021 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:28:27.021 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:28:27.021 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:28:27.021 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:28:27.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:27.063 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:28:27.070 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T05:28:27.070 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:28:27.070 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:28:27.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:27.071 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-06T05:28:27.083 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T05:28:27.083 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:28:27.083 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:27.130 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:28:27.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:28:27.130 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:27.137 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:28:27.154 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:28:27.154 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:28:27.168 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:28:27.169 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:28:27.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:27.169 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:28:27.218 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:28:27.218 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T05:28:27.220 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:28:27.236 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:28:27.236 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:28:27.245 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:28:27.245 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:28:27.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:27.246 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:28:27.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2023-10-06T05:28:27.302+0000 7f53f5557380 -1 init, newargv = 0x55cfd7c86d40 newargc=15 2023-10-06T05:28:27.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[46074]: starting ceph client 2023-10-06T05:28:27.316 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[46074]: starting fuse 2023-10-06T05:28:28.395 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:28:28.415 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:28:28.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:28:28.426 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:28:28.427 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:28:28.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:28.428 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:28:28.478 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:28:28.478 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:28:28.479 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:28:28.480 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:28.481 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2023-10-06T05:28:28.481 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:28:28.565 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.46074.asok 2023-10-06T05:28:28.750 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46074.asok 2023-10-06T05:28:28.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:28.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46074.asok status 2023-10-06T05:28:28.843 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:28:28.843 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:28:28.843 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:28:28.843 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:28:28.843 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2023-10-06T05:28:28.843 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:28:28.843 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T05:28:28.843 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "46074", 2023-10-06T05:28:28.843 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6129, 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 6129 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:28:28.844 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3827575006 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3827575006 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.6129 192.168.0.1:0/3827575006", 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/3827575006", 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:28:28.845 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 27, 2023-10-06T05:28:28.846 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 64, 2023-10-06T05:28:28.846 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:28:28.846 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:28:28.846 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:28:28.846 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:28:28.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:28.852 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:28:28.852 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:28.858 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:28:28.858 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:28.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:28.858 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:28.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:28.875 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T05:28:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:6+0 records in 2023-10-06T05:28:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:6+0 records out 2023-10-06T05:28:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0856566 s, 73.4 MB/s 2023-10-06T05:28:28.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:28.976 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T05:28:29.060 INFO:teuthology.orchestra.run.smithi029.stderr:6+0 records in 2023-10-06T05:28:29.060 INFO:teuthology.orchestra.run.smithi029.stderr:6+0 records out 2023-10-06T05:28:29.060 INFO:teuthology.orchestra.run.smithi029.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0715707 s, 87.9 MB/s 2023-10-06T05:28:29.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:28:29.061 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T05:28:29.073 INFO:teuthology.orchestra.run.smithi029.stdout:./ 2023-10-06T05:28:29.073 INFO:teuthology.orchestra.run.smithi029.stdout:./file2_sixmegs 2023-10-06T05:28:29.073 INFO:teuthology.orchestra.run.smithi029.stdout:./file3_sixmegs 2023-10-06T05:28:29.073 INFO:teuthology.orchestra.run.smithi029.stdout:./file1_sixmegs 2023-10-06T05:28:29.074 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:28:29.074 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:28:29.074 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:28:29.074 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:29.075 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T05:28:29.075 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:28:29.184 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:28:29.373 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:28:29.373 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:28:29.373 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:28:29.373 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:29.374 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2023-10-06T05:28:29.374 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:28:29.444 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627777 2023-10-06T05:28:29.632 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:28:29.632 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:28:29.632 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:28:29.632 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:29.632 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2023-10-06T05:28:29.633 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:28:29.702 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627778 2023-10-06T05:28:29.892 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:28:29.892 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:28:29.892 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:28:29.892 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:28:29.892 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2023-10-06T05:28:29.893 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:28:29.964 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627776 2023-10-06T05:28:30.152 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:28:30.153 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:28:30.153 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:30.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[46074]: fuse finished with error 0 and tester_r 0 2023-10-06T05:28:30.214 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:28:30.296 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:28:30.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:30.296 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:28:30.302 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:28:30.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.406+0000 7f62de59b700 1 Processor -- start 2023-10-06T05:28:30.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.406+0000 7f62de59b700 1 -- start start 2023-10-06T05:28:30.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.406+0000 7f62de59b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d8158bd0 0x7f62d8158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.406+0000 7f62de59b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62d806b6f0 0x7f62d80c9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.406+0000 7f62de59b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d80c7090 con 0x7f62d806b2a0 2023-10-06T05:28:30.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.406+0000 7f62de59b700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d806bc80 con 0x7f62d806b6f0 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.406+0000 7f62de59b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d806bf60 con 0x7f62d8158bd0 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62ddd9a700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62d806b6f0 0x7f62d80c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62dd599700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d8158bd0 0x7f62d8158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62ddd9a700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62d806b6f0 0x7f62d80c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:52414/0 (socket says 172.21.15.29:52414) 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62dcd98700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f62d806b2a0 0x7f62d80ac700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:52446/0 (socket says 172.21.15.29:52446) 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62ddd9a700 1 -- 172.21.15.29:0/2698062419 learned_addr learned my addr 172.21.15.29:0/2698062419 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62dd599700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d8158bd0 0x7f62d8158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:34590/0 (socket says 172.21.15.29:34590) 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62cffff700 1 -- 172.21.15.29:0/2698062419 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521577692 0 0) 0x7f62d80c7090 con 0x7f62d806b2a0 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62dd599700 1 -- 172.21.15.29:0/2698062419 >> v2:172.21.15.173:3300/0 conn(0x7f62d806b6f0 msgr2=0x7f62d80c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62dd599700 1 --2- 172.21.15.29:0/2698062419 >> v2:172.21.15.173:3300/0 conn(0x7f62d806b6f0 0x7f62d80c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62dd599700 1 -- 172.21.15.29:0/2698062419 >> v1:172.21.15.173:6789/0 conn(0x7f62d806b2a0 legacy=0x7f62d80ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62dd599700 1 -- 172.21.15.29:0/2698062419 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80c7300 con 0x7f62d8158bd0 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62dd599700 1 --2- 172.21.15.29:0/2698062419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d8158bd0 0x7f62d8158fa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62d40098e0 tx=0x7f62d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97efcc8820fd605a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62cffff700 1 -- 172.21.15.29:0/2698062419 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400b640 con 0x7f62d8158bd0 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62cffff700 1 -- 172.21.15.29:0/2698062419 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d400b7a0 con 0x7f62d8158bd0 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62cffff700 1 -- 172.21.15.29:0/2698062419 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400bb40 con 0x7f62d8158bd0 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62de59b700 1 -- 172.21.15.29:0/2698062419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d8158bd0 msgr2=0x7f62d8158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62de59b700 1 --2- 172.21.15.29:0/2698062419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d8158bd0 0x7f62d8158fa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62d40098e0 tx=0x7f62d40091a0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62de59b700 1 -- 172.21.15.29:0/2698062419 shutdown_connections 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62de59b700 1 --2- 172.21.15.29:0/2698062419 >> v2:172.21.15.173:3300/0 conn(0x7f62d806b6f0 0x7f62d80c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62de59b700 1 --2- 172.21.15.29:0/2698062419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d8158bd0 0x7f62d8158fa0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62de59b700 1 -- 172.21.15.29:0/2698062419 >> 172.21.15.29:0/2698062419 conn(0x7f62d806d7d0 msgr2=0x7f62d806dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62de59b700 1 -- 172.21.15.29:0/2698062419 shutdown_connections 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.410+0000 7f62de59b700 1 -- 172.21.15.29:0/2698062419 wait complete. 2023-10-06T05:28:30.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62de59b700 1 Processor -- start 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62de59b700 1 -- start start 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62de59b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d806b2a0 0x7f62d80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62de59b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d806b6f0 0x7f62d80c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62de59b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62d8158bd0 0x7f62d80c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62de59b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80ab630 con 0x7f62d8158bd0 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62de59b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80a9390 con 0x7f62d806b2a0 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62de59b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80a9670 con 0x7f62d806b6f0 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62ddd9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62d8158bd0 0x7f62d80c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62ddd9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62d8158bd0 0x7f62d80c04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39530/0 (socket says 172.21.15.29:39530) 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62ddd9a700 1 -- 172.21.15.29:0/212916986 learned_addr learned my addr 172.21.15.29:0/212916986 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62dcd98700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d806b6f0 0x7f62d80c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62dd599700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d806b2a0 0x7f62d80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62dcd98700 1 -- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d806b2a0 msgr2=0x7f62d80aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62dcd98700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d806b2a0 0x7f62d80aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62dcd98700 1 -- 172.21.15.29:0/212916986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62d8158bd0 msgr2=0x7f62d80c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62dcd98700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62d8158bd0 0x7f62d80c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62dcd98700 1 -- 172.21.15.29:0/212916986 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4009420 con 0x7f62d806b6f0 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62ddd9a700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62d8158bd0 0x7f62d80c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.414+0000 7f62dcd98700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d806b6f0 0x7f62d80c2a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62c800c5b0 tx=0x7f62c8007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62cd7fa700 1 -- 172.21.15.29:0/212916986 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c8005b40 con 0x7f62d806b6f0 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62cd7fa700 1 -- 172.21.15.29:0/212916986 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c8005ca0 con 0x7f62d806b6f0 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d80a9950 con 0x7f62d806b6f0 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62cd7fa700 1 -- 172.21.15.29:0/212916986 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c8007320 con 0x7f62d806b6f0 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d8156080 con 0x7f62d806b6f0 2023-10-06T05:28:30.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d80a9e50 con 0x7f62d806b6f0 2023-10-06T05:28:30.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62cd7fa700 1 -- 172.21.15.29:0/212916986 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f62c8033a20 con 0x7f62d806b6f0 2023-10-06T05:28:30.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62cd7fa700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62bc060550 0x7f62bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62cd7fa700 1 -- 172.21.15.29:0/212916986 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f62c807bf30 con 0x7f62d806b6f0 2023-10-06T05:28:30.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.418+0000 7f62dd599700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62bc060550 0x7f62bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.422+0000 7f62dd599700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62bc060550 0x7f62bc062a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f62d40093f0 tx=0x7f62d4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.430+0000 7f62cd7fa700 1 -- 172.21.15.29:0/212916986 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f62c80a5be0 con 0x7f62d806b6f0 2023-10-06T05:28:30.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.626+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62d804be00 con 0x7f62d806b6f0 2023-10-06T05:28:30.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.626+0000 7f62cd7fa700 1 -- 172.21.15.29:0/212916986 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f62c8017090 con 0x7f62d806b6f0 2023-10-06T05:28:30.632 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:30.632 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:28:16.079422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5901":{"gid":5901,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/1584172634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1584172634},{"type":"v1","addr":"172.21.15.29:6835","nonce":1584172634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:28:30.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62bc060550 msgr2=0x7f62bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62bc060550 0x7f62bc062a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f62d40093f0 tx=0x7f62d4017000 comp rx=0 tx=0).stop 2023-10-06T05:28:30.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d806b6f0 msgr2=0x7f62d80c2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d806b6f0 0x7f62d80c2a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62c800c5b0 tx=0x7f62c8007d50 comp rx=0 tx=0).stop 2023-10-06T05:28:30.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 shutdown_connections 2023-10-06T05:28:30.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62d8158bd0 0x7f62d80c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62d806b6f0 0x7f62d80c2a00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62bc060550 0x7f62bc062a00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 --2- 172.21.15.29:0/212916986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62d806b2a0 0x7f62d80aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 >> 172.21.15.29:0/212916986 conn(0x7f62d806d7d0 msgr2=0x7f62d80cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:30.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 shutdown_connections 2023-10-06T05:28:30.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.630+0000 7f62de59b700 1 -- 172.21.15.29:0/212916986 wait complete. 2023-10-06T05:28:30.635 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2023-10-06T05:28:30.650 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T05:28:30.775 INFO:teuthology.orchestra.run.smithi029.stdout:{"message":"","return_code":0} 2023-10-06T05:28:30.775 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T05:28:30.775 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi029.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T05:28:30.775 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:28:30.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:28:30.775 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:28:30.781 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T05:28:30.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:28:30.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-06T05:28:30.825 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive 2023-10-06T05:28:30.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.942+0000 7fdb44da3700 1 Processor -- start 2023-10-06T05:28:30.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.942+0000 7fdb44da3700 1 -- start start 2023-10-06T05:28:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdb40155f30 0x7fdb400686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb4015a410 0x7fdb4006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4006bbd0 con 0x7fdb40155b60 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb40159ff0 con 0x7fdb4015a410 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4006beb0 con 0x7fdb40155f30 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb4015a410 0x7fdb4006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb4015a410 0x7fdb4006d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39538/0 (socket says 172.21.15.29:39538) 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3ffff700 1 -- 172.21.15.29:0/3788213967 learned_addr learned my addr 172.21.15.29:0/3788213967 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3effd700 1 --2- 172.21.15.29:0/3788213967 >> v2:172.21.15.173:3300/0 conn(0x7fdb40155f30 0x7fdb400686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3ffff700 1 -- 172.21.15.29:0/3788213967 >> v2:172.21.15.173:3300/0 conn(0x7fdb40155f30 msgr2=0x7fdb400686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/3788213967 >> v2:172.21.15.173:3300/0 conn(0x7fdb40155f30 0x7fdb400686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3ffff700 1 -- 172.21.15.29:0/3788213967 >> v1:172.21.15.173:6789/0 conn(0x7fdb40155b60 legacy=0x7fdb4006b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3ffff700 1 -- 172.21.15.29:0/3788213967 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb40159930 con 0x7fdb4015a410 2023-10-06T05:28:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/3788213967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 0x7fdb4006d6d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fdb4006c110 tx=0x7fdb3800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f28fb6e9a83f3b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3e7fc700 1 -- 172.21.15.29:0/3788213967 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38010070 con 0x7fdb4015a410 2023-10-06T05:28:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3e7fc700 1 -- 172.21.15.29:0/3788213967 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3800b0d0 con 0x7fdb4015a410 2023-10-06T05:28:30.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb3e7fc700 1 -- 172.21.15.29:0/3788213967 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800b490 con 0x7fdb4015a410 2023-10-06T05:28:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 -- 172.21.15.29:0/3788213967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 msgr2=0x7fdb4006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 --2- 172.21.15.29:0/3788213967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 0x7fdb4006d6d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fdb4006c110 tx=0x7fdb3800ba50 comp rx=0 tx=0).stop 2023-10-06T05:28:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 -- 172.21.15.29:0/3788213967 shutdown_connections 2023-10-06T05:28:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 --2- 172.21.15.29:0/3788213967 >> v2:172.21.15.173:3300/0 conn(0x7fdb40155f30 0x7fdb400686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 --2- 172.21.15.29:0/3788213967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 0x7fdb4006d6d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 -- 172.21.15.29:0/3788213967 >> 172.21.15.29:0/3788213967 conn(0x7fdb400c9830 msgr2=0x7fdb4006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:30.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 -- 172.21.15.29:0/3788213967 shutdown_connections 2023-10-06T05:28:30.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.946+0000 7fdb44da3700 1 -- 172.21.15.29:0/3788213967 wait complete. 2023-10-06T05:28:30.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 Processor -- start 2023-10-06T05:28:30.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 -- start start 2023-10-06T05:28:30.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb40155b60 0x7fdb400c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb40155f30 0x7fdb4016a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 0x7fdb4014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40150b10 con 0x7fdb4015a410 2023-10-06T05:28:30.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400b06e0 con 0x7fdb40155b60 2023-10-06T05:28:30.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400c6020 con 0x7fdb40155f30 2023-10-06T05:28:30.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 0x7fdb4014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 0x7fdb4014fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39552/0 (socket says 172.21.15.29:39552) 2023-10-06T05:28:30.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3ffff700 1 -- 172.21.15.29:0/160496846 learned_addr learned my addr 172.21.15.29:0/160496846 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:30.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb40155b60 0x7fdb400c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3effd700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb40155f30 0x7fdb4016a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3ffff700 1 -- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb40155f30 msgr2=0x7fdb4016a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb40155f30 0x7fdb4016a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3ffff700 1 -- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb40155b60 msgr2=0x7fdb400c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb40155b60 0x7fdb400c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3ffff700 1 -- 172.21.15.29:0/160496846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3800bcf0 con 0x7fdb4015a410 2023-10-06T05:28:30.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 0x7fdb4014fb70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800bcc0 tx=0x7fdb3801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb277fe700 1 -- 172.21.15.29:0/160496846 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800ac90 con 0x7fdb4015a410 2023-10-06T05:28:30.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb277fe700 1 -- 172.21.15.29:0/160496846 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3800ae10 con 0x7fdb4015a410 2023-10-06T05:28:30.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 -- 172.21.15.29:0/160496846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb40150550 con 0x7fdb4015a410 2023-10-06T05:28:30.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb277fe700 1 -- 172.21.15.29:0/160496846 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3801d680 con 0x7fdb4015a410 2023-10-06T05:28:30.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.950+0000 7fdb44da3700 1 -- 172.21.15.29:0/160496846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb400b0370 con 0x7fdb4015a410 2023-10-06T05:28:30.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2fa155d700 1 Processor -- start 2023-10-06T05:28:30.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2fa155d700 1 -- start start 2023-10-06T05:28:30.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7fdb277fe700 1 -- 172.21.15.29:0/160496846 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdb38003040 con 0x7fdb4015a410 2023-10-06T05:28:30.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2fa155d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2f9c0ade50 0x7f2f9c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2fa155d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2f9c0ae220 0x7f2f9c0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2fa155d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c0cb030 con 0x7f2f9c06c6c0 2023-10-06T05:28:30.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2fa155d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c0c7c90 con 0x7f2f9c0ae220 2023-10-06T05:28:30.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2fa155d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c0c7680 con 0x7f2f9c0ade50 2023-10-06T05:28:30.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7fdb277fe700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb2c060550 0x7fdb2c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2f9b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2f9c0ae220 0x7f2f9c0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2f9b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2f9c0ae220 0x7f2f9c0c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39562/0 (socket says 172.21.15.29:39562) 2023-10-06T05:28:30.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.954+0000 7f2f9b7fe700 1 -- 172.21.15.29:0/1797616503 learned_addr learned my addr 172.21.15.29:0/1797616503 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:30.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2f9bfff700 1 --2- 172.21.15.29:0/1797616503 >> v2:172.21.15.173:3300/0 conn(0x7f2f9c0ade50 0x7f2f9c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb277fe700 1 -- 172.21.15.29:0/160496846 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fdb3807e0b0 con 0x7fdb4015a410 2023-10-06T05:28:30.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb2c060550 0x7fdb2c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2f9b7fe700 1 -- 172.21.15.29:0/1797616503 >> v2:172.21.15.173:3300/0 conn(0x7f2f9c0ade50 msgr2=0x7f2f9c0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:30.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2f9b7fe700 1 --2- 172.21.15.29:0/1797616503 >> v2:172.21.15.173:3300/0 conn(0x7f2f9c0ade50 0x7f2f9c0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2f9b7fe700 1 -- 172.21.15.29:0/1797616503 >> v1:172.21.15.173:6789/0 conn(0x7f2f9c06c6c0 legacy=0x7f2f9c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:30.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2f9b7fe700 1 -- 172.21.15.29:0/1797616503 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c0cb280 con 0x7f2f9c0ae220 2023-10-06T05:28:30.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2f9b7fe700 1 --2- 172.21.15.29:0/1797616503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f9c0ae220 0x7f2f9c0c9e60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c069df0 tx=0x7f2f8c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee3165be2185b96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2f9affd700 1 -- 172.21.15.29:0/1797616503 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00dca0 con 0x7f2f9c0ae220 2023-10-06T05:28:30.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2f9affd700 1 -- 172.21.15.29:0/1797616503 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c00de00 con 0x7f2f9c0ae220 2023-10-06T05:28:30.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2f9affd700 1 -- 172.21.15.29:0/1797616503 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0106c0 con 0x7f2f9c0ae220 2023-10-06T05:28:30.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb2c060550 0x7fdb2c062a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdb30003a80 tx=0x7fdb30007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb482ae740 1 Processor -- start 2023-10-06T05:28:30.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 -- 172.21.15.29:0/1797616503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f9c0ae220 msgr2=0x7f2f9c0c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 --2- 172.21.15.29:0/1797616503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f9c0ae220 0x7f2f9c0c9e60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c069df0 tx=0x7f2f8c00b4f0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb482ae740 1 -- start start 2023-10-06T05:28:30.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 -- 172.21.15.29:0/1797616503 shutdown_connections 2023-10-06T05:28:30.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 --2- 172.21.15.29:0/1797616503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f9c0ae220 0x7f2f9c0c9e60 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 --2- 172.21.15.29:0/1797616503 >> v2:172.21.15.173:3300/0 conn(0x7f2f9c0ade50 0x7f2f9c0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 -- 172.21.15.29:0/1797616503 >> 172.21.15.29:0/1797616503 conn(0x7f2f9c0670a0 msgr2=0x7f2f9c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:30.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 -- 172.21.15.29:0/1797616503 shutdown_connections 2023-10-06T05:28:30.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 -- 172.21.15.29:0/1797616503 wait complete. 2023-10-06T05:28:30.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 Processor -- start 2023-10-06T05:28:30.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 -- start start 2023-10-06T05:28:30.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 0x2c03230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2c03770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 0x2c03cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb482ae740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b31120 con 0x29859b0 2023-10-06T05:28:30.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb482ae740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b2d0c0 con 0x2985d80 2023-10-06T05:28:30.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb482ae740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2af3270 con 0x29d0a30 2023-10-06T05:28:30.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2c03770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2c03770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39568/0 (socket says 172.21.15.29:39568) 2023-10-06T05:28:30.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb3effd700 1 -- 172.21.15.29:0/945062071 learned_addr learned my addr 172.21.15.29:0/945062071 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:30.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/945062071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 0x2c03230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/945062071 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 0x2c03cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f9c06c6c0 0x7f2f9c158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c0ade50 0x7f2f9c152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f9c0ae220 0x7f2f9c0c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c157b30 con 0x7f2f9c0ae220 2023-10-06T05:28:30.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c1580f0 con 0x7f2f9c0ade50 2023-10-06T05:28:30.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.958+0000 7f2fa155d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c153780 con 0x7f2f9c06c6c0 2023-10-06T05:28:30.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa0d5c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f9c0ae220 0x7f2f9c0c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb3effd700 1 -- 172.21.15.29:0/945062071 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 msgr2=0x2c03cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:30.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb3effd700 1 --2- 172.21.15.29:0/945062071 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 0x2c03cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa0d5c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f9c0ae220 0x7f2f9c0c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39582/0 (socket says 172.21.15.29:39582) 2023-10-06T05:28:30.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa0d5c700 1 -- 172.21.15.29:0/808249915 learned_addr learned my addr 172.21.15.29:0/808249915 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:30.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb3effd700 1 -- 172.21.15.29:0/945062071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 msgr2=0x2c03230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:30.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb3effd700 1 --2- 172.21.15.29:0/945062071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 0x2c03230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2f9bfff700 1 --2- 172.21.15.29:0/808249915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f9c06c6c0 0x7f2f9c158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb3effd700 1 -- 172.21.15.29:0/945062071 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29d1c80 con 0x29859b0 2023-10-06T05:28:30.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2f9b7fe700 1 --2- 172.21.15.29:0/808249915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c0ade50 0x7f2f9c152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa0d5c700 1 -- 172.21.15.29:0/808249915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f9c06c6c0 msgr2=0x7f2f9c158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa0d5c700 1 --2- 172.21.15.29:0/808249915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f9c06c6c0 0x7f2f9c158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa0d5c700 1 -- 172.21.15.29:0/808249915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c0ade50 msgr2=0x7f2f9c152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa0d5c700 1 --2- 172.21.15.29:0/808249915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c0ade50 0x7f2f9c152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa0d5c700 1 -- 172.21.15.29:0/808249915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c00b790 con 0x7f2f9c0ae220 2023-10-06T05:28:30.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb3effd700 1 --2- 172.21.15.29:0/945062071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2c03770 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdb34006b00 tx=0x7fdb34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4671a0900203687b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa0d5c700 1 --2- 172.21.15.29:0/808249915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f9c0ae220 0x7f2f9c0c96b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000b510 tx=0x7f2f90006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2f83fff700 1 -- 172.21.15.29:0/808249915 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000be80 con 0x7f2f9c0ae220 2023-10-06T05:28:30.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb24ff9700 1 -- 172.21.15.29:0/945062071 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340106f0 con 0x29859b0 2023-10-06T05:28:30.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2f83fff700 1 -- 172.21.15.29:0/808249915 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9000f510 con 0x7f2f9c0ae220 2023-10-06T05:28:30.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb24ff9700 1 -- 172.21.15.29:0/945062071 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb34010850 con 0x29859b0 2023-10-06T05:28:30.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb24ff9700 1 -- 172.21.15.29:0/945062071 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34010bd0 con 0x29859b0 2023-10-06T05:28:30.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa155d700 1 -- 172.21.15.29:0/808249915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c153a60 con 0x7f2f9c0ae220 2023-10-06T05:28:30.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2f83fff700 1 -- 172.21.15.29:0/808249915 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000f8b0 con 0x7f2f9c0ae220 2023-10-06T05:28:30.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa155d700 1 -- 172.21.15.29:0/808249915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c154930 con 0x7f2f9c0ae220 2023-10-06T05:28:30.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2fa155d700 1 -- 172.21.15.29:0/808249915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f2f9c068f50 con 0x7f2f9c0ae220 2023-10-06T05:28:30.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 -- 172.21.15.29:0/945062071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 msgr2=0x2c03770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 --2- 172.21.15.29:0/945062071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2c03770 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdb34006b00 tx=0x7fdb34008040 comp rx=0 tx=0).stop 2023-10-06T05:28:30.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 -- 172.21.15.29:0/945062071 shutdown_connections 2023-10-06T05:28:30.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 --2- 172.21.15.29:0/945062071 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 0x2c03cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 --2- 172.21.15.29:0/945062071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2c03770 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 --2- 172.21.15.29:0/945062071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 0x2c03230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 -- 172.21.15.29:0/945062071 >> 172.21.15.29:0/945062071 conn(0x2986150 msgr2=0x2bc0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:30.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 -- 172.21.15.29:0/945062071 shutdown_connections 2023-10-06T05:28:30.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 -- 172.21.15.29:0/945062071 wait complete. 2023-10-06T05:28:30.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2f83fff700 1 -- 172.21.15.29:0/808249915 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2f9000fce0 con 0x7f2f9c0ae220 2023-10-06T05:28:30.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 -- start start 2023-10-06T05:28:30.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7fdb482ae740 1 Processor -- start 2023-10-06T05:28:30.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.962+0000 7f2f83fff700 1 --2- 172.21.15.29:0/808249915 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2f88060580 0x7f2f88062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7f2f83fff700 1 -- 172.21.15.29:0/808249915 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f2f9007ccd0 con 0x7f2f9c0ae220 2023-10-06T05:28:30.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7f2f9bfff700 1 --2- 172.21.15.29:0/808249915 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2f88060580 0x7f2f88062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7f2f83fff700 1 -- 172.21.15.29:0/808249915 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+515 (secure 0 0 0) 0x7f2f9007d1f0 con 0x7f2f9c0ae220 2023-10-06T05:28:30.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7f2fa155d700 1 -- 172.21.15.29:0/808249915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f2f9c158230 con 0x7f2f9c0ae220 2023-10-06T05:28:30.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7f2f9bfff700 1 --2- 172.21.15.29:0/808249915 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2f88060580 0x7f2f88062a30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2f94007640 tx=0x7f2f94009850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29859b0 0x2bbca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 0x2bbcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29d0a30 0x2bbd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2af2f10 con 0x29d0a30 2023-10-06T05:28:30.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2acbb30 con 0x2985d80 2023-10-06T05:28:30.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2c030e0 con 0x29859b0 2023-10-06T05:28:30.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29d0a30 0x2bbd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 10 client.0 _ll_register_callbacks cb 0x2acfe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:28:30.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29d0a30 0x2bbd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39584/0 (socket says 172.21.15.29:39584) 2023-10-06T05:28:30.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3ffff700 1 -- 172.21.15.29:0/3928587645 learned_addr learned my addr 172.21.15.29:0/3928587645 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:30.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29859b0 0x2bbca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3effd700 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 0x2bbcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3ffff700 1 -- 172.21.15.29:0/3928587645 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29859b0 msgr2=0x2bbca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:30.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29859b0 0x2bbca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3ffff700 1 -- 172.21.15.29:0/3928587645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 msgr2=0x2bbcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:30.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 0x2bbcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3ffff700 1 -- 172.21.15.29:0/3928587645 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3400e040 con 0x29d0a30 2023-10-06T05:28:30.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3effd700 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 0x2bbcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:28:30.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29d0a30 0x2bbd500 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdb38003420 tx=0x7fdb3807c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1ae97ee548b99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:30.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:28:30.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb1dffb700 1 -- 172.21.15.29:0/3928587645 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38055400 con 0x29d0a30 2023-10-06T05:28:30.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb1dffb700 1 -- 172.21.15.29:0/3928587645 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fdb38059150 con 0x29d0a30 2023-10-06T05:28:30.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 -- 172.21.15.29:0/3928587645 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2acf670 con 0x29d0a30 2023-10-06T05:28:30.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb1dffb700 1 -- 172.21.15.29:0/3928587645 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb38051660 con 0x29d0a30 2023-10-06T05:28:30.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 10 client.6150 fetch_fsmap learned FSMap version 27 2023-10-06T05:28:30.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 -- 172.21.15.29:0/3928587645 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x2afb490 con 0x29d0a30 2023-10-06T05:28:30.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb1dffb700 1 -- 172.21.15.29:0/3928587645 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2acf670 con 0x29d0a30 2023-10-06T05:28:30.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb1dffb700 1 -- 172.21.15.29:0/3928587645 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdb3806c1a0 con 0x29d0a30 2023-10-06T05:28:30.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 10 client.6150 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T05:28:30.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 10 client.6150 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:28:30.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 20 client.6150 populate_metadata read hostname 'smithi029' 2023-10-06T05:28:30.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2c0feb0 0x2c12290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 4 client.6150 mds_command: new command op to 5901 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:28:30.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb482ae740 1 -- 172.21.15.29:0/3928587645 --> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2b01530 con 0x2c0feb0 2023-10-06T05:28:30.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2c0feb0 0x2c12290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb1dffb700 10 client.6150 ms_handle_connect on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:30.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.966+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2c0feb0 0x2c12290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d207f6f4cc780a server_cookie=52f83c8302b9e292 in_seq=0 out_seq=0 2023-10-06T05:28:30.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb1dffb700 1 -- 172.21.15.29:0/3928587645 <== mds.0 v2:172.21.15.29:6834/1584172634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x2b01530 con 0x2c0feb0 2023-10-06T05:28:30.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb1dffb700 10 client.6150 handle_command_reply: tid=0 2023-10-06T05:28:30.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 client.6150 shutdown 2023-10-06T05:28:30.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 -- 172.21.15.29:0/3928587645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29d0a30 msgr2=0x2bbd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29d0a30 0x2bbd500 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdb38003420 tx=0x7fdb3807c340 comp rx=0 tx=0).stop 2023-10-06T05:28:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 -- 172.21.15.29:0/3928587645 shutdown_connections 2023-10-06T05:28:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2c0feb0 0x2c12290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29d0a30 0x2bbd500 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2985d80 0x2bbcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 --2- 172.21.15.29:0/3928587645 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29859b0 0x2bbca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 -- 172.21.15.29:0/3928587645 >> 172.21.15.29:0/3928587645 conn(0x2986150 msgr2=0x2bc05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb1dffb700 0 client.6150 ms_handle_reset on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:30.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 -- 172.21.15.29:0/3928587645 shutdown_connections 2023-10-06T05:28:30.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 1 -- 172.21.15.29:0/3928587645 wait complete. 2023-10-06T05:28:30.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.970+0000 7fdb482ae740 20 client.6150 trim_cache size 0 max 16384 2023-10-06T05:28:30.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.986+0000 7fdb482ae740 1 Processor -- start 2023-10-06T05:28:30.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.986+0000 7fdb482ae740 1 -- start start 2023-10-06T05:28:30.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2bbbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2985d80 0x2bbc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29d0a30 0x2c11ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:30.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x29fea60 con 0x29859b0 2023-10-06T05:28:30.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b28d40 con 0x29d0a30 2023-10-06T05:28:30.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2afdd30 con 0x2985d80 2023-10-06T05:28:30.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2bbbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:30.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2bbbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39590/0 (socket says 172.21.15.29:39590) 2023-10-06T05:28:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3f7fe700 1 -- 172.21.15.29:0/535218489 learned_addr learned my addr 172.21.15.29:0/535218489 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29d0a30 0x2c11ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3effd700 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2985d80 0x2bbc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3f7fe700 1 -- 172.21.15.29:0/535218489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2985d80 msgr2=0x2bbc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2985d80 0x2bbc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3f7fe700 1 -- 172.21.15.29:0/535218489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29d0a30 msgr2=0x2c11ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29d0a30 0x2c11ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3f7fe700 1 -- 172.21.15.29:0/535218489 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400678b0 con 0x29859b0 2023-10-06T05:28:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3effd700 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2985d80 0x2bbc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:28:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2bbbb10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdb30002990 tx=0x7fdb30014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22238d090f7305eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb257fa700 1 -- 172.21.15.29:0/535218489 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30028070 con 0x29859b0 2023-10-06T05:28:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb257fa700 1 -- 172.21.15.29:0/535218489 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb30014450 con 0x29859b0 2023-10-06T05:28:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb257fa700 1 -- 172.21.15.29:0/535218489 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb300147d0 con 0x29859b0 2023-10-06T05:28:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- 172.21.15.29:0/535218489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 msgr2=0x2bbbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2bbbb10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdb30002990 tx=0x7fdb30014000 comp rx=0 tx=0).stop 2023-10-06T05:28:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- 172.21.15.29:0/535218489 shutdown_connections 2023-10-06T05:28:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29d0a30 0x2c11ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2985d80 0x2bbc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- 172.21.15.29:0/535218489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x29859b0 0x2bbbb10 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- 172.21.15.29:0/535218489 >> 172.21.15.29:0/535218489 conn(0x2986150 msgr2=0x2c14100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- 172.21.15.29:0/535218489 shutdown_connections 2023-10-06T05:28:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- 172.21.15.29:0/535218489 wait complete. 2023-10-06T05:28:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- start start 2023-10-06T05:28:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 Processor -- start 2023-10-06T05:28:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29859b0 0x2c5c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2985d80 0x2c5cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 0x2be0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2acd750 con 0x2985d80 2023-10-06T05:28:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b55710 con 0x29859b0 2023-10-06T05:28:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b2f780 con 0x29d0a30 2023-10-06T05:28:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.990+0000 7fdb482ae740 10 client.0 _ll_register_callbacks cb 0x2ad6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:28:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2985d80 0x2c5cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2985d80 0x2c5cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39606/0 (socket says 172.21.15.29:39606) 2023-10-06T05:28:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3effd700 1 -- 172.21.15.29:0/626961963 learned_addr learned my addr 172.21.15.29:0/626961963 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29859b0 0x2c5c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3ffff700 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 0x2be0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3effd700 1 -- 172.21.15.29:0/626961963 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 msgr2=0x2be0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3effd700 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 0x2be0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3effd700 1 -- 172.21.15.29:0/626961963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29859b0 msgr2=0x2c5c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3effd700 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29859b0 0x2c5c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3effd700 1 -- 172.21.15.29:0/626961963 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb30019040 con 0x2985d80 2023-10-06T05:28:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3effd700 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2985d80 0x2c5cdc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdb340074b0 tx=0x7fdb3401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65a66e438cc17ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:28:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb1dffb700 1 -- 172.21.15.29:0/626961963 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34014680 con 0x2985d80 2023-10-06T05:28:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb1dffb700 1 -- 172.21.15.29:0/626961963 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7fdb340147e0 con 0x2985d80 2023-10-06T05:28:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb482ae740 1 -- 172.21.15.29:0/626961963 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb34010850 con 0x2985d80 2023-10-06T05:28:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb1dffb700 1 -- 172.21.15.29:0/626961963 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb34014bd0 con 0x2985d80 2023-10-06T05:28:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb482ae740 10 client.6156 fetch_fsmap learned FSMap version 27 2023-10-06T05:28:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb482ae740 1 -- 172.21.15.29:0/626961963 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x2ae1ea0 con 0x2985d80 2023-10-06T05:28:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb1dffb700 1 -- 172.21.15.29:0/626961963 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb34010850 con 0x2985d80 2023-10-06T05:28:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb1dffb700 1 -- 172.21.15.29:0/626961963 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdb34028070 con 0x2985d80 2023-10-06T05:28:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb482ae740 10 client.6156 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T05:28:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb482ae740 10 client.6156 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:28:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb482ae740 20 client.6156 populate_metadata read hostname 'smithi029' 2023-10-06T05:28:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb482ae740 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2be1a90 0x2be1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb482ae740 4 client.6156 mds_command: new command op to 5901 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-10-06T05:28:31.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb482ae740 1 -- 172.21.15.29:0/626961963 --> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x29dd780 con 0x2be1a90 2023-10-06T05:28:31.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2be1a90 0x2be1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb1dffb700 10 client.6156 ms_handle_connect on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:31.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb3f7fe700 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2be1a90 0x2be1e90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c5a42f1a259f129 server_cookie=3ed8e51027ea6c09 in_seq=0 out_seq=0 2023-10-06T05:28:31.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb1dffb700 1 -- 172.21.15.29:0/626961963 <== mds.0 v2:172.21.15.29:6834/1584172634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x29dd780 con 0x2be1a90 2023-10-06T05:28:31.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.994+0000 7fdb1dffb700 10 client.6156 handle_command_reply: tid=0 2023-10-06T05:28:31.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 client.6156 shutdown 2023-10-06T05:28:31.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 -- 172.21.15.29:0/626961963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2985d80 msgr2=0x2c5cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2985d80 0x2c5cdc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdb340074b0 tx=0x7fdb3401c000 comp rx=0 tx=0).stop 2023-10-06T05:28:31.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 -- 172.21.15.29:0/626961963 shutdown_connections 2023-10-06T05:28:31.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2be1a90 0x2be1e90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x29d0a30 0x2be0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb1dffb700 0 client.6156 ms_handle_reset on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:31.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2985d80 0x2c5cdc0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 --2- 172.21.15.29:0/626961963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x29859b0 0x2c5c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 -- 172.21.15.29:0/626961963 >> 172.21.15.29:0/626961963 conn(0x2986150 msgr2=0x2bbab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:31.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 -- 172.21.15.29:0/626961963 shutdown_connections 2023-10-06T05:28:31.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 1 -- 172.21.15.29:0/626961963 wait complete. 2023-10-06T05:28:31.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb482ae740 20 client.6156 trim_cache size 0 max 16384 2023-10-06T05:28:31.011 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:28:31.011 INFO:teuthology.orchestra.run.smithi029.stdout: "return_code": 0, 2023-10-06T05:28:31.011 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_tag": "3330c9f9-a89f-42bf-b308-45a87e8091ee", 2023-10-06T05:28:31.011 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": "asynchronous" 2023-10-06T05:28:31.012 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:28:31.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 -- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb2c060550 msgr2=0x7fdb2c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb2c060550 0x7fdb2c062a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdb30003a80 tx=0x7fdb30007ec0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 -- 172.21.15.29:0/160496846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 msgr2=0x7fdb4014fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 0x7fdb4014fb70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800bcc0 tx=0x7fdb3801a000 comp rx=0 tx=0).stop 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 -- 172.21.15.29:0/160496846 shutdown_connections 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb4015a410 0x7fdb4014fb70 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb40155f30 0x7fdb4016a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb2c060550 0x7fdb2c062a00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 --2- 172.21.15.29:0/160496846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb40155b60 0x7fdb400c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 -- 172.21.15.29:0/160496846 >> 172.21.15.29:0/160496846 conn(0x7fdb400c9830 msgr2=0x7fdb400c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 -- 172.21.15.29:0/160496846 shutdown_connections 2023-10-06T05:28:31.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:30.998+0000 7fdb44da3700 1 -- 172.21.15.29:0/160496846 wait complete. 2023-10-06T05:28:31.015 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T05:28:31.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 Processor -- start 2023-10-06T05:28:31.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 -- start start 2023-10-06T05:28:31.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f66a8158c40 0x7f66a80d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f66a8159010 0x7f66a806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a80cae30 con 0x7f66a80ce320 2023-10-06T05:28:31.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a806ba70 con 0x7f66a8159010 2023-10-06T05:28:31.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a806b1e0 con 0x7f66a8158c40 2023-10-06T05:28:31.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f66a8159010 0x7f66a806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f66a8159010 0x7f66a806aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39618/0 (socket says 172.21.15.29:39618) 2023-10-06T05:28:31.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a7fff700 1 -- 172.21.15.29:0/3190289450 learned_addr learned my addr 172.21.15.29:0/3190289450 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:31.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66acd91700 1 --2- 172.21.15.29:0/3190289450 >> v2:172.21.15.173:3300/0 conn(0x7f66a8158c40 0x7f66a80d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a7fff700 1 -- 172.21.15.29:0/3190289450 >> v2:172.21.15.173:3300/0 conn(0x7f66a8158c40 msgr2=0x7f66a80d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a7fff700 1 --2- 172.21.15.29:0/3190289450 >> v2:172.21.15.173:3300/0 conn(0x7f66a8158c40 0x7f66a80d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a7fff700 1 -- 172.21.15.29:0/3190289450 >> v1:172.21.15.173:6789/0 conn(0x7f66a80ce320 legacy=0x7f66a815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a7fff700 1 -- 172.21.15.29:0/3190289450 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a806b4b0 con 0x7f66a8159010 2023-10-06T05:28:31.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a7fff700 1 --2- 172.21.15.29:0/3190289450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 0x7f66a806aca0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f66a80cd8b0 tx=0x7f6690009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b262196fc525c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:31.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a77fe700 1 -- 172.21.15.29:0/3190289450 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000b860 con 0x7f66a8159010 2023-10-06T05:28:31.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a77fe700 1 -- 172.21.15.29:0/3190289450 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669000b9c0 con 0x7f66a8159010 2023-10-06T05:28:31.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66a77fe700 1 -- 172.21.15.29:0/3190289450 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000bd60 con 0x7f66a8159010 2023-10-06T05:28:31.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 -- 172.21.15.29:0/3190289450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 msgr2=0x7f66a806aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 --2- 172.21.15.29:0/3190289450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 0x7f66a806aca0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f66a80cd8b0 tx=0x7f6690009250 comp rx=0 tx=0).stop 2023-10-06T05:28:31.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 -- 172.21.15.29:0/3190289450 shutdown_connections 2023-10-06T05:28:31.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 --2- 172.21.15.29:0/3190289450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 0x7f66a806aca0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 --2- 172.21.15.29:0/3190289450 >> v2:172.21.15.173:3300/0 conn(0x7f66a8158c40 0x7f66a80d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 -- 172.21.15.29:0/3190289450 >> 172.21.15.29:0/3190289450 conn(0x7f66a80670a0 msgr2=0x7f66a80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:31.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 -- 172.21.15.29:0/3190289450 shutdown_connections 2023-10-06T05:28:31.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.130+0000 7f66add93700 1 -- 172.21.15.29:0/3190289450 wait complete. 2023-10-06T05:28:31.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 Processor -- start 2023-10-06T05:28:31.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 -- start start 2023-10-06T05:28:31.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a80ce320 0x7f66a80c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a8158c40 0x7f66a816c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 0x7f66a8152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c8a40 con 0x7f66a8159010 2023-10-06T05:28:31.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c8d20 con 0x7f66a80ce320 2023-10-06T05:28:31.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c9000 con 0x7f66a8158c40 2023-10-06T05:28:31.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66ad592700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 0x7f66a8152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66ad592700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 0x7f66a8152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39628/0 (socket says 172.21.15.29:39628) 2023-10-06T05:28:31.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66ad592700 1 -- 172.21.15.29:0/539994875 learned_addr learned my addr 172.21.15.29:0/539994875 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:31.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66a7fff700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a8158c40 0x7f66a816c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66acd91700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a80ce320 0x7f66a80c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66ad592700 1 -- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a8158c40 msgr2=0x7f66a816c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66ad592700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a8158c40 0x7f66a816c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66ad592700 1 -- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a80ce320 msgr2=0x7f66a80c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66ad592700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a80ce320 0x7f66a80c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66ad592700 1 -- 172.21.15.29:0/539994875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900094f0 con 0x7f66a8159010 2023-10-06T05:28:31.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66ad592700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 0x7f66a8152a00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c910 tx=0x7f66a00016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:31.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66a4ff9700 1 -- 172.21.15.29:0/539994875 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0012630 con 0x7f66a8159010 2023-10-06T05:28:31.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66a4ff9700 1 -- 172.21.15.29:0/539994875 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a00127b0 con 0x7f66a8159010 2023-10-06T05:28:31.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 -- 172.21.15.29:0/539994875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a80c92e0 con 0x7f66a8159010 2023-10-06T05:28:31.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66a4ff9700 1 -- 172.21.15.29:0/539994875 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0012b70 con 0x7f66a8159010 2023-10-06T05:28:31.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.134+0000 7f66add93700 1 -- 172.21.15.29:0/539994875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a80c7d30 con 0x7f66a8159010 2023-10-06T05:28:31.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66a4ff9700 1 -- 172.21.15.29:0/539994875 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f66a0003030 con 0x7f66a8159010 2023-10-06T05:28:31.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66b129e740 1 Processor -- start 2023-10-06T05:28:31.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66b129e740 1 -- start start 2023-10-06T05:28:31.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66a4ff9700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6688060550 0x7f6688062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66a4ff9700 1 -- 172.21.15.29:0/539994875 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f66a007c920 con 0x7f66a8159010 2023-10-06T05:28:31.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66a7fff700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6688060550 0x7f6688062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66b129e740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 0x1412730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66b129e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11de840 0x1412c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66b129e740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x12298c0 0x1413900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66b129e740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x138a0f0 con 0x12298c0 2023-10-06T05:28:31.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66b129e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1385ee0 con 0x11de840 2023-10-06T05:28:31.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66b129e740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x134c020 con 0x11dec10 2023-10-06T05:28:31.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66ad592700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x12298c0 0x1413900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66ad592700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x12298c0 0x1413900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39636/0 (socket says 172.21.15.29:39636) 2023-10-06T05:28:31.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66acd91700 1 --2- 172.21.15.29:0/3638647921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 0x1412730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.138+0000 7f66ad592700 1 -- 172.21.15.29:0/3638647921 learned_addr learned my addr 172.21.15.29:0/3638647921 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:31.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66a7fff700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6688060550 0x7f6688062a00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66a80cd8b0 tx=0x7f6690017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:31.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66a7fff700 1 --2- 172.21.15.29:0/3638647921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11de840 0x1412c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66ad592700 1 -- 172.21.15.29:0/3638647921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 msgr2=0x1412730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66ad592700 1 --2- 172.21.15.29:0/3638647921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 0x1412730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66ad592700 1 -- 172.21.15.29:0/3638647921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11de840 msgr2=0x1412c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66ad592700 1 --2- 172.21.15.29:0/3638647921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11de840 0x1412c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66ad592700 1 -- 172.21.15.29:0/3638647921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x122ab10 con 0x12298c0 2023-10-06T05:28:31.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66ad592700 1 --2- 172.21.15.29:0/3638647921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x12298c0 0x1413900 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f66a0001370 tx=0x7f66a007abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403e29afe14e23b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:31.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f669dffb700 1 -- 172.21.15.29:0/3638647921 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00579c0 con 0x12298c0 2023-10-06T05:28:31.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f669dffb700 1 -- 172.21.15.29:0/3638647921 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a00509e0 con 0x12298c0 2023-10-06T05:28:31.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f669dffb700 1 -- 172.21.15.29:0/3638647921 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a004ed80 con 0x12298c0 2023-10-06T05:28:31.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 -- 172.21.15.29:0/3638647921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x12298c0 msgr2=0x1413900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 --2- 172.21.15.29:0/3638647921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x12298c0 0x1413900 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f66a0001370 tx=0x7f66a007abb0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 -- 172.21.15.29:0/3638647921 shutdown_connections 2023-10-06T05:28:31.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 --2- 172.21.15.29:0/3638647921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x12298c0 0x1413900 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 --2- 172.21.15.29:0/3638647921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11de840 0x1412c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 --2- 172.21.15.29:0/3638647921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 0x1412730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 -- 172.21.15.29:0/3638647921 >> 172.21.15.29:0/3638647921 conn(0x11defe0 msgr2=0x143efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 -- 172.21.15.29:0/3638647921 shutdown_connections 2023-10-06T05:28:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 -- 172.21.15.29:0/3638647921 wait complete. 2023-10-06T05:28:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 -- start start 2023-10-06T05:28:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 Processor -- start 2023-10-06T05:28:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x1418870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 0x1416750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 0x1416c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x134bcc0 con 0x11de840 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1324820 con 0x12298c0 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x134fa30 con 0x11dec10 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66b129e740 10 client.0 _ll_register_callbacks cb 0x1328b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66acd91700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x1418870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66acd91700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x1418870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39642/0 (socket says 172.21.15.29:39642) 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66acd91700 1 -- 172.21.15.29:0/789013364 learned_addr learned my addr 172.21.15.29:0/789013364 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.142+0000 7f66a7fff700 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 0x1416750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66ad592700 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 0x1416c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66acd91700 1 -- 172.21.15.29:0/789013364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 msgr2=0x1416750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66acd91700 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 0x1416750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66acd91700 1 -- 172.21.15.29:0/789013364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 msgr2=0x1416c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66acd91700 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 0x1416c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66acd91700 1 -- 172.21.15.29:0/789013364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a80c7d30 con 0x11de840 2023-10-06T05:28:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66acd91700 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x1418870 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f66980139f0 tx=0x7f6698008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa58772f22939529 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:28:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 1 -- 172.21.15.29:0/789013364 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698015700 con 0x11de840 2023-10-06T05:28:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 1 -- 172.21.15.29:0/789013364 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f6698015860 con 0x11de840 2023-10-06T05:28:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 -- 172.21.15.29:0/789013364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x133ea10 con 0x11de840 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 1 -- 172.21.15.29:0/789013364 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6698015c30 con 0x11de840 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 10 client.6168 fetch_fsmap learned FSMap version 27 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 -- 172.21.15.29:0/789013364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x1354220 con 0x11de840 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 1 -- 172.21.15.29:0/789013364 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x133ea10 con 0x11de840 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 1 -- 172.21.15.29:0/789013364 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f669801b020 con 0x11de840 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 10 client.6168 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 10 client.6168 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 20 client.6168 populate_metadata read hostname 'smithi029' 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x143be80 0x143c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 4 client.6168 mds_command: new command op to 5901 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:28:31.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 -- 172.21.15.29:0/789013364 --> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x13283f0 con 0x143be80 2023-10-06T05:28:31.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66a7fff700 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x143be80 0x143c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 10 client.6168 ms_handle_connect on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66a7fff700 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x143be80 0x143c280 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b32faf4e32805b89 server_cookie=fec148908c05045e in_seq=0 out_seq=0 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 1 -- 172.21.15.29:0/789013364 <== mds.0 v2:172.21.15.29:6834/1584172634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x13283f0 con 0x143be80 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 10 client.6168 handle_command_reply: tid=0 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 client.6168 shutdown 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 -- 172.21.15.29:0/789013364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 msgr2=0x1418870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x1418870 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f66980139f0 tx=0x7f6698008040 comp rx=0 tx=0).stop 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 -- 172.21.15.29:0/789013364 shutdown_connections 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x143be80 0x143c280 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 0x1416c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11dec10 0x1416750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 --2- 172.21.15.29:0/789013364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x1418870 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f6686ffd700 0 client.6168 ms_handle_reset on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.146+0000 7f66b129e740 1 -- 172.21.15.29:0/789013364 >> 172.21.15.29:0/789013364 conn(0x11defe0 msgr2=0x1411720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.150+0000 7f66b129e740 1 -- 172.21.15.29:0/789013364 shutdown_connections 2023-10-06T05:28:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.150+0000 7f66b129e740 1 -- 172.21.15.29:0/789013364 wait complete. 2023-10-06T05:28:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.150+0000 7f66b129e740 20 client.6168 trim_cache size 0 max 16384 2023-10-06T05:28:31.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.166+0000 7f66b129e740 1 Processor -- start 2023-10-06T05:28:31.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 -- start start 2023-10-06T05:28:31.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11de840 0x143ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11dec10 0x143f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 0x1469190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x125ea60 con 0x11dec10 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x12578f0 con 0x12298c0 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x13838a0 con 0x11de840 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66a7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11dec10 0x143f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66a7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11dec10 0x143f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39654/0 (socket says 172.21.15.29:39654) 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66a7fff700 1 -- 172.21.15.29:0/3934554638 learned_addr learned my addr 172.21.15.29:0/3934554638 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66ad592700 1 --2- 172.21.15.29:0/3934554638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 0x1469190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66acd91700 1 --2- 172.21.15.29:0/3934554638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11de840 0x143ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66a7fff700 1 -- 172.21.15.29:0/3934554638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11de840 msgr2=0x143ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66a7fff700 1 --2- 172.21.15.29:0/3934554638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11de840 0x143ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66a7fff700 1 -- 172.21.15.29:0/3934554638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 msgr2=0x1469190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66a7fff700 1 --2- 172.21.15.29:0/3934554638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 0x1469190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66a7fff700 1 -- 172.21.15.29:0/3934554638 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a81532a0 con 0x11dec10 2023-10-06T05:28:31.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66a7fff700 1 --2- 172.21.15.29:0/3934554638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11dec10 0x143f100 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f66a806e080 tx=0x7f6690014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b4d2eaba338ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:31.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f669e7fc700 1 -- 172.21.15.29:0/3934554638 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690021070 con 0x11dec10 2023-10-06T05:28:31.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f669e7fc700 1 -- 172.21.15.29:0/3934554638 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669002e040 con 0x11dec10 2023-10-06T05:28:31.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f669e7fc700 1 -- 172.21.15.29:0/3934554638 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690011ae0 con 0x11dec10 2023-10-06T05:28:31.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 -- 172.21.15.29:0/3934554638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11dec10 msgr2=0x143f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 --2- 172.21.15.29:0/3934554638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11dec10 0x143f100 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f66a806e080 tx=0x7f6690014000 comp rx=0 tx=0).stop 2023-10-06T05:28:31.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 -- 172.21.15.29:0/3934554638 shutdown_connections 2023-10-06T05:28:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 --2- 172.21.15.29:0/3934554638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x12298c0 0x1469190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 --2- 172.21.15.29:0/3934554638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11dec10 0x143f100 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 --2- 172.21.15.29:0/3934554638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x11de840 0x143ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 -- 172.21.15.29:0/3934554638 >> 172.21.15.29:0/3934554638 conn(0x11defe0 msgr2=0x1411720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 -- 172.21.15.29:0/3934554638 shutdown_connections 2023-10-06T05:28:31.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.170+0000 7f66b129e740 1 -- 172.21.15.29:0/3934554638 wait complete. 2023-10-06T05:28:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66b129e740 1 -- start start 2023-10-06T05:28:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66b129e740 1 Processor -- start 2023-10-06T05:28:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66b129e740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x14b5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66b129e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11dec10 0x14b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66b129e740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x12298c0 0x146bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66b129e740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1356930 con 0x11de840 2023-10-06T05:28:31.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66b129e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x138a650 con 0x11dec10 2023-10-06T05:28:31.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66b129e740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1384d70 con 0x12298c0 2023-10-06T05:28:31.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66b129e740 10 client.0 _ll_register_callbacks cb 0x1302140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:28:31.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66acd91700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x14b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66acd91700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x14b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39666/0 (socket says 172.21.15.29:39666) 2023-10-06T05:28:31.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66acd91700 1 -- 172.21.15.29:0/1397399975 learned_addr learned my addr 172.21.15.29:0/1397399975 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:28:31.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66ad592700 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x12298c0 0x146bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66a7fff700 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11dec10 0x14b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66acd91700 1 -- 172.21.15.29:0/1397399975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x12298c0 msgr2=0x146bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66acd91700 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x12298c0 0x146bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66acd91700 1 -- 172.21.15.29:0/1397399975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11dec10 msgr2=0x14b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:28:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66acd91700 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11dec10 0x14b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66acd91700 1 -- 172.21.15.29:0/1397399975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a806b4b0 con 0x11de840 2023-10-06T05:28:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f66acd91700 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x14b5250 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6698007080 tx=0x7f6698023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a267fe54a93775b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:28:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f6686ffd700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:28:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.174+0000 7f6686ffd700 1 -- 172.21.15.29:0/1397399975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698030070 con 0x11de840 2023-10-06T05:28:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f6686ffd700 1 -- 172.21.15.29:0/1397399975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f6698014410 con 0x11de840 2023-10-06T05:28:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 -- 172.21.15.29:0/1397399975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66a00509e0 con 0x11de840 2023-10-06T05:28:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f6686ffd700 1 -- 172.21.15.29:0/1397399975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66980147e0 con 0x11de840 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 10 client.6174 fetch_fsmap learned FSMap version 27 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 -- 172.21.15.29:0/1397399975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x133ac30 con 0x11de840 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f6686ffd700 1 -- 172.21.15.29:0/1397399975 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a00509e0 con 0x11de840 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f6686ffd700 1 -- 172.21.15.29:0/1397399975 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f669801b070 con 0x11de840 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 10 client.6174 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 10 client.6174 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 20 client.6174 populate_metadata read hostname 'smithi029' 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x146c710 0x146cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 4 client.6174 mds_command: new command op to 5901 tid=0[{"prefix": "scrub status"}] 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 -- 172.21.15.29:0/1397399975 --> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x135a2c0 con 0x146c710 2023-10-06T05:28:31.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66a7fff700 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x146c710 0x146cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f6686ffd700 10 client.6174 ms_handle_connect on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66a7fff700 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x146c710 0x146cb10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fddcde6f67c852d server_cookie=62afac5b6bfc10c6 in_seq=0 out_seq=0 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f6686ffd700 1 -- 172.21.15.29:0/1397399975 <== mds.0 v2:172.21.15.29:6834/1584172634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x135a2c0 con 0x146c710 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f6686ffd700 10 client.6174 handle_command_reply: tid=0 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 client.6174 shutdown 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 -- 172.21.15.29:0/1397399975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 msgr2=0x14b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x14b5250 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6698007080 tx=0x7f6698023000 comp rx=0 tx=0).stop 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 -- 172.21.15.29:0/1397399975 shutdown_connections 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x146c710 0x146cb10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x12298c0 0x146bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x11dec10 0x14b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 --2- 172.21.15.29:0/1397399975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x11de840 0x14b5250 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 -- 172.21.15.29:0/1397399975 >> 172.21.15.29:0/1397399975 conn(0x11defe0 msgr2=0x1411720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f6686ffd700 0 client.6174 ms_handle_reset on v2:172.21.15.29:6834/1584172634 2023-10-06T05:28:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 -- 172.21.15.29:0/1397399975 shutdown_connections 2023-10-06T05:28:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 1 -- 172.21.15.29:0/1397399975 wait complete. 2023-10-06T05:28:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.178+0000 7f66b129e740 20 client.6174 trim_cache size 0 max 16384 2023-10-06T05:28:31.190 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:28:31.190 INFO:teuthology.orchestra.run.smithi029.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T05:28:31.190 INFO:teuthology.orchestra.run.smithi029.stdout: "scrubs": { 2023-10-06T05:28:31.190 INFO:teuthology.orchestra.run.smithi029.stdout: "3330c9f9-a89f-42bf-b308-45a87e8091ee": { 2023-10-06T05:28:31.191 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2023-10-06T05:28:31.191 INFO:teuthology.orchestra.run.smithi029.stdout: "tag": "3330c9f9-a89f-42bf-b308-45a87e8091ee", 2023-10-06T05:28:31.191 INFO:teuthology.orchestra.run.smithi029.stdout: "options": "recursive,repair" 2023-10-06T05:28:31.191 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:31.191 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:28:31.191 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 -- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6688060550 msgr2=0x7f6688062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6688060550 0x7f6688062a00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66a80cd8b0 tx=0x7f6690017000 comp rx=0 tx=0).stop 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 -- 172.21.15.29:0/539994875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 msgr2=0x7f66a8152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 0x7f66a8152a00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c910 tx=0x7f66a00016d0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 -- 172.21.15.29:0/539994875 shutdown_connections 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66a8159010 0x7f66a8152a00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66a8158c40 0x7f66a816c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6688060550 0x7f6688062a00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 --2- 172.21.15.29:0/539994875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f66a80ce320 0x7f66a80c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:28:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 -- 172.21.15.29:0/539994875 >> 172.21.15.29:0/539994875 conn(0x7f66a80670a0 msgr2=0x7f66a81547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:28:31.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 -- 172.21.15.29:0/539994875 shutdown_connections 2023-10-06T05:28:31.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:31.182+0000 7f66add93700 1 -- 172.21.15.29:0/539994875 wait complete. 2023-10-06T05:28:31.200 INFO:tasks.cephfs.filesystem:scrub status for tag:3330c9f9-a89f-42bf-b308-45a87e8091ee - {'path': '/', 'tag': '3330c9f9-a89f-42bf-b308-45a87e8091ee', 'options': 'recursive,repair'} 2023-10-06T05:28:32.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:32.530+0000 7f2f83fff700 1 -- 172.21.15.29:0/808249915 <== mon.0 v2:172.21.15.29:3300/0 7 ==== log(4 entries from seq 1 at 2023-10-06T05:28:30.997695+0000) v1 ==== 695+0+0 (secure 0 0 0) 0x7f2f90051550 con 0x7f2f9c0ae220 2023-10-06T05:28:32.535 INFO:teuthology.orchestra.run.smithi029.stdout: cluster: 2023-10-06T05:28:32.535 INFO:teuthology.orchestra.run.smithi029.stdout: id: bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:28:32.535 INFO:teuthology.orchestra.run.smithi029.stdout: health: HEALTH_OK 2023-10-06T05:28:32.535 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:32.535 INFO:teuthology.orchestra.run.smithi029.stdout: services: 2023-10-06T05:28:32.535 INFO:teuthology.orchestra.run.smithi029.stdout: mon: 3 daemons, quorum a,b,c (age 3m) 2023-10-06T05:28:32.535 INFO:teuthology.orchestra.run.smithi029.stdout: mgr: x(active, since 3m), standbys: y 2023-10-06T05:28:32.535 INFO:teuthology.orchestra.run.smithi029.stdout: mds: 1/1 daemons up, 3 standby 2023-10-06T05:28:32.535 INFO:teuthology.orchestra.run.smithi029.stdout: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: data: 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: volumes: 1/1 healthy 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: pools: 4 pools, 105 pgs 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: objects: 26 objects, 6.6 MiB 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: usage: 2.3 GiB used, 718 GiB / 720 GiB avail 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: pgs: 105 active+clean 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: io: 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: client: 127 B/s rd, 770 KiB/s wr, 0 op/s rd, 2 op/s wr 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:32.536 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:28:32.537 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:28:30.997695+0000 mds.c [INF] scrub queued for path: / 2023-10-06T05:28:32.537 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:28:30.997701+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T05:28:32.537 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:28:30.997710+0000 mds.c [INF] scrub summary: active paths [/] 2023-10-06T05:28:32.537 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:28:30.999754+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T05:28:33.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:28:33.538+0000 7f2f83fff700 1 -- 172.21.15.29:0/808249915 <== mon.0 v2:172.21.15.29:3300/0 8 ==== log(1 entries from seq 5 at 2023-10-06T05:28:32.821634+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f2f900540a0 con 0x7f2f9c0ae220 2023-10-06T05:28:33.544 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:28:32.821634+0000 mds.c [INF] scrub summary: idle 2023-10-06T05:28:40.207 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:28:40.210 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:29:01.201 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T05:29:01.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f5127fff700 1 Processor -- start 2023-10-06T05:29:01.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f5127fff700 1 -- start start 2023-10-06T05:29:01.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f5127fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5128155020 0x7f51281553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f5127fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51280c8f00 0x7f51280af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f5127fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512806cad0 con 0x7f51280af580 2023-10-06T05:29:01.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f5127fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51280afa00 con 0x7f5128155020 2023-10-06T05:29:01.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f5127fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51280afce0 con 0x7f51280c8f00 2023-10-06T05:29:01.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f5126ffd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5128155020 0x7f51281553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f511e7fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51280c8f00 0x7f51280af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f51277fe700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f51280af580 0x7f51280681b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:40388/0 (socket says 172.21.15.29:40388) 2023-10-06T05:29:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f51277fe700 1 -- 172.21.15.29:0/4098128536 learned_addr learned my addr 172.21.15.29:0/4098128536 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f511e7fc700 1 -- 172.21.15.29:0/4098128536 >> v2:172.21.15.173:3300/0 conn(0x7f5128155020 msgr2=0x7f51281553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f511e7fc700 1 --2- 172.21.15.29:0/4098128536 >> v2:172.21.15.173:3300/0 conn(0x7f5128155020 0x7f51281553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f511e7fc700 1 -- 172.21.15.29:0/4098128536 >> v1:172.21.15.173:6789/0 conn(0x7f51280af580 legacy=0x7f51280681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f511e7fc700 1 -- 172.21.15.29:0/4098128536 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512806c760 con 0x7f51280c8f00 2023-10-06T05:29:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f51267fc700 1 -- 172.21.15.29:0/4098128536 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426146994 0 0) 0x7f512806cad0 con 0x7f51280af580 2023-10-06T05:29:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f5126ffd700 1 --2- 172.21.15.29:0/4098128536 >> v2:172.21.15.173:3300/0 conn(0x7f5128155020 0x7f51281553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:01.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.321+0000 7f511e7fc700 1 --2- 172.21.15.29:0/4098128536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51280c8f00 0x7f51280af040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51100098e0 tx=0x7f51100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b59632a0595756f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f51267fc700 1 -- 172.21.15.29:0/4098128536 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000b640 con 0x7f51280c8f00 2023-10-06T05:29:01.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f51267fc700 1 -- 172.21.15.29:0/4098128536 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511000b7a0 con 0x7f51280c8f00 2023-10-06T05:29:01.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f51267fc700 1 -- 172.21.15.29:0/4098128536 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000bb40 con 0x7f51280c8f00 2023-10-06T05:29:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 -- 172.21.15.29:0/4098128536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51280c8f00 msgr2=0x7f51280af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 --2- 172.21.15.29:0/4098128536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51280c8f00 0x7f51280af040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51100098e0 tx=0x7f51100091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 -- 172.21.15.29:0/4098128536 shutdown_connections 2023-10-06T05:29:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 --2- 172.21.15.29:0/4098128536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51280c8f00 0x7f51280af040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 --2- 172.21.15.29:0/4098128536 >> v2:172.21.15.173:3300/0 conn(0x7f5128155020 0x7f51281553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 -- 172.21.15.29:0/4098128536 >> 172.21.15.29:0/4098128536 conn(0x7f512806abc0 msgr2=0x7f51280adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 -- 172.21.15.29:0/4098128536 shutdown_connections 2023-10-06T05:29:01.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 -- 172.21.15.29:0/4098128536 wait complete. 2023-10-06T05:29:01.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 Processor -- start 2023-10-06T05:29:01.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.325+0000 7f5127fff700 1 -- start start 2023-10-06T05:29:01.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5127fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51280c8f00 0x7f512814d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5127fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5128155020 0x7f5128169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5127fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5128168ce0 0x7f512816bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5127fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512816c100 con 0x7f51280c8f00 2023-10-06T05:29:01.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5127fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51280c27d0 con 0x7f5128155020 2023-10-06T05:29:01.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5127fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5128169cd0 con 0x7f5128168ce0 2023-10-06T05:29:01.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5126ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51280c8f00 0x7f512814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5126ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51280c8f00 0x7f512814d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42844/0 (socket says 172.21.15.29:42844) 2023-10-06T05:29:01.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5126ffd700 1 -- 172.21.15.29:0/3905238824 learned_addr learned my addr 172.21.15.29:0/3905238824 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f51277fe700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5128168ce0 0x7f512816bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f511e7fc700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5128155020 0x7f5128169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5126ffd700 1 -- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5128168ce0 msgr2=0x7f512816bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5126ffd700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5128168ce0 0x7f512816bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5126ffd700 1 -- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5128155020 msgr2=0x7f5128169ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5126ffd700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5128155020 0x7f5128169ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5126ffd700 1 -- 172.21.15.29:0/3905238824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51180093c0 con 0x7f51280c8f00 2023-10-06T05:29:01.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5126ffd700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51280c8f00 0x7f512814d440 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f511800ecb0 tx=0x7f5118009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f511f7fe700 1 -- 172.21.15.29:0/3905238824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118005a00 con 0x7f51280c8f00 2023-10-06T05:29:01.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f511f7fe700 1 -- 172.21.15.29:0/3905238824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118005b60 con 0x7f51280c8f00 2023-10-06T05:29:01.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5127fff700 1 -- 172.21.15.29:0/3905238824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5110009420 con 0x7f51280c8f00 2023-10-06T05:29:01.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f511f7fe700 1 -- 172.21.15.29:0/3905238824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511800c850 con 0x7f51280c8f00 2023-10-06T05:29:01.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.329+0000 7f5127fff700 1 -- 172.21.15.29:0/3905238824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5128169710 con 0x7f51280c8f00 2023-10-06T05:29:01.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.333+0000 7f511f7fe700 1 -- 172.21.15.29:0/3905238824 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f511800cbc0 con 0x7f51280c8f00 2023-10-06T05:29:01.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.333+0000 7f511f7fe700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5108060550 0x7f5108062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.333+0000 7f511f7fe700 1 -- 172.21.15.29:0/3905238824 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f511807cd50 con 0x7f51280c8f00 2023-10-06T05:29:01.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.333+0000 7f511e7fc700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5108060550 0x7f5108062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.333+0000 7f511e7fc700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5108060550 0x7f5108062a00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f51100091e0 tx=0x7f5110017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.333+0000 7f512f8e1740 1 Processor -- start 2023-10-06T05:29:01.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 -- start start 2023-10-06T05:29:01.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x2859730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 0x2859c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x285a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x27d10f0 con 0x2625c10 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x27ccee0 con 0x26708c0 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2793020 con 0x2625840 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5126ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x2859730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5126ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x2859730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42852/0 (socket says 172.21.15.29:42852) 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5126ffd700 1 -- 172.21.15.29:0/3363841568 learned_addr learned my addr 172.21.15.29:0/3363841568 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f511e7fc700 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 0x2859c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f51277fe700 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x285a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5126ffd700 1 -- 172.21.15.29:0/3363841568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 msgr2=0x2859c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5126ffd700 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 0x2859c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5126ffd700 1 -- 172.21.15.29:0/3363841568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 msgr2=0x285a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5126ffd700 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x285a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5126ffd700 1 -- 172.21.15.29:0/3363841568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2671b10 con 0x2625c10 2023-10-06T05:29:01.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f51277fe700 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x285a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5126ffd700 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x2859730 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f511804d310 tx=0x7f511807afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9936500b15f84b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5107fff700 1 -- 172.21.15.29:0/3363841568 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118057df0 con 0x2625c10 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5107fff700 1 -- 172.21.15.29:0/3363841568 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118066200 con 0x2625c10 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f5107fff700 1 -- 172.21.15.29:0/3363841568 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511804ef50 con 0x2625c10 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 -- 172.21.15.29:0/3363841568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 msgr2=0x2859730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x2859730 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f511804d310 tx=0x7f511807afe0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 -- 172.21.15.29:0/3363841568 shutdown_connections 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x285a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 0x2859c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 --2- 172.21.15.29:0/3363841568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x2859730 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 -- 172.21.15.29:0/3363841568 >> 172.21.15.29:0/3363841568 conn(0x2625fe0 msgr2=0x2885fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 -- 172.21.15.29:0/3363841568 shutdown_connections 2023-10-06T05:29:01.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.337+0000 7f512f8e1740 1 -- 172.21.15.29:0/3363841568 wait complete. 2023-10-06T05:29:01.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 -- start start 2023-10-06T05:29:01.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 Processor -- start 2023-10-06T05:29:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625840 0x285f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625c10 0x285d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26708c0 0x285dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2792cc0 con 0x2625840 2023-10-06T05:29:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x276b820 con 0x2625c10 2023-10-06T05:29:01.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2796000 con 0x26708c0 2023-10-06T05:29:01.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 10 client.0 _ll_register_callbacks cb 0x276fb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:01.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f5126ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625840 0x285f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f5126ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625840 0x285f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42858/0 (socket says 172.21.15.29:42858) 2023-10-06T05:29:01.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f5126ffd700 1 -- 172.21.15.29:0/1100474821 learned_addr learned my addr 172.21.15.29:0/1100474821 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f51277fe700 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26708c0 0x285dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f511e7fc700 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625c10 0x285d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f5126ffd700 1 -- 172.21.15.29:0/1100474821 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26708c0 msgr2=0x285dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f5126ffd700 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26708c0 0x285dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f5126ffd700 1 -- 172.21.15.29:0/1100474821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625c10 msgr2=0x285d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f5126ffd700 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625c10 0x285d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f5126ffd700 1 -- 172.21.15.29:0/1100474821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5128169710 con 0x2625840 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f51277fe700 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26708c0 0x285dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f5126ffd700 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625840 0x285f870 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5118050b10 tx=0x7f5118067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea5e20c3ea01e34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f51057fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f51057fa700 1 -- 172.21.15.29:0/1100474821 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51180510b0 con 0x2625840 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f51057fa700 1 -- 172.21.15.29:0/1100474821 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f5118051210 con 0x2625840 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 -- 172.21.15.29:0/1100474821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2785a10 con 0x2625840 2023-10-06T05:29:01.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f51057fa700 1 -- 172.21.15.29:0/1100474821 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5118050510 con 0x2625840 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 10 client.6183 fetch_fsmap learned FSMap version 27 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 1 -- 172.21.15.29:0/1100474821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x279b220 con 0x2625840 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f51057fa700 1 -- 172.21.15.29:0/1100474821 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2785a10 con 0x2625840 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f51057fa700 1 -- 172.21.15.29:0/1100474821 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f511806d070 con 0x2625840 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 10 client.6183 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 10 client.6183 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.341+0000 7f512f8e1740 20 client.6183 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2882e80 0x2883280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 4 client.6183 mds_command: new command op to 5901 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 -- 172.21.15.29:0/1100474821 --> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x276f3f0 con 0x2882e80 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f511e7fc700 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2882e80 0x2883280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f51057fa700 10 client.6183 ms_handle_connect on v2:172.21.15.29:6834/1584172634 2023-10-06T05:29:01.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f511e7fc700 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2882e80 0x2883280 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ae5c01677b6bfe6 server_cookie=c01fcaedce0b86b6 in_seq=0 out_seq=0 2023-10-06T05:29:01.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f51057fa700 1 -- 172.21.15.29:0/1100474821 <== mds.0 v2:172.21.15.29:6834/1584172634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x276f3f0 con 0x2882e80 2023-10-06T05:29:01.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f51057fa700 10 client.6183 handle_command_reply: tid=0 2023-10-06T05:29:01.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 client.6183 shutdown 2023-10-06T05:29:01.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 -- 172.21.15.29:0/1100474821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625840 msgr2=0x285f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625840 0x285f870 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5118050b10 tx=0x7f5118067000 comp rx=0 tx=0).stop 2023-10-06T05:29:01.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 -- 172.21.15.29:0/1100474821 shutdown_connections 2023-10-06T05:29:01.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x2882e80 0x2883280 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26708c0 0x285dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625c10 0x285d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f51057fa700 0 client.6183 ms_handle_reset on v2:172.21.15.29:6834/1584172634 2023-10-06T05:29:01.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 --2- 172.21.15.29:0/1100474821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625840 0x285f870 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 -- 172.21.15.29:0/1100474821 >> 172.21.15.29:0/1100474821 conn(0x2625fe0 msgr2=0x2858720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 -- 172.21.15.29:0/1100474821 shutdown_connections 2023-10-06T05:29:01.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 1 -- 172.21.15.29:0/1100474821 wait complete. 2023-10-06T05:29:01.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.345+0000 7f512f8e1740 20 client.6183 trim_cache size 0 max 16384 2023-10-06T05:29:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f512f8e1740 1 Processor -- start 2023-10-06T05:29:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f512f8e1740 1 -- start start 2023-10-06T05:29:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625840 0x2885bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625c10 0x2886100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26708c0 0x28b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f512f8e1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x27d10f0 con 0x26708c0 2023-10-06T05:29:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f512f8e1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x279d930 con 0x2625840 2023-10-06T05:29:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f512f8e1740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x283b630 con 0x2625c10 2023-10-06T05:29:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f51277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26708c0 0x28b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f51277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26708c0 0x28b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42872/0 (socket says 172.21.15.29:42872) 2023-10-06T05:29:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f51277fe700 1 -- 172.21.15.29:0/2433471125 learned_addr learned my addr 172.21.15.29:0/2433471125 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f511e7fc700 1 --2- 172.21.15.29:0/2433471125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625c10 0x2886100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f5126ffd700 1 --2- 172.21.15.29:0/2433471125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625840 0x2885bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f51277fe700 1 -- 172.21.15.29:0/2433471125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625c10 msgr2=0x2886100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f51277fe700 1 --2- 172.21.15.29:0/2433471125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625c10 0x2886100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f51277fe700 1 -- 172.21.15.29:0/2433471125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625840 msgr2=0x2885bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f51277fe700 1 --2- 172.21.15.29:0/2433471125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625840 0x2885bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f51277fe700 1 -- 172.21.15.29:0/2433471125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280adbe0 con 0x26708c0 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f51277fe700 1 --2- 172.21.15.29:0/2433471125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26708c0 0x28b0190 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5120002180 tx=0x7f5120009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59240cf33746674 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f511cff9700 1 -- 172.21.15.29:0/2433471125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5120016450 con 0x26708c0 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f511cff9700 1 -- 172.21.15.29:0/2433471125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51200165b0 con 0x26708c0 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.365+0000 7f511cff9700 1 -- 172.21.15.29:0/2433471125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5120016970 con 0x26708c0 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 -- 172.21.15.29:0/2433471125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26708c0 msgr2=0x28b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2433471125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26708c0 0x28b0190 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5120002180 tx=0x7f5120009040 comp rx=0 tx=0).stop 2023-10-06T05:29:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 -- 172.21.15.29:0/2433471125 shutdown_connections 2023-10-06T05:29:01.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2433471125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26708c0 0x28b0190 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2433471125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625c10 0x2886100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2433471125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2625840 0x2885bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 -- 172.21.15.29:0/2433471125 >> 172.21.15.29:0/2433471125 conn(0x2625fe0 msgr2=0x2858720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 -- 172.21.15.29:0/2433471125 shutdown_connections 2023-10-06T05:29:01.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 -- 172.21.15.29:0/2433471125 wait complete. 2023-10-06T05:29:01.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 -- start start 2023-10-06T05:29:01.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 Processor -- start 2023-10-06T05:29:01.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 0x28fc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x28fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x28b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x274bd80 con 0x2625c10 2023-10-06T05:29:01.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2623560 con 0x26708c0 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2670fd0 con 0x2625840 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f511e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x28fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f511e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x28fcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42886/0 (socket says 172.21.15.29:42886) 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f511e7fc700 1 -- 172.21.15.29:0/2126506625 learned_addr learned my addr 172.21.15.29:0/2126506625 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f512f8e1740 10 client.0 _ll_register_callbacks cb 0x2749140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f5126ffd700 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 0x28fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f51277fe700 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x28b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f511e7fc700 1 -- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 msgr2=0x28fc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f511e7fc700 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 0x28fc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f511e7fc700 1 -- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 msgr2=0x28b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f511e7fc700 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x28b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f511e7fc700 1 -- 172.21.15.29:0/2126506625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5120001ee0 con 0x2625c10 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f51277fe700 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x28b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f5126ffd700 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 0x28fc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f511e7fc700 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x28fcbb0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5110013000 tx=0x7f5110003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebe5237e71a3337 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.369+0000 7f51057fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f51057fa700 1 -- 172.21.15.29:0/2126506625 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110021070 con 0x2625c10 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f51057fa700 1 -- 172.21.15.29:0/2126506625 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f511001ada0 con 0x2625c10 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 -- 172.21.15.29:0/2126506625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5118066200 con 0x2625c10 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f51057fa700 1 -- 172.21.15.29:0/2126506625 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51100356c0 con 0x2625c10 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 10 client.6189 fetch_fsmap learned FSMap version 27 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 -- 172.21.15.29:0/2126506625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x2781c30 con 0x2625c10 2023-10-06T05:29:01.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f51057fa700 1 -- 172.21.15.29:0/2126506625 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118066200 con 0x2625c10 2023-10-06T05:29:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f51057fa700 1 -- 172.21.15.29:0/2126506625 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5110035820 con 0x2625c10 2023-10-06T05:29:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 10 client.6189 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T05:29:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 10 client.6189 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:29:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 20 client.6189 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x28b3ca0 0x28b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 4 client.6189 mds_command: new command op to 5901 tid=0[{"prefix": "scrub status"}] 2023-10-06T05:29:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 -- 172.21.15.29:0/2126506625 --> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x27a12c0 con 0x28b3ca0 2023-10-06T05:29:01.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5126ffd700 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x28b3ca0 0x28b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f51057fa700 10 client.6189 ms_handle_connect on v2:172.21.15.29:6834/1584172634 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5126ffd700 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x28b3ca0 0x28b40a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65f808eee6465147 server_cookie=32fe6c116ed8e92a in_seq=0 out_seq=0 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f51057fa700 1 -- 172.21.15.29:0/2126506625 <== mds.0 v2:172.21.15.29:6834/1584172634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x27a12c0 con 0x28b3ca0 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f51057fa700 10 client.6189 handle_command_reply: tid=0 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 client.6189 shutdown 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 -- 172.21.15.29:0/2126506625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 msgr2=0x28fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x28fcbb0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5110013000 tx=0x7f5110003040 comp rx=0 tx=0).stop 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 -- 172.21.15.29:0/2126506625 shutdown_connections 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.29:6834/1584172634,v1:172.21.15.29:6835/1584172634] conn(0x28b3ca0 0x28b40a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26708c0 0x28b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x2625c10 0x28fcbb0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 --2- 172.21.15.29:0/2126506625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2625840 0x28fc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f51057fa700 0 client.6189 ms_handle_reset on v2:172.21.15.29:6834/1584172634 2023-10-06T05:29:01.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 -- 172.21.15.29:0/2126506625 >> 172.21.15.29:0/2126506625 conn(0x2625fe0 msgr2=0x2885dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 -- 172.21.15.29:0/2126506625 shutdown_connections 2023-10-06T05:29:01.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 1 -- 172.21.15.29:0/2126506625 wait complete. 2023-10-06T05:29:01.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f512f8e1740 20 client.6189 trim_cache size 0 max 16384 2023-10-06T05:29:01.383 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:29:01.384 INFO:teuthology.orchestra.run.smithi029.stdout: "status": "no active scrubs running", 2023-10-06T05:29:01.384 INFO:teuthology.orchestra.run.smithi029.stdout: "scrubs": {} 2023-10-06T05:29:01.384 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 -- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5108060550 msgr2=0x7f5108062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5108060550 0x7f5108062a00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f51100091e0 tx=0x7f5110017000 comp rx=0 tx=0).stop 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 -- 172.21.15.29:0/3905238824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51280c8f00 msgr2=0x7f512814d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51280c8f00 0x7f512814d440 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f511800ecb0 tx=0x7f5118009120 comp rx=0 tx=0).stop 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 -- 172.21.15.29:0/3905238824 shutdown_connections 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5128168ce0 0x7f512816bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5108060550 0x7f5108062a00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5128155020 0x7f5128169ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 --2- 172.21.15.29:0/3905238824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51280c8f00 0x7f512814d440 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.373+0000 7f5127fff700 1 -- 172.21.15.29:0/3905238824 >> 172.21.15.29:0/3905238824 conn(0x7f512806abc0 msgr2=0x7f51281579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.377+0000 7f5127fff700 1 -- 172.21.15.29:0/3905238824 shutdown_connections 2023-10-06T05:29:01.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.377+0000 7f5127fff700 1 -- 172.21.15.29:0/3905238824 wait complete. 2023-10-06T05:29:01.397 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T05:29:01.498 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T05:29:01.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8eaafcc700 1 Processor -- start 2023-10-06T05:29:01.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8eaafcc700 1 -- start start 2023-10-06T05:29:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8eaafcc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea415a220 0x7f8ea40cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8eaafcc700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8ea406c6c0 0x7f8ea41568a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8eaafcc700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea40cb750 con 0x7f8ea40c81b0 2023-10-06T05:29:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea8d68700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8ea40c81b0 0x7f8ea40c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43086/0 (socket says 172.21.15.29:43086) 2023-10-06T05:29:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea8d68700 1 -- 172.21.15.29:0/2115211348 learned_addr learned my addr 172.21.15.29:0/2115211348 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8eaafcc700 1 -- 172.21.15.29:0/2115211348 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea40c78e0 con 0x7f8ea406c6c0 2023-10-06T05:29:01.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8eaafcc700 1 -- 172.21.15.29:0/2115211348 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c9c10 con 0x7f8ea415a220 2023-10-06T05:29:01.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803625543 0 0) 0x7f8e94001110 con 0x7f8ea40c81b0 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea3fff700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea415a220 0x7f8ea40cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea9569700 1 --2- 172.21.15.29:0/2115211348 >> v2:172.21.15.173:3300/0 conn(0x7f8ea406c6c0 0x7f8ea41568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e8c003570 con 0x7f8ea40c81b0 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 430873918 0 0) 0x7f8e8c003570 con 0x7f8ea40c81b0 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea415a220 msgr2=0x7f8ea40cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea37fe700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea415a220 0x7f8ea40cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 >> v2:172.21.15.173:3300/0 conn(0x7f8ea406c6c0 msgr2=0x7f8ea41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.609+0000 7f8ea37fe700 1 --2- 172.21.15.29:0/2115211348 >> v2:172.21.15.173:3300/0 conn(0x7f8ea406c6c0 0x7f8ea41568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4156410 con 0x7f8ea40c81b0 2023-10-06T05:29:01.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f8e94001600 con 0x7f8ea40c81b0 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 >> v1:172.21.15.29:6789/0 conn(0x7f8ea40c81b0 legacy=0x7f8ea40c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e8c003a60 0x7f8e8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e8c004810 0x7f8e8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea415a220 0x7f8e8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c78e0 con 0x7f8e8c004810 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c9c10 con 0x7f8e8c003a60 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c00ba60 con 0x7f8ea415a220 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea3fff700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e8c004810 0x7f8e8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea8d68700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e8c003a60 0x7f8e8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea9569700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea415a220 0x7f8e8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea3fff700 1 -- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea415a220 msgr2=0x7f8e8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea3fff700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea415a220 0x7f8e8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea3fff700 1 -- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e8c003a60 msgr2=0x7f8e8c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea3fff700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e8c003a60 0x7f8e8c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea3fff700 1 -- 172.21.15.29:0/2115211348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c003570 con 0x7f8e8c004810 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea3fff700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e8c004810 0x7f8e8c004c80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009c30 tx=0x7f8e980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e84fa221e71bf7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800e710 con 0x7f8e8c004810 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9800e870 con 0x7f8e8c004810 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea37fe700 1 -- 172.21.15.29:0/2115211348 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800ec30 con 0x7f8e8c004810 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8eaafcc700 1 -- 172.21.15.29:0/2115211348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e8c004810 msgr2=0x7f8e8c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8eaafcc700 1 --2- 172.21.15.29:0/2115211348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e8c004810 0x7f8e8c004c80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009c30 tx=0x7f8e980091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8ea9569700 1 -- 172.21.15.29:0/2115211348 reap_dead start 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8eaafcc700 1 -- 172.21.15.29:0/2115211348 shutdown_connections 2023-10-06T05:29:01.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8eaafcc700 1 -- 172.21.15.29:0/2115211348 >> 172.21.15.29:0/2115211348 conn(0x7f8ea40ccef0 msgr2=0x7f8ea40c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8eaafcc700 1 -- 172.21.15.29:0/2115211348 shutdown_connections 2023-10-06T05:29:01.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.613+0000 7f8eaafcc700 1 -- 172.21.15.29:0/2115211348 wait complete. 2023-10-06T05:29:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 Processor -- start 2023-10-06T05:29:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 -- start start 2023-10-06T05:29:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e8c004810 0x7f8ea414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea414ac30 0x7f8ea4158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea40c3670 0x7f8ea40af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4157ca0 con 0x7f8ea414ac30 2023-10-06T05:29:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4156db0 con 0x7f8ea40c3670 2023-10-06T05:29:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4157090 con 0x7f8e8c004810 2023-10-06T05:29:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea414ac30 0x7f8ea4158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea414ac30 0x7f8ea4158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42914/0 (socket says 172.21.15.29:42914) 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea3fff700 1 -- 172.21.15.29:0/1154607560 learned_addr learned my addr 172.21.15.29:0/1154607560 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea9569700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea40c3670 0x7f8ea40af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea8d68700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e8c004810 0x7f8ea414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea3fff700 1 -- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e8c004810 msgr2=0x7f8ea414ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea3fff700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e8c004810 0x7f8ea414ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea3fff700 1 -- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea40c3670 msgr2=0x7f8ea40af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea3fff700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea40c3670 0x7f8ea40af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea3fff700 1 -- 172.21.15.29:0/1154607560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4157370 con 0x7f8ea414ac30 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea9569700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea40c3670 0x7f8ea40af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea8d68700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e8c004810 0x7f8ea414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:01.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea3fff700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea414ac30 0x7f8ea4158130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e4b0 tx=0x7f8e9801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea0ff9700 1 -- 172.21.15.29:0/1154607560 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98023070 con 0x7f8ea414ac30 2023-10-06T05:29:01.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea0ff9700 1 -- 172.21.15.29:0/1154607560 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9800e9e0 con 0x7f8ea414ac30 2023-10-06T05:29:01.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea4157650 con 0x7f8ea414ac30 2023-10-06T05:29:01.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8ea0ff9700 1 -- 172.21.15.29:0/1154607560 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9801e030 con 0x7f8ea414ac30 2023-10-06T05:29:01.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.617+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea4158670 con 0x7f8ea414ac30 2023-10-06T05:29:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.621+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea41588c0 con 0x7f8ea414ac30 2023-10-06T05:29:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.621+0000 7f8ea0ff9700 1 -- 172.21.15.29:0/1154607560 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8e98013470 con 0x7f8ea414ac30 2023-10-06T05:29:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.621+0000 7f8ea0ff9700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e90060550 0x7f8e90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.621+0000 7f8ea0ff9700 1 -- 172.21.15.29:0/1154607560 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6203+0+0 (secure 0 0 0) 0x7f8e9807e140 con 0x7f8ea414ac30 2023-10-06T05:29:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.621+0000 7f8ea8d68700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e90060550 0x7f8e90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.625+0000 7f8ea8d68700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e90060550 0x7f8e90062a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8e940017b0 tx=0x7f8e94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.629+0000 7f8ea0ff9700 1 -- 172.21.15.29:0/1154607560 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8e98051fd0 con 0x7f8ea414ac30 2023-10-06T05:29:01.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.833+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8ea4071120 con 0x7f8ea414ac30 2023-10-06T05:29:01.842 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-06T05:29:01.833+0000 7fe44aab2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T05:29:01.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.841+0000 7f8ea0ff9700 1 -- 172.21.15.29:0/1154607560 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8e98051b60 con 0x7f8ea414ac30 2023-10-06T05:29:01.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e90060550 msgr2=0x7f8e90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e90060550 0x7f8e90062a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8e940017b0 tx=0x7f8e94009040 comp rx=0 tx=0).stop 2023-10-06T05:29:01.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea414ac30 msgr2=0x7f8ea4158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea414ac30 0x7f8ea4158130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e4b0 tx=0x7f8e9801a000 comp rx=0 tx=0).stop 2023-10-06T05:29:01.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 shutdown_connections 2023-10-06T05:29:01.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e90060550 0x7f8e90062a00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea40c3670 0x7f8ea40af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea414ac30 0x7f8ea4158130 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 --2- 172.21.15.29:0/1154607560 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e8c004810 0x7f8ea414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 >> 172.21.15.29:0/1154607560 conn(0x7f8ea40ccef0 msgr2=0x7f8ea406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 shutdown_connections 2023-10-06T05:29:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.845+0000 7f8eaafcc700 1 -- 172.21.15.29:0/1154607560 wait complete. 2023-10-06T05:29:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T05:29:01.853 INFO:tasks.ceph.mds.c.smithi029.stderr: -5363> 2023-10-06T05:28:18.446+0000 7f5c42ea2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:29:01.864 DEBUG:teuthology.orchestra.run.smithi029:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2023-10-06T05:29:01.886 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:29:01.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 -- start start 2023-10-06T05:29:01.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 Processor -- start 2023-10-06T05:29:01.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4200400 0x5556e4272580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4200800 0x5556e4272b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4200c00 0x5556e4273080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e414cdc0 con 0x5556e4200800 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e414dcc0 con 0x5556e4200400 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e414db80 con 0x5556e4200c00 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde28ecb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4200800 0x5556e4272b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde28ecb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4200800 0x5556e4272b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42932/0 (socket says 172.21.15.29:42932) 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde28ecb700 1 -- 172.21.15.29:0/1204364711 learned_addr learned my addr 172.21.15.29:0/1204364711 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde296cc700 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4200400 0x5556e4272580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde28ecb700 1 -- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4200c00 msgr2=0x5556e4273080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde29ecd700 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4200c00 0x5556e4273080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde28ecb700 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4200c00 0x5556e4273080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde28ecb700 1 -- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4200400 msgr2=0x5556e4272580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde28ecb700 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4200400 0x5556e4272580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde28ecb700 1 -- 172.21.15.29:0/1204364711 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556e4130340 con 0x5556e4200800 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde296cc700 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4200400 0x5556e4272580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde29ecd700 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4200c00 0x5556e4273080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde28ecb700 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4200800 0x5556e4272b00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x5556e4e86090 tx=0x5556e4eb1bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd3438d1aa50ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde26ec7700 1 -- 172.21.15.29:0/1204364711 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e415b080 con 0x5556e4200800 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde26ec7700 1 -- 172.21.15.29:0/1204364711 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5556e4162f00 con 0x5556e4200800 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde26ec7700 1 -- 172.21.15.29:0/1204364711 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e415b600 con 0x5556e4200800 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 -- 172.21.15.29:0/1204364711 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556e4130000 con 0x5556e4200800 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 1 -- 172.21.15.29:0/1204364711 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5556e4130ea0 con 0x5556e4200800 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 4 waiting for MDS map... 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde26ec7700 1 -- 172.21.15.29:0/1204364711 <== mon.0 v2:172.21.15.29:3300/0 4 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x5556e4ef0a80 con 0x5556e4200800 2023-10-06T05:29:01.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde26ec7700 1 -- 172.21.15.29:0/1204364711 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 28) v1 ==== 2559+0+0 (secure 0 0 0) 0x5556e4f18300 con 0x5556e4200800 2023-10-06T05:29:01.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 4 Got MDS map 28 2023-10-06T05:29:01.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.893+0000 7fde2af120c0 10 main: JournalTool::main 2023-10-06T05:29:01.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 4 main: JournalTool: connecting to RADOS... 2023-10-06T05:29:01.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 Processor -- start 2023-10-06T05:29:01.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 -- start start 2023-10-06T05:29:01.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201800 0x5556e4273600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4201c00 0x5556e4273b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4f78000 0x5556e4274100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e414c3c0 con 0x5556e4201c00 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e414dcc0 con 0x5556e4201800 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e414cdc0 con 0x5556e4f78000 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde296cc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4201c00 0x5556e4273b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde296cc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4201c00 0x5556e4273b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42936/0 (socket says 172.21.15.29:42936) 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde296cc700 1 -- 172.21.15.29:0/4164893916 learned_addr learned my addr 172.21.15.29:0/4164893916 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde28ecb700 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4f78000 0x5556e4274100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde29ecd700 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201800 0x5556e4273600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde296cc700 1 -- 172.21.15.29:0/4164893916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4f78000 msgr2=0x5556e4274100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde296cc700 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4f78000 0x5556e4274100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde296cc700 1 -- 172.21.15.29:0/4164893916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201800 msgr2=0x5556e4273600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde296cc700 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201800 0x5556e4273600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde296cc700 1 -- 172.21.15.29:0/4164893916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556e4131860 con 0x5556e4201c00 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde29ecd700 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201800 0x5556e4273600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde296cc700 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4201c00 0x5556e4273b80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x5556e4e86f90 tx=0x5556e4f8a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f100017e2ac7b1c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde24ec3700 1 -- 172.21.15.29:0/4164893916 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e415b080 con 0x5556e4201c00 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde24ec3700 1 -- 172.21.15.29:0/4164893916 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5556e4f1e480 con 0x5556e4201c00 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde24ec3700 1 -- 172.21.15.29:0/4164893916 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e415b600 con 0x5556e4201c00 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 -- 172.21.15.29:0/4164893916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4201c00 msgr2=0x5556e4273b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4201c00 0x5556e4273b80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x5556e4e86f90 tx=0x5556e4f8a000 comp rx=0 tx=0).stop 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 -- 172.21.15.29:0/4164893916 shutdown_connections 2023-10-06T05:29:01.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4f78000 0x5556e4274100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4201c00 0x5556e4273b80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4164893916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201800 0x5556e4273600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 -- 172.21.15.29:0/4164893916 >> 172.21.15.29:0/4164893916 conn(0x5556e4201000 msgr2=0x5556e4e83800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 -- 172.21.15.29:0/4164893916 shutdown_connections 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 -- 172.21.15.29:0/4164893916 wait complete. 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.897+0000 7fde2af120c0 1 Processor -- start 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 1 -- start start 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201c00 0x5556e4274c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4201800 0x5556e4274680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4ef4000 0x5556e4274100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e414c000 con 0x5556e4ef4000 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e414d180 con 0x5556e4201c00 2023-10-06T05:29:01.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e414d040 con 0x5556e4201800 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde28ecb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4ef4000 0x5556e4274100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde29ecd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201c00 0x5556e4274c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde28ecb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4ef4000 0x5556e4274100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42938/0 (socket says 172.21.15.29:42938) 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde28ecb700 1 -- 172.21.15.29:0/4237487365 learned_addr learned my addr 172.21.15.29:0/4237487365 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde296cc700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4201800 0x5556e4274680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde28ecb700 1 -- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4201800 msgr2=0x5556e4274680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde28ecb700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4201800 0x5556e4274680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde28ecb700 1 -- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201c00 msgr2=0x5556e4274c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde28ecb700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4201c00 0x5556e4274c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde28ecb700 1 -- 172.21.15.29:0/4237487365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556e41309c0 con 0x5556e4ef4000 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde28ecb700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4ef4000 0x5556e4274100 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5556e4f94060 tx=0x5556e4eb1a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde236c0700 1 -- 172.21.15.29:0/4237487365 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e415b1e0 con 0x5556e4ef4000 2023-10-06T05:29:01.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde236c0700 1 -- 172.21.15.29:0/4237487365 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5556e4162000 con 0x5556e4ef4000 2023-10-06T05:29:01.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5556e4131a00 con 0x5556e4ef4000 2023-10-06T05:29:01.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde236c0700 1 -- 172.21.15.29:0/4237487365 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e415af20 con 0x5556e4ef4000 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556e4130340 con 0x5556e4ef4000 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.901+0000 7fde2af120c0 4 main: JournalTool: resolving pool 9 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde236c0700 1 -- 172.21.15.29:0/4237487365 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x5556e4e7d080 con 0x5556e4ef4000 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde236c0700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5556e4f9c800 0x5556e4275700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde236c0700 1 -- 172.21.15.29:0/4237487365 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x5556e4ef1880 con 0x5556e4ef4000 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde2af120c0 4 main: JournalTool: creating IoCtx.. 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde2af120c0 4 main: Executing for rank 0 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde2af120c0 4 Filtering by inode '1099511627777' 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5556e4ef4400 0x5556e4273b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:1 9.f 9:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65) v8 -- 0x5556e4ef4800 con 0x5556e4ef4400 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde29ecd700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5556e4f9c800 0x5556e4275700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde296cc700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5556e4ef4400 0x5556e4273b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde29ecd700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5556e4f9c800 0x5556e4275700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5556e4e8b770 tx=0x5556e4f8b0e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde296cc700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5556e4ef4400 0x5556e4273b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde296cc700 1 -- 172.21.15.29:0/4237487365 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5556e4eeefc0 con 0x5556e4ef4400 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde2af120c0 4 Pointer 400.00000000 is readable 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde2af120c0 4 JournalScanner::scan: reading header object '200.00000000' 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x5556e4ef4c00 0x5556e4273600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.905+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:2 9.14 9:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65) v8 -- 0x5556e4ef5000 con 0x5556e4ef4c00 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde29ecd700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x5556e4ef4c00 0x5556e4273600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde29ecd700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x5556e4ef4c00 0x5556e4273600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde29ecd700 1 -- 172.21.15.29:0/4237487365 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5556e4eef200 con 0x5556e4ef4c00 2023-10-06T05:29:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 10 Header 0x400000 0x405cea 0x406066 2023-10-06T05:29:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 10 Starting journal scan from offset 0x405cea 2023-10-06T05:29:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:3 9.14 9:2e2fa760:::200.00000001:head [read 23786~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65) v8 -- 0x5556e4ef5400 con 0x5556e4ef4c00 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde29ecd700 1 -- 172.21.15.29:0/4237487365 <== osd.1 v2:172.21.15.29:6816/33422 2 ==== osd_op_reply(3 200.00000001 [read 23786~892 out=892b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x5556e4eef200 con 0x5556e4ef4c00 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 4 Read 0x37c bytes from 200.00000001 gap=0 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 10 Parsing data, 0x37c bytes available 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 10 Attempting decode at 0x405cea 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 10 Consumed 0x37c bytes 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 10 Valid entry at 0x405cea 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5556e4ef5800 0x5556e507e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:4 9.1b 9:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65) v8 -- 0x5556e4ef5c00 con 0x5556e4ef5800 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde296cc700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5556e4ef5800 0x5556e507e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde296cc700 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5556e4ef5800 0x5556e507e000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde296cc700 1 -- 172.21.15.29:0/4237487365 <== osd.3 v2:172.21.15.29:6800/33419 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5556e4eeefc0 con 0x5556e4ef5800 2023-10-06T05:29:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 4 Reached end of journal objects 2023-10-06T05:29:01.917 INFO:teuthology.orchestra.run.smithi029.stdout:Events by type: 2023-10-06T05:29:01.917 INFO:teuthology.orchestra.run.smithi029.stdout:Errors: 0 2023-10-06T05:29:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 4 Scanned objects, 0 missing, 1 valid 2023-10-06T05:29:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 4 Events scanned, 0 gaps 2023-10-06T05:29:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 4 Found 1 valid events 2023-10-06T05:29:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 4 Selected 0 events events for processing 2023-10-06T05:29:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 4 0 events 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x5556e4ef4c00 msgr2=0x5556e4273600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x5556e4ef4c00 0x5556e4273600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5556e4ef5800 msgr2=0x5556e507e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5556e4ef5800 0x5556e507e000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5556e4ef4400 msgr2=0x5556e4273b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5556e4ef4400 0x5556e4273b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde296cc700 1 -- 172.21.15.29:0/4237487365 reap_dead start 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5556e4f9c800 msgr2=0x5556e4275700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5556e4f9c800 0x5556e4275700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5556e4e8b770 tx=0x5556e4f8b0e0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4ef4000 msgr2=0x5556e4274100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4ef4000 0x5556e4274100 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5556e4f94060 tx=0x5556e4eb1a40 comp rx=0 tx=0).stop 2023-10-06T05:29:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 shutdown_connections 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4ef4000 0x5556e4274100 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 --2- 172.21.15.29:0/4237487365 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5556e4f9c800 0x5556e4275700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 >> 172.21.15.29:0/4237487365 conn(0x5556e4201000 msgr2=0x5556e4e83800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 shutdown_connections 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.909+0000 7fde2af120c0 1 -- 172.21.15.29:0/4237487365 wait complete. 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.913+0000 7fde2af120c0 1 -- 172.21.15.29:0/1204364711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4200800 msgr2=0x5556e4272b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.913+0000 7fde2af120c0 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4200800 0x5556e4272b00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x5556e4e86090 tx=0x5556e4eb1bc0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.913+0000 7fde2af120c0 1 -- 172.21.15.29:0/1204364711 shutdown_connections 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.913+0000 7fde2af120c0 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5556e4200c00 0x5556e4273080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.913+0000 7fde2af120c0 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5556e4200800 0x5556e4272b00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.913+0000 7fde2af120c0 1 --2- 172.21.15.29:0/1204364711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556e4200400 0x5556e4272580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.913+0000 7fde2af120c0 1 -- 172.21.15.29:0/1204364711 >> 172.21.15.29:0/1204364711 conn(0x5556e4200000 msgr2=0x5556e4e83000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.913+0000 7fde2af120c0 1 -- 172.21.15.29:0/1204364711 shutdown_connections 2023-10-06T05:29:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.913+0000 7fde2af120c0 1 -- 172.21.15.29:0/1204364711 wait complete. 2023-10-06T05:29:01.922 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.057964, result: Events by type: Errors: 0 2023-10-06T05:29:01.922 DEBUG:teuthology.orchestra.run.smithi029:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2023-10-06T05:29:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.953+0000 7fa94b9a20c0 1 -- start start 2023-10-06T05:29:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.953+0000 7fa94b9a20c0 1 Processor -- start 2023-10-06T05:29:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b4400 0x555b3dc58580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b4800 0x555b3dc58b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b4c00 0x555b3dc59080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b3db24dc0 con 0x555b3e8b4c00 2023-10-06T05:29:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b3db25cc0 con 0x555b3e8b4800 2023-10-06T05:29:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b3db25b80 con 0x555b3e8b4400 2023-10-06T05:29:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a95d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b4c00 0x555b3dc59080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a95d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b4c00 0x555b3dc59080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42956/0 (socket says 172.21.15.29:42956) 2023-10-06T05:29:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a95d700 1 -- 172.21.15.29:0/1028273538 learned_addr learned my addr 172.21.15.29:0/1028273538 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94995b700 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b4800 0x555b3dc58b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a15c700 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b4400 0x555b3dc58580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a95d700 1 -- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b4400 msgr2=0x555b3dc58580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a95d700 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b4400 0x555b3dc58580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a95d700 1 -- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b4800 msgr2=0x555b3dc58b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a95d700 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b4800 0x555b3dc58b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a95d700 1 -- 172.21.15.29:0/1028273538 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b3db08340 con 0x555b3e8b4c00 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a15c700 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b4400 0x555b3dc58580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94995b700 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b4800 0x555b3dc58b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94a95d700 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b4c00 0x555b3dc59080 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x555b3e83e030 tx=0x555b3dc5c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ddb5b5f4161fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa947957700 1 -- 172.21.15.29:0/1028273538 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555b3db33080 con 0x555b3e8b4c00 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa947957700 1 -- 172.21.15.29:0/1028273538 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555b3db3af00 con 0x555b3e8b4c00 2023-10-06T05:29:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa947957700 1 -- 172.21.15.29:0/1028273538 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555b3db33600 con 0x555b3e8b4c00 2023-10-06T05:29:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/1028273538 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b3db08000 con 0x555b3e8b4c00 2023-10-06T05:29:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/1028273538 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555b3db08ea0 con 0x555b3e8b4c00 2023-10-06T05:29:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 4 waiting for MDS map... 2023-10-06T05:29:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa947957700 1 -- 172.21.15.29:0/1028273538 <== mon.0 v2:172.21.15.29:3300/0 4 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x555b3e83ca80 con 0x555b3e8b4c00 2023-10-06T05:29:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa947957700 1 -- 172.21.15.29:0/1028273538 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 28) v1 ==== 2559+0+0 (secure 0 0 0) 0x555b3e8d6000 con 0x555b3e8b4c00 2023-10-06T05:29:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 4 Got MDS map 28 2023-10-06T05:29:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.957+0000 7fa94b9a20c0 10 main: JournalTool::main 2023-10-06T05:29:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94b9a20c0 4 main: JournalTool: connecting to RADOS... 2023-10-06T05:29:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94b9a20c0 1 Processor -- start 2023-10-06T05:29:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94b9a20c0 1 -- start start 2023-10-06T05:29:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94b9a20c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b5800 0x555b3dc59600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94b9a20c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b5c00 0x555b3dc59b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94b9a20c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e93a000 0x555b3dc5a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94b9a20c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b3db243c0 con 0x555b3e8b5c00 2023-10-06T05:29:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94b9a20c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b3db25cc0 con 0x555b3e8b5800 2023-10-06T05:29:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94b9a20c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b3db24dc0 con 0x555b3e93a000 2023-10-06T05:29:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94a15c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b5c00 0x555b3dc59b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94a15c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b5c00 0x555b3dc59b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42966/0 (socket says 172.21.15.29:42966) 2023-10-06T05:29:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94a15c700 1 -- 172.21.15.29:0/3117039894 learned_addr learned my addr 172.21.15.29:0/3117039894 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94995b700 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b5800 0x555b3dc59600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94995b700 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e93a000 0x555b3dc5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94a15c700 1 -- 172.21.15.29:0/3117039894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e93a000 msgr2=0x555b3dc5a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94a15c700 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e93a000 0x555b3dc5a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94a15c700 1 -- 172.21.15.29:0/3117039894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b5800 msgr2=0x555b3dc59600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.961+0000 7fa94a15c700 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b5800 0x555b3dc59600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94a15c700 1 -- 172.21.15.29:0/3117039894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b3db09860 con 0x555b3e8b5c00 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94995b700 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e93a000 0x555b3dc5a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94a15c700 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b5c00 0x555b3dc59b80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x555b3e83f590 tx=0x555b3e95a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d0d92c83823c05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa945953700 1 -- 172.21.15.29:0/3117039894 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555b3db33080 con 0x555b3e8b5c00 2023-10-06T05:29:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa945953700 1 -- 172.21.15.29:0/3117039894 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555b3db3a600 con 0x555b3e8b5c00 2023-10-06T05:29:01.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa945953700 1 -- 172.21.15.29:0/3117039894 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555b3db33600 con 0x555b3e8b5c00 2023-10-06T05:29:01.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/3117039894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b5c00 msgr2=0x555b3dc59b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b5c00 0x555b3dc59b80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x555b3e83f590 tx=0x555b3e95a000 comp rx=0 tx=0).stop 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/3117039894 shutdown_connections 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e93a000 0x555b3dc5a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b5c00 0x555b3dc59b80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/3117039894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b5800 0x555b3dc59600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/3117039894 >> 172.21.15.29:0/3117039894 conn(0x555b3e8b5000 msgr2=0x555b3e85b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/3117039894 shutdown_connections 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/3117039894 wait complete. 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 Processor -- start 2023-10-06T05:29:01.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.965+0000 7fa94b9a20c0 1 -- start start 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94b9a20c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b5c00 0x555b3dc5ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94b9a20c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b5800 0x555b3dc5a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94b9a20c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e946000 0x555b3dc5a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94b9a20c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b3db24000 con 0x555b3e946000 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94b9a20c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b3db25180 con 0x555b3e8b5800 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94b9a20c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b3db25040 con 0x555b3e8b5c00 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e946000 0x555b3dc5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e946000 0x555b3dc5a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42974/0 (socket says 172.21.15.29:42974) 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 -- 172.21.15.29:0/4057523409 learned_addr learned my addr 172.21.15.29:0/4057523409 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94a15c700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b5800 0x555b3dc5a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b5c00 0x555b3dc5ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 -- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b5c00 msgr2=0x555b3dc5ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b5c00 0x555b3dc5ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 -- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b5800 msgr2=0x555b3dc5a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b5800 0x555b3dc5a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 -- 172.21.15.29:0/4057523409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b3db089c0 con 0x555b3e946000 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94995b700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e946000 0x555b3dc5a100 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x555b3e95c0f0 tx=0x555b3e95af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa944150700 1 -- 172.21.15.29:0/4057523409 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555b3db33080 con 0x555b3e946000 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa944150700 1 -- 172.21.15.29:0/4057523409 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555b3e8ee480 con 0x555b3e946000 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa944150700 1 -- 172.21.15.29:0/4057523409 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555b3db33600 con 0x555b3e946000 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b3db09a00 con 0x555b3e946000 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b3db089c0 con 0x555b3e946000 2023-10-06T05:29:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.969+0000 7fa94b9a20c0 4 main: JournalTool: resolving pool 9 2023-10-06T05:29:01.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa944150700 1 -- 172.21.15.29:0/4057523409 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x555b3e855080 con 0x555b3e946000 2023-10-06T05:29:01.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa944150700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x555b3e96a400 0x555b3dc5b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa944150700 1 -- 172.21.15.29:0/4057523409 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x555b3e83d880 con 0x555b3e946000 2023-10-06T05:29:01.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94b9a20c0 4 main: JournalTool: creating IoCtx.. 2023-10-06T05:29:01.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94b9a20c0 4 main: Executing for rank 0 2023-10-06T05:29:01.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94b9a20c0 4 Filtering by inode '1099511627778' 2023-10-06T05:29:01.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x555b3e946400 0x555b3dc59b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:1 9.f 9:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65) v8 -- 0x555b3e946800 con 0x555b3e946400 2023-10-06T05:29:01.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94a15c700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x555b3e96a400 0x555b3dc5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94995b700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x555b3e946400 0x555b3dc59b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94a15c700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x555b3e96a400 0x555b3dc5b700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x555b3e83f590 tx=0x555b3dc5df20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94995b700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x555b3e946400 0x555b3dc59b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94995b700 1 -- 172.21.15.29:0/4057523409 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x555b3e83afc0 con 0x555b3e946400 2023-10-06T05:29:01.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94b9a20c0 4 Pointer 400.00000000 is readable 2023-10-06T05:29:01.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94b9a20c0 4 JournalScanner::scan: reading header object '200.00000000' 2023-10-06T05:29:01.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x555b3e946c00 0x555b3dc59600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:2 9.14 9:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65) v8 -- 0x555b3e947000 con 0x555b3e946c00 2023-10-06T05:29:01.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94a95d700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x555b3e946c00 0x555b3dc59600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.973+0000 7fa94a95d700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x555b3e946c00 0x555b3dc59600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94a95d700 1 -- 172.21.15.29:0/4057523409 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x555b3e83b200 con 0x555b3e946c00 2023-10-06T05:29:01.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 10 Header 0x400000 0x405cea 0x406066 2023-10-06T05:29:01.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 10 Starting journal scan from offset 0x405cea 2023-10-06T05:29:01.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:3 9.14 9:2e2fa760:::200.00000001:head [read 23786~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65) v8 -- 0x555b3e947400 con 0x555b3e946c00 2023-10-06T05:29:01.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94a95d700 1 -- 172.21.15.29:0/4057523409 <== osd.1 v2:172.21.15.29:6816/33422 2 ==== osd_op_reply(3 200.00000001 [read 23786~892 out=892b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x555b3e83b200 con 0x555b3e946c00 2023-10-06T05:29:01.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 4 Read 0x37c bytes from 200.00000001 gap=0 2023-10-06T05:29:01.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 10 Parsing data, 0x37c bytes available 2023-10-06T05:29:01.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 10 Attempting decode at 0x405cea 2023-10-06T05:29:01.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 10 Consumed 0x37c bytes 2023-10-06T05:29:01.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 10 Valid entry at 0x405cea 2023-10-06T05:29:01.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x555b3e947800 0x555b3ea44000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:01.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:4 9.1b 9:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65) v8 -- 0x555b3e947c00 con 0x555b3e947800 2023-10-06T05:29:01.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94a15c700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x555b3e947800 0x555b3ea44000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:01.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94a15c700 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x555b3e947800 0x555b3ea44000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:01.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94a15c700 1 -- 172.21.15.29:0/4057523409 <== osd.3 v2:172.21.15.29:6800/33419 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x555b3e83b440 con 0x555b3e947800 2023-10-06T05:29:01.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 4 Reached end of journal objects 2023-10-06T05:29:01.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 4 Scanned objects, 0 missing, 1 valid 2023-10-06T05:29:01.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 4 Events scanned, 0 gaps 2023-10-06T05:29:01.983 INFO:teuthology.orchestra.run.smithi029.stdout:Events by type: 2023-10-06T05:29:01.983 INFO:teuthology.orchestra.run.smithi029.stdout:Errors: 0 2023-10-06T05:29:01.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 4 Found 1 valid events 2023-10-06T05:29:01.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 4 Selected 0 events events for processing 2023-10-06T05:29:01.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 4 0 events 2023-10-06T05:29:01.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x555b3e946c00 msgr2=0x555b3dc59600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x555b3e946c00 0x555b3dc59600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x555b3e947800 msgr2=0x555b3ea44000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x555b3e947800 0x555b3ea44000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x555b3e946400 msgr2=0x555b3dc59b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x555b3e946400 0x555b3dc59b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94a15c700 1 -- 172.21.15.29:0/4057523409 reap_dead start 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x555b3e96a400 msgr2=0x555b3dc5b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x555b3e96a400 0x555b3dc5b700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x555b3e83f590 tx=0x555b3dc5df20 comp rx=0 tx=0).stop 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e946000 msgr2=0x555b3dc5a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e946000 0x555b3dc5a100 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x555b3e95c0f0 tx=0x555b3e95af00 comp rx=0 tx=0).stop 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 shutdown_connections 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e946000 0x555b3dc5a100 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/4057523409 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x555b3e96a400 0x555b3dc5b700 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 >> 172.21.15.29:0/4057523409 conn(0x555b3e8b5000 msgr2=0x555b3e85b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 shutdown_connections 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/4057523409 wait complete. 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/1028273538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b4c00 msgr2=0x555b3dc59080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b4c00 0x555b3dc59080 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x555b3e83e030 tx=0x555b3dc5c300 comp rx=0 tx=0).stop 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/1028273538 shutdown_connections 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555b3e8b4c00 0x555b3dc59080 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555b3e8b4800 0x555b3dc58b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 --2- 172.21.15.29:0/1028273538 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x555b3e8b4400 0x555b3dc58580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/1028273538 >> 172.21.15.29:0/1028273538 conn(0x555b3e8b4000 msgr2=0x555b3e85b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/1028273538 shutdown_connections 2023-10-06T05:29:01.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:01.977+0000 7fa94b9a20c0 1 -- 172.21.15.29:0/1028273538 wait complete. 2023-10-06T05:29:01.988 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.066195, result: Events by type: Errors: 0 2023-10-06T05:29:01.988 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2023-10-06T05:29:02.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.017+0000 7f5085d93e80 1 Processor -- start 2023-10-06T05:29:02.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.017+0000 7f5085d93e80 1 -- start start 2023-10-06T05:29:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f5085d93e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fd39d80 0x55900fd24c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f5085d93e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fdc2900 0x55900fdbc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f5085d93e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc8830 0x55900fdbce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f5085d93e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55900fc97220 con 0x55900fdc8830 2023-10-06T05:29:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f5085d93e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55900fc3b840 con 0x55900fdc2900 2023-10-06T05:29:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f5085d93e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55900fc3b4e0 con 0x55900fd39d80 2023-10-06T05:29:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50830c9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fdc2900 0x55900fdbc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50840cb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc8830 0x55900fdbce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50838ca700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fd39d80 0x55900fd24c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50830c9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fdc2900 0x55900fdbc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:44578/0 (socket says 172.21.15.29:44578) 2023-10-06T05:29:02.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50830c9700 1 -- 172.21.15.29:0/582826738 learned_addr learned my addr 172.21.15.29:0/582826738 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50830c9700 1 -- 172.21.15.29:0/582826738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fd39d80 msgr2=0x55900fd24c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50830c9700 1 --2- 172.21.15.29:0/582826738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fd39d80 0x55900fd24c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50830c9700 1 -- 172.21.15.29:0/582826738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc8830 msgr2=0x55900fdbce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50830c9700 1 --2- 172.21.15.29:0/582826738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc8830 0x55900fdbce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50830c9700 1 -- 172.21.15.29:0/582826738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c005cf0 con 0x55900fdc2900 2023-10-06T05:29:02.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50840cb700 1 --2- 172.21.15.29:0/582826738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc8830 0x55900fdbce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:02.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50830c9700 1 --2- 172.21.15.29:0/582826738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fdc2900 0x55900fdbc660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55900fd400d0 tx=0x7f506c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd8002d5c880a07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:02.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50820c7700 1 -- 172.21.15.29:0/582826738 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c000bc0 con 0x55900fdc2900 2023-10-06T05:29:02.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50820c7700 1 -- 172.21.15.29:0/582826738 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c0089d0 con 0x55900fdc2900 2023-10-06T05:29:02.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.021+0000 7f50820c7700 1 -- 172.21.15.29:0/582826738 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c026460 con 0x55900fdc2900 2023-10-06T05:29:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 -- 172.21.15.29:0/582826738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fdc2900 msgr2=0x55900fdbc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 --2- 172.21.15.29:0/582826738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fdc2900 0x55900fdbc660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55900fd400d0 tx=0x7f506c016000 comp rx=0 tx=0).stop 2023-10-06T05:29:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 -- 172.21.15.29:0/582826738 shutdown_connections 2023-10-06T05:29:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 --2- 172.21.15.29:0/582826738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc8830 0x55900fdbce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 --2- 172.21.15.29:0/582826738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fdc2900 0x55900fdbc660 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 --2- 172.21.15.29:0/582826738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fd39d80 0x55900fd24c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 -- 172.21.15.29:0/582826738 >> 172.21.15.29:0/582826738 conn(0x55900fd3fcd0 msgr2=0x55900fd244f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 -- 172.21.15.29:0/582826738 shutdown_connections 2023-10-06T05:29:02.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 -- 172.21.15.29:0/582826738 wait complete. 2023-10-06T05:29:02.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 Processor -- start 2023-10-06T05:29:02.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 -- start start 2023-10-06T05:29:02.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fd39d80 0x55900fd243d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc2900 0x55900fdbae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fdc8830 0x55900fd23810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55900fc32270 con 0x55900fdc2900 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55900fd24910 con 0x55900fd39d80 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f5085d93e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55900fdd9820 con 0x55900fdc8830 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50830c9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc2900 0x55900fdbae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50830c9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc2900 0x55900fdbae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43002/0 (socket says 172.21.15.29:43002) 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50830c9700 1 -- 172.21.15.29:0/2494745157 learned_addr learned my addr 172.21.15.29:0/2494745157 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50838ca700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fd39d80 0x55900fd243d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50840cb700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fdc8830 0x55900fd23810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50830c9700 1 -- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fdc8830 msgr2=0x55900fd23810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50830c9700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fdc8830 0x55900fd23810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50830c9700 1 -- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fd39d80 msgr2=0x55900fd243d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50830c9700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fd39d80 0x55900fd243d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50830c9700 1 -- 172.21.15.29:0/2494745157 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c00a040 con 0x55900fdc2900 2023-10-06T05:29:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50838ca700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55900fd39d80 0x55900fd243d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50840cb700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55900fdc8830 0x55900fd23810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:02.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.025+0000 7f50830c9700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc2900 0x55900fdbae50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f506c005a90 tx=0x7f506c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f50808c4700 1 -- 172.21.15.29:0/2494745157 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c032470 con 0x55900fdc2900 2023-10-06T05:29:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f50808c4700 1 -- 172.21.15.29:0/2494745157 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c0325d0 con 0x55900fdc2900 2023-10-06T05:29:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55900fc4a250 con 0x55900fdc2900 2023-10-06T05:29:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f50808c4700 1 -- 172.21.15.29:0/2494745157 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c032990 con 0x55900fdc2900 2023-10-06T05:29:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55900fc3d770 con 0x55900fdc2900 2023-10-06T05:29:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f50808c4700 1 -- 172.21.15.29:0/2494745157 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f506c02e070 con 0x55900fdc2900 2023-10-06T05:29:02.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f50808c4700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f506405eee0 0x7f5064061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f50808c4700 1 -- 172.21.15.29:0/2494745157 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f506c07f670 con 0x55900fdc2900 2023-10-06T05:29:02.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f50838ca700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f506405eee0 0x7f5064061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f5085d93e80 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55900fdc77a0 0x55900fd3e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.029+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:1 9.13 9:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65) v8 -- 0x55900fd3e7b0 con 0x55900fdc77a0 2023-10-06T05:29:02.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.033+0000 7f50838ca700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f506405eee0 0x7f5064061390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5074001560 tx=0x7f5074008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:02.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.033+0000 7f50840cb700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55900fdc77a0 0x55900fd3e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.033+0000 7f50840cb700 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55900fdc77a0 0x55900fd3e270 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:02.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f50840cb700 1 -- 172.21.15.29:0/2494745157 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v65'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f507c00d5d0 con 0x55900fdc77a0 2023-10-06T05:29:02.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55900fdc77a0 msgr2=0x55900fd3e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55900fdc77a0 0x55900fd3e270 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f506405eee0 msgr2=0x7f5064061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f506405eee0 0x7f5064061390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5074001560 tx=0x7f5074008040 comp rx=0 tx=0).stop 2023-10-06T05:29:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc2900 msgr2=0x55900fdbae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 --2- 172.21.15.29:0/2494745157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55900fdc2900 0x55900fdbae50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f506c005a90 tx=0x7f506c01e000 comp rx=0 tx=0).stop 2023-10-06T05:29:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f50840cb700 1 -- 172.21.15.29:0/2494745157 reap_dead start 2023-10-06T05:29:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 shutdown_connections 2023-10-06T05:29:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 >> 172.21.15.29:0/2494745157 conn(0x55900fd3fcd0 msgr2=0x55900fdbc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 shutdown_connections 2023-10-06T05:29:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.037+0000 7f5085d93e80 1 -- 172.21.15.29:0/2494745157 wait complete. 2023-10-06T05:29:02.046 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T05:29:02.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f6213358700 1 Processor -- start 2023-10-06T05:29:02.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f6213358700 1 -- start start 2023-10-06T05:29:02.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f6213358700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0cc200 0x7f620c161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f6213358700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620c06b200 con 0x7f620c1569e0 2023-10-06T05:29:02.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f6213358700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620c06a5f0 con 0x7f620c156db0 2023-10-06T05:29:02.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f6213358700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620c06a8d0 con 0x7f620c0cc200 2023-10-06T05:29:02.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f62110f4700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f620c1569e0 0x7f620c0c6ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43118/0 (socket says 172.21.15.29:43118) 2023-10-06T05:29:02.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f62110f4700 1 -- 172.21.15.29:0/3173481879 learned_addr learned my addr 172.21.15.29:0/3173481879 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f62118f5700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0cc200 0x7f620c161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685323887 0 0) 0x7f620c06b200 con 0x7f620c1569e0 2023-10-06T05:29:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f8003570 con 0x7f620c1569e0 2023-10-06T05:29:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244298907 0 0) 0x7f620c06a5f0 con 0x7f620c156db0 2023-10-06T05:29:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f620c06b200 con 0x7f620c156db0 2023-10-06T05:29:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1907510322 0 0) 0x7f61f8003570 con 0x7f620c1569e0 2023-10-06T05:29:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0cc200 msgr2=0x7f620c161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:02.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0cc200 0x7f620c161a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 >> v1:172.21.15.173:6789/0 conn(0x7f620c156db0 legacy=0x7f620c0cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c06abb0 con 0x7f620c1569e0 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f62080017f0 con 0x7f620c1569e0 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f62118f5700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0cc200 0x7f620c161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 >> v1:172.21.15.29:6789/0 conn(0x7f620c1569e0 legacy=0x7f620c0c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8003c20 0x7f61f8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0cc200 0x7f61f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f8004d50 0x7f61f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620c06a8d0 con 0x7f61f8004d50 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f800bb10 con 0x7f61f8003c20 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f800bcd0 con 0x7f620c0cc200 2023-10-06T05:29:02.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f62118f5700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f8004d50 0x7f61f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f62110f4700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8003c20 0x7f61f8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.213+0000 7f62108f3700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0cc200 0x7f61f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f62118f5700 1 -- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0cc200 msgr2=0x7f61f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f62118f5700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0cc200 0x7f61f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f62118f5700 1 -- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8003c20 msgr2=0x7f61f8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f62118f5700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8003c20 0x7f61f8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f62118f5700 1 -- 172.21.15.29:0/3173481879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204009420 con 0x7f61f8004d50 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f62118f5700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f8004d50 0x7f61f80051c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f620c0cc600 tx=0x7f62040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9597c16265d5b2f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204009740 con 0x7f61f8004d50 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620400e920 con 0x7f61f8004d50 2023-10-06T05:29:02.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f61fffff700 1 -- 172.21.15.29:0/3173481879 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620400ece0 con 0x7f61f8004d50 2023-10-06T05:29:02.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f6213358700 1 -- 172.21.15.29:0/3173481879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f8004d50 msgr2=0x7f61f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f6213358700 1 --2- 172.21.15.29:0/3173481879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f8004d50 0x7f61f80051c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f620c0cc600 tx=0x7f62040091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f62118f5700 1 -- 172.21.15.29:0/3173481879 reap_dead start 2023-10-06T05:29:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f6213358700 1 -- 172.21.15.29:0/3173481879 shutdown_connections 2023-10-06T05:29:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f6213358700 1 -- 172.21.15.29:0/3173481879 >> 172.21.15.29:0/3173481879 conn(0x7f620c0670a0 msgr2=0x7f620c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f6213358700 1 -- 172.21.15.29:0/3173481879 shutdown_connections 2023-10-06T05:29:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f6213358700 1 -- 172.21.15.29:0/3173481879 wait complete. 2023-10-06T05:29:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f6213358700 1 Processor -- start 2023-10-06T05:29:02.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.217+0000 7f6213358700 1 -- start start 2023-10-06T05:29:02.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f6213358700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8004d50 0x7f620c14c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f6213358700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0c2c10 0x7f620c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f6213358700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f620c0b02e0 0x7f620c0c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f6213358700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620c0c5f20 con 0x7f620c0b02e0 2023-10-06T05:29:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f6213358700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620c0af7c0 con 0x7f61f8004d50 2023-10-06T05:29:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f6213358700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620c0ae960 con 0x7f620c0c2c10 2023-10-06T05:29:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62118f5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f620c0b02e0 0x7f620c0c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62118f5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f620c0b02e0 0x7f620c0c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43022/0 (socket says 172.21.15.29:43022) 2023-10-06T05:29:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62118f5700 1 -- 172.21.15.29:0/848424585 learned_addr learned my addr 172.21.15.29:0/848424585 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62110f4700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8004d50 0x7f620c14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62108f3700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0c2c10 0x7f620c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62118f5700 1 -- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0c2c10 msgr2=0x7f620c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62118f5700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0c2c10 0x7f620c0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62118f5700 1 -- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8004d50 msgr2=0x7f620c14c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62118f5700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8004d50 0x7f620c14c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62118f5700 1 -- 172.21.15.29:0/848424585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c0aebb0 con 0x7f620c0b02e0 2023-10-06T05:29:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f62118f5700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f620c0b02e0 0x7f620c0c21f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f620400e790 tx=0x7f620401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:02.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f61fd7fa700 1 -- 172.21.15.29:0/848424585 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204022070 con 0x7f620c0b02e0 2023-10-06T05:29:02.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f61fd7fa700 1 -- 172.21.15.29:0/848424585 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6204009740 con 0x7f620c0b02e0 2023-10-06T05:29:02.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620c0aee90 con 0x7f620c0b02e0 2023-10-06T05:29:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f61fd7fa700 1 -- 172.21.15.29:0/848424585 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620401c890 con 0x7f620c0b02e0 2023-10-06T05:29:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.221+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620c0af450 con 0x7f620c0b02e0 2023-10-06T05:29:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.225+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620c071120 con 0x7f620c0b02e0 2023-10-06T05:29:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.225+0000 7f61fd7fa700 1 -- 172.21.15.29:0/848424585 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f620401ccc0 con 0x7f620c0b02e0 2023-10-06T05:29:02.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.225+0000 7f61fd7fa700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61f0060550 0x7f61f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.225+0000 7f61fd7fa700 1 -- 172.21.15.29:0/848424585 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f6204000e40 con 0x7f620c0b02e0 2023-10-06T05:29:02.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.225+0000 7f62110f4700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61f0060550 0x7f61f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.225+0000 7f62110f4700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61f0060550 0x7f61f0062a00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6208001580 tx=0x7f6208002190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:02.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.233+0000 7f61fd7fa700 1 -- 172.21.15.29:0/848424585 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f620404e940 con 0x7f620c0b02e0 2023-10-06T05:29:02.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.437+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f620c06ae90 con 0x7f620c0b02e0 2023-10-06T05:29:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.845+0000 7f61fd7fa700 1 -- 172.21.15.29:0/848424585 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v29) v1 ==== 162+0+0 (secure 0 0 0) 0x7f6204051f60 con 0x7f620c0b02e0 2023-10-06T05:29:02.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61f0060550 msgr2=0x7f61f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61f0060550 0x7f61f0062a00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6208001580 tx=0x7f6208002190 comp rx=0 tx=0).stop 2023-10-06T05:29:02.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f620c0b02e0 msgr2=0x7f620c0c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f620c0b02e0 0x7f620c0c21f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f620400e790 tx=0x7f620401a000 comp rx=0 tx=0).stop 2023-10-06T05:29:02.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 shutdown_connections 2023-10-06T05:29:02.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f620c0b02e0 0x7f620c0c21f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f620c0c2c10 0x7f620c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61f0060550 0x7f61f0062a00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 --2- 172.21.15.29:0/848424585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8004d50 0x7f620c14c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 >> 172.21.15.29:0/848424585 conn(0x7f620c0670a0 msgr2=0x7f620c0c0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:02.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.849+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 shutdown_connections 2023-10-06T05:29:02.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.853+0000 7f6213358700 1 -- 172.21.15.29:0/848424585 wait complete. 2023-10-06T05:29:02.857 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T05:29:02.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:29:02.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c58f9f700 1 Processor -- start 2023-10-06T05:29:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c58f9f700 1 -- start start 2023-10-06T05:29:02.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c58f9f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c54158c00 0x7f5c5406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c58f9f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c540ce740 0x7f5c540cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c58f9f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5406b250 con 0x7f5c540ceb90 2023-10-06T05:29:02.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c58f9f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5406a640 con 0x7f5c540ce740 2023-10-06T05:29:02.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c58f9f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5406a920 con 0x7f5c54158c00 2023-10-06T05:29:02.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c52ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c540ce740 0x7f5c540cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c52ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c540ce740 0x7f5c540cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43024/0 (socket says 172.21.15.29:43024) 2023-10-06T05:29:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c52ffd700 1 -- 172.21.15.29:0/3127139572 learned_addr learned my addr 172.21.15.29:0/3127139572 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c537fe700 1 --2- 172.21.15.29:0/3127139572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c54158c00 0x7f5c5406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c52ffd700 1 -- 172.21.15.29:0/3127139572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c54158c00 msgr2=0x7f5c5406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c52ffd700 1 --2- 172.21.15.29:0/3127139572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c54158c00 0x7f5c5406b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c52ffd700 1 -- 172.21.15.29:0/3127139572 >> v1:172.21.15.29:6789/0 conn(0x7f5c540ceb90 legacy=0x7f5c5415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c527fc700 1 -- 172.21.15.29:0/3127139572 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158402295 0 0) 0x7f5c5406b250 con 0x7f5c540ceb90 2023-10-06T05:29:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c52ffd700 1 -- 172.21.15.29:0/3127139572 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5406ac00 con 0x7f5c540ce740 2023-10-06T05:29:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c537fe700 1 --2- 172.21.15.29:0/3127139572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c54158c00 0x7f5c5406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c52ffd700 1 --2- 172.21.15.29:0/3127139572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 0x7f5c540cfb60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009f20 tx=0x7f5c44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f87be8e13f2643 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c527fc700 1 -- 172.21.15.29:0/3127139572 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400e070 con 0x7f5c540ce740 2023-10-06T05:29:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c527fc700 1 -- 172.21.15.29:0/3127139572 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400ba80 con 0x7f5c540ce740 2023-10-06T05:29:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.977+0000 7f5c527fc700 1 -- 172.21.15.29:0/3127139572 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440092e0 con 0x7f5c540ce740 2023-10-06T05:29:02.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 -- 172.21.15.29:0/3127139572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 msgr2=0x7f5c540cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 --2- 172.21.15.29:0/3127139572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 0x7f5c540cfb60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009f20 tx=0x7f5c44009840 comp rx=0 tx=0).stop 2023-10-06T05:29:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 -- 172.21.15.29:0/3127139572 shutdown_connections 2023-10-06T05:29:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 --2- 172.21.15.29:0/3127139572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 0x7f5c540cfb60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 --2- 172.21.15.29:0/3127139572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c54158c00 0x7f5c5406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 -- 172.21.15.29:0/3127139572 >> 172.21.15.29:0/3127139572 conn(0x7f5c540670a0 msgr2=0x7f5c54067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 -- 172.21.15.29:0/3127139572 shutdown_connections 2023-10-06T05:29:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 -- 172.21.15.29:0/3127139572 wait complete. 2023-10-06T05:29:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 Processor -- start 2023-10-06T05:29:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 -- start start 2023-10-06T05:29:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 0x7f5c5414bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c540ceb90 0x7f5c54153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c54158c00 0x7f5c541542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540c95e0 con 0x7f5c540ce740 2023-10-06T05:29:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540c89d0 con 0x7f5c54158c00 2023-10-06T05:29:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c58f9f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540c8cb0 con 0x7f5c540ceb90 2023-10-06T05:29:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c537fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 0x7f5c5414bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c537fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 0x7f5c5414bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43030/0 (socket says 172.21.15.29:43030) 2023-10-06T05:29:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c537fe700 1 -- 172.21.15.29:0/383135857 learned_addr learned my addr 172.21.15.29:0/383135857 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c52ffd700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c540ceb90 0x7f5c54153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.981+0000 7f5c53fff700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c54158c00 0x7f5c541542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c537fe700 1 -- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c540ceb90 msgr2=0x7f5c54153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c537fe700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c540ceb90 0x7f5c54153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c537fe700 1 -- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c54158c00 msgr2=0x7f5c541542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:02.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c537fe700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c54158c00 0x7f5c541542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:02.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c537fe700 1 -- 172.21.15.29:0/383135857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009ae0 con 0x7f5c540ce740 2023-10-06T05:29:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c537fe700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 0x7f5c5414bc30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00d860 tx=0x7f5c3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c4b7fe700 1 -- 172.21.15.29:0/383135857 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0125f0 con 0x7f5c540ce740 2023-10-06T05:29:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c4b7fe700 1 -- 172.21.15.29:0/383135857 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c012750 con 0x7f5c540ce740 2023-10-06T05:29:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c4b7fe700 1 -- 172.21.15.29:0/383135857 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c012af0 con 0x7f5c540ce740 2023-10-06T05:29:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c540c8f90 con 0x7f5c540ce740 2023-10-06T05:29:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5414c170 con 0x7f5c540ce740 2023-10-06T05:29:02.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5404be00 con 0x7f5c540ce740 2023-10-06T05:29:02.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.985+0000 7f5c4b7fe700 1 -- 172.21.15.29:0/383135857 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5c3c013480 con 0x7f5c540ce740 2023-10-06T05:29:02.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.989+0000 7f5c4b7fe700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5c34060550 0x7f5c34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:02.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.989+0000 7f5c4b7fe700 1 -- 172.21.15.29:0/383135857 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f5c3c07cc00 con 0x7f5c540ce740 2023-10-06T05:29:02.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.989+0000 7f5c52ffd700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5c34060550 0x7f5c34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:02.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.989+0000 7f5c52ffd700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5c34060550 0x7f5c34062a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009880 tx=0x7f5c44018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:03.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:02.997+0000 7f5c4b7fe700 1 -- 172.21.15.29:0/383135857 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5c3c04cf00 con 0x7f5c540ce740 2023-10-06T05:29:03.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.189+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c540681b0 con 0x7f5c540ce740 2023-10-06T05:29:03.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.189+0000 7f5c4b7fe700 1 -- 172.21.15.29:0/383135857 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f5c3c050520 con 0x7f5c540ce740 2023-10-06T05:29:03.196 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:03.196 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:29:02.849637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6201":{"gid":6201,"name":"c","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.29:6835/184173135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":184173135},{"type":"v1","addr":"172.21.15.29:6835","nonce":184173135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:29:03.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5c34060550 msgr2=0x7f5c34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:03.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5c34060550 0x7f5c34062a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009880 tx=0x7f5c44018000 comp rx=0 tx=0).stop 2023-10-06T05:29:03.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 msgr2=0x7f5c5414bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:03.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 0x7f5c5414bc30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00d860 tx=0x7f5c3c008040 comp rx=0 tx=0).stop 2023-10-06T05:29:03.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 shutdown_connections 2023-10-06T05:29:03.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5c34060550 0x7f5c34062a00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:03.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c54158c00 0x7f5c541542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:03.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c540ceb90 0x7f5c54153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:03.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 --2- 172.21.15.29:0/383135857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c540ce740 0x7f5c5414bc30 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:03.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 >> 172.21.15.29:0/383135857 conn(0x7f5c540670a0 msgr2=0x7f5c540c5010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:03.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 shutdown_connections 2023-10-06T05:29:03.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:03.193+0000 7f5c58f9f700 1 -- 172.21.15.29:0/383135857 wait complete. 2023-10-06T05:29:03.200 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 30 2023-10-06T05:29:03.612 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:28:13.425370+0000', 'modified': '2023-10-06T05:29:02.849637+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 65, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6201}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6201': {'gid': 6201, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.29:6835/184173135', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 184173135}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 184173135}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:29:03.612 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6201:up:replay 2023-10-06T05:29:04.613 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:29:04.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f5732a47700 1 Processor -- start 2023-10-06T05:29:04.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f5732a47700 1 -- start start 2023-10-06T05:29:04.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f5732a47700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f572c06a500 0x7f572c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:04.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f5732a47700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c0c5a10 con 0x7f572c158ee0 2023-10-06T05:29:04.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f5732a47700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c06a990 con 0x7f572c1592b0 2023-10-06T05:29:04.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f5732a47700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c06ac70 con 0x7f572c06a500 2023-10-06T05:29:04.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f572bfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f572c158ee0 0x7f572c15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51376/0 (socket says 172.21.15.29:51376) 2023-10-06T05:29:04.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f572bfff700 1 -- 172.21.15.29:0/2933426496 learned_addr learned my addr 172.21.15.29:0/2933426496 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:04.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f57237fe700 1 --2- 172.21.15.29:0/2933426496 >> v2:172.21.15.173:3300/0 conn(0x7f572c06a500 0x7f572c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f572b7fe700 1 -- 172.21.15.29:0/2933426496 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017625526 0 0) 0x7f572c0c5a10 con 0x7f572c158ee0 2023-10-06T05:29:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f572b7fe700 1 -- 172.21.15.29:0/2933426496 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5718003570 con 0x7f572c158ee0 2023-10-06T05:29:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f57237fe700 1 -- 172.21.15.29:0/2933426496 >> v1:172.21.15.173:6789/0 conn(0x7f572c1592b0 legacy=0x7f572c0cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f57237fe700 1 -- 172.21.15.29:0/2933426496 >> v1:172.21.15.29:6789/0 conn(0x7f572c158ee0 legacy=0x7f572c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f572b7fe700 1 -- 172.21.15.29:0/2933426496 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390647908 0 0) 0x7f5718003570 con 0x7f572c158ee0 2023-10-06T05:29:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f57237fe700 1 -- 172.21.15.29:0/2933426496 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c06af50 con 0x7f572c06a500 2023-10-06T05:29:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f57237fe700 1 --2- 172.21.15.29:0/2933426496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c06a500 0x7f572c06c6c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f57140098e0 tx=0x7f57140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=358eba4384931c3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.725+0000 7f572b7fe700 1 -- 172.21.15.29:0/2933426496 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571400b640 con 0x7f572c06a500 2023-10-06T05:29:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.729+0000 7f572b7fe700 1 -- 172.21.15.29:0/2933426496 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571400b7a0 con 0x7f572c06a500 2023-10-06T05:29:04.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.729+0000 7f572b7fe700 1 -- 172.21.15.29:0/2933426496 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571400bb20 con 0x7f572c06a500 2023-10-06T05:29:04.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.729+0000 7f5732a47700 1 -- 172.21.15.29:0/2933426496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c06a500 msgr2=0x7f572c06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:04.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.729+0000 7f5732a47700 1 --2- 172.21.15.29:0/2933426496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c06a500 0x7f572c06c6c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f57140098e0 tx=0x7f57140091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:04.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.729+0000 7f5732a47700 1 -- 172.21.15.29:0/2933426496 shutdown_connections 2023-10-06T05:29:04.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.729+0000 7f5732a47700 1 --2- 172.21.15.29:0/2933426496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c06a500 0x7f572c06c6c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:04.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.729+0000 7f5732a47700 1 -- 172.21.15.29:0/2933426496 >> 172.21.15.29:0/2933426496 conn(0x7f572c062b60 msgr2=0x7f572c062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:04.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.729+0000 7f5732a47700 1 -- 172.21.15.29:0/2933426496 shutdown_connections 2023-10-06T05:29:04.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.729+0000 7f5732a47700 1 -- 172.21.15.29:0/2933426496 wait complete. 2023-10-06T05:29:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5732a47700 1 Processor -- start 2023-10-06T05:29:04.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5732a47700 1 -- start start 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5732a47700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c06a500 0x7f572c148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5732a47700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f572c158ee0 0x7f572c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5732a47700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f572c1592b0 0x7f572c157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5732a47700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c16d7a0 con 0x7f572c1592b0 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5732a47700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c16cbd0 con 0x7f572c06a500 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5732a47700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c16ce70 con 0x7f572c158ee0 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5730fe4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f572c1592b0 0x7f572c157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5730fe4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f572c1592b0 0x7f572c157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46812/0 (socket says 172.21.15.29:46812) 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5730fe4700 1 -- 172.21.15.29:0/765127162 learned_addr learned my addr 172.21.15.29:0/765127162 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f57237fe700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f572c158ee0 0x7f572c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f572bfff700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c06a500 0x7f572c148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5730fe4700 1 -- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f572c158ee0 msgr2=0x7f572c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:04.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5730fe4700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f572c158ee0 0x7f572c15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5730fe4700 1 -- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c06a500 msgr2=0x7f572c148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5730fe4700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c06a500 0x7f572c148bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5730fe4700 1 -- 172.21.15.29:0/765127162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714009420 con 0x7f572c1592b0 2023-10-06T05:29:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5730fe4700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f572c1592b0 0x7f572c157c20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f572400c840 tx=0x7f5724001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5728ff9700 1 -- 172.21.15.29:0/765127162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724012630 con 0x7f572c1592b0 2023-10-06T05:29:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5728ff9700 1 -- 172.21.15.29:0/765127162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57240127b0 con 0x7f572c1592b0 2023-10-06T05:29:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c16d150 con 0x7f572c1592b0 2023-10-06T05:29:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.733+0000 7f5728ff9700 1 -- 172.21.15.29:0/765127162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724012b70 con 0x7f572c1592b0 2023-10-06T05:29:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.737+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c0ce510 con 0x7f572c1592b0 2023-10-06T05:29:04.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.737+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c16d910 con 0x7f572c1592b0 2023-10-06T05:29:04.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.737+0000 7f5728ff9700 1 -- 172.21.15.29:0/765127162 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f572401a3a0 con 0x7f572c1592b0 2023-10-06T05:29:04.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.737+0000 7f5728ff9700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f570c060550 0x7f570c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.737+0000 7f5728ff9700 1 -- 172.21.15.29:0/765127162 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f572407cbc0 con 0x7f572c1592b0 2023-10-06T05:29:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.737+0000 7f572bfff700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f570c060550 0x7f570c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:04.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.737+0000 7f572bfff700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f570c060550 0x7f570c062a00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f571c0011e0 tx=0x7f571c007ad0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:04.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.749+0000 7f5728ff9700 1 -- 172.21.15.29:0/765127162 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f572404cf60 con 0x7f572c1592b0 2023-10-06T05:29:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.945+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f572c04be00 con 0x7f572c1592b0 2023-10-06T05:29:04.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5728ff9700 1 -- 172.21.15.29:0/765127162 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f5724050580 con 0x7f572c1592b0 2023-10-06T05:29:04.952 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:04.952 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:29:04.856318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6201":{"gid":6201,"name":"c","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.29:6835/184173135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":184173135},{"type":"v1","addr":"172.21.15.29:6835","nonce":184173135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:29:04.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f570c060550 msgr2=0x7f570c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f570c060550 0x7f570c062a00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f571c0011e0 tx=0x7f571c007ad0 comp rx=0 tx=0).stop 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f572c1592b0 msgr2=0x7f572c157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f572c1592b0 0x7f572c157c20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f572400c840 tx=0x7f5724001670 comp rx=0 tx=0).stop 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 shutdown_connections 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f572c1592b0 0x7f572c157c20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f572c158ee0 0x7f572c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f570c060550 0x7f570c062a00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 --2- 172.21.15.29:0/765127162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c06a500 0x7f572c148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 >> 172.21.15.29:0/765127162 conn(0x7f572c062b60 msgr2=0x7f572c0cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 shutdown_connections 2023-10-06T05:29:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:04.949+0000 7f5732a47700 1 -- 172.21.15.29:0/765127162 wait complete. 2023-10-06T05:29:04.956 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 32 2023-10-06T05:29:05.369 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:28:13.425370+0000', 'modified': '2023-10-06T05:29:04.856318+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 65, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6201}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6201': {'gid': 6201, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.29:6835/184173135', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 184173135}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 184173135}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:29:05.369 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6201:up:rejoin 2023-10-06T05:29:06.370 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:29:06.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe401da1700 1 Processor -- start 2023-10-06T05:29:06.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe401da1700 1 -- start start 2023-10-06T05:29:06.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe401da1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe3fc1569f0 0x7fe3fc0ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:06.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe401da1700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe3fc156dc0 0x7fe3fc15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:06.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe401da1700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc06a5b0 con 0x7fe3fc0c68b0 2023-10-06T05:29:06.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe401da1700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc15b0a0 con 0x7fe3fc1569f0 2023-10-06T05:29:06.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe401da1700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc15b380 con 0x7fe3fc156dc0 2023-10-06T05:29:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe400d9f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe3fc1569f0 0x7fe3fc0ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe4015a0700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe3fc0c68b0 0x7fe3fc06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51378/0 (socket says 172.21.15.29:51378) 2023-10-06T05:29:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe4015a0700 1 -- 172.21.15.29:0/3721479810 learned_addr learned my addr 172.21.15.29:0/3721479810 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.485+0000 7fe3fbfff700 1 --2- 172.21.15.29:0/3721479810 >> v2:172.21.15.173:3300/0 conn(0x7fe3fc156dc0 0x7fe3fc15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:06.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe3fb7fe700 1 -- 172.21.15.29:0/3721479810 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836654714 0 0) 0x7fe3fc06a5b0 con 0x7fe3fc0c68b0 2023-10-06T05:29:06.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe3fb7fe700 1 -- 172.21.15.29:0/3721479810 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e8003570 con 0x7fe3fc0c68b0 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe400d9f700 1 -- 172.21.15.29:0/3721479810 >> v2:172.21.15.173:3300/0 conn(0x7fe3fc156dc0 msgr2=0x7fe3fc15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe400d9f700 1 --2- 172.21.15.29:0/3721479810 >> v2:172.21.15.173:3300/0 conn(0x7fe3fc156dc0 0x7fe3fc15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe400d9f700 1 -- 172.21.15.29:0/3721479810 >> v1:172.21.15.29:6789/0 conn(0x7fe3fc0c68b0 legacy=0x7fe3fc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe400d9f700 1 -- 172.21.15.29:0/3721479810 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc15b660 con 0x7fe3fc1569f0 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe3fbfff700 1 --2- 172.21.15.29:0/3721479810 >> v2:172.21.15.173:3300/0 conn(0x7fe3fc156dc0 0x7fe3fc15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe400d9f700 1 --2- 172.21.15.29:0/3721479810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc1569f0 0x7fe3fc0ab220 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc15b960 tx=0x7fe3ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589ea45a4bf73329 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe3fb7fe700 1 -- 172.21.15.29:0/3721479810 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec011630 con 0x7fe3fc1569f0 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe3fb7fe700 1 -- 172.21.15.29:0/3721479810 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec0117b0 con 0x7fe3fc1569f0 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe3fb7fe700 1 -- 172.21.15.29:0/3721479810 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec011b70 con 0x7fe3fc1569f0 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 -- 172.21.15.29:0/3721479810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc1569f0 msgr2=0x7fe3fc0ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:06.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 --2- 172.21.15.29:0/3721479810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc1569f0 0x7fe3fc0ab220 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc15b960 tx=0x7fe3ec0091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 -- 172.21.15.29:0/3721479810 shutdown_connections 2023-10-06T05:29:06.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 --2- 172.21.15.29:0/3721479810 >> v2:172.21.15.173:3300/0 conn(0x7fe3fc156dc0 0x7fe3fc15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 --2- 172.21.15.29:0/3721479810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc1569f0 0x7fe3fc0ab220 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 -- 172.21.15.29:0/3721479810 >> 172.21.15.29:0/3721479810 conn(0x7fe3fc0670a0 msgr2=0x7fe3fc0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:06.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 -- 172.21.15.29:0/3721479810 shutdown_connections 2023-10-06T05:29:06.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 -- 172.21.15.29:0/3721479810 wait complete. 2023-10-06T05:29:06.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 Processor -- start 2023-10-06T05:29:06.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.489+0000 7fe401da1700 1 -- start start 2023-10-06T05:29:06.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe401da1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe3fc0c68b0 0x7fe3fc1465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe401da1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3fc1569f0 0x7fe3fc0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe401da1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc156dc0 0x7fe3fc0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe401da1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0caa90 con 0x7fe3fc156dc0 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe401da1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cb460 con 0x7fe3fc1569f0 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe401da1700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c9e80 con 0x7fe3fc0c68b0 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe4015a0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc156dc0 0x7fe3fc0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe4015a0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc156dc0 0x7fe3fc0c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46818/0 (socket says 172.21.15.29:46818) 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe4015a0700 1 -- 172.21.15.29:0/1166687508 learned_addr learned my addr 172.21.15.29:0/1166687508 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe400d9f700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe3fc0c68b0 0x7fe3fc1465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:06.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe3fbfff700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3fc1569f0 0x7fe3fc0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe4015a0700 1 -- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe3fc0c68b0 msgr2=0x7fe3fc1465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe4015a0700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe3fc0c68b0 0x7fe3fc1465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe4015a0700 1 -- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3fc1569f0 msgr2=0x7fe3fc0caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe4015a0700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3fc1569f0 0x7fe3fc0caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe4015a0700 1 -- 172.21.15.29:0/1166687508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e4009420 con 0x7fe3fc156dc0 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe4015a0700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc156dc0 0x7fe3fc0c94a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4001460 tx=0x7fe3f4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe3f8ff9700 1 -- 172.21.15.29:0/1166687508 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400a890 con 0x7fe3fc156dc0 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe3f8ff9700 1 -- 172.21.15.29:0/1166687508 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400a9f0 con 0x7fe3fc156dc0 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe3f8ff9700 1 -- 172.21.15.29:0/1166687508 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400ad70 con 0x7fe3fc156dc0 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ec009420 con 0x7fe3fc156dc0 2023-10-06T05:29:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.493+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc0ca440 con 0x7fe3fc156dc0 2023-10-06T05:29:06.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.497+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc0cac40 con 0x7fe3fc156dc0 2023-10-06T05:29:06.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.497+0000 7fe3f8ff9700 1 -- 172.21.15.29:0/1166687508 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe3f4007300 con 0x7fe3fc156dc0 2023-10-06T05:29:06.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.497+0000 7fe3f8ff9700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe3dc060550 0x7fe3dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:06.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.497+0000 7fe3f8ff9700 1 -- 172.21.15.29:0/1166687508 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7fe3f407cda0 con 0x7fe3fc156dc0 2023-10-06T05:29:06.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.497+0000 7fe400d9f700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe3dc060550 0x7fe3dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:06.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.497+0000 7fe400d9f700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe3dc060550 0x7fe3dc062a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc15b960 tx=0x7fe3ec017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:06.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.505+0000 7fe3f8ff9700 1 -- 172.21.15.29:0/1166687508 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe3f404d130 con 0x7fe3fc156dc0 2023-10-06T05:29:06.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.697+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3fc04be00 con 0x7fe3fc156dc0 2023-10-06T05:29:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe3f8ff9700 1 -- 172.21.15.29:0/1166687508 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe3f4050750 con 0x7fe3fc156dc0 2023-10-06T05:29:06.705 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:06.705 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:29:05.859142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6201":{"gid":6201,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/184173135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":184173135},{"type":"v1","addr":"172.21.15.29:6835","nonce":184173135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:29:06.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe3dc060550 msgr2=0x7fe3dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe3dc060550 0x7fe3dc062a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc15b960 tx=0x7fe3ec017000 comp rx=0 tx=0).stop 2023-10-06T05:29:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc156dc0 msgr2=0x7fe3fc0c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc156dc0 0x7fe3fc0c94a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4001460 tx=0x7fe3f4001ae0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 shutdown_connections 2023-10-06T05:29:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3fc156dc0 0x7fe3fc0c94a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe3dc060550 0x7fe3dc062a00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3fc1569f0 0x7fe3fc0caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 --2- 172.21.15.29:0/1166687508 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe3fc0c68b0 0x7fe3fc1465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:06.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 >> 172.21.15.29:0/1166687508 conn(0x7fe3fc0670a0 msgr2=0x7fe3fc0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:06.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 shutdown_connections 2023-10-06T05:29:06.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:06.701+0000 7fe401da1700 1 -- 172.21.15.29:0/1166687508 wait complete. 2023-10-06T05:29:06.711 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 33 2023-10-06T05:29:07.122 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:28:13.425370+0000', 'modified': '2023-10-06T05:29:05.859142+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 65, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6201}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6201': {'gid': 6201, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.29:6835/184173135', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 184173135}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 184173135}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:29:07.123 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T05:29:07.123 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T05:29:07.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f632717e700 1 Processor -- start 2023-10-06T05:29:07.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f632717e700 1 -- start start 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f632717e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6320158fd0 0x7f63201593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f632717e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632015cb00 0x7f632006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f632717e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f632006ec70 0x7f632006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f632717e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63201598e0 con 0x7f6320158fd0 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f632717e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632006f0f0 con 0x7f632006ec70 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f632717e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63200afbe0 con 0x7f632015cb00 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f6324f1a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6320158fd0 0x7f63201593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f6324f1a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6320158fd0 0x7f63201593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46824/0 (socket says 172.21.15.29:46824) 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.237+0000 7f6324f1a700 1 -- 172.21.15.29:0/2952244884 learned_addr learned my addr 172.21.15.29:0/2952244884 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632571b700 1 --2- 172.21.15.29:0/2952244884 >> v2:172.21.15.173:3300/0 conn(0x7f632006ec70 0x7f632006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f631ffff700 1 --2- 172.21.15.29:0/2952244884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632015cb00 0x7f632006e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f6324f1a700 1 -- 172.21.15.29:0/2952244884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632015cb00 msgr2=0x7f632006e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f6324f1a700 1 --2- 172.21.15.29:0/2952244884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632015cb00 0x7f632006e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f6324f1a700 1 -- 172.21.15.29:0/2952244884 >> v2:172.21.15.173:3300/0 conn(0x7f632006ec70 msgr2=0x7f632006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f6324f1a700 1 --2- 172.21.15.29:0/2952244884 >> v2:172.21.15.173:3300/0 conn(0x7f632006ec70 0x7f632006a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f6324f1a700 1 -- 172.21.15.29:0/2952244884 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632015d350 con 0x7f6320158fd0 2023-10-06T05:29:07.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f6324f1a700 1 --2- 172.21.15.29:0/2952244884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6320158fd0 0x7f63201593a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6320067f70 tx=0x7f6308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03257e191887d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f631f7fe700 1 -- 172.21.15.29:0/2952244884 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800b640 con 0x7f6320158fd0 2023-10-06T05:29:07.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f631f7fe700 1 -- 172.21.15.29:0/2952244884 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630800b7a0 con 0x7f6320158fd0 2023-10-06T05:29:07.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f631f7fe700 1 -- 172.21.15.29:0/2952244884 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800bb60 con 0x7f6320158fd0 2023-10-06T05:29:07.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632717e700 1 -- 172.21.15.29:0/2952244884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6320158fd0 msgr2=0x7f63201593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632717e700 1 --2- 172.21.15.29:0/2952244884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6320158fd0 0x7f63201593a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6320067f70 tx=0x7f6308009250 comp rx=0 tx=0).stop 2023-10-06T05:29:07.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632717e700 1 -- 172.21.15.29:0/2952244884 shutdown_connections 2023-10-06T05:29:07.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632717e700 1 --2- 172.21.15.29:0/2952244884 >> v2:172.21.15.173:3300/0 conn(0x7f632006ec70 0x7f632006a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632717e700 1 --2- 172.21.15.29:0/2952244884 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632015cb00 0x7f632006e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632717e700 1 --2- 172.21.15.29:0/2952244884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6320158fd0 0x7f63201593a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632717e700 1 -- 172.21.15.29:0/2952244884 >> 172.21.15.29:0/2952244884 conn(0x7f6320067b70 msgr2=0x7f632006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632717e700 1 -- 172.21.15.29:0/2952244884 shutdown_connections 2023-10-06T05:29:07.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.241+0000 7f632717e700 1 -- 172.21.15.29:0/2952244884 wait complete. 2023-10-06T05:29:07.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632717e700 1 Processor -- start 2023-10-06T05:29:07.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632717e700 1 -- start start 2023-10-06T05:29:07.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632717e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632006ec70 0x7f6320157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632717e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6320158fd0 0x7f63200b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632717e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f632015cb00 0x7f6320152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632717e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632016a400 con 0x7f632015cb00 2023-10-06T05:29:07.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632717e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320157f70 con 0x7f6320158fd0 2023-10-06T05:29:07.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632717e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63201697f0 con 0x7f632006ec70 2023-10-06T05:29:07.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632571b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f632015cb00 0x7f6320152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632571b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f632015cb00 0x7f6320152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46828/0 (socket says 172.21.15.29:46828) 2023-10-06T05:29:07.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632571b700 1 -- 172.21.15.29:0/46105044 learned_addr learned my addr 172.21.15.29:0/46105044 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f631ffff700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6320158fd0 0x7f63200b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f6324f1a700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632006ec70 0x7f6320157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632571b700 1 -- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632006ec70 msgr2=0x7f6320157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632571b700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632006ec70 0x7f6320157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632571b700 1 -- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6320158fd0 msgr2=0x7f63200b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632571b700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6320158fd0 0x7f63200b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632571b700 1 -- 172.21.15.29:0/46105044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63080094f0 con 0x7f632015cb00 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f631ffff700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6320158fd0 0x7f63200b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.245+0000 7f632571b700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f632015cb00 0x7f6320152690 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6318009e90 tx=0x7f631800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f631cff9700 1 -- 172.21.15.29:0/46105044 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800cb70 con 0x7f632015cb00 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f631cff9700 1 -- 172.21.15.29:0/46105044 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631800f040 con 0x7f632015cb00 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f632717e700 1 -- 172.21.15.29:0/46105044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6320169ad0 con 0x7f632015cb00 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f631cff9700 1 -- 172.21.15.29:0/46105044 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318014480 con 0x7f632015cb00 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f632717e700 1 -- 172.21.15.29:0/46105044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632016a090 con 0x7f632015cb00 2023-10-06T05:29:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f631cff9700 1 -- 172.21.15.29:0/46105044 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6318014830 con 0x7f632015cb00 2023-10-06T05:29:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f631cff9700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6300060550 0x7f6300062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f631cff9700 1 -- 172.21.15.29:0/46105044 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f631807d460 con 0x7f632015cb00 2023-10-06T05:29:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f6324f1a700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6300060550 0x7f6300062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.249+0000 7f6324f1a700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6300060550 0x7f6300062a00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6320067f70 tx=0x7f6308017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f6329427740 1 Processor -- start 2023-10-06T05:29:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f6329427740 1 -- start start 2023-10-06T05:29:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f6329427740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 0x1c6f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f6329427740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2710 0x1c6fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f6329427740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 0x1c700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f6329427740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b9df30 con 0x19f2710 2023-10-06T05:29:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f6329427740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b99ed0 con 0x19f2ae0 2023-10-06T05:29:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f6329427740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b600b0 con 0x1a3d790 2023-10-06T05:29:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f631ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2710 0x1c6fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f631ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2710 0x1c6fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46836/0 (socket says 172.21.15.29:46836) 2023-10-06T05:29:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.253+0000 7f631ffff700 1 -- 172.21.15.29:0/3211948573 learned_addr learned my addr 172.21.15.29:0/3211948573 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f632571b700 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 0x1c700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6324f1a700 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 0x1c6f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f631ffff700 1 -- 172.21.15.29:0/3211948573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 msgr2=0x1c700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f631ffff700 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 0x1c700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f631ffff700 1 -- 172.21.15.29:0/3211948573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 msgr2=0x1c6f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f631ffff700 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 0x1c6f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f631ffff700 1 -- 172.21.15.29:0/3211948573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a3e9e0 con 0x19f2710 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6324f1a700 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 0x1c6f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f631ffff700 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2710 0x1c6fb70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f63100112c0 tx=0x7f63100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ca9c64629a67b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6315ffb700 1 -- 172.21.15.29:0/3211948573 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310011eb0 con 0x19f2710 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6315ffb700 1 -- 172.21.15.29:0/3211948573 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310014440 con 0x19f2710 2023-10-06T05:29:07.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6315ffb700 1 -- 172.21.15.29:0/3211948573 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63100147c0 con 0x19f2710 2023-10-06T05:29:07.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 -- 172.21.15.29:0/3211948573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2710 msgr2=0x1c6fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2710 0x1c6fb70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f63100112c0 tx=0x7f63100091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 -- 172.21.15.29:0/3211948573 shutdown_connections 2023-10-06T05:29:07.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 0x1c700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2710 0x1c6fb70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 --2- 172.21.15.29:0/3211948573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 0x1c6f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 -- 172.21.15.29:0/3211948573 >> 172.21.15.29:0/3211948573 conn(0x19f2eb0 msgr2=0x1c2c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 -- 172.21.15.29:0/3211948573 shutdown_connections 2023-10-06T05:29:07.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 -- 172.21.15.29:0/3211948573 wait complete. 2023-10-06T05:29:07.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 -- start start 2023-10-06T05:29:07.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.257+0000 7f6329427740 1 Processor -- start 2023-10-06T05:29:07.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 0x1c73c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 0x1c74180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1a3d790 0x1c29c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b5fd50 con 0x1a3d790 2023-10-06T05:29:07.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b38970 con 0x19f2ae0 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ad6430 con 0x19f2710 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 10 client.0 _ll_register_callbacks cb 0x1b3cb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f632571b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1a3d790 0x1c29c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f632571b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1a3d790 0x1c29c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46838/0 (socket says 172.21.15.29:46838) 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f632571b700 1 -- 172.21.15.29:0/1807988541 learned_addr learned my addr 172.21.15.29:0/1807988541 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6324f1a700 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 0x1c73c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f631ffff700 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 0x1c74180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f632571b700 1 -- 172.21.15.29:0/1807988541 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 msgr2=0x1c73c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f632571b700 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 0x1c73c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f632571b700 1 -- 172.21.15.29:0/1807988541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 msgr2=0x1c74180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f632571b700 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 0x1c74180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f632571b700 1 -- 172.21.15.29:0/1807988541 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6310009cc0 con 0x1a3d790 2023-10-06T05:29:07.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6324f1a700 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 0x1c73c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:07.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f632571b700 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1a3d790 0x1c29c60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6318019000 tx=0x7f631807d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4660614029a12b49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f62feffd700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:29:07.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f62feffd700 1 -- 172.21.15.29:0/1807988541 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318058520 con 0x1a3d790 2023-10-06T05:29:07.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f62feffd700 1 -- 172.21.15.29:0/1807988541 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f631804f860 con 0x1a3d790 2023-10-06T05:29:07.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 -- 172.21.15.29:0/1807988541 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b38cc0 con 0x1a3d790 2023-10-06T05:29:07.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f62feffd700 1 -- 172.21.15.29:0/1807988541 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6318050bc0 con 0x1a3d790 2023-10-06T05:29:07.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 10 client.6276 fetch_fsmap learned FSMap version 33 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 -- 172.21.15.29:0/1807988541 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1b68370 con 0x1a3d790 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f62feffd700 1 -- 172.21.15.29:0/1807988541 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b38cc0 con 0x1a3d790 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f62feffd700 1 -- 172.21.15.29:0/1807988541 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f631807b2a0 con 0x1a3d790 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 10 client.6276 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 10 client.6276 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 20 client.6276 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1c2b280 0x1c7ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 4 client.6276 mds_command: new command op to 6201 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6329427740 1 -- 172.21.15.29:0/1807988541 --> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b3c3e0 con 0x1c2b280 2023-10-06T05:29:07.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.261+0000 7f6324f1a700 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1c2b280 0x1c7ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f62feffd700 10 client.6276 ms_handle_connect on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6324f1a700 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1c2b280 0x1c7ede0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bc6199e46619c96 server_cookie=e17c7438dd763b42 in_seq=0 out_seq=0 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f62feffd700 1 -- 172.21.15.29:0/1807988541 <== mds.0 v2:172.21.15.29:6834/184173135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1b3c3e0 con 0x1c2b280 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f62feffd700 10 client.6276 handle_command_reply: tid=0 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 client.6276 shutdown 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 -- 172.21.15.29:0/1807988541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1a3d790 msgr2=0x1c29c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1a3d790 0x1c29c60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6318019000 tx=0x7f631807d040 comp rx=0 tx=0).stop 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 -- 172.21.15.29:0/1807988541 shutdown_connections 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1c2b280 0x1c7ede0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1a3d790 0x1c29c60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f62feffd700 0 client.6276 ms_handle_reset on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2ae0 0x1c74180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 --2- 172.21.15.29:0/1807988541 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 0x1c73c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 -- 172.21.15.29:0/1807988541 >> 172.21.15.29:0/1807988541 conn(0x19f2eb0 msgr2=0x1c531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 -- 172.21.15.29:0/1807988541 shutdown_connections 2023-10-06T05:29:07.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 1 -- 172.21.15.29:0/1807988541 wait complete. 2023-10-06T05:29:07.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.265+0000 7f6329427740 20 client.6276 trim_cache size 0 max 16384 2023-10-06T05:29:07.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6329427740 1 Processor -- start 2023-10-06T05:29:07.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6329427740 1 -- start start 2023-10-06T05:29:07.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6329427740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2710 0x1c531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6329427740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1c53720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6329427740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 0x1c7cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6329427740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b6f010 con 0x19f2ae0 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6329427740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6f650 con 0x19f2710 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6329427740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b9d5d0 con 0x1a3d790 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f631ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1c53720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f631ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1c53720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46846/0 (socket says 172.21.15.29:46846) 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f631ffff700 1 -- 172.21.15.29:0/3775267207 learned_addr learned my addr 172.21.15.29:0/3775267207 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f632571b700 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 0x1c7cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6324f1a700 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2710 0x1c531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f631ffff700 1 -- 172.21.15.29:0/3775267207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 msgr2=0x1c7cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f631ffff700 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 0x1c7cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f631ffff700 1 -- 172.21.15.29:0/3775267207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2710 msgr2=0x1c531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f631ffff700 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2710 0x1c531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f631ffff700 1 -- 172.21.15.29:0/3775267207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320152f30 con 0x19f2ae0 2023-10-06T05:29:07.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.285+0000 7f6324f1a700 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2710 0x1c531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:07.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f631ffff700 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1c53720 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x1b97b50 tx=0x7f631001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b91508a9452ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f63167fc700 1 -- 172.21.15.29:0/3775267207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310009210 con 0x19f2ae0 2023-10-06T05:29:07.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f63167fc700 1 -- 172.21.15.29:0/3775267207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310011eb0 con 0x19f2ae0 2023-10-06T05:29:07.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f63167fc700 1 -- 172.21.15.29:0/3775267207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310014bf0 con 0x19f2ae0 2023-10-06T05:29:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 -- 172.21.15.29:0/3775267207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 msgr2=0x1c53720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1c53720 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x1b97b50 tx=0x7f631001c000 comp rx=0 tx=0).stop 2023-10-06T05:29:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 -- 172.21.15.29:0/3775267207 shutdown_connections 2023-10-06T05:29:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1a3d790 0x1c7cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1c53720 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 --2- 172.21.15.29:0/3775267207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x19f2710 0x1c531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 -- 172.21.15.29:0/3775267207 >> 172.21.15.29:0/3775267207 conn(0x19f2eb0 msgr2=0x1c72650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 -- 172.21.15.29:0/3775267207 shutdown_connections 2023-10-06T05:29:07.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 -- 172.21.15.29:0/3775267207 wait complete. 2023-10-06T05:29:07.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 -- start start 2023-10-06T05:29:07.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.289+0000 7f6329427740 1 Processor -- start 2023-10-06T05:29:07.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 0x1cc9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1cc9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a3d790 0x1c4d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b9c590 con 0x19f2ae0 2023-10-06T05:29:07.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b63400 con 0x1a3d790 2023-10-06T05:29:07.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b71d60 con 0x19f2710 2023-10-06T05:29:07.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f631ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1cc9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f631ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1cc9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46848/0 (socket says 172.21.15.29:46848) 2023-10-06T05:29:07.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f631ffff700 1 -- 172.21.15.29:0/633844647 learned_addr learned my addr 172.21.15.29:0/633844647 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6324f1a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 0x1cc9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 10 client.0 _ll_register_callbacks cb 0x1b65110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:07.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f632571b700 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a3d790 0x1c4d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f631ffff700 1 -- 172.21.15.29:0/633844647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 msgr2=0x1cc9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f631ffff700 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 0x1cc9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f631ffff700 1 -- 172.21.15.29:0/633844647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a3d790 msgr2=0x1c4d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f631ffff700 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a3d790 0x1c4d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f631ffff700 1 -- 172.21.15.29:0/633844647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1a3e9e0 con 0x19f2ae0 2023-10-06T05:29:07.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f631ffff700 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1cc9b90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6310028040 tx=0x7f6310024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d251527c6c2009 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f62feffd700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:29:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f62feffd700 1 -- 172.21.15.29:0/633844647 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310026440 con 0x19f2ae0 2023-10-06T05:29:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f62feffd700 1 -- 172.21.15.29:0/633844647 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f6310018070 con 0x19f2ae0 2023-10-06T05:29:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 -- 172.21.15.29:0/633844647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6310014440 con 0x19f2ae0 2023-10-06T05:29:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f62feffd700 1 -- 172.21.15.29:0/633844647 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63100267b0 con 0x19f2ae0 2023-10-06T05:29:07.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 10 client.6282 fetch_fsmap learned FSMap version 33 2023-10-06T05:29:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 -- 172.21.15.29:0/633844647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1b4ed80 con 0x19f2ae0 2023-10-06T05:29:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f62feffd700 1 -- 172.21.15.29:0/633844647 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310014440 con 0x19f2ae0 2023-10-06T05:29:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f62feffd700 1 -- 172.21.15.29:0/633844647 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6310026910 con 0x19f2ae0 2023-10-06T05:29:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 10 client.6282 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T05:29:07.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 10 client.6282 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:29:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 20 client.6282 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1c4d990 0x1c4dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 4 client.6282 mds_command: new command op to 6201 tid=0[{"prefix": "status"}] 2023-10-06T05:29:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6329427740 1 -- 172.21.15.29:0/633844647 --> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1b6e410 con 0x1c4d990 2023-10-06T05:29:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6324f1a700 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1c4d990 0x1c4dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f62feffd700 10 client.6282 ms_handle_connect on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.293+0000 7f6324f1a700 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1c4d990 0x1c4dd60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6fb5ef22642a48c server_cookie=834b182561123be9 in_seq=0 out_seq=0 2023-10-06T05:29:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f62feffd700 1 -- 172.21.15.29:0/633844647 <== mds.0 v2:172.21.15.29:6834/184173135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1b6e410 con 0x1c4d990 2023-10-06T05:29:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f62feffd700 10 client.6282 handle_command_reply: tid=0 2023-10-06T05:29:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 client.6282 shutdown 2023-10-06T05:29:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 -- 172.21.15.29:0/633844647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 msgr2=0x1cc9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1cc9b90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6310028040 tx=0x7f6310024000 comp rx=0 tx=0).stop 2023-10-06T05:29:07.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 -- 172.21.15.29:0/633844647 shutdown_connections 2023-10-06T05:29:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1c4d990 0x1c4dd60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1a3d790 0x1c4d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19f2ae0 0x1cc9b90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f62feffd700 0 client.6282 ms_handle_reset on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 --2- 172.21.15.29:0/633844647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19f2710 0x1cc9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 -- 172.21.15.29:0/633844647 >> 172.21.15.29:0/633844647 conn(0x19f2eb0 msgr2=0x1c72650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 -- 172.21.15.29:0/633844647 shutdown_connections 2023-10-06T05:29:07.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 1 -- 172.21.15.29:0/633844647 wait complete. 2023-10-06T05:29:07.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f6329427740 20 client.6282 trim_cache size 0 max 16384 2023-10-06T05:29:07.316 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:29:07.316 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "bd99696d-d9bf-47c8-93f5-f978334ae590", 2023-10-06T05:29:07.316 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-06T05:29:07.317 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6201, 2023-10-06T05:29:07.317 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-06T05:29:07.317 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-06T05:29:07.317 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-06T05:29:07.317 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 4.4395986360000004, 2023-10-06T05:29:07.317 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 33, 2023-10-06T05:29:07.317 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 65, 2023-10-06T05:29:07.318 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 65, 2023-10-06T05:29:07.318 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 5.4125229729999997 2023-10-06T05:29:07.318 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:29:07.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 -- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6300060550 msgr2=0x7f6300062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6300060550 0x7f6300062a00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6320067f70 tx=0x7f6308017000 comp rx=0 tx=0).stop 2023-10-06T05:29:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 -- 172.21.15.29:0/46105044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f632015cb00 msgr2=0x7f6320152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f632015cb00 0x7f6320152690 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6318009e90 tx=0x7f631800b040 comp rx=0 tx=0).stop 2023-10-06T05:29:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 -- 172.21.15.29:0/46105044 shutdown_connections 2023-10-06T05:29:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f632015cb00 0x7f6320152690 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6300060550 0x7f6300062a00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6320158fd0 0x7f63200b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 --2- 172.21.15.29:0/46105044 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f632006ec70 0x7f6320157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 -- 172.21.15.29:0/46105044 >> 172.21.15.29:0/46105044 conn(0x7f6320067b70 msgr2=0x7f632015a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 -- 172.21.15.29:0/46105044 shutdown_connections 2023-10-06T05:29:07.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.297+0000 7f632717e700 1 -- 172.21.15.29:0/46105044 wait complete. 2023-10-06T05:29:07.323 DEBUG:teuthology.orchestra.run.smithi029:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-06T05:29:07.325 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive 2023-10-06T05:29:07.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35cab9d700 1 Processor -- start 2023-10-06T05:29:07.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35cab9d700 1 -- start start 2023-10-06T05:29:07.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35cab9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f35c40c3660 0x7f35c406c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35cab9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c40c9500 con 0x7f35c415c450 2023-10-06T05:29:07.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35cab9d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c40ca080 con 0x7f35c406cce0 2023-10-06T05:29:07.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35cab9d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c40cb880 con 0x7f35c40c3660 2023-10-06T05:29:07.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35c9b9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f35c415c450 0x7f35c40c2f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51380/0 (socket says 172.21.15.29:51380) 2023-10-06T05:29:07.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35c9b9b700 1 -- 172.21.15.29:0/4122566664 learned_addr learned my addr 172.21.15.29:0/4122566664 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:07.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35c939a700 1 --2- 172.21.15.29:0/4122566664 >> v2:172.21.15.173:3300/0 conn(0x7f35c40c3660 0x7f35c406c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35c939a700 1 -- 172.21.15.29:0/4122566664 >> v1:172.21.15.173:6789/0 conn(0x7f35c406cce0 legacy=0x7f35c40c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35c939a700 1 -- 172.21.15.29:0/4122566664 >> v1:172.21.15.29:6789/0 conn(0x7f35c415c450 legacy=0x7f35c40c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35c939a700 1 -- 172.21.15.29:0/4122566664 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40c9750 con 0x7f35c40c3660 2023-10-06T05:29:07.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.453+0000 7f35c939a700 1 --2- 172.21.15.29:0/4122566664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c40c3660 0x7f35c406c7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f35b40098e0 tx=0x7f35b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a01338421b60e21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35c8b99700 1 -- 172.21.15.29:0/4122566664 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4009e80 con 0x7f35c40c3660 2023-10-06T05:29:07.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35c8b99700 1 -- 172.21.15.29:0/4122566664 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400b860 con 0x7f35c40c3660 2023-10-06T05:29:07.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35c8b99700 1 -- 172.21.15.29:0/4122566664 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400bbe0 con 0x7f35c40c3660 2023-10-06T05:29:07.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 -- 172.21.15.29:0/4122566664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c40c3660 msgr2=0x7f35c406c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 --2- 172.21.15.29:0/4122566664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c40c3660 0x7f35c406c7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f35b40098e0 tx=0x7f35b40091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 -- 172.21.15.29:0/4122566664 shutdown_connections 2023-10-06T05:29:07.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 --2- 172.21.15.29:0/4122566664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c40c3660 0x7f35c406c7a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 -- 172.21.15.29:0/4122566664 >> 172.21.15.29:0/4122566664 conn(0x7f35c406ba30 msgr2=0x7f35c4095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 -- 172.21.15.29:0/4122566664 shutdown_connections 2023-10-06T05:29:07.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 -- 172.21.15.29:0/4122566664 wait complete. 2023-10-06T05:29:07.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 Processor -- start 2023-10-06T05:29:07.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 -- start start 2023-10-06T05:29:07.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35c406cce0 0x7f35c415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c40c3660 0x7f35c414caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35c415c450 0x7f35c40c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c415a3f0 con 0x7f35c415c450 2023-10-06T05:29:07.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c4159500 con 0x7f35c40c3660 2023-10-06T05:29:07.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35cab9d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c41597e0 con 0x7f35c406cce0 2023-10-06T05:29:07.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35ca39c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35c415c450 0x7f35c40c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35ca39c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35c415c450 0x7f35c40c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46856/0 (socket says 172.21.15.29:46856) 2023-10-06T05:29:07.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35ca39c700 1 -- 172.21.15.29:0/2433068994 learned_addr learned my addr 172.21.15.29:0/2433068994 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35c406cce0 0x7f35c415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35c939a700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c40c3660 0x7f35c414caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35ca39c700 1 -- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35c406cce0 msgr2=0x7f35c415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35ca39c700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35c406cce0 0x7f35c415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35ca39c700 1 -- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c40c3660 msgr2=0x7f35c414caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35ca39c700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c40c3660 0x7f35c414caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.461+0000 7f35ca39c700 1 -- 172.21.15.29:0/2433068994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009420 con 0x7f35c415c450 2023-10-06T05:29:07.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35ca39c700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35c415c450 0x7f35c40c6130 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c8e0 tx=0x7f35bc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35b9ffb700 1 -- 172.21.15.29:0/2433068994 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc012630 con 0x7f35c415c450 2023-10-06T05:29:07.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35b9ffb700 1 -- 172.21.15.29:0/2433068994 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc012790 con 0x7f35c415c450 2023-10-06T05:29:07.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35cab9d700 1 -- 172.21.15.29:0/2433068994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c4159ac0 con 0x7f35c415c450 2023-10-06T05:29:07.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35b9ffb700 1 -- 172.21.15.29:0/2433068994 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc012b50 con 0x7f35c415c450 2023-10-06T05:29:07.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35cab9d700 1 -- 172.21.15.29:0/2433068994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c415a080 con 0x7f35c415c450 2023-10-06T05:29:07.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35b9ffb700 1 -- 172.21.15.29:0/2433068994 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f35bc00a3b0 con 0x7f35c415c450 2023-10-06T05:29:07.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35b9ffb700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35a8060550 0x7f35a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35b9ffb700 1 -- 172.21.15.29:0/2433068994 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f35bc07ccb0 con 0x7f35c415c450 2023-10-06T05:29:07.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35a8060550 0x7f35a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.465+0000 7f35ce0a8740 1 Processor -- start 2023-10-06T05:29:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- start start 2023-10-06T05:29:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35a8060550 0x7f35a8062a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f35c0002780 tx=0x7f35c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x256c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x22ee9b0 0x256c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2339a30 0x256ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x249a120 con 0x22eed80 2023-10-06T05:29:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x24960c0 con 0x22ee9b0 2023-10-06T05:29:07.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x245c270 con 0x2339a30 2023-10-06T05:29:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x256c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x256c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46862/0 (socket says 172.21.15.29:46862) 2023-10-06T05:29:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 -- 172.21.15.29:0/2298929892 learned_addr learned my addr 172.21.15.29:0/2298929892 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c939a700 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x22ee9b0 0x256c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ca39c700 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2339a30 0x256ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 -- 172.21.15.29:0/2298929892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2339a30 msgr2=0x256ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2339a30 0x256ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 -- 172.21.15.29:0/2298929892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x22ee9b0 msgr2=0x256c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x22ee9b0 0x256c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 -- 172.21.15.29:0/2298929892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x233ac80 con 0x22eed80 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ca39c700 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2339a30 0x256ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x256c230 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f35c00075f0 tx=0x7f35c0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65043030d7e06f61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35aeffd700 1 -- 172.21.15.29:0/2298929892 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00076a0 con 0x22eed80 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35aeffd700 1 -- 172.21.15.29:0/2298929892 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0013630 con 0x22eed80 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35aeffd700 1 -- 172.21.15.29:0/2298929892 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00139b0 con 0x22eed80 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- 172.21.15.29:0/2298929892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 msgr2=0x256c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x256c230 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f35c00075f0 tx=0x7f35c0013000 comp rx=0 tx=0).stop 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- 172.21.15.29:0/2298929892 shutdown_connections 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x2339a30 0x256ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x22ee9b0 0x256c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/2298929892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x256c230 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- 172.21.15.29:0/2298929892 >> 172.21.15.29:0/2298929892 conn(0x22ef150 msgr2=0x2529550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- 172.21.15.29:0/2298929892 shutdown_connections 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- 172.21.15.29:0/2298929892 wait complete. 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 -- start start 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.469+0000 7f35ce0a8740 1 Processor -- start 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2525560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2525aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x2525fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x245bf10 con 0x22eed80 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2434b30 con 0x2339a30 2023-10-06T05:29:07.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x249c480 con 0x22ee9b0 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 10 client.0 _ll_register_callbacks cb 0x2438e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c939a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2525aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c9b9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2525560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c9b9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2525560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52142/0 (socket says 172.21.15.29:52142) 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c9b9b700 1 -- 172.21.15.29:0/1034307534 learned_addr learned my addr 172.21.15.29:0/1034307534 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ca39c700 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x2525fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c9b9b700 1 -- 172.21.15.29:0/1034307534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 msgr2=0x2525fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x2525fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c9b9b700 1 -- 172.21.15.29:0/1034307534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 msgr2=0x2525aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2525aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c9b9b700 1 -- 172.21.15.29:0/1034307534 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c000f040 con 0x22ee9b0 2023-10-06T05:29:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb199e75700 1 Processor -- start 2023-10-06T05:29:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb199e75700 1 -- start start 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2525560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x2451470 tx=0x7f35c0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a1693e4d836f66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3301/0 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35a3fff700 1 -- 172.21.15.29:0/1034307534 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0029070 con 0x22ee9b0 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35a3fff700 1 -- 172.21.15.29:0/1034307534 <== mon.2 v2:172.21.15.173:3301/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f35c0025a20 con 0x22ee9b0 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1034307534 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2438670 con 0x22ee9b0 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35a3fff700 1 -- 172.21.15.29:0/1034307534 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c00139b0 con 0x22ee9b0 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 10 client.5684 fetch_fsmap learned FSMap version 33 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1034307534 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x2464490 con 0x22ee9b0 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35a3fff700 1 -- 172.21.15.29:0/1034307534 <== mon.2 v2:172.21.15.173:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2438670 con 0x22ee9b0 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35a3fff700 1 -- 172.21.15.29:0/1034307534 <== mon.2 v2:172.21.15.173:3301/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f35c0025160 con 0x22ee9b0 2023-10-06T05:29:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 10 client.5684 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T05:29:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 10 client.5684 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:29:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 20 client.5684 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x2578eb0 0x257b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 4 client.5684 mds_command: new command op to 6201 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:29:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1034307534 --> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x246a530 con 0x2578eb0 2023-10-06T05:29:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c939a700 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x2578eb0 0x257b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb199e75700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb194158ba0 0x7fb194158f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb199e75700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb1940afe90 0x7fb19406a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb199e75700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1940ca900 con 0x7fb1940b02c0 2023-10-06T05:29:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb199e75700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1940cffe0 con 0x7fb194158ba0 2023-10-06T05:29:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb199e75700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19406af70 con 0x7fb1940afe90 2023-10-06T05:29:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb1937fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb194158ba0 0x7fb194158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb1937fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb194158ba0 0x7fb194158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46882/0 (socket says 172.21.15.29:46882) 2023-10-06T05:29:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb1937fe700 1 -- 172.21.15.29:0/2649355104 learned_addr learned my addr 172.21.15.29:0/2649355104 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb18bfff700 1 --2- 172.21.15.29:0/2649355104 >> v2:172.21.15.173:3300/0 conn(0x7fb1940afe90 0x7fb19406a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35a3fff700 10 client.5684 ms_handle_connect on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7f35c939a700 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x2578eb0 0x257b290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7667232200cc4f86 server_cookie=d70ae914be708c24 in_seq=0 out_seq=0 2023-10-06T05:29:07.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb1937fe700 1 -- 172.21.15.29:0/2649355104 >> v2:172.21.15.173:3300/0 conn(0x7fb1940afe90 msgr2=0x7fb19406a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb1937fe700 1 --2- 172.21.15.29:0/2649355104 >> v2:172.21.15.173:3300/0 conn(0x7fb1940afe90 0x7fb19406a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb1937fe700 1 -- 172.21.15.29:0/2649355104 >> v1:172.21.15.29:6789/0 conn(0x7fb1940b02c0 legacy=0x7fb19406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.473+0000 7fb1937fe700 1 -- 172.21.15.29:0/2649355104 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19406b250 con 0x7fb194158ba0 2023-10-06T05:29:07.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb1937fe700 1 --2- 172.21.15.29:0/2649355104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb194158ba0 0x7fb194158f70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb19406a1f0 tx=0x7fb184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9825883f333622 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb192ffd700 1 -- 172.21.15.29:0/2649355104 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184009e70 con 0x7fb194158ba0 2023-10-06T05:29:07.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb192ffd700 1 -- 172.21.15.29:0/2649355104 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18400b860 con 0x7fb194158ba0 2023-10-06T05:29:07.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb192ffd700 1 -- 172.21.15.29:0/2649355104 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400bc00 con 0x7fb194158ba0 2023-10-06T05:29:07.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35a3fff700 1 -- 172.21.15.29:0/1034307534 <== mds.0 v2:172.21.15.29:6834/184173135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x246a530 con 0x2578eb0 2023-10-06T05:29:07.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35a3fff700 10 client.5684 handle_command_reply: tid=0 2023-10-06T05:29:07.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 client.5684 shutdown 2023-10-06T05:29:07.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1034307534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 msgr2=0x2525560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2525560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x2451470 tx=0x7f35c0017000 comp rx=0 tx=0).stop 2023-10-06T05:29:07.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1034307534 shutdown_connections 2023-10-06T05:29:07.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x2578eb0 0x257b290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x2525fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2525aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35a3fff700 0 client.5684 ms_handle_reset on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1034307534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2525560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1034307534 >> 172.21.15.29:0/1034307534 conn(0x22ef150 msgr2=0x25295a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1034307534 shutdown_connections 2023-10-06T05:29:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1034307534 wait complete. 2023-10-06T05:29:07.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7f35ce0a8740 20 client.5684 trim_cache size 0 max 16384 2023-10-06T05:29:07.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 -- 172.21.15.29:0/2649355104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb194158ba0 msgr2=0x7fb194158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 --2- 172.21.15.29:0/2649355104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb194158ba0 0x7fb194158f70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb19406a1f0 tx=0x7fb184009250 comp rx=0 tx=0).stop 2023-10-06T05:29:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 -- 172.21.15.29:0/2649355104 shutdown_connections 2023-10-06T05:29:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 --2- 172.21.15.29:0/2649355104 >> v2:172.21.15.173:3300/0 conn(0x7fb1940afe90 0x7fb19406a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 --2- 172.21.15.29:0/2649355104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb194158ba0 0x7fb194158f70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 -- 172.21.15.29:0/2649355104 >> 172.21.15.29:0/2649355104 conn(0x7fb194062b60 msgr2=0x7fb194062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 -- 172.21.15.29:0/2649355104 shutdown_connections 2023-10-06T05:29:07.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 -- 172.21.15.29:0/2649355104 wait complete. 2023-10-06T05:29:07.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 Processor -- start 2023-10-06T05:29:07.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.477+0000 7fb199e75700 1 -- start start 2023-10-06T05:29:07.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb199e75700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1940afe90 0x7fb1940c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb199e75700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1940b02c0 0x7fb1940c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb199e75700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb194158ba0 0x7fb194148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb199e75700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940c83f0 con 0x7fb1940afe90 2023-10-06T05:29:07.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb199e75700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940c8110 con 0x7fb194158ba0 2023-10-06T05:29:07.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb199e75700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19415a640 con 0x7fb1940b02c0 2023-10-06T05:29:07.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb1937fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1940afe90 0x7fb1940c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb1937fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1940afe90 0x7fb1940c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46890/0 (socket says 172.21.15.29:46890) 2023-10-06T05:29:07.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb1937fe700 1 -- 172.21.15.29:0/978748150 learned_addr learned my addr 172.21.15.29:0/978748150 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb18bfff700 1 --2- 172.21.15.29:0/978748150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1940b02c0 0x7fb1940c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb193fff700 1 --2- 172.21.15.29:0/978748150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb194158ba0 0x7fb194148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb1937fe700 1 -- 172.21.15.29:0/978748150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1940b02c0 msgr2=0x7fb1940c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb1937fe700 1 --2- 172.21.15.29:0/978748150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb1940b02c0 0x7fb1940c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb1937fe700 1 -- 172.21.15.29:0/978748150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb194158ba0 msgr2=0x7fb194148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb1937fe700 1 --2- 172.21.15.29:0/978748150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb194158ba0 0x7fb194148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb1937fe700 1 -- 172.21.15.29:0/978748150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840094f0 con 0x7fb1940afe90 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb1937fe700 1 --2- 172.21.15.29:0/978748150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1940afe90 0x7fb1940c8f70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb19406a0d0 tx=0x7fb184017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb18b7fe700 1 -- 172.21.15.29:0/978748150 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184011420 con 0x7fb1940afe90 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb18b7fe700 1 -- 172.21.15.29:0/978748150 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1840115a0 con 0x7fb1940afe90 2023-10-06T05:29:07.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb199e75700 1 -- 172.21.15.29:0/978748150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19415a920 con 0x7fb1940afe90 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb18b7fe700 1 -- 172.21.15.29:0/978748150 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184011960 con 0x7fb1940afe90 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb199e75700 1 -- 172.21.15.29:0/978748150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb194148790 con 0x7fb1940afe90 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb199e75700 1 -- 172.21.15.29:0/978748150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb19415ada0 con 0x7fb1940afe90 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.481+0000 7fb18b7fe700 1 -- 172.21.15.29:0/978748150 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb1840253f0 con 0x7fb1940afe90 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.485+0000 7fb18b7fe700 1 --2- 172.21.15.29:0/978748150 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb174060550 0x7fb174062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.485+0000 7fb18b7fe700 1 -- 172.21.15.29:0/978748150 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7fb18407e350 con 0x7fb1940afe90 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.485+0000 7fb18b7fe700 1 -- 172.21.15.29:0/978748150 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+512 (secure 0 0 0) 0x7fb184085070 con 0x7fb1940afe90 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.485+0000 7fb18bfff700 1 --2- 172.21.15.29:0/978748150 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb174060550 0x7fb174062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.485+0000 7fb18bfff700 1 --2- 172.21.15.29:0/978748150 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb174060550 0x7fb174062a00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb1940d08a0 tx=0x7fb17c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.489+0000 7fb199e75700 1 -- 172.21.15.29:0/978748150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fb19404be00 con 0x7fb1940afe90 2023-10-06T05:29:07.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 Processor -- start 2023-10-06T05:29:07.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- start start 2023-10-06T05:29:07.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2523b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2524040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x2579280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2493a80 con 0x22eed80 2023-10-06T05:29:07.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2378120 con 0x2339a30 2023-10-06T05:29:07.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2491d40 con 0x22ee9b0 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c939a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2524040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c939a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2524040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46892/0 (socket says 172.21.15.29:46892) 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c939a700 1 -- 172.21.15.29:0/4124815868 learned_addr learned my addr 172.21.15.29:0/4124815868 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/4124815868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2523b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ca39c700 1 --2- 172.21.15.29:0/4124815868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x2579280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c939a700 1 -- 172.21.15.29:0/4124815868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 msgr2=0x2523b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c939a700 1 --2- 172.21.15.29:0/4124815868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2523b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c939a700 1 -- 172.21.15.29:0/4124815868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 msgr2=0x2579280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c939a700 1 --2- 172.21.15.29:0/4124815868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x2579280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c939a700 1 -- 172.21.15.29:0/4124815868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40c69d0 con 0x22eed80 2023-10-06T05:29:07.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35c939a700 1 --2- 172.21.15.29:0/4124815868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2524040 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f35c406f0f0 tx=0x7f35b4003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f487068dc76fd90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35af7fe700 1 -- 172.21.15.29:0/4124815868 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4021040 con 0x22eed80 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35af7fe700 1 -- 172.21.15.29:0/4124815868 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b4022040 con 0x22eed80 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35af7fe700 1 -- 172.21.15.29:0/4124815868 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400b9d0 con 0x22eed80 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- 172.21.15.29:0/4124815868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 msgr2=0x2524040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/4124815868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2524040 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f35c406f0f0 tx=0x7f35b4003040 comp rx=0 tx=0).stop 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- 172.21.15.29:0/4124815868 shutdown_connections 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/4124815868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x2579280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/4124815868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22eed80 0x2524040 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/4124815868 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x22ee9b0 0x2523b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- 172.21.15.29:0/4124815868 >> 172.21.15.29:0/4124815868 conn(0x22ef150 msgr2=0x2524a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- 172.21.15.29:0/4124815868 shutdown_connections 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- 172.21.15.29:0/4124815868 wait complete. 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.497+0000 7f35ce0a8740 1 -- start start 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 Processor -- start 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22ee9b0 0x25c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x25c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x257c390 0x257c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2459cd0 con 0x22ee9b0 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x249b0e0 con 0x2339a30 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2367a60 con 0x257c390 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 10 client.0 _ll_register_callbacks cb 0x243fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c9b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22ee9b0 0x25c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c9b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22ee9b0 0x25c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46900/0 (socket says 172.21.15.29:46900) 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c9b9b700 1 -- 172.21.15.29:0/1934769105 learned_addr learned my addr 172.21.15.29:0/1934769105 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c939a700 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x25c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ca39c700 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x257c390 0x257c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c9b9b700 1 -- 172.21.15.29:0/1934769105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x257c390 msgr2=0x257c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x257c390 0x257c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c9b9b700 1 -- 172.21.15.29:0/1934769105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 msgr2=0x25c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x25c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c9b9b700 1 -- 172.21.15.29:0/1934769105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c40c9750 con 0x22ee9b0 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c9b9b700 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22ee9b0 0x25c5a90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009010 tx=0x7f35c0029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1376c9f36d1636 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35a3fff700 1 -- 172.21.15.29:0/1934769105 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c003e060 con 0x22ee9b0 2023-10-06T05:29:07.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35a3fff700 1 -- 172.21.15.29:0/1934769105 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f35c0025670 con 0x22ee9b0 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1934769105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35c0013630 con 0x22ee9b0 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35a3fff700 1 -- 172.21.15.29:0/1934769105 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c0007540 con 0x22ee9b0 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 10 client.6306 fetch_fsmap learned FSMap version 33 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1934769105 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x244aea0 con 0x22ee9b0 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35a3fff700 1 -- 172.21.15.29:0/1934769105 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0013630 con 0x22ee9b0 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35a3fff700 1 -- 172.21.15.29:0/1934769105 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f35c0021450 con 0x22ee9b0 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 10 client.6306 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 10 client.6306 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 20 client.6306 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x257d180 0x257d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 4 client.6306 mds_command: new command op to 6201 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1934769105 --> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x2346780 con 0x257d180 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c939a700 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x257d180 0x257d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35a3fff700 10 client.6306 ms_handle_connect on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.501+0000 7f35c939a700 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x257d180 0x257d580 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b9b2b3c01fae35f server_cookie=20efd1da3db5dc19 in_seq=0 out_seq=0 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35a3fff700 1 -- 172.21.15.29:0/1934769105 <== mds.0 v2:172.21.15.29:6834/184173135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x2346780 con 0x257d180 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35a3fff700 10 client.6306 handle_command_reply: tid=0 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 client.6306 shutdown 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1934769105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22ee9b0 msgr2=0x25c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22ee9b0 0x25c5a90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009010 tx=0x7f35c0029000 comp rx=0 tx=0).stop 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1934769105 shutdown_connections 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x257d180 0x257d580 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x257c390 0x257c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x2339a30 0x25c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 --2- 172.21.15.29:0/1934769105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x22ee9b0 0x25c5a90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1934769105 >> 172.21.15.29:0/1934769105 conn(0x22ef150 msgr2=0x254c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35a3fff700 0 client.6306 ms_handle_reset on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1934769105 shutdown_connections 2023-10-06T05:29:07.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 1 -- 172.21.15.29:0/1934769105 wait complete. 2023-10-06T05:29:07.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35ce0a8740 20 client.6306 trim_cache size 0 max 16384 2023-10-06T05:29:07.520 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:29:07.520 INFO:teuthology.orchestra.run.smithi029.stdout: "return_code": 0, 2023-10-06T05:29:07.520 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_tag": "d542ea38-f8a7-4d33-8cc5-eb15c35b3bac", 2023-10-06T05:29:07.521 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": "asynchronous" 2023-10-06T05:29:07.521 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:29:07.521 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:29:07.505+0000 7fbd59608700 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2023-10-06T05:29:07.521 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:29:07.505+0000 7fbd59608700 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2023-10-06T05:29:07.521 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:29:07.505+0000 7fbd59608700 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2023-10-06T05:29:07.521 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:29:07.505+0000 7fbd59608700 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2023-10-06T05:29:07.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 -- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35a8060550 msgr2=0x7f35a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35a8060550 0x7f35a8062a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f35c0002780 tx=0x7f35c0009040 comp rx=0 tx=0).stop 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 -- 172.21.15.29:0/2433068994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35c415c450 msgr2=0x7f35c40c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35c415c450 0x7f35c40c6130 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c8e0 tx=0x7f35bc001710 comp rx=0 tx=0).stop 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 -- 172.21.15.29:0/2433068994 shutdown_connections 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35c415c450 0x7f35c40c6130 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f35a8060550 0x7f35a8062a00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35c40c3660 0x7f35c414caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 --2- 172.21.15.29:0/2433068994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35c406cce0 0x7f35c415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 -- 172.21.15.29:0/2433068994 >> 172.21.15.29:0/2433068994 conn(0x7f35c406ba30 msgr2=0x7f35c4158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 -- 172.21.15.29:0/2433068994 shutdown_connections 2023-10-06T05:29:07.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.505+0000 7f35cab9d700 1 -- 172.21.15.29:0/2433068994 wait complete. 2023-10-06T05:29:07.524 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T05:29:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80ff59e700 1 Processor -- start 2023-10-06T05:29:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80ff59e700 1 -- start start 2023-10-06T05:29:07.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 0x7f8100068260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80ff59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810006bf90 con 0x7f8100159200 2023-10-06T05:29:07.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80ff59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810006b6f0 con 0x7f81000687a0 2023-10-06T05:29:07.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80ff59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810006b9d0 con 0x7f8100158e30 2023-10-06T05:29:07.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80f7fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8100159200 0x7f81000c6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51394/0 (socket says 172.21.15.29:51394) 2023-10-06T05:29:07.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80f7fff700 1 -- 172.21.15.29:0/1341696079 learned_addr learned my addr 172.21.15.29:0/1341696079 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:07.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80fe59c700 1 --2- 172.21.15.29:0/1341696079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 0x7f8100068260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80fdd9b700 1 -- 172.21.15.29:0/1341696079 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203849782 0 0) 0x7f810006bf90 con 0x7f8100159200 2023-10-06T05:29:07.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80fdd9b700 1 -- 172.21.15.29:0/1341696079 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80ec003570 con 0x7f8100159200 2023-10-06T05:29:07.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80fdd9b700 1 -- 172.21.15.29:0/1341696079 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078648958 0 0) 0x7f810006b6f0 con 0x7f81000687a0 2023-10-06T05:29:07.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80fdd9b700 1 -- 172.21.15.29:0/1341696079 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f810006bf90 con 0x7f81000687a0 2023-10-06T05:29:07.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80fe59c700 1 -- 172.21.15.29:0/1341696079 >> v1:172.21.15.173:6789/0 conn(0x7f81000687a0 legacy=0x7f81000676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80fe59c700 1 -- 172.21.15.29:0/1341696079 >> v1:172.21.15.29:6789/0 conn(0x7f8100159200 legacy=0x7f81000c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80fe59c700 1 -- 172.21.15.29:0/1341696079 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810006bcb0 con 0x7f8100158e30 2023-10-06T05:29:07.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.637+0000 7f80fe59c700 1 --2- 172.21.15.29:0/1341696079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 0x7f8100068260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009910 tx=0x7f80f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=812346e8e17dc8b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80fdd9b700 1 -- 172.21.15.29:0/1341696079 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0011630 con 0x7f8100158e30 2023-10-06T05:29:07.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80fdd9b700 1 -- 172.21.15.29:0/1341696079 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0011790 con 0x7f8100158e30 2023-10-06T05:29:07.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80fdd9b700 1 -- 172.21.15.29:0/1341696079 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0011b10 con 0x7f8100158e30 2023-10-06T05:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80ff59e700 1 -- 172.21.15.29:0/1341696079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 msgr2=0x7f8100068260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80ff59e700 1 --2- 172.21.15.29:0/1341696079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 0x7f8100068260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009910 tx=0x7f80f00091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80ff59e700 1 -- 172.21.15.29:0/1341696079 shutdown_connections 2023-10-06T05:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80ff59e700 1 --2- 172.21.15.29:0/1341696079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 0x7f8100068260 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80ff59e700 1 -- 172.21.15.29:0/1341696079 >> 172.21.15.29:0/1341696079 conn(0x7f81000c9830 msgr2=0x7f810006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80ff59e700 1 -- 172.21.15.29:0/1341696079 shutdown_connections 2023-10-06T05:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80ff59e700 1 -- 172.21.15.29:0/1341696079 wait complete. 2023-10-06T05:29:07.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80ff59e700 1 Processor -- start 2023-10-06T05:29:07.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.641+0000 7f80ff59e700 1 -- start start 2023-10-06T05:29:07.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81000687a0 0x7f8100154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 0x7f8100169920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8100159200 0x7f81000c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80ff59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81000b01b0 con 0x7f81000687a0 2023-10-06T05:29:07.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80ff59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810016a170 con 0x7f8100159200 2023-10-06T05:29:07.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80ff59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810016a450 con 0x7f8100158e30 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fe59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81000687a0 0x7f8100154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fe59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81000687a0 0x7f8100154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46910/0 (socket says 172.21.15.29:46910) 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fe59c700 1 -- 172.21.15.29:0/1559500242 learned_addr learned my addr 172.21.15.29:0/1559500242 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80f7fff700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 0x7f8100169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fed9d700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8100159200 0x7f81000c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fe59c700 1 -- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 msgr2=0x7f8100169920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fe59c700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 0x7f8100169920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fe59c700 1 -- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8100159200 msgr2=0x7f81000c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fe59c700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8100159200 0x7f81000c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fe59c700 1 -- 172.21.15.29:0/1559500242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0009420 con 0x7f81000687a0 2023-10-06T05:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80fe59c700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81000687a0 0x7f8100154c50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f810006eda0 tx=0x7f80f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80f67fc700 1 -- 172.21.15.29:0/1559500242 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0011900 con 0x7f81000687a0 2023-10-06T05:29:07.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80f67fc700 1 -- 172.21.15.29:0/1559500242 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0011a60 con 0x7f81000687a0 2023-10-06T05:29:07.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80ff59e700 1 -- 172.21.15.29:0/1559500242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810016a730 con 0x7f81000687a0 2023-10-06T05:29:07.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80f67fc700 1 -- 172.21.15.29:0/1559500242 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0025640 con 0x7f81000687a0 2023-10-06T05:29:07.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.645+0000 7f80ff59e700 1 -- 172.21.15.29:0/1559500242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81000afd80 con 0x7f81000687a0 2023-10-06T05:29:07.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.649+0000 7f80f67fc700 1 -- 172.21.15.29:0/1559500242 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f80f0025a30 con 0x7f81000687a0 2023-10-06T05:29:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.649+0000 7f80f67fc700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e0060550 0x7f80e0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.649+0000 7f80f67fc700 1 -- 172.21.15.29:0/1559500242 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f80f007e0a0 con 0x7f81000687a0 2023-10-06T05:29:07.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.649+0000 7f80f7fff700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e0060550 0x7f80e0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.649+0000 7f80f7fff700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e0060550 0x7f80e0062a00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f81000b13b0 tx=0x7f80e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 Processor -- start 2023-10-06T05:29:07.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 -- start start 2023-10-06T05:29:07.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e3f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 0x1e3fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 0x1e40900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1db70f0 con 0x1c0bc10 2023-10-06T05:29:07.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1db2ee0 con 0x1c0b840 2023-10-06T05:29:07.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d79020 con 0x1c568c0 2023-10-06T05:29:07.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fe59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e3f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fe59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e3f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46922/0 (socket says 172.21.15.29:46922) 2023-10-06T05:29:07.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fe59c700 1 -- 172.21.15.29:0/3217649238 learned_addr learned my addr 172.21.15.29:0/3217649238 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fed9d700 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 0x1e40900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80f7fff700 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 0x1e3fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fe59c700 1 -- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 msgr2=0x1e40900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fe59c700 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 0x1e40900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fe59c700 1 -- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 msgr2=0x1e3fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fe59c700 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 0x1e3fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fe59c700 1 -- 172.21.15.29:0/3217649238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c57b10 con 0x1c0bc10 2023-10-06T05:29:07.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fed9d700 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 0x1e40900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:07.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80f7fff700 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 0x1e3fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:07.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80fe59c700 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e3f730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f80f007c3a0 tx=0x7f80f0003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fdf00aa140d4b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80df7fe700 1 -- 172.21.15.29:0/3217649238 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0052840 con 0x1c0bc10 2023-10-06T05:29:07.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80df7fe700 1 -- 172.21.15.29:0/3217649238 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0055390 con 0x1c0bc10 2023-10-06T05:29:07.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f80df7fe700 1 -- 172.21.15.29:0/3217649238 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f00590e0 con 0x1c0bc10 2023-10-06T05:29:07.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 -- 172.21.15.29:0/3217649238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 msgr2=0x1e3f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e3f730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f80f007c3a0 tx=0x7f80f0003040 comp rx=0 tx=0).stop 2023-10-06T05:29:07.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 -- 172.21.15.29:0/3217649238 shutdown_connections 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 0x1e40900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 0x1e3fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 --2- 172.21.15.29:0/3217649238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e3f730 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 -- 172.21.15.29:0/3217649238 >> 172.21.15.29:0/3217649238 conn(0x1c0bfe0 msgr2=0x1e6bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 -- 172.21.15.29:0/3217649238 shutdown_connections 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.653+0000 7f8107014740 1 -- 172.21.15.29:0/3217649238 wait complete. 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f8107014740 1 -- start start 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f8107014740 1 Processor -- start 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f8107014740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e45870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f8107014740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e43750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f8107014740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c568c0 0x1e43c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f8107014740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d78cc0 con 0x1c0bc10 2023-10-06T05:29:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f8107014740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d51820 con 0x1c568c0 2023-10-06T05:29:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f8107014740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1db26f0 con 0x1c0b840 2023-10-06T05:29:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f8107014740 10 client.0 _ll_register_callbacks cb 0x1d55b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80f7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e43750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80fe59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e45870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80fe59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e45870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52200/0 (socket says 172.21.15.29:52200) 2023-10-06T05:29:07.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80fe59c700 1 -- 172.21.15.29:0/3604298992 learned_addr learned my addr 172.21.15.29:0/3604298992 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80fed9d700 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c568c0 0x1e43c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80f7fff700 1 -- 172.21.15.29:0/3604298992 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 msgr2=0x1e45870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80f7fff700 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e45870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80f7fff700 1 -- 172.21.15.29:0/3604298992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c568c0 msgr2=0x1e43c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80f7fff700 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c568c0 0x1e43c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80f7fff700 1 -- 172.21.15.29:0/3604298992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81000afd80 con 0x1c0bc10 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.657+0000 7f80fe59c700 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e45870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80f7fff700 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e43750 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f80e8007fd0 tx=0x7f80e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3611ad602cd53a28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:29:07.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 1 -- 172.21.15.29:0/3604298992 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800fee0 con 0x1c0bc10 2023-10-06T05:29:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 1 -- 172.21.15.29:0/3604298992 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f80e801c040 con 0x1c0bc10 2023-10-06T05:29:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 -- 172.21.15.29:0/3604298992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1d6ba10 con 0x1c0bc10 2023-10-06T05:29:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 1 -- 172.21.15.29:0/3604298992 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80e8014e40 con 0x1c0bc10 2023-10-06T05:29:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 10 client.6318 fetch_fsmap learned FSMap version 33 2023-10-06T05:29:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 -- 172.21.15.29:0/3604298992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1d81220 con 0x1c0bc10 2023-10-06T05:29:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 1 -- 172.21.15.29:0/3604298992 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1d6ba10 con 0x1c0bc10 2023-10-06T05:29:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 1 -- 172.21.15.29:0/3604298992 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f80e8004830 con 0x1c0bc10 2023-10-06T05:29:07.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 10 client.6318 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T05:29:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 10 client.6318 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:29:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 20 client.6318 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1e68e80 0x1e69280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 4 client.6318 mds_command: new command op to 6201 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:29:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 -- 172.21.15.29:0/3604298992 --> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1d553f0 con 0x1e68e80 2023-10-06T05:29:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80fe59c700 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1e68e80 0x1e69280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80fe59c700 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1e68e80 0x1e69280 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61816e2c6acc08fa server_cookie=d14350b26fc4123d in_seq=0 out_seq=0 2023-10-06T05:29:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 10 client.6318 ms_handle_connect on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 1 -- 172.21.15.29:0/3604298992 <== mds.0 v2:172.21.15.29:6834/184173135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1d553f0 con 0x1e68e80 2023-10-06T05:29:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 10 client.6318 handle_command_reply: tid=0 2023-10-06T05:29:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 client.6318 shutdown 2023-10-06T05:29:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 -- 172.21.15.29:0/3604298992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 msgr2=0x1e43750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e43750 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f80e8007fd0 tx=0x7f80e8015000 comp rx=0 tx=0).stop 2023-10-06T05:29:07.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 -- 172.21.15.29:0/3604298992 shutdown_connections 2023-10-06T05:29:07.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1e68e80 0x1e69280 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c568c0 0x1e43c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1e43750 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 --2- 172.21.15.29:0/3604298992 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e45870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f80dcff9700 0 client.6318 ms_handle_reset on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 -- 172.21.15.29:0/3604298992 >> 172.21.15.29:0/3604298992 conn(0x1c0bfe0 msgr2=0x1e3e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 -- 172.21.15.29:0/3604298992 shutdown_connections 2023-10-06T05:29:07.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 1 -- 172.21.15.29:0/3604298992 wait complete. 2023-10-06T05:29:07.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.661+0000 7f8107014740 20 client.6318 trim_cache size 0 max 16384 2023-10-06T05:29:07.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.677+0000 7f8107014740 1 Processor -- start 2023-10-06T05:29:07.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.677+0000 7f8107014740 1 -- start start 2023-10-06T05:29:07.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e6bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0bc10 0x1e6c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c568c0 0x1e96190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1db1d70 con 0x1c568c0 2023-10-06T05:29:07.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d76a60 con 0x1c0bc10 2023-10-06T05:29:07.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ddaae0 con 0x1c0b840 2023-10-06T05:29:07.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c568c0 0x1e96190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c568c0 0x1e96190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46932/0 (socket says 172.21.15.29:46932) 2023-10-06T05:29:07.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fed9d700 1 -- 172.21.15.29:0/1296568071 learned_addr learned my addr 172.21.15.29:0/1296568071 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fe59c700 1 --2- 172.21.15.29:0/1296568071 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e6bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80f7fff700 1 --2- 172.21.15.29:0/1296568071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0bc10 0x1e6c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fed9d700 1 -- 172.21.15.29:0/1296568071 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 msgr2=0x1e6bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fed9d700 1 --2- 172.21.15.29:0/1296568071 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e6bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fed9d700 1 -- 172.21.15.29:0/1296568071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0bc10 msgr2=0x1e6c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fed9d700 1 --2- 172.21.15.29:0/1296568071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0bc10 0x1e6c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fed9d700 1 -- 172.21.15.29:0/1296568071 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000c5830 con 0x1c568c0 2023-10-06T05:29:07.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80fed9d700 1 --2- 172.21.15.29:0/1296568071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c568c0 0x1e96190 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f80f80040b0 tx=0x7f80f8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4da945521192645 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80dffff700 1 -- 172.21.15.29:0/1296568071 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8014ca0 con 0x1c568c0 2023-10-06T05:29:07.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80dffff700 1 -- 172.21.15.29:0/1296568071 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f8014e00 con 0x1c568c0 2023-10-06T05:29:07.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f80dffff700 1 -- 172.21.15.29:0/1296568071 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f801f670 con 0x1c568c0 2023-10-06T05:29:07.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 -- 172.21.15.29:0/1296568071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c568c0 msgr2=0x1e96190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 --2- 172.21.15.29:0/1296568071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c568c0 0x1e96190 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f80f80040b0 tx=0x7f80f8009040 comp rx=0 tx=0).stop 2023-10-06T05:29:07.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 -- 172.21.15.29:0/1296568071 shutdown_connections 2023-10-06T05:29:07.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 --2- 172.21.15.29:0/1296568071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c568c0 0x1e96190 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 --2- 172.21.15.29:0/1296568071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0bc10 0x1e6c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 --2- 172.21.15.29:0/1296568071 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c0b840 0x1e6bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 -- 172.21.15.29:0/1296568071 >> 172.21.15.29:0/1296568071 conn(0x1c0bfe0 msgr2=0x1e3e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 -- 172.21.15.29:0/1296568071 shutdown_connections 2023-10-06T05:29:07.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 -- 172.21.15.29:0/1296568071 wait complete. 2023-10-06T05:29:07.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 -- start start 2023-10-06T05:29:07.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.681+0000 7f8107014740 1 Processor -- start 2023-10-06T05:29:07.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 0x1ee2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1ee2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 0x1e98d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e21630 con 0x1c0bc10 2023-10-06T05:29:07.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d83930 con 0x1c0b840 2023-10-06T05:29:07.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d7dc00 con 0x1c568c0 2023-10-06T05:29:07.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 10 client.0 _ll_register_callbacks cb 0x1d2f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:07.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80f7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1ee2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80f7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1ee2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46948/0 (socket says 172.21.15.29:46948) 2023-10-06T05:29:07.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80f7fff700 1 -- 172.21.15.29:0/553451874 learned_addr learned my addr 172.21.15.29:0/553451874 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:07.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80fed9d700 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 0x1e98d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80fe59c700 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 0x1ee2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80f7fff700 1 -- 172.21.15.29:0/553451874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 msgr2=0x1e98d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80f7fff700 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 0x1e98d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80f7fff700 1 -- 172.21.15.29:0/553451874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 msgr2=0x1ee2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80f7fff700 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 0x1ee2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80f7fff700 1 -- 172.21.15.29:0/553451874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810006bf90 con 0x1c0bc10 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80f7fff700 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1ee2790 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f80e80229e0 tx=0x7f80e801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58352091af078148 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80dcff9700 1 -- 172.21.15.29:0/553451874 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800fee0 con 0x1c0bc10 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80dcff9700 1 -- 172.21.15.29:0/553451874 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f80e8004d90 con 0x1c0bc10 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 -- 172.21.15.29:0/553451874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80f0055390 con 0x1c0bc10 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80dcff9700 1 -- 172.21.15.29:0/553451874 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80e8014ab0 con 0x1c0bc10 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 10 client.6324 fetch_fsmap learned FSMap version 33 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 -- 172.21.15.29:0/553451874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1d67c30 con 0x1c0bc10 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80dcff9700 1 -- 172.21.15.29:0/553451874 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0055390 con 0x1c0bc10 2023-10-06T05:29:07.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f80dcff9700 1 -- 172.21.15.29:0/553451874 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f80e80060f0 con 0x1c0bc10 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 10 client.6324 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 10 client.6324 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 20 client.6324 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1e99c50 0x1e9a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 4 client.6324 mds_command: new command op to 6201 tid=0[{"prefix": "scrub status"}] 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.685+0000 7f8107014740 1 -- 172.21.15.29:0/553451874 --> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1d872c0 con 0x1e99c50 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80fe59c700 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1e99c50 0x1e9a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80dcff9700 10 client.6324 ms_handle_connect on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80fe59c700 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1e99c50 0x1e9a050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c228ca3fff4c8e26 server_cookie=7d95fae50cbfbfe8 in_seq=0 out_seq=0 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80dcff9700 1 -- 172.21.15.29:0/553451874 <== mds.0 v2:172.21.15.29:6834/184173135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x1d872c0 con 0x1e99c50 2023-10-06T05:29:07.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80dcff9700 10 client.6324 handle_command_reply: tid=0 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 client.6324 shutdown 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 -- 172.21.15.29:0/553451874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 msgr2=0x1ee2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1ee2790 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f80e80229e0 tx=0x7f80e801b000 comp rx=0 tx=0).stop 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 -- 172.21.15.29:0/553451874 shutdown_connections 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1e99c50 0x1e9a050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1c568c0 0x1e98d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1c0bc10 0x1ee2790 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 --2- 172.21.15.29:0/553451874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1c0b840 0x1ee2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80dcff9700 0 client.6324 ms_handle_reset on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 -- 172.21.15.29:0/553451874 >> 172.21.15.29:0/553451874 conn(0x1c0bfe0 msgr2=0x1e3e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 -- 172.21.15.29:0/553451874 shutdown_connections 2023-10-06T05:29:07.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 1 -- 172.21.15.29:0/553451874 wait complete. 2023-10-06T05:29:07.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f8107014740 20 client.6324 trim_cache size 0 max 16384 2023-10-06T05:29:07.702 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:29:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T05:29:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "scrubs": { 2023-10-06T05:29:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "d542ea38-f8a7-4d33-8cc5-eb15c35b3bac": { 2023-10-06T05:29:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2023-10-06T05:29:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "tag": "d542ea38-f8a7-4d33-8cc5-eb15c35b3bac", 2023-10-06T05:29:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "options": "recursive,repair" 2023-10-06T05:29:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:07.703 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 -- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e0060550 msgr2=0x7f80e0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e0060550 0x7f80e0062a00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f81000b13b0 tx=0x7f80e8009040 comp rx=0 tx=0).stop 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 -- 172.21.15.29:0/1559500242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81000687a0 msgr2=0x7f8100154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81000687a0 0x7f8100154c50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f810006eda0 tx=0x7f80f0017000 comp rx=0 tx=0).stop 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 -- 172.21.15.29:0/1559500242 shutdown_connections 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e0060550 0x7f80e0062a00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8100159200 0x7f81000c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8100158e30 0x7f8100169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 --2- 172.21.15.29:0/1559500242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81000687a0 0x7f8100154c50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:07.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 -- 172.21.15.29:0/1559500242 >> 172.21.15.29:0/1559500242 conn(0x7f81000c9830 msgr2=0x7f81000c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:07.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 -- 172.21.15.29:0/1559500242 shutdown_connections 2023-10-06T05:29:07.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:07.689+0000 7f80ff59e700 1 -- 172.21.15.29:0/1559500242 wait complete. 2023-10-06T05:29:07.711 INFO:tasks.cephfs.filesystem:scrub status for tag:d542ea38-f8a7-4d33-8cc5-eb15c35b3bac - {'path': '/', 'tag': 'd542ea38-f8a7-4d33-8cc5-eb15c35b3bac', 'options': 'recursive,repair'} 2023-10-06T05:29:07.862 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:29:07.857+0000 7fbd5ce0f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:29:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:08.457+0000 7fb18b7fe700 1 -- 172.21.15.29:0/978748150 <== mon.0 v2:172.21.15.29:3300/0 7 ==== log(8 entries from seq 1 at 2023-10-06T05:29:07.506644+0000) v1 ==== 1407+0+0 (secure 0 0 0) 0x7fb184001d20 con 0x7fb1940afe90 2023-10-06T05:29:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: cluster: 2023-10-06T05:29:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: id: bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: health: HEALTH_OK 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: services: 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: mon: 3 daemons, quorum a,b,c (age 3m) 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: mgr: x(active, since 3m), standbys: y 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: mds: 1/1 daemons up, 3 standby 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: data: 2023-10-06T05:29:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: volumes: 1/1 healthy 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: pools: 4 pools, 105 pgs 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: objects: 30 objects, 19 MiB 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: usage: 2.3 GiB used, 718 GiB / 720 GiB avail 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: pgs: 105 active+clean 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: io: 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: client: 614 B/s rd, 102 B/s wr, 0 op/s rd, 0 op/s wr 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:29:07.506644+0000 mds.c [INF] scrub queued for path: / 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:29:07.506647+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T05:29:08.466 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:29:07.506652+0000 mds.c [INF] scrub summary: active paths [/] 2023-10-06T05:29:08.467 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:29:07.509187+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000001 2023-10-06T05:29:08.467 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:29:07.509192+0000 mds.c [ERR] inode table repaired for inode: 0x10000000001 2023-10-06T05:29:08.467 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:29:07.509255+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000002 2023-10-06T05:29:08.467 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:29:07.509259+0000 mds.c [ERR] inode table repaired for inode: 0x10000000002 2023-10-06T05:29:08.467 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:29:07.509297+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T05:29:10.271 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:29:10.274 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:29:13.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:13.477+0000 7fb18b7fe700 1 -- 172.21.15.29:0/978748150 <== mon.0 v2:172.21.15.29:3300/0 8 ==== log(1 entries from seq 9 at 2023-10-06T05:29:11.888772+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb184052af0 con 0x7fb1940afe90 2023-10-06T05:29:13.484 INFO:teuthology.orchestra.run.smithi029.stdout:2023-10-06T05:29:11.888772+0000 mds.c [INF] scrub summary: idle 2023-10-06T05:29:37.712 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T05:29:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.829+0000 7f55493c2700 1 Processor -- start 2023-10-06T05:29:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.829+0000 7f55493c2700 1 -- start start 2023-10-06T05:29:37.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.829+0000 7f55493c2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5544155460 0x7f554406af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.829+0000 7f55493c2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f554406cdd0 0x7f554406b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.829+0000 7f55493c2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55441591e0 con 0x7f5544155830 2023-10-06T05:29:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.829+0000 7f55493c2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5544159a80 con 0x7f5544155460 2023-10-06T05:29:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.829+0000 7f55493c2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554406d380 con 0x7f554406cdd0 2023-10-06T05:29:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f5542ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5544155460 0x7f554406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f553a7fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5544155830 0x7f554406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45148/0 (socket says 172.21.15.29:45148) 2023-10-06T05:29:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f553a7fc700 1 -- 172.21.15.29:0/3722321237 learned_addr learned my addr 172.21.15.29:0/3722321237 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55437fe700 1 --2- 172.21.15.29:0/3722321237 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f554406cdd0 0x7f554406b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f5542ffd700 1 -- 172.21.15.29:0/3722321237 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f554406cdd0 msgr2=0x7f554406b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:37.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f5542ffd700 1 --2- 172.21.15.29:0/3722321237 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f554406cdd0 0x7f554406b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55427fc700 1 -- 172.21.15.29:0/3722321237 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890523312 0 0) 0x7f55441591e0 con 0x7f5544155830 2023-10-06T05:29:37.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f5542ffd700 1 -- 172.21.15.29:0/3722321237 >> v1:172.21.15.29:6789/0 conn(0x7f5544155830 legacy=0x7f554406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f5542ffd700 1 -- 172.21.15.29:0/3722321237 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5544159430 con 0x7f5544155460 2023-10-06T05:29:37.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f5542ffd700 1 --2- 172.21.15.29:0/3722321237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 0x7f554406af70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f55340098e0 tx=0x7f55340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04967856534b3a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:37.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55427fc700 1 -- 172.21.15.29:0/3722321237 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400b640 con 0x7f5544155460 2023-10-06T05:29:37.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55427fc700 1 -- 172.21.15.29:0/3722321237 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553400b7a0 con 0x7f5544155460 2023-10-06T05:29:37.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55427fc700 1 -- 172.21.15.29:0/3722321237 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400bb40 con 0x7f5544155460 2023-10-06T05:29:37.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55493c2700 1 -- 172.21.15.29:0/3722321237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 msgr2=0x7f554406af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55493c2700 1 --2- 172.21.15.29:0/3722321237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 0x7f554406af70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f55340098e0 tx=0x7f55340091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55493c2700 1 -- 172.21.15.29:0/3722321237 shutdown_connections 2023-10-06T05:29:37.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55493c2700 1 --2- 172.21.15.29:0/3722321237 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f554406cdd0 0x7f554406b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55493c2700 1 --2- 172.21.15.29:0/3722321237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 0x7f554406af70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55493c2700 1 -- 172.21.15.29:0/3722321237 >> 172.21.15.29:0/3722321237 conn(0x7f55440cd0e0 msgr2=0x7f55440c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:37.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55493c2700 1 -- 172.21.15.29:0/3722321237 shutdown_connections 2023-10-06T05:29:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.833+0000 7f55493c2700 1 -- 172.21.15.29:0/3722321237 wait complete. 2023-10-06T05:29:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f55493c2700 1 Processor -- start 2023-10-06T05:29:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f55493c2700 1 -- start start 2023-10-06T05:29:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f55493c2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554406cdd0 0x7f554414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f55493c2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 0x7f5544166ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f55493c2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5544155830 0x7f5544153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f55493c2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554414ea30 con 0x7f5544155460 2023-10-06T05:29:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f55493c2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5544167580 con 0x7f554406cdd0 2023-10-06T05:29:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f55493c2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5544167860 con 0x7f5544155830 2023-10-06T05:29:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f553a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 0x7f5544166ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f553a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 0x7f5544166ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39844/0 (socket says 172.21.15.29:39844) 2023-10-06T05:29:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f553a7fc700 1 -- 172.21.15.29:0/2186836560 learned_addr learned my addr 172.21.15.29:0/2186836560 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f55437fe700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5544155830 0x7f5544153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.837+0000 7f5542ffd700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554406cdd0 0x7f554414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f553a7fc700 1 -- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5544155830 msgr2=0x7f5544153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f553a7fc700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5544155830 0x7f5544153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f553a7fc700 1 -- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554406cdd0 msgr2=0x7f554414e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f553a7fc700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554406cdd0 0x7f554414e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f553a7fc700 1 -- 172.21.15.29:0/2186836560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534009420 con 0x7f5544155460 2023-10-06T05:29:37.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f553a7fc700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 0x7f5544166ce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f552c00c5e0 tx=0x7f552c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:37.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f553b7fe700 1 -- 172.21.15.29:0/2186836560 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c005b30 con 0x7f5544155460 2023-10-06T05:29:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f553b7fe700 1 -- 172.21.15.29:0/2186836560 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c005c90 con 0x7f5544155460 2023-10-06T05:29:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f55493c2700 1 -- 172.21.15.29:0/2186836560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5544167b40 con 0x7f5544155460 2023-10-06T05:29:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f553b7fe700 1 -- 172.21.15.29:0/2186836560 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c007300 con 0x7f5544155460 2023-10-06T05:29:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.841+0000 7f55493c2700 1 -- 172.21.15.29:0/2186836560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55440c4ed0 con 0x7f5544155460 2023-10-06T05:29:37.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553b7fe700 1 -- 172.21.15.29:0/2186836560 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f552c01b3b0 con 0x7f5544155460 2023-10-06T05:29:37.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f554b66b740 1 Processor -- start 2023-10-06T05:29:37.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f554b66b740 1 -- start start 2023-10-06T05:29:37.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553b7fe700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5528060550 0x7f5528062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553b7fe700 1 -- 172.21.15.29:0/2186836560 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f552c07be90 con 0x7f5544155460 2023-10-06T05:29:37.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f55437fe700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5528060550 0x7f5528062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f554b66b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 0x1b42370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f554b66b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b3c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f554b66b740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b3cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f554b66b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ab40f0 con 0x1908840 2023-10-06T05:29:37.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f554b66b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aafee0 con 0x1908c10 2023-10-06T05:29:37.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f554b66b740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a76020 con 0x19538c0 2023-10-06T05:29:37.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b3c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b3c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39848/0 (socket says 172.21.15.29:39848) 2023-10-06T05:29:37.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553a7fc700 1 -- 172.21.15.29:0/2049736283 learned_addr learned my addr 172.21.15.29:0/2049736283 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:37.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f5542ffd700 1 --2- 172.21.15.29:0/2049736283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 0x1b42370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f55437fe700 1 --2- 172.21.15.29:0/2049736283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b3cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f55437fe700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5528060550 0x7f5528062a00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f553c009fd0 tx=0x7f553c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:37.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553a7fc700 1 -- 172.21.15.29:0/2049736283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 msgr2=0x1b3cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:37.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553a7fc700 1 --2- 172.21.15.29:0/2049736283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b3cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553a7fc700 1 -- 172.21.15.29:0/2049736283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 msgr2=0x1b42370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553a7fc700 1 --2- 172.21.15.29:0/2049736283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 0x1b42370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553a7fc700 1 -- 172.21.15.29:0/2049736283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1954b10 con 0x1908840 2023-10-06T05:29:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f553a7fc700 1 --2- 172.21.15.29:0/2049736283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b3c730 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f552c07a0c0 tx=0x7f552c07a020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e805afa7fa8dcd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f5533fff700 1 -- 172.21.15.29:0/2049736283 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c065070 con 0x1908840 2023-10-06T05:29:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f5533fff700 1 -- 172.21.15.29:0/2049736283 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c0530e0 con 0x1908840 2023-10-06T05:29:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.845+0000 7f5533fff700 1 -- 172.21.15.29:0/2049736283 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c050ea0 con 0x1908840 2023-10-06T05:29:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 -- 172.21.15.29:0/2049736283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 msgr2=0x1b3c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 --2- 172.21.15.29:0/2049736283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b3c730 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f552c07a0c0 tx=0x7f552c07a020 comp rx=0 tx=0).stop 2023-10-06T05:29:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 -- 172.21.15.29:0/2049736283 shutdown_connections 2023-10-06T05:29:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 --2- 172.21.15.29:0/2049736283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b3cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 --2- 172.21.15.29:0/2049736283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b3c730 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 --2- 172.21.15.29:0/2049736283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 0x1b42370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 -- 172.21.15.29:0/2049736283 >> 172.21.15.29:0/2049736283 conn(0x1908fe0 msgr2=0x1b68fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 -- 172.21.15.29:0/2049736283 shutdown_connections 2023-10-06T05:29:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 -- 172.21.15.29:0/2049736283 wait complete. 2023-10-06T05:29:37.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 -- start start 2023-10-06T05:29:37.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 Processor -- start 2023-10-06T05:29:37.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b89df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 0x1b8a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b8cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a75cc0 con 0x1908840 2023-10-06T05:29:37.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a4e820 con 0x1908c10 2023-10-06T05:29:37.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a79a30 con 0x19538c0 2023-10-06T05:29:37.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f5542ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b89df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f554b66b740 10 client.0 _ll_register_callbacks cb 0x1a52b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:37.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f5542ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b89df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39858/0 (socket says 172.21.15.29:39858) 2023-10-06T05:29:37.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f5542ffd700 1 -- 172.21.15.29:0/471171374 learned_addr learned my addr 172.21.15.29:0/471171374 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:37.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f55437fe700 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b8cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.849+0000 7f553a7fc700 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 0x1b8a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f5542ffd700 1 -- 172.21.15.29:0/471171374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 msgr2=0x1b8cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:37.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f5542ffd700 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b8cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f5542ffd700 1 -- 172.21.15.29:0/471171374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 msgr2=0x1b8a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:37.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f5542ffd700 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 0x1b8a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f5542ffd700 1 -- 172.21.15.29:0/471171374 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55440c4ed0 con 0x1908840 2023-10-06T05:29:37.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f5542ffd700 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b89df0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5534009f80 tx=0x7f5534017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8fee390882b87c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f55317fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:29:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f55317fa700 1 -- 172.21.15.29:0/471171374 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534021070 con 0x1908840 2023-10-06T05:29:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f55317fa700 1 -- 172.21.15.29:0/471171374 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f553401a420 con 0x1908840 2023-10-06T05:29:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 1 -- 172.21.15.29:0/471171374 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a68a10 con 0x1908840 2023-10-06T05:29:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f55317fa700 1 -- 172.21.15.29:0/471171374 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f553401a830 con 0x1908840 2023-10-06T05:29:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 10 client.6339 fetch_fsmap learned FSMap version 33 2023-10-06T05:29:37.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 1 -- 172.21.15.29:0/471171374 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1a7e220 con 0x1908840 2023-10-06T05:29:37.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f55317fa700 1 -- 172.21.15.29:0/471171374 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a68a10 con 0x1908840 2023-10-06T05:29:37.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f55317fa700 1 -- 172.21.15.29:0/471171374 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f553401a990 con 0x1908840 2023-10-06T05:29:37.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 10 client.6339 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T05:29:37.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 10 client.6339 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:29:37.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 20 client.6339 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:37.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1b408d0 0x1b40cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 4 client.6339 mds_command: new command op to 6201 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:29:37.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 1 -- 172.21.15.29:0/471171374 --> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a523f0 con 0x1b408d0 2023-10-06T05:29:37.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f553a7fc700 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1b408d0 0x1b40cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f55317fa700 10 client.6339 ms_handle_connect on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:37.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f553a7fc700 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1b408d0 0x1b40cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be50881fb8f289a8 server_cookie=337240d856364027 in_seq=0 out_seq=0 2023-10-06T05:29:37.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f55317fa700 1 -- 172.21.15.29:0/471171374 <== mds.0 v2:172.21.15.29:6834/184173135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1a523f0 con 0x1b408d0 2023-10-06T05:29:37.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f55317fa700 10 client.6339 handle_command_reply: tid=0 2023-10-06T05:29:37.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.853+0000 7f554b66b740 1 client.6339 shutdown 2023-10-06T05:29:37.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 -- 172.21.15.29:0/471171374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 msgr2=0x1b89df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b89df0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5534009f80 tx=0x7f5534017000 comp rx=0 tx=0).stop 2023-10-06T05:29:37.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 -- 172.21.15.29:0/471171374 shutdown_connections 2023-10-06T05:29:37.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1b408d0 0x1b40cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b8cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f55317fa700 0 client.6339 ms_handle_reset on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908c10 0x1b8a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 --2- 172.21.15.29:0/471171374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908840 0x1b89df0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 -- 172.21.15.29:0/471171374 >> 172.21.15.29:0/471171374 conn(0x1908fe0 msgr2=0x1b68bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 -- 172.21.15.29:0/471171374 shutdown_connections 2023-10-06T05:29:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 1 -- 172.21.15.29:0/471171374 wait complete. 2023-10-06T05:29:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.857+0000 7f554b66b740 20 client.6339 trim_cache size 0 max 16384 2023-10-06T05:29:37.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f554b66b740 1 Processor -- start 2023-10-06T05:29:37.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f554b66b740 1 -- start start 2023-10-06T05:29:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f554b66b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 0x1b41580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f554b66b740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1908c10 0x1b41ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f554b66b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19538c0 0x1b979d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f554b66b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a75340 con 0x19538c0 2023-10-06T05:29:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f554b66b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ab50b0 con 0x1908840 2023-10-06T05:29:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f554b66b740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ab62f0 con 0x1908c10 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f55437fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19538c0 0x1b979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f55437fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19538c0 0x1b979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39866/0 (socket says 172.21.15.29:39866) 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f55437fe700 1 -- 172.21.15.29:0/2031527267 learned_addr learned my addr 172.21.15.29:0/2031527267 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f5542ffd700 1 --2- 172.21.15.29:0/2031527267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 0x1b41580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f553a7fc700 1 --2- 172.21.15.29:0/2031527267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1908c10 0x1b41ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f55437fe700 1 -- 172.21.15.29:0/2031527267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1908c10 msgr2=0x1b41ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f55437fe700 1 --2- 172.21.15.29:0/2031527267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1908c10 0x1b41ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f55437fe700 1 -- 172.21.15.29:0/2031527267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 msgr2=0x1b41580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f55437fe700 1 --2- 172.21.15.29:0/2031527267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 0x1b41580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f55437fe700 1 -- 172.21.15.29:0/2031527267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a64c30 con 0x19538c0 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f55437fe700 1 --2- 172.21.15.29:0/2031527267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19538c0 0x1b979d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f553c0198c0 tx=0x7f553c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c85d25e99877ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f5538ff9700 1 -- 172.21.15.29:0/2031527267 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00e040 con 0x19538c0 2023-10-06T05:29:37.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f5538ff9700 1 -- 172.21.15.29:0/2031527267 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c027070 con 0x19538c0 2023-10-06T05:29:37.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.877+0000 7f5538ff9700 1 -- 172.21.15.29:0/2031527267 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c017650 con 0x19538c0 2023-10-06T05:29:37.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 -- 172.21.15.29:0/2031527267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19538c0 msgr2=0x1b979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 --2- 172.21.15.29:0/2031527267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19538c0 0x1b979d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f553c0198c0 tx=0x7f553c01d000 comp rx=0 tx=0).stop 2023-10-06T05:29:37.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 -- 172.21.15.29:0/2031527267 shutdown_connections 2023-10-06T05:29:37.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 --2- 172.21.15.29:0/2031527267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x19538c0 0x1b979d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 --2- 172.21.15.29:0/2031527267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1908c10 0x1b41ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 --2- 172.21.15.29:0/2031527267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 0x1b41580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 -- 172.21.15.29:0/2031527267 >> 172.21.15.29:0/2031527267 conn(0x1908fe0 msgr2=0x1b65670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:37.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 -- 172.21.15.29:0/2031527267 shutdown_connections 2023-10-06T05:29:37.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 -- 172.21.15.29:0/2031527267 wait complete. 2023-10-06T05:29:37.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 -- start start 2023-10-06T05:29:37.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.881+0000 7f554b66b740 1 Processor -- start 2023-10-06T05:29:37.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 0x1be34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908c10 0x1be3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b99c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a80930 con 0x1908c10 2023-10-06T05:29:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ab39e0 con 0x1908840 2023-10-06T05:29:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a87aa0 con 0x19538c0 2023-10-06T05:29:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 10 client.0 _ll_register_callbacks cb 0x1a2c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:29:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f553a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908c10 0x1be3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f553a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908c10 0x1be3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39870/0 (socket says 172.21.15.29:39870) 2023-10-06T05:29:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f553a7fc700 1 -- 172.21.15.29:0/3475314993 learned_addr learned my addr 172.21.15.29:0/3475314993 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f5542ffd700 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 0x1be34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55437fe700 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b99c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f553a7fc700 1 -- 172.21.15.29:0/3475314993 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 msgr2=0x1b99c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f553a7fc700 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b99c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f553a7fc700 1 -- 172.21.15.29:0/3475314993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 msgr2=0x1be34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f553a7fc700 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 0x1be34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f553a7fc700 1 -- 172.21.15.29:0/3475314993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c0195f0 con 0x1908c10 2023-10-06T05:29:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f5542ffd700 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 0x1be34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f553a7fc700 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908c10 0x1be3a10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f552c04f7d0 tx=0x7f552c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0baa23216f53aec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55317fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:29:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55317fa700 1 -- 172.21.15.29:0/3475314993 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c065040 con 0x1908c10 2023-10-06T05:29:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55317fa700 1 -- 172.21.15.29:0/3475314993 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f552c070e20 con 0x1908c10 2023-10-06T05:29:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 -- 172.21.15.29:0/3475314993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f552c0530e0 con 0x1908c10 2023-10-06T05:29:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55317fa700 1 -- 172.21.15.29:0/3475314993 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f552c050ea0 con 0x1908c10 2023-10-06T05:29:37.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 10 client.6345 fetch_fsmap learned FSMap version 33 2023-10-06T05:29:37.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 -- 172.21.15.29:0/3475314993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1a58fe0 con 0x1908c10 2023-10-06T05:29:37.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55317fa700 1 -- 172.21.15.29:0/3475314993 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c0530e0 con 0x1908c10 2023-10-06T05:29:37.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55317fa700 1 -- 172.21.15.29:0/3475314993 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f552c0076f0 con 0x1908c10 2023-10-06T05:29:37.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 10 client.6345 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T05:29:37.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 10 client.6345 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T05:29:37.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 20 client.6345 populate_metadata read hostname 'smithi029' 2023-10-06T05:29:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1b408d0 0x1b9a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 4 client.6345 mds_command: new command op to 6201 tid=0[{"prefix": "scrub status"}] 2023-10-06T05:29:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 -- 172.21.15.29:0/3475314993 --> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1a842c0 con 0x1b408d0 2023-10-06T05:29:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f5542ffd700 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1b408d0 0x1b9a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55317fa700 10 client.6345 ms_handle_connect on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f5542ffd700 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1b408d0 0x1b9a610 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=986d605207ea3599 server_cookie=b1c51dccc13d47cc in_seq=0 out_seq=0 2023-10-06T05:29:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55317fa700 1 -- 172.21.15.29:0/3475314993 <== mds.0 v2:172.21.15.29:6834/184173135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1a842c0 con 0x1b408d0 2023-10-06T05:29:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f55317fa700 10 client.6345 handle_command_reply: tid=0 2023-10-06T05:29:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 client.6345 shutdown 2023-10-06T05:29:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 -- 172.21.15.29:0/3475314993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908c10 msgr2=0x1be3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.885+0000 7f554b66b740 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908c10 0x1be3a10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f552c04f7d0 tx=0x7f552c014000 comp rx=0 tx=0).stop 2023-10-06T05:29:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f554b66b740 1 -- 172.21.15.29:0/3475314993 shutdown_connections 2023-10-06T05:29:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f554b66b740 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.29:6834/184173135,v1:172.21.15.29:6835/184173135] conn(0x1b408d0 0x1b9a610 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f554b66b740 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x19538c0 0x1b99c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55317fa700 0 client.6345 ms_handle_reset on v2:172.21.15.29:6834/184173135 2023-10-06T05:29:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f554b66b740 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1908c10 0x1be3a10 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f554b66b740 1 --2- 172.21.15.29:0/3475314993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1908840 0x1be34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f554b66b740 1 -- 172.21.15.29:0/3475314993 >> 172.21.15.29:0/3475314993 conn(0x1908fe0 msgr2=0x1b42020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f554b66b740 1 -- 172.21.15.29:0/3475314993 shutdown_connections 2023-10-06T05:29:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f554b66b740 1 -- 172.21.15.29:0/3475314993 wait complete. 2023-10-06T05:29:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f554b66b740 20 client.6345 trim_cache size 0 max 16384 2023-10-06T05:29:37.899 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:29:37.899 INFO:teuthology.orchestra.run.smithi029.stdout: "status": "no active scrubs running", 2023-10-06T05:29:37.899 INFO:teuthology.orchestra.run.smithi029.stdout: "scrubs": {} 2023-10-06T05:29:37.899 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:29:37.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 -- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5528060550 msgr2=0x7f5528062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5528060550 0x7f5528062a00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f553c009fd0 tx=0x7f553c00b040 comp rx=0 tx=0).stop 2023-10-06T05:29:37.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 -- 172.21.15.29:0/2186836560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 msgr2=0x7f5544166ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:37.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 0x7f5544166ce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f552c00c5e0 tx=0x7f552c000fe0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 -- 172.21.15.29:0/2186836560 shutdown_connections 2023-10-06T05:29:37.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5544155830 0x7f5544153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5544155460 0x7f5544166ce0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5528060550 0x7f5528062a00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 --2- 172.21.15.29:0/2186836560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554406cdd0 0x7f554414e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:37.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 -- 172.21.15.29:0/2186836560 >> 172.21.15.29:0/2186836560 conn(0x7f55440cd0e0 msgr2=0x7f55440c13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:37.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 -- 172.21.15.29:0/2186836560 shutdown_connections 2023-10-06T05:29:37.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:37.889+0000 7f55493c2700 1 -- 172.21.15.29:0/2186836560 wait complete. 2023-10-06T05:29:37.910 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T05:29:38.014 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T05:29:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f2ce3700 1 Processor -- start 2023-10-06T05:29:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f2ce3700 1 -- start start 2023-10-06T05:29:38.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f2ce3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19ec0ab400 0x7f19ec0ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f2ce3700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f19ec06cdd0 0x7f19ec0accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f2ce3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec0ab8e0 con 0x7f19ec15c200 2023-10-06T05:29:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f2ce3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec0abbc0 con 0x7f19ec0ab400 2023-10-06T05:29:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f2ce3700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec0abea0 con 0x7f19ec06cdd0 2023-10-06T05:29:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19ebfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19ec0ab400 0x7f19ec0ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f0a7f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f19ec15c200 0x7f19ec0aece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45162/0 (socket says 172.21.15.29:45162) 2023-10-06T05:29:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f0a7f700 1 -- 172.21.15.29:0/4094852558 learned_addr learned my addr 172.21.15.29:0/4094852558 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19f1280700 1 --2- 172.21.15.29:0/4094852558 >> v2:172.21.15.173:3300/0 conn(0x7f19ec06cdd0 0x7f19ec0accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19eb7fe700 1 -- 172.21.15.29:0/4094852558 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985444474 0 0) 0x7f19ec0ab8e0 con 0x7f19ec15c200 2023-10-06T05:29:38.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19eb7fe700 1 -- 172.21.15.29:0/4094852558 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19cc003570 con 0x7f19ec15c200 2023-10-06T05:29:38.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19ebfff700 1 -- 172.21.15.29:0/4094852558 >> v2:172.21.15.173:3300/0 conn(0x7f19ec06cdd0 msgr2=0x7f19ec0accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:38.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19ebfff700 1 --2- 172.21.15.29:0/4094852558 >> v2:172.21.15.173:3300/0 conn(0x7f19ec06cdd0 0x7f19ec0accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19ebfff700 1 -- 172.21.15.29:0/4094852558 >> v1:172.21.15.29:6789/0 conn(0x7f19ec15c200 legacy=0x7f19ec0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19ebfff700 1 -- 172.21.15.29:0/4094852558 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec0ac180 con 0x7f19ec0ab400 2023-10-06T05:29:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19ebfff700 1 --2- 172.21.15.29:0/4094852558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec0ab400 0x7f19ec0ac7b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f19ec064450 tx=0x7f19e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b485d58b2af8a18a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19eb7fe700 1 -- 172.21.15.29:0/4094852558 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e400e070 con 0x7f19ec0ab400 2023-10-06T05:29:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.125+0000 7f19eb7fe700 1 -- 172.21.15.29:0/4094852558 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e400bab0 con 0x7f19ec0ab400 2023-10-06T05:29:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19eb7fe700 1 -- 172.21.15.29:0/4094852558 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e400be70 con 0x7f19ec0ab400 2023-10-06T05:29:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 -- 172.21.15.29:0/4094852558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec0ab400 msgr2=0x7f19ec0ac7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 --2- 172.21.15.29:0/4094852558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec0ab400 0x7f19ec0ac7b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f19ec064450 tx=0x7f19e4009780 comp rx=0 tx=0).stop 2023-10-06T05:29:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 -- 172.21.15.29:0/4094852558 shutdown_connections 2023-10-06T05:29:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 --2- 172.21.15.29:0/4094852558 >> v2:172.21.15.173:3300/0 conn(0x7f19ec06cdd0 0x7f19ec0accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 --2- 172.21.15.29:0/4094852558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec0ab400 0x7f19ec0ac7b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 -- 172.21.15.29:0/4094852558 >> 172.21.15.29:0/4094852558 conn(0x7f19ec067b70 msgr2=0x7f19ec06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 -- 172.21.15.29:0/4094852558 shutdown_connections 2023-10-06T05:29:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 -- 172.21.15.29:0/4094852558 wait complete. 2023-10-06T05:29:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 Processor -- start 2023-10-06T05:29:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.129+0000 7f19f2ce3700 1 -- start start 2023-10-06T05:29:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f2ce3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19ec06cdd0 0x7f19ec0af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f2ce3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ec0ab400 0x7f19ec16d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f2ce3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec15c200 0x7f19ec140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f2ce3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec16d830 con 0x7f19ec15c200 2023-10-06T05:29:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f2ce3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0b0890 con 0x7f19ec0ab400 2023-10-06T05:29:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f2ce3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0afc80 con 0x7f19ec06cdd0 2023-10-06T05:29:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f1280700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec15c200 0x7f19ec140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f1280700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec15c200 0x7f19ec140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39880/0 (socket says 172.21.15.29:39880) 2023-10-06T05:29:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f1280700 1 -- 172.21.15.29:0/776276954 learned_addr learned my addr 172.21.15.29:0/776276954 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19ebfff700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ec0ab400 0x7f19ec16d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f0a7f700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19ec06cdd0 0x7f19ec0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f1280700 1 -- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19ec06cdd0 msgr2=0x7f19ec0af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f1280700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19ec06cdd0 0x7f19ec0af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f1280700 1 -- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ec0ab400 msgr2=0x7f19ec16d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f1280700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ec0ab400 0x7f19ec16d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f1280700 1 -- 172.21.15.29:0/776276954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e4009a20 con 0x7f19ec15c200 2023-10-06T05:29:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f1280700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec15c200 0x7f19ec140730 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00ea80 tx=0x7f19dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19e8ff9700 1 -- 172.21.15.29:0/776276954 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00c920 con 0x7f19ec15c200 2023-10-06T05:29:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19e8ff9700 1 -- 172.21.15.29:0/776276954 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00ca80 con 0x7f19ec15c200 2023-10-06T05:29:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec0aff60 con 0x7f19ec15c200 2023-10-06T05:29:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19e8ff9700 1 -- 172.21.15.29:0/776276954 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00ce40 con 0x7f19ec15c200 2023-10-06T05:29:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec0b0520 con 0x7f19ec15c200 2023-10-06T05:29:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19e8ff9700 1 -- 172.21.15.29:0/776276954 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f19dc013680 con 0x7f19ec15c200 2023-10-06T05:29:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.133+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec071120 con 0x7f19ec15c200 2023-10-06T05:29:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.137+0000 7f19e8ff9700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19d0060550 0x7f19d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.137+0000 7f19e8ff9700 1 -- 172.21.15.29:0/776276954 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6289+0+0 (secure 0 0 0) 0x7f19dc07cd80 con 0x7f19ec15c200 2023-10-06T05:29:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.137+0000 7f19f0a7f700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19d0060550 0x7f19d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.137+0000 7f19f0a7f700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19d0060550 0x7f19d0062a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f19ec16c810 tx=0x7f19d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.145+0000 7f19e8ff9700 1 -- 172.21.15.29:0/776276954 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f19dc04d120 con 0x7f19ec15c200 2023-10-06T05:29:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.341+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f19ec0b09d0 con 0x7f19ec15c200 2023-10-06T05:29:38.347 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-06T05:29:38.341+0000 7fe44aab2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T05:29:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.349+0000 7f19e8ff9700 1 -- 172.21.15.29:0/776276954 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f19dc050740 con 0x7f19ec15c200 2023-10-06T05:29:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19d0060550 msgr2=0x7f19d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19d0060550 0x7f19d0062a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f19ec16c810 tx=0x7f19d4009040 comp rx=0 tx=0).stop 2023-10-06T05:29:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec15c200 msgr2=0x7f19ec140730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec15c200 0x7f19ec140730 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00ea80 tx=0x7f19dc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 shutdown_connections 2023-10-06T05:29:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19ec15c200 0x7f19ec140730 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19d0060550 0x7f19d0062a00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19ec0ab400 0x7f19ec16d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 --2- 172.21.15.29:0/776276954 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19ec06cdd0 0x7f19ec0af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 >> 172.21.15.29:0/776276954 conn(0x7f19ec067b70 msgr2=0x7f19ec15c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:38.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 shutdown_connections 2023-10-06T05:29:38.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.353+0000 7f19f2ce3700 1 -- 172.21.15.29:0/776276954 wait complete. 2023-10-06T05:29:38.361 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T05:29:38.361 INFO:tasks.ceph.mds.c.smithi029.stderr: -839> 2023-10-06T05:29:07.505+0000 7fbd59608700 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2023-10-06T05:29:38.362 INFO:tasks.ceph.mds.c.smithi029.stderr: -836> 2023-10-06T05:29:07.505+0000 7fbd59608700 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2023-10-06T05:29:38.362 INFO:tasks.ceph.mds.c.smithi029.stderr: -820> 2023-10-06T05:29:07.505+0000 7fbd59608700 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2023-10-06T05:29:38.362 INFO:tasks.ceph.mds.c.smithi029.stderr: -817> 2023-10-06T05:29:07.505+0000 7fbd59608700 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2023-10-06T05:29:38.362 INFO:tasks.ceph.mds.c.smithi029.stderr: -759> 2023-10-06T05:29:07.857+0000 7fbd5ce0f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:29:38.375 DEBUG:teuthology.orchestra.run.smithi029:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2023-10-06T05:29:38.385 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:29:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca1b5d0c0 1 -- start start 2023-10-06T05:29:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca1b5d0c0 1 Processor -- start 2023-10-06T05:29:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca1b5d0c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa651b6400 0x55fa651a6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca1b5d0c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b6800 0x55fa651a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca1b5d0c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b6c00 0x55fa651a7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca1b5d0c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6442adc0 con 0x55fa651b6c00 2023-10-06T05:29:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca1b5d0c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6442bcc0 con 0x55fa651b6400 2023-10-06T05:29:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca1b5d0c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa6442bb80 con 0x55fa651b6800 2023-10-06T05:29:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0b18700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b6c00 0x55fa651a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0317700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa651b6400 0x55fa651a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0317700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa651b6400 0x55fa651a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:50374/0 (socket says 172.21.15.29:50374) 2023-10-06T05:29:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdc9fb16700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b6800 0x55fa651a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0317700 1 -- 172.21.15.29:0/2711559402 learned_addr learned my addr 172.21.15.29:0/2711559402 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0317700 1 -- 172.21.15.29:0/2711559402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b6800 msgr2=0x55fa651a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0317700 1 --2- 172.21.15.29:0/2711559402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b6800 0x55fa651a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0317700 1 -- 172.21.15.29:0/2711559402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b6c00 msgr2=0x55fa651a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0317700 1 --2- 172.21.15.29:0/2711559402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b6c00 0x55fa651a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0317700 1 -- 172.21.15.29:0/2711559402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa6440e340 con 0x55fa651b6400 2023-10-06T05:29:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0b18700 1 --2- 172.21.15.29:0/2711559402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b6c00 0x55fa651a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdca0317700 1 --2- 172.21.15.29:0/2711559402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa651b6400 0x55fa651a6580 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55fa65177d70 tx=0x55fa6516ad20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c35956602f09709e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.401+0000 7fdc9db12700 1 -- 172.21.15.29:0/2711559402 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa64439600 con 0x55fa651b6400 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdc9db12700 1 -- 172.21.15.29:0/2711559402 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa64440600 con 0x55fa651b6400 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdc9db12700 1 -- 172.21.15.29:0/2711559402 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa644391e0 con 0x55fa651b6400 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2711559402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa6440e000 con 0x55fa651b6400 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2711559402 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fa6440eea0 con 0x55fa651b6400 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 4 waiting for MDS map... 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdc9db12700 1 -- 172.21.15.29:0/2711559402 <== mon.1 v2:172.21.15.173:3300/0 4 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x55fa651caa80 con 0x55fa651b6400 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdc9db12700 1 -- 172.21.15.29:0/2711559402 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 34) v1 ==== 2559+0+0 (secure 0 0 0) 0x55fa651ec600 con 0x55fa651b6400 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 4 Got MDS map 34 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 10 main: main 2023-10-06T05:29:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 4 main: connecting to RADOS... 2023-10-06T05:29:38.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 Processor -- start 2023-10-06T05:29:38.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 -- start start 2023-10-06T05:29:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b7c00 0x55fa651a7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa6524e000 0x55fa651a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa6524e400 0x55fa651a8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6442a3c0 con 0x55fa6524e000 2023-10-06T05:29:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6442adc0 con 0x55fa6524e400 2023-10-06T05:29:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca1b5d0c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa6442a000 con 0x55fa651b7c00 2023-10-06T05:29:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0317700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa6524e000 0x55fa651a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0317700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa6524e000 0x55fa651a7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39902/0 (socket says 172.21.15.29:39902) 2023-10-06T05:29:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0317700 1 -- 172.21.15.29:0/2861233467 learned_addr learned my addr 172.21.15.29:0/2861233467 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0b18700 1 --2- 172.21.15.29:0/2861233467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b7c00 0x55fa651a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdc9fb16700 1 --2- 172.21.15.29:0/2861233467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa6524e400 0x55fa651a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0317700 1 -- 172.21.15.29:0/2861233467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b7c00 msgr2=0x55fa651a7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0317700 1 --2- 172.21.15.29:0/2861233467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b7c00 0x55fa651a7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0317700 1 -- 172.21.15.29:0/2861233467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa6524e400 msgr2=0x55fa651a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0317700 1 --2- 172.21.15.29:0/2861233467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa6524e400 0x55fa651a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0317700 1 -- 172.21.15.29:0/2861233467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa6440f860 con 0x55fa6524e000 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdca0317700 1 --2- 172.21.15.29:0/2861233467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa6524e000 0x55fa651a7b80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55fa651deae0 tx=0x55fa644a6c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8181e0b6e725fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdc9bb0e700 1 -- 172.21.15.29:0/2861233467 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa64438f20 con 0x55fa6524e000 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdc9bb0e700 1 -- 172.21.15.29:0/2861233467 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa64440c00 con 0x55fa6524e000 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.405+0000 7fdc9bb0e700 1 -- 172.21.15.29:0/2861233467 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa64439600 con 0x55fa6524e000 2023-10-06T05:29:38.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2861233467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa6524e000 msgr2=0x55fa651a7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/2861233467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa6524e000 0x55fa651a7b80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55fa651deae0 tx=0x55fa644a6c60 comp rx=0 tx=0).stop 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2861233467 shutdown_connections 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/2861233467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa6524e400 0x55fa651a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/2861233467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa6524e000 0x55fa651a7b80 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/2861233467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b7c00 0x55fa651a7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2861233467 >> 172.21.15.29:0/2861233467 conn(0x55fa651b7000 msgr2=0x55fa65173800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2861233467 shutdown_connections 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2861233467 wait complete. 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 Processor -- start 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 -- start start 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b7000 0x55fa651a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa6524e000 0x55fa651a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa6524e400 0x55fa651a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6442b180 con 0x55fa651b7000 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa6442b040 con 0x55fa6524e000 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca1b5d0c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa6442af00 con 0x55fa6524e400 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca0b18700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b7000 0x55fa651a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca0b18700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b7000 0x55fa651a8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39904/0 (socket says 172.21.15.29:39904) 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca0b18700 1 -- 172.21.15.29:0/1471725704 learned_addr learned my addr 172.21.15.29:0/1471725704 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca0317700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa6524e000 0x55fa651a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdc9fb16700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa6524e400 0x55fa651a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca0b18700 1 -- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa6524e400 msgr2=0x55fa651a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca0b18700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa6524e400 0x55fa651a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca0b18700 1 -- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa6524e000 msgr2=0x55fa651a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca0b18700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa6524e000 0x55fa651a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdca0b18700 1 -- 172.21.15.29:0/1471725704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa6440e340 con 0x55fa651b7000 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.409+0000 7fdc9fb16700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa6524e400 0x55fa651a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.413+0000 7fdca0b18700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b7000 0x55fa651a8c00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55fa651dfe60 tx=0x55fa65204e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.413+0000 7fdc9a30b700 1 -- 172.21.15.29:0/1471725704 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa64438f20 con 0x55fa651b7000 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.413+0000 7fdc9a30b700 1 -- 172.21.15.29:0/1471725704 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa65200300 con 0x55fa651b7000 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.413+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa6440fa00 con 0x55fa651b7000 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.413+0000 7fdc9a30b700 1 -- 172.21.15.29:0/1471725704 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa64439600 con 0x55fa651b7000 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.413+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa6440e340 con 0x55fa651b7000 2023-10-06T05:29:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.413+0000 7fdca1b5d0c0 4 main: resolving pool 9 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.413+0000 7fdc9a30b700 1 -- 172.21.15.29:0/1471725704 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x55fa6515b080 con 0x55fa651b7000 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.413+0000 7fdc9a30b700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55fa65268800 0x55fa651a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdc9a30b700 1 -- 172.21.15.29:0/1471725704 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x55fa651cb880 con 0x55fa651b7000 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 4 main: creating IoCtx.. 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55fa6524e800 0x55fa651a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:1 9.13 9:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x55fa6524ec00 con 0x55fa6524e800 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca0317700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55fa65268800 0x55fa651a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdc9fb16700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55fa6524e800 0x55fa651a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca0317700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55fa65268800 0x55fa651a9700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55fa651deae0 tx=0x55fa65204cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdc9fb16700 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55fa6524e800 0x55fa651a7b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdc9fb16700 1 -- 172.21.15.29:0/1471725704 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55fa651c8fc0 con 0x55fa6524e800 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout: "0": { 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout: "data": { 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 5, 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout: "inotable": { 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout: "projected_free": [ 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout: "start": 1099511627779, 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout: "len": 1099511627773 2023-10-06T05:29:38.429 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: "free": [ 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: "start": 1099511627779, 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: "len": 1099511627773 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:38.430 INFO:teuthology.orchestra.run.smithi029.stdout: "result": 0 2023-10-06T05:29:38.431 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:38.431 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:29:38.431 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:38.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55fa6524e800 msgr2=0x55fa651a7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55fa6524e800 0x55fa651a7b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55fa65268800 msgr2=0x55fa651a9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55fa65268800 0x55fa651a9700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55fa651deae0 tx=0x55fa65204cc0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b7000 msgr2=0x55fa651a8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/1471725704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b7000 0x55fa651a8c00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55fa651dfe60 tx=0x55fa65204e40 comp rx=0 tx=0).stop 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdc9fb16700 1 -- 172.21.15.29:0/1471725704 reap_dead start 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 shutdown_connections 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 >> 172.21.15.29:0/1471725704 conn(0x55fa651b7c00 msgr2=0x55fa65173800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 shutdown_connections 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/1471725704 wait complete. 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2711559402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa651b6400 msgr2=0x55fa651a6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/2711559402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa651b6400 0x55fa651a6580 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55fa65177d70 tx=0x55fa6516ad20 comp rx=0 tx=0).stop 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2711559402 shutdown_connections 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/2711559402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fa651b6c00 0x55fa651a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/2711559402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fa651b6800 0x55fa651a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 --2- 172.21.15.29:0/2711559402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa651b6400 0x55fa651a6580 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2711559402 >> 172.21.15.29:0/2711559402 conn(0x55fa651b6000 msgr2=0x55fa65173000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2711559402 shutdown_connections 2023-10-06T05:29:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.417+0000 7fdca1b5d0c0 1 -- 172.21.15.29:0/2711559402 wait complete. 2023-10-06T05:29:38.435 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.059743, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2023-10-06T05:29:38.435 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T05:29:38.435 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:29:38.455 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:29:38.477 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T05:29:38.477 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:29:38.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:29:38.477 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:29:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T05:29:38.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:29:38.485 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:29:38.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:29:38.485 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T05:29:38.527 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T05:29:38.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:29:38.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:29:38.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:29:38.528 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T05:29:38.535 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T05:29:38.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:29:38.536 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:29:38.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:29:38.537 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T05:29:38.543 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T05:29:38.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:29:38.545 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:29:38.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 Processor -- start 2023-10-06T05:29:38.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 -- start start 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0fb4155980 0x7f0fb4159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb4155d50 0x7f0fb4069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cc040 0x7f0fb40cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb40cca00 con 0x7f0fb4155980 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb40c8870 con 0x7f0fb40cc040 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb415a760 con 0x7f0fb4155d50 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb259c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0fb4155980 0x7f0fb4159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb259c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0fb4155980 0x7f0fb4159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39918/0 (socket says 172.21.15.29:39918) 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb259c700 1 -- 172.21.15.29:0/592920831 learned_addr learned my addr 172.21.15.29:0/592920831 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:38.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb2d9d700 1 --2- 172.21.15.29:0/592920831 >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cc040 0x7f0fb40cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb259c700 1 -- 172.21.15.29:0/592920831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb4155d50 msgr2=0x7f0fb4069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:38.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb1d9b700 1 --2- 172.21.15.29:0/592920831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb4155d50 0x7f0fb4069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb259c700 1 --2- 172.21.15.29:0/592920831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb4155d50 0x7f0fb4069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb259c700 1 -- 172.21.15.29:0/592920831 >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cc040 msgr2=0x7f0fb40cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:38.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb259c700 1 --2- 172.21.15.29:0/592920831 >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cc040 0x7f0fb40cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb259c700 1 -- 172.21.15.29:0/592920831 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4069d70 con 0x7f0fb4155980 2023-10-06T05:29:38.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb1d9b700 1 --2- 172.21.15.29:0/592920831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb4155d50 0x7f0fb4069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:38.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb259c700 1 --2- 172.21.15.29:0/592920831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 0x7f0fb4159800 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40ccbf0 tx=0x7f0fa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1497601d6be9e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb159a700 1 -- 172.21.15.29:0/592920831 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400b820 con 0x7f0fb4155980 2023-10-06T05:29:38.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb159a700 1 -- 172.21.15.29:0/592920831 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400b980 con 0x7f0fb4155980 2023-10-06T05:29:38.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb159a700 1 -- 172.21.15.29:0/592920831 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400bd20 con 0x7f0fb4155980 2023-10-06T05:29:38.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 -- 172.21.15.29:0/592920831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 msgr2=0x7f0fb4159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.657+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/592920831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 0x7f0fb4159800 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40ccbf0 tx=0x7f0fa4009250 comp rx=0 tx=0).stop 2023-10-06T05:29:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.661+0000 7f0fb8c85700 1 -- 172.21.15.29:0/592920831 shutdown_connections 2023-10-06T05:29:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.661+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/592920831 >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cc040 0x7f0fb40cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.661+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/592920831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb4155d50 0x7f0fb4069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.661+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/592920831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 0x7f0fb4159800 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.661+0000 7f0fb8c85700 1 -- 172.21.15.29:0/592920831 >> 172.21.15.29:0/592920831 conn(0x7f0fb406e270 msgr2=0x7f0fb40675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.661+0000 7f0fb8c85700 1 -- 172.21.15.29:0/592920831 shutdown_connections 2023-10-06T05:29:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.661+0000 7f0fb8c85700 1 -- 172.21.15.29:0/592920831 wait complete. 2023-10-06T05:29:38.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.661+0000 7f0fb8c85700 1 Processor -- start 2023-10-06T05:29:38.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.661+0000 7f0fb8c85700 1 -- start start 2023-10-06T05:29:38.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb8c85700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40cc040 0x7f0fb4157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb8c85700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 0x7f0fb4145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb8c85700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb4155d50 0x7f0fb40b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb8c85700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4166df0 con 0x7f0fb4155980 2023-10-06T05:29:38.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb8c85700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4167c10 con 0x7f0fb4155d50 2023-10-06T05:29:38.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb8c85700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4167000 con 0x7f0fb40cc040 2023-10-06T05:29:38.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb1d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 0x7f0fb4145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb1d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 0x7f0fb4145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39932/0 (socket says 172.21.15.29:39932) 2023-10-06T05:29:38.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb1d9b700 1 -- 172.21.15.29:0/450589355 learned_addr learned my addr 172.21.15.29:0/450589355 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb259c700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40cc040 0x7f0fb4157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb2d9d700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb4155d50 0x7f0fb40b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb1d9b700 1 -- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40cc040 msgr2=0x7f0fb4157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb1d9b700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40cc040 0x7f0fb4157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb1d9b700 1 -- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb4155d50 msgr2=0x7f0fb40b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb1d9b700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb4155d50 0x7f0fb40b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb1d9b700 1 -- 172.21.15.29:0/450589355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40094f0 con 0x7f0fb4155980 2023-10-06T05:29:38.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb1d9b700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 0x7f0fb4145a80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00cfb0 tx=0x7f0fac007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0faa7fc700 1 -- 172.21.15.29:0/450589355 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00ad80 con 0x7f0fb4155980 2023-10-06T05:29:38.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0faa7fc700 1 -- 172.21.15.29:0/450589355 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac016420 con 0x7f0fb4155980 2023-10-06T05:29:38.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0faa7fc700 1 -- 172.21.15.29:0/450589355 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0167e0 con 0x7f0fb4155980 2023-10-06T05:29:38.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb41672e0 con 0x7f0fb4155980 2023-10-06T05:29:38.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.665+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb41678a0 con 0x7f0fb4155980 2023-10-06T05:29:38.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.669+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb404be00 con 0x7f0fb4155980 2023-10-06T05:29:38.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.669+0000 7f0faa7fc700 1 -- 172.21.15.29:0/450589355 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0fac016bd0 con 0x7f0fb4155980 2023-10-06T05:29:38.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.669+0000 7f0faa7fc700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f94060550 0x7f0f94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:38.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.669+0000 7f0faa7fc700 1 -- 172.21.15.29:0/450589355 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f0fac012070 con 0x7f0fb4155980 2023-10-06T05:29:38.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.669+0000 7f0fb259c700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f94060550 0x7f0f94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:38.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.669+0000 7f0fb259c700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f94060550 0x7f0f94062a00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40ccbf0 tx=0x7f0fa4017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:38.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.677+0000 7f0faa7fc700 1 -- 172.21.15.29:0/450589355 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0fac04cbe0 con 0x7f0fb4155980 2023-10-06T05:29:38.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fb4159ec0 con 0x7f0fb4155980 2023-10-06T05:29:38.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0faa7fc700 1 -- 172.21.15.29:0/450589355 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3834 (secure 0 0 0) 0x7f0fac04d630 con 0x7f0fb4155980 2023-10-06T05:29:38.877 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:38.877 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":34,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:29:38.345816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f94060550 msgr2=0x7f0f94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f94060550 0x7f0f94062a00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40ccbf0 tx=0x7f0fa4017000 comp rx=0 tx=0).stop 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 msgr2=0x7f0fb4145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 0x7f0fb4145a80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00cfb0 tx=0x7f0fac007870 comp rx=0 tx=0).stop 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 shutdown_connections 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f94060550 0x7f0f94062a00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb4155d50 0x7f0fb40b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fb4155980 0x7f0fb4145a80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 --2- 172.21.15.29:0/450589355 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40cc040 0x7f0fb4157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 >> 172.21.15.29:0/450589355 conn(0x7f0fb406e270 msgr2=0x7f0fb40ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 shutdown_connections 2023-10-06T05:29:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.873+0000 7f0fb8c85700 1 -- 172.21.15.29:0/450589355 wait complete. 2023-10-06T05:29:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 34 2023-10-06T05:29:38.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:29:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207359e700 1 Processor -- start 2023-10-06T05:29:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207359e700 1 -- start start 2023-10-06T05:29:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207359e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f20740ab220 0x7f2074156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207406a5b0 con 0x7f20740c68b0 2023-10-06T05:29:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207359e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207415b0a0 con 0x7f20741569f0 2023-10-06T05:29:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207359e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207415b380 con 0x7f20740ab220 2023-10-06T05:29:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f2072d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f20740c68b0 0x7f207406aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45174/0 (socket says 172.21.15.29:45174) 2023-10-06T05:29:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f2072d9d700 1 -- 172.21.15.29:0/3540415834 learned_addr learned my addr 172.21.15.29:0/3540415834 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f2071d9b700 1 --2- 172.21.15.29:0/3540415834 >> v2:172.21.15.173:3300/0 conn(0x7f20740ab220 0x7f2074156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694966760 0 0) 0x7f207406a5b0 con 0x7f20740c68b0 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2060003570 con 0x7f20740c68b0 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1839718132 0 0) 0x7f2060003570 con 0x7f20740c68b0 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 >> v2:172.21.15.173:3300/0 conn(0x7f20740ab220 msgr2=0x7f2074156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 --2- 172.21.15.29:0/3540415834 >> v2:172.21.15.173:3300/0 conn(0x7f20740ab220 0x7f2074156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 >> v1:172.21.15.173:6789/0 conn(0x7f20741569f0 legacy=0x7f207415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207415b660 con 0x7f20740c68b0 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f206c0017f0 con 0x7f20740c68b0 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 >> v1:172.21.15.29:6789/0 conn(0x7f20740c68b0 legacy=0x7f207406aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2060003a60 0x7f2060003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2060004810 0x7f2060004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20600051c0 0x7f206000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207415b380 con 0x7f20600051c0 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206000c0d0 con 0x7f2060004810 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:38.997+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206000c290 con 0x7f2060003a60 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f2071d9b700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2060004810 0x7f2060004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207259c700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2060003a60 0x7f2060003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f2072d9d700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20600051c0 0x7f206000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f2071d9b700 1 -- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2060003a60 msgr2=0x7f2060003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f2071d9b700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2060003a60 0x7f2060003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f2071d9b700 1 -- 172.21.15.29:0/3540415834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20600051c0 msgr2=0x7f206000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f2071d9b700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20600051c0 0x7f206000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f2072d9d700 1 -- 172.21.15.29:0/3540415834 reap_dead start 2023-10-06T05:29:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f2071d9b700 1 -- 172.21.15.29:0/3540415834 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2060003570 con 0x7f2060004810 2023-10-06T05:29:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207259c700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2060003a60 0x7f2060003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f2071d9b700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2060004810 0x7f2060004c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f207406d6d0 tx=0x7f205c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7bde794ea698d72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c00e710 con 0x7f2060004810 2023-10-06T05:29:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c00e870 con 0x7f2060004810 2023-10-06T05:29:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207159a700 1 -- 172.21.15.29:0/3540415834 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c00ec30 con 0x7f2060004810 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207359e700 1 -- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2060004810 msgr2=0x7f2060004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207359e700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2060004810 0x7f2060004c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f207406d6d0 tx=0x7f205c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207359e700 1 -- 172.21.15.29:0/3540415834 shutdown_connections 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207359e700 1 --2- 172.21.15.29:0/3540415834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2060004810 0x7f2060004c80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207359e700 1 -- 172.21.15.29:0/3540415834 >> 172.21.15.29:0/3540415834 conn(0x7f20740670a0 msgr2=0x7f20740674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207359e700 1 -- 172.21.15.29:0/3540415834 shutdown_connections 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.001+0000 7f207359e700 1 -- 172.21.15.29:0/3540415834 wait complete. 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 Processor -- start 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 -- start start 2023-10-06T05:29:39.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2060004810 0x7f2074157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20740c3340 0x7f20740b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20740c37b0 0x7f20740b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20741578a0 con 0x7f2060004810 2023-10-06T05:29:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207414fa80 con 0x7f20740c3340 2023-10-06T05:29:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20740c3c20 con 0x7f20740c37b0 2023-10-06T05:29:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2060004810 0x7f2074157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2060004810 0x7f2074157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39946/0 (socket says 172.21.15.29:39946) 2023-10-06T05:29:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207259c700 1 -- 172.21.15.29:0/3478681793 learned_addr learned my addr 172.21.15.29:0/3478681793 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f2071d9b700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20740c3340 0x7f20740b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f2072d9d700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20740c37b0 0x7f20740b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207259c700 1 -- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20740c37b0 msgr2=0x7f20740b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207259c700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20740c37b0 0x7f20740b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207259c700 1 -- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20740c3340 msgr2=0x7f20740b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207259c700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20740c3340 0x7f20740b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207259c700 1 -- 172.21.15.29:0/3478681793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20740c3f00 con 0x7f2060004810 2023-10-06T05:29:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207259c700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2060004810 0x7f2074157360 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2064000c00 tx=0x7f2064009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f206a7fc700 1 -- 172.21.15.29:0/3478681793 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400d680 con 0x7f2060004810 2023-10-06T05:29:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f206a7fc700 1 -- 172.21.15.29:0/3478681793 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206400d7e0 con 0x7f2060004810 2023-10-06T05:29:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f206a7fc700 1 -- 172.21.15.29:0/3478681793 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400dba0 con 0x7f2060004810 2023-10-06T05:29:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20740b00d0 con 0x7f2060004810 2023-10-06T05:29:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.005+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20740b0690 con 0x7f2060004810 2023-10-06T05:29:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.009+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20740aff30 con 0x7f2060004810 2023-10-06T05:29:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.009+0000 7f206a7fc700 1 -- 172.21.15.29:0/3478681793 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f206401d460 con 0x7f2060004810 2023-10-06T05:29:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.009+0000 7f206a7fc700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2054060550 0x7f2054062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.009+0000 7f206a7fc700 1 -- 172.21.15.29:0/3478681793 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f206407cba0 con 0x7f2060004810 2023-10-06T05:29:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.009+0000 7f2071d9b700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2054060550 0x7f2054062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.009+0000 7f2071d9b700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2054060550 0x7f2054062a00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f205c0091e0 tx=0x7f205c01a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.017+0000 7f206a7fc700 1 -- 172.21.15.29:0/3478681793 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f20740aff30 con 0x7f2060004810 2023-10-06T05:29:39.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.181+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20740aff30 con 0x7f2060004810 2023-10-06T05:29:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.181+0000 7f206a7fc700 1 -- 172.21.15.29:0/3478681793 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17365 (secure 0 0 0) 0x7f20740aff30 con 0x7f2060004810 2023-10-06T05:29:39.188 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:39.188 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":66,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:29:38.345337+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:28:11.073066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T05:28:12.396583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.11","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.2a","mappings":[{"from":7,"to":5}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/184173135":"2023-10-07T05:29:38.345270+0000","172.21.15.29:6834/184173135":"2023-10-07T05:29:38.345270+0000","172.21.15.29:6835/1584172634":"2023-10-07T05:29:01.837299+0000","172.21.15.29:6834/1584172634":"2023-10-07T05:29:01.837299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:29:39.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2054060550 msgr2=0x7f2054062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2054060550 0x7f2054062a00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f205c0091e0 tx=0x7f205c01a000 comp rx=0 tx=0).stop 2023-10-06T05:29:39.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2060004810 msgr2=0x7f2074157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2060004810 0x7f2074157360 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2064000c00 tx=0x7f2064009040 comp rx=0 tx=0).stop 2023-10-06T05:29:39.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 shutdown_connections 2023-10-06T05:29:39.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20740c37b0 0x7f20740b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2054060550 0x7f2054062a00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20740c3340 0x7f20740b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 --2- 172.21.15.29:0/3478681793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2060004810 0x7f2074157360 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 >> 172.21.15.29:0/3478681793 conn(0x7f20740670a0 msgr2=0x7f20740c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 shutdown_connections 2023-10-06T05:29:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.185+0000 7f207359e700 1 -- 172.21.15.29:0/3478681793 wait complete. 2023-10-06T05:29:39.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:28:11.073066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:28:12.396583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:29:39.204 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:29:39.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.309+0000 7f823b01c700 1 Processor -- start 2023-10-06T05:29:39.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.309+0000 7f823b01c700 1 -- start start 2023-10-06T05:29:39.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.309+0000 7f823b01c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f823415d730 0x7f823406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.309+0000 7f823b01c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823406cc00 0x7f823406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.309+0000 7f823b01c700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82340cacd0 con 0x7f8234158f10 2023-10-06T05:29:39.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.309+0000 7f823b01c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823406a600 con 0x7f823415d730 2023-10-06T05:29:39.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.309+0000 7f823b01c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823406d080 con 0x7f823406cc00 2023-10-06T05:29:39.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239819700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f823415d730 0x7f823406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823a01a700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f8234158f10 0x7f82340ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:41396/0 (socket says 172.21.15.29:41396) 2023-10-06T05:29:39.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823a01a700 1 -- 172.21.15.29:0/3686315828 learned_addr learned my addr 172.21.15.29:0/3686315828 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:39.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823a81b700 1 --2- 172.21.15.29:0/3686315828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823406cc00 0x7f823406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239018700 1 -- 172.21.15.29:0/3686315828 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824449601 0 0) 0x7f82340cacd0 con 0x7f8234158f10 2023-10-06T05:29:39.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239018700 1 -- 172.21.15.29:0/3686315828 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8220003570 con 0x7f8234158f10 2023-10-06T05:29:39.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239819700 1 -- 172.21.15.29:0/3686315828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823406cc00 msgr2=0x7f823406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:39.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239819700 1 --2- 172.21.15.29:0/3686315828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823406cc00 0x7f823406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239819700 1 -- 172.21.15.29:0/3686315828 >> v1:172.21.15.173:6789/0 conn(0x7f8234158f10 legacy=0x7f82340ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239819700 1 -- 172.21.15.29:0/3686315828 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340cafb0 con 0x7f823415d730 2023-10-06T05:29:39.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823a81b700 1 --2- 172.21.15.29:0/3686315828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823406cc00 0x7f823406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:39.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239819700 1 --2- 172.21.15.29:0/3686315828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f823415d730 0x7f823406c6c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82240098e0 tx=0x7f82240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc2a70b05bf256d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239018700 1 -- 172.21.15.29:0/3686315828 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224011630 con 0x7f823415d730 2023-10-06T05:29:39.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239018700 1 -- 172.21.15.29:0/3686315828 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224011790 con 0x7f823415d730 2023-10-06T05:29:39.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f8239018700 1 -- 172.21.15.29:0/3686315828 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224011b30 con 0x7f823415d730 2023-10-06T05:29:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 -- 172.21.15.29:0/3686315828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f823415d730 msgr2=0x7f823406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 --2- 172.21.15.29:0/3686315828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f823415d730 0x7f823406c6c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82240098e0 tx=0x7f82240091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 -- 172.21.15.29:0/3686315828 shutdown_connections 2023-10-06T05:29:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 --2- 172.21.15.29:0/3686315828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823406cc00 0x7f823406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 --2- 172.21.15.29:0/3686315828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f823415d730 0x7f823406c6c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 -- 172.21.15.29:0/3686315828 >> 172.21.15.29:0/3686315828 conn(0x7f8234062b60 msgr2=0x7f8234062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 -- 172.21.15.29:0/3686315828 shutdown_connections 2023-10-06T05:29:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 -- 172.21.15.29:0/3686315828 wait complete. 2023-10-06T05:29:39.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 Processor -- start 2023-10-06T05:29:39.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.313+0000 7f823b01c700 1 -- start start 2023-10-06T05:29:39.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823b01c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406cc00 0x7f82340c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823b01c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234158f10 0x7f82340c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823b01c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823415d730 0x7f8234148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823b01c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340c8050 con 0x7f823406cc00 2023-10-06T05:29:39.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823b01c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8234156c30 con 0x7f8234158f10 2023-10-06T05:29:39.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823b01c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82340c4660 con 0x7f823415d730 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a01a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406cc00 0x7f82340c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a01a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406cc00 0x7f82340c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39954/0 (socket says 172.21.15.29:39954) 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a01a700 1 -- 172.21.15.29:0/2947501774 learned_addr learned my addr 172.21.15.29:0/2947501774 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f8239819700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234158f10 0x7f82340c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a81b700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823415d730 0x7f8234148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a01a700 1 -- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823415d730 msgr2=0x7f8234148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a01a700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823415d730 0x7f8234148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a01a700 1 -- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234158f10 msgr2=0x7f82340c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a01a700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234158f10 0x7f82340c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a01a700 1 -- 172.21.15.29:0/2947501774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c009a20 con 0x7f823406cc00 2023-10-06T05:29:39.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f8239819700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234158f10 0x7f82340c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823a01a700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406cc00 0x7f82340c9ed0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f823000c5c0 tx=0x7f8230007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f822a7fc700 1 -- 172.21.15.29:0/2947501774 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8230005b30 con 0x7f823406cc00 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f822a7fc700 1 -- 172.21.15.29:0/2947501774 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8230005cb0 con 0x7f823406cc00 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8224009420 con 0x7f823406cc00 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f822a7fc700 1 -- 172.21.15.29:0/2947501774 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8230007320 con 0x7f823406cc00 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82340c7dd0 con 0x7f823406cc00 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.317+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82341487a0 con 0x7f823406cc00 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.321+0000 7f822a7fc700 1 -- 172.21.15.29:0/2947501774 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f823001b3b0 con 0x7f823406cc00 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.321+0000 7f822a7fc700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060550 0x7f8218062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.321+0000 7f822a7fc700 1 -- 172.21.15.29:0/2947501774 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f823007c030 con 0x7f823406cc00 2023-10-06T05:29:39.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.321+0000 7f8239819700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060550 0x7f8218062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.321+0000 7f8239819700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060550 0x7f8218062a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f82240091e0 tx=0x7f8224017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.329+0000 7f822a7fc700 1 -- 172.21.15.29:0/2947501774 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f823004c380 con 0x7f823406cc00 2023-10-06T05:29:39.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f823404be00 con 0x7f823406cc00 2023-10-06T05:29:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f822a7fc700 1 -- 172.21.15.29:0/2947501774 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82300170a0 con 0x7f823406cc00 2023-10-06T05:29:39.493 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:29:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060550 msgr2=0x7f8218062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060550 0x7f8218062a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f82240091e0 tx=0x7f8224017000 comp rx=0 tx=0).stop 2023-10-06T05:29:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406cc00 msgr2=0x7f82340c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406cc00 0x7f82340c9ed0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f823000c5c0 tx=0x7f8230007e00 comp rx=0 tx=0).stop 2023-10-06T05:29:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 shutdown_connections 2023-10-06T05:29:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f823415d730 0x7f8234148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060550 0x7f8218062a00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8234158f10 0x7f82340c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 --2- 172.21.15.29:0/2947501774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406cc00 0x7f82340c9ed0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 >> 172.21.15.29:0/2947501774 conn(0x7f8234062b60 msgr2=0x7f82340ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 shutdown_connections 2023-10-06T05:29:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.489+0000 7f823b01c700 1 -- 172.21.15.29:0/2947501774 wait complete. 2023-10-06T05:29:39.507 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:29:39.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.617+0000 7f11a8c83700 1 Processor -- start 2023-10-06T05:29:39.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.617+0000 7f11a8c83700 1 -- start start 2023-10-06T05:29:39.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a8c83700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11a4155b60 0x7f11a40686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a8c83700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a4155f30 0x7f11a415a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a8c83700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a406bbd0 con 0x7f11a406b380 2023-10-06T05:29:39.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a8c83700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a4159ff0 con 0x7f11a4155b60 2023-10-06T05:29:39.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a8c83700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a406beb0 con 0x7f11a4155f30 2023-10-06T05:29:39.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11a4155b60 0x7f11a40686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11a4155b60 0x7f11a40686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39968/0 (socket says 172.21.15.29:39968) 2023-10-06T05:29:39.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a37fe700 1 -- 172.21.15.29:0/1857294418 learned_addr learned my addr 172.21.15.29:0/1857294418 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:39.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a2ffd700 1 --2- 172.21.15.29:0/1857294418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a4155f30 0x7f11a415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a37fe700 1 -- 172.21.15.29:0/1857294418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a4155f30 msgr2=0x7f11a415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:39.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a37fe700 1 --2- 172.21.15.29:0/1857294418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a4155f30 0x7f11a415a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a37fe700 1 -- 172.21.15.29:0/1857294418 >> v1:172.21.15.173:6789/0 conn(0x7f11a406b380 legacy=0x7f11a406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a37fe700 1 -- 172.21.15.29:0/1857294418 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a4159930 con 0x7f11a4155b60 2023-10-06T05:29:39.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a2ffd700 1 --2- 172.21.15.29:0/1857294418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a4155f30 0x7f11a415a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:39.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a37fe700 1 --2- 172.21.15.29:0/1857294418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 0x7f11a40686a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f11940099b0 tx=0x7f1194009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f8b53de8a58453 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a27fc700 1 -- 172.21.15.29:0/1857294418 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119400b8f0 con 0x7f11a4155b60 2023-10-06T05:29:39.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a27fc700 1 -- 172.21.15.29:0/1857294418 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119400ba50 con 0x7f11a4155b60 2023-10-06T05:29:39.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a27fc700 1 -- 172.21.15.29:0/1857294418 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119400bdf0 con 0x7f11a4155b60 2023-10-06T05:29:39.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a8c83700 1 -- 172.21.15.29:0/1857294418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 msgr2=0x7f11a40686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a8c83700 1 --2- 172.21.15.29:0/1857294418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 0x7f11a40686a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f11940099b0 tx=0x7f1194009250 comp rx=0 tx=0).stop 2023-10-06T05:29:39.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a8c83700 1 -- 172.21.15.29:0/1857294418 shutdown_connections 2023-10-06T05:29:39.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.621+0000 7f11a8c83700 1 --2- 172.21.15.29:0/1857294418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a4155f30 0x7f11a415a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.625+0000 7f11a8c83700 1 --2- 172.21.15.29:0/1857294418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 0x7f11a40686a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.625+0000 7f11a8c83700 1 -- 172.21.15.29:0/1857294418 >> 172.21.15.29:0/1857294418 conn(0x7f11a40c9830 msgr2=0x7f11a406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:39.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.625+0000 7f11a8c83700 1 -- 172.21.15.29:0/1857294418 shutdown_connections 2023-10-06T05:29:39.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.625+0000 7f11a8c83700 1 -- 172.21.15.29:0/1857294418 wait complete. 2023-10-06T05:29:39.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.625+0000 7f11a8c83700 1 Processor -- start 2023-10-06T05:29:39.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.625+0000 7f11a8c83700 1 -- start start 2023-10-06T05:29:39.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a8c83700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a406b380 0x7f11a40a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a8c83700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 0x7f11a4067320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a8c83700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11a4155f30 0x7f11a4166d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a8c83700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40a44c0 con 0x7f11a4155b60 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a8c83700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40b1fd0 con 0x7f11a4155f30 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a8c83700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40a4710 con 0x7f11a406b380 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 0x7f11a4067320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 0x7f11a4067320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39976/0 (socket says 172.21.15.29:39976) 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a2ffd700 1 -- 172.21.15.29:0/1335028760 learned_addr learned my addr 172.21.15.29:0/1335028760 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a37fe700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a406b380 0x7f11a40a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a3fff700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11a4155f30 0x7f11a4166d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a2ffd700 1 -- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a406b380 msgr2=0x7f11a40a51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a2ffd700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a406b380 0x7f11a40a51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a2ffd700 1 -- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11a4155f30 msgr2=0x7f11a4166d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a2ffd700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11a4155f30 0x7f11a4166d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a2ffd700 1 -- 172.21.15.29:0/1335028760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940094f0 con 0x7f11a4155b60 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a2ffd700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 0x7f11a4067320 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f119800d860 tx=0x7f1198008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f118b7fe700 1 -- 172.21.15.29:0/1335028760 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11980125f0 con 0x7f11a4155b60 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f118b7fe700 1 -- 172.21.15.29:0/1335028760 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198012750 con 0x7f11a4155b60 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a40a49f0 con 0x7f11a4155b60 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f118b7fe700 1 -- 172.21.15.29:0/1335028760 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198012af0 con 0x7f11a4155b60 2023-10-06T05:29:39.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.629+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a40a5710 con 0x7f11a4155b60 2023-10-06T05:29:39.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.633+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a404be00 con 0x7f11a4155b60 2023-10-06T05:29:39.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.633+0000 7f118b7fe700 1 -- 172.21.15.29:0/1335028760 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1198013480 con 0x7f11a4155b60 2023-10-06T05:29:39.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.633+0000 7f118b7fe700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1190060550 0x7f1190062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.633+0000 7f118b7fe700 1 -- 172.21.15.29:0/1335028760 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f119807cbe0 con 0x7f11a4155b60 2023-10-06T05:29:39.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.633+0000 7f11a37fe700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1190060550 0x7f1190062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.633+0000 7f11a37fe700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1190060550 0x7f1190062a00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f11940099b0 tx=0x7f1194017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.645+0000 7f118b7fe700 1 -- 172.21.15.29:0/1335028760 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f119804cf30 con 0x7f11a4155b60 2023-10-06T05:29:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f11a4062f90 con 0x7f11a4155b60 2023-10-06T05:29:39.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f118b7fe700 1 -- 172.21.15.29:0/1335028760 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1198050550 con 0x7f11a4155b60 2023-10-06T05:29:39.810 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:29:39.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1190060550 msgr2=0x7f1190062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1190060550 0x7f1190062a00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f11940099b0 tx=0x7f1194017000 comp rx=0 tx=0).stop 2023-10-06T05:29:39.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 msgr2=0x7f11a4067320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 0x7f11a4067320 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f119800d860 tx=0x7f1198008040 comp rx=0 tx=0).stop 2023-10-06T05:29:39.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 shutdown_connections 2023-10-06T05:29:39.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1190060550 0x7f1190062a00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11a4155f30 0x7f11a4166d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11a4155b60 0x7f11a4067320 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 --2- 172.21.15.29:0/1335028760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11a406b380 0x7f11a40a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.805+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 >> 172.21.15.29:0/1335028760 conn(0x7f11a40c9830 msgr2=0x7f11a40c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:39.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.809+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 shutdown_connections 2023-10-06T05:29:39.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.809+0000 7f11a8c83700 1 -- 172.21.15.29:0/1335028760 wait complete. 2023-10-06T05:29:39.824 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:29:39.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e9275700 1 Processor -- start 2023-10-06T05:29:39.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e9275700 1 -- start start 2023-10-06T05:29:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e9275700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e4158c30 0x7f77e4159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e9275700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f77e415d890 0x7f77e406b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e9275700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e406b380 con 0x7f77e40ce910 2023-10-06T05:29:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e9275700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e406a770 con 0x7f77e415d890 2023-10-06T05:29:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e9275700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e406aa50 con 0x7f77e4158c30 2023-10-06T05:29:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e2ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e4158c30 0x7f77e4159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77da7fc700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f77e415d890 0x7f77e406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77da7fc700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f77e415d890 0x7f77e406b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:50476/0 (socket says 172.21.15.29:50476) 2023-10-06T05:29:39.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77da7fc700 1 -- 172.21.15.29:0/4228177138 learned_addr learned my addr 172.21.15.29:0/4228177138 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:39.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e2ffd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e4158c30 0x7f77e4159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:41388/0 (socket says 172.21.15.29:41388) 2023-10-06T05:29:39.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e37fe700 1 --1- 172.21.15.29:0/4228177138 >> v1:172.21.15.173:6789/0 conn(0x7f77e40ce910 0x7f77e40cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:41412/0 (socket says 172.21.15.29:41412) 2023-10-06T05:29:39.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77da7fc700 1 -- 172.21.15.29:0/4228177138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e4158c30 msgr2=0x7f77e4159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:39.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77da7fc700 1 --2- 172.21.15.29:0/4228177138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e4158c30 0x7f77e4159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77da7fc700 1 -- 172.21.15.29:0/4228177138 >> v1:172.21.15.173:6789/0 conn(0x7f77e40ce910 legacy=0x7f77e40cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77da7fc700 1 -- 172.21.15.29:0/4228177138 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e406ad30 con 0x7f77e415d890 2023-10-06T05:29:39.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77e2ffd700 1 --2- 172.21.15.29:0/4228177138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e4158c30 0x7f77e4159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:39.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.933+0000 7f77da7fc700 1 --2- 172.21.15.29:0/4228177138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77e415d890 0x7f77e406b810 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0099b0 tx=0x7f77cc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=496cf5e0fb5287f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e27fc700 1 -- 172.21.15.29:0/4228177138 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc009ea0 con 0x7f77e415d890 2023-10-06T05:29:39.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e27fc700 1 -- 172.21.15.29:0/4228177138 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc00b860 con 0x7f77e415d890 2023-10-06T05:29:39.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e27fc700 1 -- 172.21.15.29:0/4228177138 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00bc00 con 0x7f77e415d890 2023-10-06T05:29:39.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 -- 172.21.15.29:0/4228177138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77e415d890 msgr2=0x7f77e406b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 --2- 172.21.15.29:0/4228177138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77e415d890 0x7f77e406b810 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0099b0 tx=0x7f77cc009250 comp rx=0 tx=0).stop 2023-10-06T05:29:39.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 -- 172.21.15.29:0/4228177138 shutdown_connections 2023-10-06T05:29:39.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 --2- 172.21.15.29:0/4228177138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77e415d890 0x7f77e406b810 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 --2- 172.21.15.29:0/4228177138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e4158c30 0x7f77e4159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 -- 172.21.15.29:0/4228177138 >> 172.21.15.29:0/4228177138 conn(0x7f77e40670a0 msgr2=0x7f77e40674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:39.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 -- 172.21.15.29:0/4228177138 shutdown_connections 2023-10-06T05:29:39.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 -- 172.21.15.29:0/4228177138 wait complete. 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 Processor -- start 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.937+0000 7f77e9275700 1 -- start start 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e9275700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77e40ce910 0x7f77e4154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e9275700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e4158c30 0x7f77e416ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e9275700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e415d890 0x7f77e416a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e9275700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e416cf60 con 0x7f77e4158c30 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e9275700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e40b2f80 con 0x7f77e40ce910 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e9275700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e416d190 con 0x7f77e415d890 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77da7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e4158c30 0x7f77e416ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77da7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e4158c30 0x7f77e416ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39988/0 (socket says 172.21.15.29:39988) 2023-10-06T05:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77da7fc700 1 -- 172.21.15.29:0/1360950973 learned_addr learned my addr 172.21.15.29:0/1360950973 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e2ffd700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77e40ce910 0x7f77e4154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e37fe700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e415d890 0x7f77e416a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77da7fc700 1 -- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e415d890 msgr2=0x7f77e416a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77da7fc700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e415d890 0x7f77e416a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77da7fc700 1 -- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77e40ce910 msgr2=0x7f77e4154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77da7fc700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77e40ce910 0x7f77e4154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77da7fc700 1 -- 172.21.15.29:0/1360950973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4009420 con 0x7f77e4158c30 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77da7fc700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e4158c30 0x7f77e416ca20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f77e406e090 tx=0x7f77cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77db7fe700 1 -- 172.21.15.29:0/1360950973 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00bbe0 con 0x7f77e4158c30 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77db7fe700 1 -- 172.21.15.29:0/1360950973 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc011420 con 0x7f77e4158c30 2023-10-06T05:29:39.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc0094f0 con 0x7f77e4158c30 2023-10-06T05:29:39.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77db7fe700 1 -- 172.21.15.29:0/1360950973 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0117c0 con 0x7f77e4158c30 2023-10-06T05:29:39.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.941+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e416d750 con 0x7f77e4158c30 2023-10-06T05:29:39.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.945+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e40b3130 con 0x7f77e4158c30 2023-10-06T05:29:39.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.945+0000 7f77db7fe700 1 -- 172.21.15.29:0/1360950973 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f77cc011bf0 con 0x7f77e4158c30 2023-10-06T05:29:39.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.945+0000 7f77db7fe700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f77c4060550 0x7f77c4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:39.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.945+0000 7f77db7fe700 1 -- 172.21.15.29:0/1360950973 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f77cc07e280 con 0x7f77e4158c30 2023-10-06T05:29:39.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.945+0000 7f77e2ffd700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f77c4060550 0x7f77c4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:39.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.945+0000 7f77e2ffd700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f77c4060550 0x7f77c4062a00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009f40 tx=0x7f77d40091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:39.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:39.953+0000 7f77db7fe700 1 -- 172.21.15.29:0/1360950973 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f77e40b3130 con 0x7f77e4158c30 2023-10-06T05:29:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.113+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77e416d970 con 0x7f77e4158c30 2023-10-06T05:29:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.113+0000 7f77db7fe700 1 -- 172.21.15.29:0/1360950973 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77cc04e5d0 con 0x7f77e4158c30 2023-10-06T05:29:40.120 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:29:40.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f77c4060550 msgr2=0x7f77c4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f77c4060550 0x7f77c4062a00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009f40 tx=0x7f77d40091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e4158c30 msgr2=0x7f77e416ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e4158c30 0x7f77e416ca20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f77e406e090 tx=0x7f77cc017000 comp rx=0 tx=0).stop 2023-10-06T05:29:40.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 shutdown_connections 2023-10-06T05:29:40.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77e415d890 0x7f77e416a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e4158c30 0x7f77e416ca20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f77c4060550 0x7f77c4062a00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 --2- 172.21.15.29:0/1360950973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77e40ce910 0x7f77e4154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 >> 172.21.15.29:0/1360950973 conn(0x7f77e40670a0 msgr2=0x7f77e40cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:40.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 shutdown_connections 2023-10-06T05:29:40.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.117+0000 7f77e9275700 1 -- 172.21.15.29:0/1360950973 wait complete. 2023-10-06T05:29:40.135 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:29:40.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fee06e5c700 1 Processor -- start 2023-10-06T05:29:40.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fee06e5c700 1 -- start start 2023-10-06T05:29:40.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fee06e5c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fee00157130 0x7fee00157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fee06e5c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee000c6c50 con 0x7fee00156d60 2023-10-06T05:29:40.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fee06e5c700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee000c7ab0 con 0x7fee0006b680 2023-10-06T05:29:40.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fee06e5c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee00158480 con 0x7fee00157130 2023-10-06T05:29:40.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fee04bf8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fee00156d60 0x7fee0006af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45178/0 (socket says 172.21.15.29:45178) 2023-10-06T05:29:40.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fee04bf8700 1 -- 172.21.15.29:0/647404547 learned_addr learned my addr 172.21.15.29:0/647404547 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:40.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fee053f9700 1 --2- 172.21.15.29:0/647404547 >> v2:172.21.15.173:3300/0 conn(0x7fee00157130 0x7fee00157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794840858 0 0) 0x7fee000c6c50 con 0x7fee00156d60 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedec003570 con 0x7fee00156d60 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921619871 0 0) 0x7fee000c7ab0 con 0x7fee0006b680 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee000c6c50 con 0x7fee0006b680 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1267825838 0 0) 0x7fedec003570 con 0x7fee00156d60 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 >> v2:172.21.15.173:3300/0 conn(0x7fee00157130 msgr2=0x7fee00157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fedff7fe700 1 --2- 172.21.15.29:0/647404547 >> v2:172.21.15.173:3300/0 conn(0x7fee00157130 0x7fee00157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.245+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 >> v1:172.21.15.173:6789/0 conn(0x7fee0006b680 legacy=0x7fee0006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000c6ea0 con 0x7fee00156d60 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fedf00017f0 con 0x7fee00156d60 2023-10-06T05:29:40.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 >> v1:172.21.15.29:6789/0 conn(0x7fee00156d60 legacy=0x7fee0006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedec003bf0 0x7fedec003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedec004810 0x7fedec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedec0051c0 0x7fedec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee00158480 con 0x7fedec003bf0 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec00c0b0 con 0x7fedec004810 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec00c270 con 0x7fedec0051c0 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee04bf8700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedec003bf0 0x7fedec003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee053f9700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedec0051c0 0x7fedec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedfffff700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedec004810 0x7fedec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee04bf8700 1 -- 172.21.15.29:0/647404547 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedec0051c0 msgr2=0x7fedec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee04bf8700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fedec0051c0 0x7fedec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee04bf8700 1 -- 172.21.15.29:0/647404547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedec004810 msgr2=0x7fedec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:40.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee04bf8700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedec004810 0x7fedec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee053f9700 1 -- 172.21.15.29:0/647404547 reap_dead start 2023-10-06T05:29:40.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee04bf8700 1 -- 172.21.15.29:0/647404547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec003570 con 0x7fedec003bf0 2023-10-06T05:29:40.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee04bf8700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedec003bf0 0x7fedec003fe0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fedf000a8f0 tx=0x7fedf0002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7018112f37c1bfcf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:40.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00070d0 con 0x7fedec003bf0 2023-10-06T05:29:40.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf0007250 con 0x7fedec003bf0 2023-10-06T05:29:40.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fedff7fe700 1 -- 172.21.15.29:0/647404547 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0007610 con 0x7fedec003bf0 2023-10-06T05:29:40.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee06e5c700 1 -- 172.21.15.29:0/647404547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedec003bf0 msgr2=0x7fedec003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee06e5c700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedec003bf0 0x7fedec003fe0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fedf000a8f0 tx=0x7fedf0002190 comp rx=0 tx=0).stop 2023-10-06T05:29:40.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee06e5c700 1 -- 172.21.15.29:0/647404547 shutdown_connections 2023-10-06T05:29:40.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee06e5c700 1 --2- 172.21.15.29:0/647404547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedec003bf0 0x7fedec003fe0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee06e5c700 1 -- 172.21.15.29:0/647404547 >> 172.21.15.29:0/647404547 conn(0x7fee000cd0e0 msgr2=0x7fee000c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:40.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee06e5c700 1 -- 172.21.15.29:0/647404547 shutdown_connections 2023-10-06T05:29:40.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.249+0000 7fee06e5c700 1 -- 172.21.15.29:0/647404547 wait complete. 2023-10-06T05:29:40.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee06e5c700 1 Processor -- start 2023-10-06T05:29:40.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee06e5c700 1 -- start start 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee06e5c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedec003bf0 0x7fee000c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee06e5c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee000ab330 0x7fee00155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee06e5c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee000a6550 0x7fee000a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee06e5c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000a6f00 con 0x7fee000ab330 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee06e5c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c46b0 con 0x7fedec003bf0 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee06e5c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c4990 con 0x7fee000a6550 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fedfffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee000ab330 0x7fee00155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fedfffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee000ab330 0x7fee00155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40010/0 (socket says 172.21.15.29:40010) 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fedfffff700 1 -- 172.21.15.29:0/3997521157 learned_addr learned my addr 172.21.15.29:0/3997521157 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee04bf8700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedec003bf0 0x7fee000c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.253+0000 7fee053f9700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee000a6550 0x7fee000a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfffff700 1 -- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee000a6550 msgr2=0x7fee000a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfffff700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee000a6550 0x7fee000a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfffff700 1 -- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedec003bf0 msgr2=0x7fee000c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfffff700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedec003bf0 0x7fee000c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfffff700 1 -- 172.21.15.29:0/3997521157 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000c4c70 con 0x7fee000ab330 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfffff700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee000ab330 0x7fee00155010 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fede8002ab0 tx=0x7fede8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfcff9700 1 -- 172.21.15.29:0/3997521157 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8002e90 con 0x7fee000ab330 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfcff9700 1 -- 172.21.15.29:0/3997521157 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede8006a30 con 0x7fee000ab330 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee000c4f50 con 0x7fee000ab330 2023-10-06T05:29:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfcff9700 1 -- 172.21.15.29:0/3997521157 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8006df0 con 0x7fee000ab330 2023-10-06T05:29:40.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee000ab7a0 con 0x7fee000ab330 2023-10-06T05:29:40.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee00071120 con 0x7fee000ab330 2023-10-06T05:29:40.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.257+0000 7fedfcff9700 1 -- 172.21.15.29:0/3997521157 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fede8007260 con 0x7fee000ab330 2023-10-06T05:29:40.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.261+0000 7fedfcff9700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fede0060580 0x7fede0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.261+0000 7fedfcff9700 1 -- 172.21.15.29:0/3997521157 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fede807cbe0 con 0x7fee000ab330 2023-10-06T05:29:40.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.261+0000 7fee04bf8700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fede0060580 0x7fede0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.261+0000 7fee04bf8700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fede0060580 0x7fede0062a30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fedf000a3b0 tx=0x7fedf0016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:40.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.269+0000 7fedfcff9700 1 -- 172.21.15.29:0/3997521157 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fede804cf30 con 0x7fee000ab330 2023-10-06T05:29:40.335 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:29:40.337 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:29:40.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee000c7180 con 0x7fee000ab330 2023-10-06T05:29:40.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fedfcff9700 1 -- 172.21.15.29:0/3997521157 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7fede8050550 con 0x7fee000ab330 2023-10-06T05:29:40.429 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:29:40.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fede0060580 msgr2=0x7fede0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fede0060580 0x7fede0062a30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fedf000a3b0 tx=0x7fedf0016000 comp rx=0 tx=0).stop 2023-10-06T05:29:40.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee000ab330 msgr2=0x7fee00155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee000ab330 0x7fee00155010 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fede8002ab0 tx=0x7fede8007d30 comp rx=0 tx=0).stop 2023-10-06T05:29:40.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 shutdown_connections 2023-10-06T05:29:40.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee000a6550 0x7fee000a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee000ab330 0x7fee00155010 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fede0060580 0x7fede0062a30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 --2- 172.21.15.29:0/3997521157 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fedec003bf0 0x7fee000c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 >> 172.21.15.29:0/3997521157 conn(0x7fee000cd0e0 msgr2=0x7fee00070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:40.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 shutdown_connections 2023-10-06T05:29:40.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.425+0000 7fee06e5c700 1 -- 172.21.15.29:0/3997521157 wait complete. 2023-10-06T05:29:40.443 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:29:40.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.545+0000 7f74b60da700 1 Processor -- start 2023-10-06T05:29:40.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.545+0000 7f74b60da700 1 -- start start 2023-10-06T05:29:40.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b60da700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c91d0 0x7f74b0067880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b60da700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00c82b0 con 0x7f74b00cdb00 2023-10-06T05:29:40.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b60da700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00685b0 con 0x7f74b00c8d50 2023-10-06T05:29:40.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b60da700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b0068890 con 0x7f74b00c91d0 2023-10-06T05:29:40.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b50d8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f74b00cdb00 0x7f74b00cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45182/0 (socket says 172.21.15.29:45182) 2023-10-06T05:29:40.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b50d8700 1 -- 172.21.15.29:0/1693024390 learned_addr learned my addr 172.21.15.29:0/1693024390 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:40.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b58d9700 1 --2- 172.21.15.29:0/1693024390 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c91d0 0x7f74b0067880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74a7fff700 1 -- 172.21.15.29:0/1693024390 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199254195 0 0) 0x7f74b00c82b0 con 0x7f74b00cdb00 2023-10-06T05:29:40.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74a7fff700 1 -- 172.21.15.29:0/1693024390 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f749c003570 con 0x7f74b00cdb00 2023-10-06T05:29:40.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74a7fff700 1 -- 172.21.15.29:0/1693024390 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770354625 0 0) 0x7f74b00685b0 con 0x7f74b00c8d50 2023-10-06T05:29:40.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74a7fff700 1 -- 172.21.15.29:0/1693024390 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b00c82b0 con 0x7f74b00c8d50 2023-10-06T05:29:40.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b58d9700 1 -- 172.21.15.29:0/1693024390 >> v1:172.21.15.173:6789/0 conn(0x7f74b00c8d50 legacy=0x7f74b00af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b58d9700 1 -- 172.21.15.29:0/1693024390 >> v1:172.21.15.29:6789/0 conn(0x7f74b00cdb00 legacy=0x7f74b00cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b58d9700 1 -- 172.21.15.29:0/1693024390 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b00c8550 con 0x7f74b00c91d0 2023-10-06T05:29:40.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74b58d9700 1 --2- 172.21.15.29:0/1693024390 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c91d0 0x7f74b0067880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e90 tx=0x7f74a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776b29405b17b0e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:40.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74a7fff700 1 -- 172.21.15.29:0/1693024390 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a800e070 con 0x7f74b00c91d0 2023-10-06T05:29:40.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74a7fff700 1 -- 172.21.15.29:0/1693024390 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a800bb80 con 0x7f74b00c91d0 2023-10-06T05:29:40.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.549+0000 7f74a7fff700 1 -- 172.21.15.29:0/1693024390 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8012430 con 0x7f74b00c91d0 2023-10-06T05:29:40.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 -- 172.21.15.29:0/1693024390 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c91d0 msgr2=0x7f74b0067880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 --2- 172.21.15.29:0/1693024390 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c91d0 0x7f74b0067880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e90 tx=0x7f74a8009780 comp rx=0 tx=0).stop 2023-10-06T05:29:40.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 -- 172.21.15.29:0/1693024390 shutdown_connections 2023-10-06T05:29:40.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 --2- 172.21.15.29:0/1693024390 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c91d0 0x7f74b0067880 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 -- 172.21.15.29:0/1693024390 >> 172.21.15.29:0/1693024390 conn(0x7f74b00692b0 msgr2=0x7f74b0069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:40.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 -- 172.21.15.29:0/1693024390 shutdown_connections 2023-10-06T05:29:40.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 -- 172.21.15.29:0/1693024390 wait complete. 2023-10-06T05:29:40.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 Processor -- start 2023-10-06T05:29:40.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 -- start start 2023-10-06T05:29:40.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c8d50 0x7f74b014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00c91d0 0x7f74b00c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74b00cdb00 0x7f74b00ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00c1ff0 con 0x7f74b00c91d0 2023-10-06T05:29:40.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00c13e0 con 0x7f74b00cdb00 2023-10-06T05:29:40.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b60da700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00c16c0 con 0x7f74b00c8d50 2023-10-06T05:29:40.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b48d7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00c91d0 0x7f74b00c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b48d7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00c91d0 0x7f74b00c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40024/0 (socket says 172.21.15.29:40024) 2023-10-06T05:29:40.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b48d7700 1 -- 172.21.15.29:0/3008114224 learned_addr learned my addr 172.21.15.29:0/3008114224 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:40.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b50d8700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c8d50 0x7f74b014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.553+0000 7f74b58d9700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74b00cdb00 0x7f74b00ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74b48d7700 1 -- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c8d50 msgr2=0x7f74b014ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74b48d7700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c8d50 0x7f74b014ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74b48d7700 1 -- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74b00cdb00 msgr2=0x7f74b00ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74b48d7700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74b00cdb00 0x7f74b00ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74b48d7700 1 -- 172.21.15.29:0/3008114224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009a20 con 0x7f74b00c91d0 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74b48d7700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00c91d0 0x7f74b00c7630 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f74a000c790 tx=0x7f74a0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74a57fa700 1 -- 172.21.15.29:0/3008114224 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0010510 con 0x7f74b00c91d0 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74a57fa700 1 -- 172.21.15.29:0/3008114224 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0010670 con 0x7f74b00c91d0 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b00c19a0 con 0x7f74b00c91d0 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74a57fa700 1 -- 172.21.15.29:0/3008114224 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0010a10 con 0x7f74b00c91d0 2023-10-06T05:29:40.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b014f4b0 con 0x7f74b00c91d0 2023-10-06T05:29:40.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b004be00 con 0x7f74b00c91d0 2023-10-06T05:29:40.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.557+0000 7f74a57fa700 1 -- 172.21.15.29:0/3008114224 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f74a001b3b0 con 0x7f74b00c91d0 2023-10-06T05:29:40.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.561+0000 7f74a57fa700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7494060550 0x7f7494062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.561+0000 7f74a57fa700 1 -- 172.21.15.29:0/3008114224 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f74a007c310 con 0x7f74b00c91d0 2023-10-06T05:29:40.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.561+0000 7f74b50d8700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7494060550 0x7f7494062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.561+0000 7f74b50d8700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7494060550 0x7f7494062a00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007fd0 tx=0x7f74ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:40.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.569+0000 7f74a57fa700 1 -- 172.21.15.29:0/3008114224 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f74a004c660 con 0x7f74b00c91d0 2023-10-06T05:29:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.761+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74b00c8830 con 0x7f74b00c91d0 2023-10-06T05:29:40.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74a57fa700 1 -- 172.21.15.29:0/3008114224 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f74a0017090 con 0x7f74b00c91d0 2023-10-06T05:29:40.769 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:40.769 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6360,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2681982923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2681982923},{"type":"v1","addr":"172.21.15.29:6835","nonce":2681982923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:29:38.345816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:29:40.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7494060550 msgr2=0x7f7494062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7494060550 0x7f7494062a00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007fd0 tx=0x7f74ac009040 comp rx=0 tx=0).stop 2023-10-06T05:29:40.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00c91d0 msgr2=0x7f74b00c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00c91d0 0x7f74b00c7630 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f74a000c790 tx=0x7f74a0007e10 comp rx=0 tx=0).stop 2023-10-06T05:29:40.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 shutdown_connections 2023-10-06T05:29:40.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7494060550 0x7f7494062a00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74b00cdb00 0x7f74b00ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00c91d0 0x7f74b00c7630 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 --2- 172.21.15.29:0/3008114224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74b00c8d50 0x7f74b014ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 >> 172.21.15.29:0/3008114224 conn(0x7f74b00692b0 msgr2=0x7f74b015af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:40.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 shutdown_connections 2023-10-06T05:29:40.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.765+0000 7f74b60da700 1 -- 172.21.15.29:0/3008114224 wait complete. 2023-10-06T05:29:40.773 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 35 2023-10-06T05:29:40.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:29:40.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 Processor -- start 2023-10-06T05:29:40.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 -- start start 2023-10-06T05:29:40.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f670406e960 0x7f670406ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040b0490 con 0x7f670415a220 2023-10-06T05:29:40.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040b06e0 con 0x7f6704155d90 2023-10-06T05:29:40.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040b09c0 con 0x7f670406e960 2023-10-06T05:29:40.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6709c49700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f670406e960 0x7f670406ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6709448700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f670415a220 0x7f6704155680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45198/0 (socket says 172.21.15.29:45198) 2023-10-06T05:29:40.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6709448700 1 -- 172.21.15.29:0/1144774448 learned_addr learned my addr 172.21.15.29:0/1144774448 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:40.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6709c49700 1 -- 172.21.15.29:0/1144774448 >> v1:172.21.15.173:6789/0 conn(0x7f6704155d90 legacy=0x7f67040aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:40.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6709c49700 1 -- 172.21.15.29:0/1144774448 >> v1:172.21.15.29:6789/0 conn(0x7f670415a220 legacy=0x7f6704155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6709c49700 1 -- 172.21.15.29:0/1144774448 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040b0ca0 con 0x7f670406e960 2023-10-06T05:29:40.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6709c49700 1 --2- 172.21.15.29:0/1144774448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f670406e960 0x7f670406ed30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f67000098e0 tx=0x7f67000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b5dd33c2c5ae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:40.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6708c47700 1 -- 172.21.15.29:0/1144774448 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700009e80 con 0x7f670406e960 2023-10-06T05:29:40.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6708c47700 1 -- 172.21.15.29:0/1144774448 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670000b860 con 0x7f670406e960 2023-10-06T05:29:40.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f6708c47700 1 -- 172.21.15.29:0/1144774448 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670000bbe0 con 0x7f670406e960 2023-10-06T05:29:40.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 -- 172.21.15.29:0/1144774448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f670406e960 msgr2=0x7f670406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 --2- 172.21.15.29:0/1144774448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f670406e960 0x7f670406ed30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f67000098e0 tx=0x7f67000091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 -- 172.21.15.29:0/1144774448 shutdown_connections 2023-10-06T05:29:40.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 --2- 172.21.15.29:0/1144774448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f670406e960 0x7f670406ed30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 -- 172.21.15.29:0/1144774448 >> 172.21.15.29:0/1144774448 conn(0x7f6704067b70 msgr2=0x7f670406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:40.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 -- 172.21.15.29:0/1144774448 shutdown_connections 2023-10-06T05:29:40.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.889+0000 7f670bead700 1 -- 172.21.15.29:0/1144774448 wait complete. 2023-10-06T05:29:40.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f670bead700 1 Processor -- start 2023-10-06T05:29:40.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f670bead700 1 -- start start 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f670bead700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f670406e960 0x7f67040ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f670bead700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6704155d90 0x7f67040c1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f670bead700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f670415a220 0x7f670414c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f670bead700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040add10 con 0x7f6704155d90 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f670bead700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c1780 con 0x7f670415a220 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f670bead700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c25a0 con 0x7f670406e960 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f6709448700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6704155d90 0x7f67040c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f6709448700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6704155d90 0x7f67040c1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40044/0 (socket says 172.21.15.29:40044) 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f6709448700 1 -- 172.21.15.29:0/1763585336 learned_addr learned my addr 172.21.15.29:0/1763585336 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f670a44a700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f670415a220 0x7f670414c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.893+0000 7f6709c49700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f670406e960 0x7f67040ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f6709448700 1 -- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f670406e960 msgr2=0x7f67040ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f6709448700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f670406e960 0x7f67040ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f6709448700 1 -- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f670415a220 msgr2=0x7f670414c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f6709448700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f670415a220 0x7f670414c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f6709448700 1 -- 172.21.15.29:0/1763585336 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700009420 con 0x7f6704155d90 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f6709448700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6704155d90 0x7f67040c1240 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f66f400c560 tx=0x7f66f4001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f66f9ffb700 1 -- 172.21.15.29:0/1763585336 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4005b30 con 0x7f6704155d90 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f66f9ffb700 1 -- 172.21.15.29:0/1763585336 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4005c90 con 0x7f6704155d90 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f66f9ffb700 1 -- 172.21.15.29:0/1763585336 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4007320 con 0x7f6704155d90 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040c1990 con 0x7f6704155d90 2023-10-06T05:29:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67040c1f50 con 0x7f6704155d90 2023-10-06T05:29:40.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67040c2730 con 0x7f6704155d90 2023-10-06T05:29:40.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.897+0000 7f66f9ffb700 1 -- 172.21.15.29:0/1763585336 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f66f401b3b0 con 0x7f6704155d90 2023-10-06T05:29:40.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.901+0000 7f66f9ffb700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f66e8060550 0x7f66e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:40.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.901+0000 7f66f9ffb700 1 -- 172.21.15.29:0/1763585336 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f66f407bdd0 con 0x7f6704155d90 2023-10-06T05:29:40.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.901+0000 7f6709c49700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f66e8060550 0x7f66e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:40.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.901+0000 7f6709c49700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f66e8060550 0x7f66e8062a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f67000093f0 tx=0x7f6700017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:40.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:40.909+0000 7f66f9ffb700 1 -- 172.21.15.29:0/1763585336 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f66f404c120 con 0x7f6704155d90 2023-10-06T05:29:41.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67040b0f80 con 0x7f6704155d90 2023-10-06T05:29:41.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f66f9ffb700 1 -- 172.21.15.29:0/1763585336 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17365 (secure 0 0 0) 0x7f66f404f740 con 0x7f6704155d90 2023-10-06T05:29:41.078 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:41.078 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":66,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:29:38.345337+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:28:11.073066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T05:28:12.396583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.11","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.2a","mappings":[{"from":7,"to":5}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/184173135":"2023-10-07T05:29:38.345270+0000","172.21.15.29:6834/184173135":"2023-10-07T05:29:38.345270+0000","172.21.15.29:6835/1584172634":"2023-10-07T05:29:01.837299+0000","172.21.15.29:6834/1584172634":"2023-10-07T05:29:01.837299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:29:41.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f66e8060550 msgr2=0x7f66e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f66e8060550 0x7f66e8062a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f67000093f0 tx=0x7f6700017000 comp rx=0 tx=0).stop 2023-10-06T05:29:41.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6704155d90 msgr2=0x7f67040c1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6704155d90 0x7f67040c1240 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f66f400c560 tx=0x7f66f4001020 comp rx=0 tx=0).stop 2023-10-06T05:29:41.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 shutdown_connections 2023-10-06T05:29:41.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f66e8060550 0x7f66e8062a00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f670415a220 0x7f670414c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6704155d90 0x7f67040c1240 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 --2- 172.21.15.29:0/1763585336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f670406e960 0x7f67040ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 >> 172.21.15.29:0/1763585336 conn(0x7f6704067b70 msgr2=0x7f67040aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:41.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 shutdown_connections 2023-10-06T05:29:41.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.073+0000 7f670bead700 1 -- 172.21.15.29:0/1763585336 wait complete. 2023-10-06T05:29:41.092 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T05:29:41.092 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:29:41.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.197+0000 7f97808f0700 1 Processor -- start 2023-10-06T05:29:41.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.197+0000 7f97808f0700 1 -- start start 2023-10-06T05:29:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f977c06c8f0 0x7f977c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06ccc0 0x7f977c0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f977c159850 0x7f977c0c8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c159cb0 con 0x7f977c159850 2023-10-06T05:29:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c06aef0 con 0x7f977c06c8f0 2023-10-06T05:29:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c06a2e0 con 0x7f977c06ccc0 2023-10-06T05:29:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f977c159850 0x7f977c0c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f977c159850 0x7f977c0c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40048/0 (socket says 172.21.15.29:40048) 2023-10-06T05:29:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977bfff700 1 -- 172.21.15.29:0/2307889481 learned_addr learned my addr 172.21.15.29:0/2307889481 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977affd700 1 --2- 172.21.15.29:0/2307889481 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06ccc0 0x7f977c0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977b7fe700 1 --2- 172.21.15.29:0/2307889481 >> v2:172.21.15.173:3300/0 conn(0x7f977c06c8f0 0x7f977c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977bfff700 1 -- 172.21.15.29:0/2307889481 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06ccc0 msgr2=0x7f977c0c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977bfff700 1 --2- 172.21.15.29:0/2307889481 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06ccc0 0x7f977c0c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977bfff700 1 -- 172.21.15.29:0/2307889481 >> v2:172.21.15.173:3300/0 conn(0x7f977c06c8f0 msgr2=0x7f977c06b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977bfff700 1 --2- 172.21.15.29:0/2307889481 >> v2:172.21.15.173:3300/0 conn(0x7f977c06c8f0 0x7f977c06b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977bfff700 1 -- 172.21.15.29:0/2307889481 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c06a5c0 con 0x7f977c159850 2023-10-06T05:29:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977b7fe700 1 --2- 172.21.15.29:0/2307889481 >> v2:172.21.15.173:3300/0 conn(0x7f977c06c8f0 0x7f977c06b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977bfff700 1 --2- 172.21.15.29:0/2307889481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 0x7f977c0c8370 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f977c06dec0 tx=0x7f9774009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601d2c22b6079e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977a7fc700 1 -- 172.21.15.29:0/2307889481 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400e070 con 0x7f977c159850 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977a7fc700 1 -- 172.21.15.29:0/2307889481 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400ba50 con 0x7f977c159850 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f977a7fc700 1 -- 172.21.15.29:0/2307889481 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740092e0 con 0x7f977c159850 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 -- 172.21.15.29:0/2307889481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 msgr2=0x7f977c0c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 --2- 172.21.15.29:0/2307889481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 0x7f977c0c8370 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f977c06dec0 tx=0x7f9774009840 comp rx=0 tx=0).stop 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 -- 172.21.15.29:0/2307889481 shutdown_connections 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 --2- 172.21.15.29:0/2307889481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 0x7f977c0c8370 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 --2- 172.21.15.29:0/2307889481 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06ccc0 0x7f977c0c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 --2- 172.21.15.29:0/2307889481 >> v2:172.21.15.173:3300/0 conn(0x7f977c06c8f0 0x7f977c06b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 -- 172.21.15.29:0/2307889481 >> 172.21.15.29:0/2307889481 conn(0x7f977c0670a0 msgr2=0x7f977c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 -- 172.21.15.29:0/2307889481 shutdown_connections 2023-10-06T05:29:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.201+0000 7f97808f0700 1 -- 172.21.15.29:0/2307889481 wait complete. 2023-10-06T05:29:41.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 Processor -- start 2023-10-06T05:29:41.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 -- start start 2023-10-06T05:29:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06c8f0 0x7f977c0c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c06ccc0 0x7f977c154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 0x7f977c0c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c156c30 con 0x7f977c159850 2023-10-06T05:29:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c156e40 con 0x7f977c06ccc0 2023-10-06T05:29:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c157120 con 0x7f977c06c8f0 2023-10-06T05:29:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 0x7f977c0c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 0x7f977c0c3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40054/0 (socket says 172.21.15.29:40054) 2023-10-06T05:29:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977bfff700 1 -- 172.21.15.29:0/2798296841 learned_addr learned my addr 172.21.15.29:0/2798296841 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977affd700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c06ccc0 0x7f977c154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977b7fe700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06c8f0 0x7f977c0c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977bfff700 1 -- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06c8f0 msgr2=0x7f977c0c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977bfff700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06c8f0 0x7f977c0c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977bfff700 1 -- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c06ccc0 msgr2=0x7f977c154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977bfff700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c06ccc0 0x7f977c154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977bfff700 1 -- 172.21.15.29:0/2798296841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009ae0 con 0x7f977c159850 2023-10-06T05:29:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977affd700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c06ccc0 0x7f977c154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f977bfff700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 0x7f977c0c3b00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f977c06e4b0 tx=0x7f9774018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97737fe700 1 -- 172.21.15.29:0/2798296841 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774008e80 con 0x7f977c159850 2023-10-06T05:29:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97737fe700 1 -- 172.21.15.29:0/2798296841 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9774025460 con 0x7f977c159850 2023-10-06T05:29:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c157400 con 0x7f977c159850 2023-10-06T05:29:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97737fe700 1 -- 172.21.15.29:0/2798296841 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774025800 con 0x7f977c159850 2023-10-06T05:29:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.205+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c1579c0 con 0x7f977c159850 2023-10-06T05:29:41.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.209+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c04be00 con 0x7f977c159850 2023-10-06T05:29:41.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.209+0000 7f97737fe700 1 -- 172.21.15.29:0/2798296841 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9774003040 con 0x7f977c159850 2023-10-06T05:29:41.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.209+0000 7f97737fe700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f975c060550 0x7f975c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.209+0000 7f97737fe700 1 -- 172.21.15.29:0/2798296841 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f977407e260 con 0x7f977c159850 2023-10-06T05:29:41.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.209+0000 7f977b7fe700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f975c060550 0x7f975c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.209+0000 7f977b7fe700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f975c060550 0x7f975c062a00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f976c00ac00 tx=0x7f976c006f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:41.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.217+0000 7f97737fe700 1 -- 172.21.15.29:0/2798296841 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f977404e5b0 con 0x7f977c159850 2023-10-06T05:29:41.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.417+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f977c06a8a0 con 0x7f977c159850 2023-10-06T05:29:41.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.417+0000 7f97737fe700 1 -- 172.21.15.29:0/2798296841 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f9774051bd0 con 0x7f977c159850 2023-10-06T05:29:41.424 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:41.424 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6360,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2681982923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2681982923},{"type":"v1","addr":"172.21.15.29:6835","nonce":2681982923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:29:38.345816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f975c060550 msgr2=0x7f975c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f975c060550 0x7f975c062a00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f976c00ac00 tx=0x7f976c006f90 comp rx=0 tx=0).stop 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 msgr2=0x7f977c0c3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 0x7f977c0c3b00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f977c06e4b0 tx=0x7f9774018000 comp rx=0 tx=0).stop 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 shutdown_connections 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f977c159850 0x7f977c0c3b00 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f975c060550 0x7f975c062a00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977c06ccc0 0x7f977c154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 --2- 172.21.15.29:0/2798296841 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977c06c8f0 0x7f977c0c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 >> 172.21.15.29:0/2798296841 conn(0x7f977c0670a0 msgr2=0x7f977c0c6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 shutdown_connections 2023-10-06T05:29:41.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.421+0000 7f97808f0700 1 -- 172.21.15.29:0/2798296841 wait complete. 2023-10-06T05:29:41.428 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 35 2023-10-06T05:29:41.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:29:41.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36f4daf700 1 Processor -- start 2023-10-06T05:29:41.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36f4daf700 1 -- start start 2023-10-06T05:29:41.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36f4daf700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f00b1340 0x7f36f0160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36f4daf700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f0156cb0 con 0x7f36f006dde0 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36f4daf700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f00af150 con 0x7f36f014ffd0 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36f4daf700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00ae750 con 0x7f36f00b1340 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36edd9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f36f006dde0 0x7f36f00b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45204/0 (socket says 172.21.15.29:45204) 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36edd9b700 1 -- 172.21.15.29:0/292243417 learned_addr learned my addr 172.21.15.29:0/292243417 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36eed9d700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f00b1340 0x7f36f0160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590018825 0 0) 0x7f36f0156cb0 con 0x7f36f006dde0 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d4003570 con 0x7f36f006dde0 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248645766 0 0) 0x7f36f00af150 con 0x7f36f014ffd0 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f0156cb0 con 0x7f36f014ffd0 2023-10-06T05:29:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2361360540 0 0) 0x7f36d4003570 con 0x7f36f006dde0 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f00b1340 msgr2=0x7f36f0160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f00b1340 0x7f36f0160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 >> v1:172.21.15.173:6789/0 conn(0x7f36f014ffd0 legacy=0x7f36f006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0156380 con 0x7f36f006dde0 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f36e00017f0 con 0x7f36f006dde0 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 >> v1:172.21.15.29:6789/0 conn(0x7f36f006dde0 legacy=0x7f36f00b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36d4003c20 0x7f36d4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f00b1340 0x7f36d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d4004d50 0x7f36d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00ae750 con 0x7f36d4004d50 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d400dd50 con 0x7f36d4003c20 2023-10-06T05:29:41.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d400df10 con 0x7f36f00b1340 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36eed9d700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d4004d50 0x7f36d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36edd9b700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f00b1340 0x7f36d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.545+0000 7f36ee59c700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36d4003c20 0x7f36d4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36eed9d700 1 -- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f00b1340 msgr2=0x7f36d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36eed9d700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36f00b1340 0x7f36d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36eed9d700 1 -- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36d4003c20 msgr2=0x7f36d4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36eed9d700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36d4003c20 0x7f36d4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36eed9d700 1 -- 172.21.15.29:0/292243417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d4003570 con 0x7f36d4004d50 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36ee59c700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36d4003c20 0x7f36d4004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36eed9d700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d4004d50 0x7f36d40051c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009c00 tx=0x7f36e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15aba7f39a907ec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e800e710 con 0x7f36d4004d50 2023-10-06T05:29:41.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e800e870 con 0x7f36d4004d50 2023-10-06T05:29:41.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36ed59a700 1 -- 172.21.15.29:0/292243417 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e800ec30 con 0x7f36d4004d50 2023-10-06T05:29:41.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36f4daf700 1 -- 172.21.15.29:0/292243417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d4004d50 msgr2=0x7f36d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36f4daf700 1 --2- 172.21.15.29:0/292243417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d4004d50 0x7f36d40051c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009c00 tx=0x7f36e80091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36eed9d700 1 -- 172.21.15.29:0/292243417 reap_dead start 2023-10-06T05:29:41.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36f4daf700 1 -- 172.21.15.29:0/292243417 shutdown_connections 2023-10-06T05:29:41.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36f4daf700 1 -- 172.21.15.29:0/292243417 >> 172.21.15.29:0/292243417 conn(0x7f36f006b770 msgr2=0x7f36f00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:41.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36f4daf700 1 -- 172.21.15.29:0/292243417 shutdown_connections 2023-10-06T05:29:41.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.549+0000 7f36f4daf700 1 -- 172.21.15.29:0/292243417 wait complete. 2023-10-06T05:29:41.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36f4daf700 1 Processor -- start 2023-10-06T05:29:41.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36f4daf700 1 -- start start 2023-10-06T05:29:41.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36f4daf700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36d4004d50 0x7f36f014d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36f4daf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f01537a0 0x7f36f0151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36f4daf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36f0155030 0x7f36f01554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36f4daf700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f014dc70 con 0x7f36f0155030 2023-10-06T05:29:41.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36f4daf700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0151560 con 0x7f36f01537a0 2023-10-06T05:29:41.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36f4daf700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0151800 con 0x7f36d4004d50 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36eed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36f0155030 0x7f36f01554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36eed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36f0155030 0x7f36f01554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40072/0 (socket says 172.21.15.29:40072) 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36eed9d700 1 -- 172.21.15.29:0/3710917285 learned_addr learned my addr 172.21.15.29:0/3710917285 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36edd9b700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f01537a0 0x7f36f0151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36ee59c700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36d4004d50 0x7f36f014d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36eed9d700 1 -- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36d4004d50 msgr2=0x7f36f014d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36eed9d700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36d4004d50 0x7f36f014d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36eed9d700 1 -- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f01537a0 msgr2=0x7f36f0151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36eed9d700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f01537a0 0x7f36f0151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36eed9d700 1 -- 172.21.15.29:0/3710917285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0151ae0 con 0x7f36f0155030 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36eed9d700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36f0155030 0x7f36f01554a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f36e8016000 tx=0x7f36e801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:41.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36e67fc700 1 -- 172.21.15.29:0/3710917285 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8022070 con 0x7f36f0155030 2023-10-06T05:29:41.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.553+0000 7f36e67fc700 1 -- 172.21.15.29:0/3710917285 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e800ebf0 con 0x7f36f0155030 2023-10-06T05:29:41.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.557+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f0151dc0 con 0x7f36f0155030 2023-10-06T05:29:41.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.557+0000 7f36e67fc700 1 -- 172.21.15.29:0/3710917285 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e800e710 con 0x7f36f0155030 2023-10-06T05:29:41.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.557+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f00c9770 con 0x7f36f0155030 2023-10-06T05:29:41.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.557+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f004be00 con 0x7f36f0155030 2023-10-06T05:29:41.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.557+0000 7f36e67fc700 1 -- 172.21.15.29:0/3710917285 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f36e8027980 con 0x7f36f0155030 2023-10-06T05:29:41.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.557+0000 7f36e67fc700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f36d8060550 0x7f36d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.557+0000 7f36e67fc700 1 -- 172.21.15.29:0/3710917285 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f36e8000e40 con 0x7f36f0155030 2023-10-06T05:29:41.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.557+0000 7f36ee59c700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f36d8060550 0x7f36d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.561+0000 7f36ee59c700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f36d8060550 0x7f36d8062a00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0011e0 tx=0x7f36dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.565+0000 7f36e67fc700 1 -- 172.21.15.29:0/3710917285 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f36e804eb40 con 0x7f36f0155030 2023-10-06T05:29:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.757+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36f00ae180 con 0x7f36f0155030 2023-10-06T05:29:41.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36e67fc700 1 -- 172.21.15.29:0/3710917285 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f36e8017090 con 0x7f36f0155030 2023-10-06T05:29:41.765 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:41.765 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6360,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2681982923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2681982923},{"type":"v1","addr":"172.21.15.29:6835","nonce":2681982923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:28:13.425370+0000","modified":"2023-10-06T05:29:38.345816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T05:29:41.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f36d8060550 msgr2=0x7f36d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f36d8060550 0x7f36d8062a00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0011e0 tx=0x7f36dc009040 comp rx=0 tx=0).stop 2023-10-06T05:29:41.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36f0155030 msgr2=0x7f36f01554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36f0155030 0x7f36f01554a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f36e8016000 tx=0x7f36e801a000 comp rx=0 tx=0).stop 2023-10-06T05:29:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 shutdown_connections 2023-10-06T05:29:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36f0155030 0x7f36f01554a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f36d8060550 0x7f36d8062a00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36f01537a0 0x7f36f0151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 --2- 172.21.15.29:0/3710917285 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36d4004d50 0x7f36f014d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 >> 172.21.15.29:0/3710917285 conn(0x7f36f006b770 msgr2=0x7f36f006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 shutdown_connections 2023-10-06T05:29:41.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.761+0000 7f36f4daf700 1 -- 172.21.15.29:0/3710917285 wait complete. 2023-10-06T05:29:41.769 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 35 2023-10-06T05:29:41.779 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:29:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.877+0000 7f6221202700 1 Processor -- start 2023-10-06T05:29:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.877+0000 7f6221202700 1 -- start start 2023-10-06T05:29:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c0c8b50 0x7f621c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f621c155cb0 0x7f621c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621c06b9e0 con 0x7f621c06c8f0 2023-10-06T05:29:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621c0cb7e0 con 0x7f621c155cb0 2023-10-06T05:29:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0caf80 con 0x7f621c0c8b50 2023-10-06T05:29:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6220a01700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f621c155cb0 0x7f621c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621b7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c0c8b50 0x7f621c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6220a01700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f621c155cb0 0x7f621c06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:50596/0 (socket says 172.21.15.29:50596) 2023-10-06T05:29:41.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621bfff700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f621c06c8f0 0x7f621c1555a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:41454/0 (socket says 172.21.15.29:41454) 2023-10-06T05:29:41.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6220a01700 1 -- 172.21.15.29:0/3720949751 learned_addr learned my addr 172.21.15.29:0/3720949751 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:41.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621b7fe700 1 -- 172.21.15.29:0/3720949751 >> v2:172.21.15.173:3300/0 conn(0x7f621c155cb0 msgr2=0x7f621c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:41.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621b7fe700 1 --2- 172.21.15.29:0/3720949751 >> v2:172.21.15.173:3300/0 conn(0x7f621c155cb0 0x7f621c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621b7fe700 1 -- 172.21.15.29:0/3720949751 >> v1:172.21.15.173:6789/0 conn(0x7f621c06c8f0 legacy=0x7f621c1555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621b7fe700 1 -- 172.21.15.29:0/3720949751 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c0c7660 con 0x7f621c0c8b50 2023-10-06T05:29:41.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621b7fe700 1 --2- 172.21.15.29:0/3720949751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c0c8b50 0x7f621c06ccc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f62040098e0 tx=0x7f62040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86de65174a065388 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:41.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621affd700 1 -- 172.21.15.29:0/3720949751 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620400b640 con 0x7f621c0c8b50 2023-10-06T05:29:41.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621affd700 1 -- 172.21.15.29:0/3720949751 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620400b7a0 con 0x7f621c0c8b50 2023-10-06T05:29:41.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f621affd700 1 -- 172.21.15.29:0/3720949751 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620400bb40 con 0x7f621c0c8b50 2023-10-06T05:29:41.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 -- 172.21.15.29:0/3720949751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c0c8b50 msgr2=0x7f621c06ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 --2- 172.21.15.29:0/3720949751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c0c8b50 0x7f621c06ccc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f62040098e0 tx=0x7f62040091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 -- 172.21.15.29:0/3720949751 shutdown_connections 2023-10-06T05:29:41.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 --2- 172.21.15.29:0/3720949751 >> v2:172.21.15.173:3300/0 conn(0x7f621c155cb0 0x7f621c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 --2- 172.21.15.29:0/3720949751 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c0c8b50 0x7f621c06ccc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 -- 172.21.15.29:0/3720949751 >> 172.21.15.29:0/3720949751 conn(0x7f621c0670a0 msgr2=0x7f621c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:41.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 -- 172.21.15.29:0/3720949751 shutdown_connections 2023-10-06T05:29:41.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.881+0000 7f6221202700 1 -- 172.21.15.29:0/3720949751 wait complete. 2023-10-06T05:29:41.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 Processor -- start 2023-10-06T05:29:41.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 -- start start 2023-10-06T05:29:41.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621c06c8f0 0x7f621c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c155cb0 0x7f621c137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f621c138470 0x7f621c13bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c138cd0 con 0x7f621c06c8f0 2023-10-06T05:29:41.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c153de0 con 0x7f621c138470 2023-10-06T05:29:41.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1540c0 con 0x7f621c155cb0 2023-10-06T05:29:41.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621c06c8f0 0x7f621c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621c06c8f0 0x7f621c1537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40074/0 (socket says 172.21.15.29:40074) 2023-10-06T05:29:41.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621bfff700 1 -- 172.21.15.29:0/1858632394 learned_addr learned my addr 172.21.15.29:0/1858632394 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:41.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621b7fe700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c155cb0 0x7f621c137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6220a01700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f621c138470 0x7f621c13bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621bfff700 1 -- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c155cb0 msgr2=0x7f621c137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621bfff700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c155cb0 0x7f621c137f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621bfff700 1 -- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f621c138470 msgr2=0x7f621c13bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:41.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621bfff700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f621c138470 0x7f621c13bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:41.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621bfff700 1 -- 172.21.15.29:0/1858632394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204009420 con 0x7f621c06c8f0 2023-10-06T05:29:41.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f621bfff700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621c06c8f0 0x7f621c1537a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c7c0 tx=0x7f620c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:41.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6213fff700 1 -- 172.21.15.29:0/1858632394 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c005a70 con 0x7f621c06c8f0 2023-10-06T05:29:41.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6213fff700 1 -- 172.21.15.29:0/1858632394 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c005bd0 con 0x7f621c06c8f0 2023-10-06T05:29:41.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c1543a0 con 0x7f621c06c8f0 2023-10-06T05:29:41.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6213fff700 1 -- 172.21.15.29:0/1858632394 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c0070d0 con 0x7f621c06c8f0 2023-10-06T05:29:41.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.885+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c13f1c0 con 0x7f621c06c8f0 2023-10-06T05:29:41.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.889+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c04be00 con 0x7f621c06c8f0 2023-10-06T05:29:41.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.889+0000 7f6213fff700 1 -- 172.21.15.29:0/1858632394 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f620c007480 con 0x7f621c06c8f0 2023-10-06T05:29:41.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.889+0000 7f6213fff700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61fc060550 0x7f61fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:41.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.889+0000 7f6213fff700 1 -- 172.21.15.29:0/1858632394 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f620c07bd70 con 0x7f621c06c8f0 2023-10-06T05:29:41.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.889+0000 7f621b7fe700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61fc060550 0x7f61fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:41.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.893+0000 7f621b7fe700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61fc060550 0x7f61fc062a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f62040093f0 tx=0x7f6204017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:41.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:41.897+0000 7f6213fff700 1 -- 172.21.15.29:0/1858632394 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f620c04c020 con 0x7f621c06c8f0 2023-10-06T05:29:42.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.057+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f621c06b9e0 con 0x7f621c06c8f0 2023-10-06T05:29:42.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6213fff700 1 -- 172.21.15.29:0/1858632394 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17365 (secure 0 0 0) 0x7f621c06b9e0 con 0x7f621c06c8f0 2023-10-06T05:29:42.065 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:42.065 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":66,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:29:38.345337+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:28:11.073066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T05:28:12.396583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.11","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.2a","mappings":[{"from":7,"to":5}]},{"pgid":"10.33","mappings":[{"from":4,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/184173135":"2023-10-07T05:29:38.345270+0000","172.21.15.29:6834/184173135":"2023-10-07T05:29:38.345270+0000","172.21.15.29:6835/1584172634":"2023-10-07T05:29:01.837299+0000","172.21.15.29:6834/1584172634":"2023-10-07T05:29:01.837299+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:29:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61fc060550 msgr2=0x7f61fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61fc060550 0x7f61fc062a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f62040093f0 tx=0x7f6204017000 comp rx=0 tx=0).stop 2023-10-06T05:29:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621c06c8f0 msgr2=0x7f621c1537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621c06c8f0 0x7f621c1537a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c7c0 tx=0x7f620c007f70 comp rx=0 tx=0).stop 2023-10-06T05:29:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 shutdown_connections 2023-10-06T05:29:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61fc060550 0x7f61fc062a00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f621c138470 0x7f621c13bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f621c155cb0 0x7f621c137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 --2- 172.21.15.29:0/1858632394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621c06c8f0 0x7f621c1537a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 >> 172.21.15.29:0/1858632394 conn(0x7f621c0670a0 msgr2=0x7f621c149900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 shutdown_connections 2023-10-06T05:29:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.061+0000 7f6221202700 1 -- 172.21.15.29:0/1858632394 wait complete. 2023-10-06T05:29:42.082 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T05:29:42.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.181+0000 7f7fe5ec4700 1 Processor -- start 2023-10-06T05:29:42.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.181+0000 7f7fe5ec4700 1 -- start start 2023-10-06T05:29:42.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7fe00c8f60 0x7f7fe0068790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe00af890 con 0x7f7fe00683c0 2023-10-06T05:29:42.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe00afb70 con 0x7f7fe00c8830 2023-10-06T05:29:42.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe006c6c0 con 0x7f7fe00c8f60 2023-10-06T05:29:42.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe4ec2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7fe00683c0 0x7f7fe00af040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45212/0 (socket says 172.21.15.29:45212) 2023-10-06T05:29:42.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe4ec2700 1 -- 172.21.15.29:0/1680496067 learned_addr learned my addr 172.21.15.29:0/1680496067 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:42.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd7fff700 1 --2- 172.21.15.29:0/1680496067 >> v2:172.21.15.29:3300/0 conn(0x7f7fe00c8f60 0x7f7fe0068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd77fe700 1 -- 172.21.15.29:0/1680496067 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131768866 0 0) 0x7f7fe00af890 con 0x7f7fe00683c0 2023-10-06T05:29:42.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd77fe700 1 -- 172.21.15.29:0/1680496067 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc8004680 con 0x7f7fe00683c0 2023-10-06T05:29:42.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd7fff700 1 -- 172.21.15.29:0/1680496067 >> v1:172.21.15.173:6789/0 conn(0x7f7fe00c8830 legacy=0x7f7fe0154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd77fe700 1 -- 172.21.15.29:0/1680496067 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216613848 0 0) 0x7f7fe00afb70 con 0x7f7fe00c8830 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd7fff700 1 -- 172.21.15.29:0/1680496067 >> v1:172.21.15.29:6789/0 conn(0x7f7fe00683c0 legacy=0x7f7fe00af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd7fff700 1 -- 172.21.15.29:0/1680496067 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe00afe50 con 0x7f7fe00c8f60 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd7fff700 1 --2- 172.21.15.29:0/1680496067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8f60 0x7f7fe0068790 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00098e0 tx=0x7f7fd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7ef01bb1901afa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd77fe700 1 -- 172.21.15.29:0/1680496067 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc001470 con 0x7f7fe00c8f60 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd77fe700 1 -- 172.21.15.29:0/1680496067 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0011420 con 0x7f7fe00c8f60 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fd77fe700 1 -- 172.21.15.29:0/1680496067 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00117a0 con 0x7f7fe00c8f60 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1680496067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8f60 msgr2=0x7f7fe0068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 --2- 172.21.15.29:0/1680496067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8f60 0x7f7fe0068790 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00098e0 tx=0x7f7fd00091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1680496067 shutdown_connections 2023-10-06T05:29:42.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 --2- 172.21.15.29:0/1680496067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8f60 0x7f7fe0068790 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1680496067 >> 172.21.15.29:0/1680496067 conn(0x7f7fe006abc0 msgr2=0x7f7fe00adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:42.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1680496067 shutdown_connections 2023-10-06T05:29:42.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.185+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1680496067 wait complete. 2023-10-06T05:29:42.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe5ec4700 1 Processor -- start 2023-10-06T05:29:42.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe5ec4700 1 -- start start 2023-10-06T05:29:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe5ec4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fe00683c0 0x7f7fe0140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe5ec4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8830 0x7f7fe00c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe5ec4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fe0156c30 0x7f7fe01570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe5ec4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe0157610 con 0x7f7fe00c8830 2023-10-06T05:29:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe5ec4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe01414b0 con 0x7f7fe00683c0 2023-10-06T05:29:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe5ec4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe0168d20 con 0x7f7fe0156c30 2023-10-06T05:29:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fd7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8830 0x7f7fe00c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fd7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8830 0x7f7fe00c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40098/0 (socket says 172.21.15.29:40098) 2023-10-06T05:29:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fd7fff700 1 -- 172.21.15.29:0/1281978860 learned_addr learned my addr 172.21.15.29:0/1281978860 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe4ec2700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fe00683c0 0x7f7fe0140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe56c3700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fe0156c30 0x7f7fe01570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fd7fff700 1 -- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fe0156c30 msgr2=0x7f7fe01570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fd7fff700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fe0156c30 0x7f7fe01570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fd7fff700 1 -- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fe00683c0 msgr2=0x7f7fe0140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fd7fff700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fe00683c0 0x7f7fe0140f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fd7fff700 1 -- 172.21.15.29:0/1281978860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009420 con 0x7f7fe00c8830 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.189+0000 7f7fe56c3700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fe0156c30 0x7f7fe01570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fd7fff700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8830 0x7f7fe00c3bf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0002000 tx=0x7f7fd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fd4ff9700 1 -- 172.21.15.29:0/1281978860 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0010b30 con 0x7f7fe00c8830 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fd4ff9700 1 -- 172.21.15.29:0/1281978860 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0010c90 con 0x7f7fe00c8830 2023-10-06T05:29:42.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe0167e60 con 0x7f7fe00c8830 2023-10-06T05:29:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fd4ff9700 1 -- 172.21.15.29:0/1281978860 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd001d680 con 0x7f7fe00c8830 2023-10-06T05:29:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe01683f0 con 0x7f7fe00c8830 2023-10-06T05:29:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe004be00 con 0x7f7fe00c8830 2023-10-06T05:29:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fd4ff9700 1 -- 172.21.15.29:0/1281978860 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7fd001d9f0 con 0x7f7fe00c8830 2023-10-06T05:29:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fd4ff9700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fcc060550 0x7f7fcc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fd4ff9700 1 -- 172.21.15.29:0/1281978860 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f7fd007e5e0 con 0x7f7fe00c8830 2023-10-06T05:29:42.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.193+0000 7f7fe4ec2700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fcc060550 0x7f7fcc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.197+0000 7f7fe4ec2700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fcc060550 0x7f7fcc062a00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0011e0 tx=0x7f7fdc000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:42.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.201+0000 7f7fd4ff9700 1 -- 172.21.15.29:0/1281978860 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7fd004e930 con 0x7f7fe00c8830 2023-10-06T05:29:42.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.397+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7fe0168e60 con 0x7f7fe00c8830 2023-10-06T05:29:42.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.581+0000 7f7fd4ff9700 1 -- 172.21.15.29:0/1281978860 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7fd0051f50 con 0x7f7fe00c8830 2023-10-06T05:29:42.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fcc060550 msgr2=0x7f7fcc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fcc060550 0x7f7fcc062a00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0011e0 tx=0x7f7fdc000bc0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8830 msgr2=0x7f7fe00c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8830 0x7f7fe00c3bf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0002000 tx=0x7f7fd0017000 comp rx=0 tx=0).stop 2023-10-06T05:29:42.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 shutdown_connections 2023-10-06T05:29:42.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fe0156c30 0x7f7fe01570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe00c8830 0x7f7fe00c3bf0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7fcc060550 0x7f7fcc062a00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 --2- 172.21.15.29:0/1281978860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fe00683c0 0x7f7fe0140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 >> 172.21.15.29:0/1281978860 conn(0x7f7fe006abc0 msgr2=0x7f7fe00caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 shutdown_connections 2023-10-06T05:29:42.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.585+0000 7f7fe5ec4700 1 -- 172.21.15.29:0/1281978860 wait complete. 2023-10-06T05:29:42.594 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T05:29:42.609 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T05:29:42.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f08954700 1 Processor -- start 2023-10-06T05:29:42.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f08954700 1 -- start start 2023-10-06T05:29:42.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f08954700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3f04158c40 0x7f3f040d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f08954700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f04159010 0x7f3f0406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f08954700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f040cae30 con 0x7f3f040ce320 2023-10-06T05:29:42.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f08954700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0406ba70 con 0x7f3f04159010 2023-10-06T05:29:42.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f08954700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0406b1e0 con 0x7f3f04158c40 2023-10-06T05:29:42.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f02ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f04159010 0x7f3f0406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f02ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f04159010 0x7f3f0406aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40110/0 (socket says 172.21.15.29:40110) 2023-10-06T05:29:42.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f02ffd700 1 -- 172.21.15.29:0/2558465329 learned_addr learned my addr 172.21.15.29:0/2558465329 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:42.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f037fe700 1 --2- 172.21.15.29:0/2558465329 >> v2:172.21.15.173:3300/0 conn(0x7f3f04158c40 0x7f3f040d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f02ffd700 1 -- 172.21.15.29:0/2558465329 >> v2:172.21.15.173:3300/0 conn(0x7f3f04158c40 msgr2=0x7f3f040d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:42.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f02ffd700 1 --2- 172.21.15.29:0/2558465329 >> v2:172.21.15.173:3300/0 conn(0x7f3f04158c40 0x7f3f040d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f02ffd700 1 -- 172.21.15.29:0/2558465329 >> v1:172.21.15.173:6789/0 conn(0x7f3f040ce320 legacy=0x7f3f0415ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f02ffd700 1 -- 172.21.15.29:0/2558465329 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0406b4b0 con 0x7f3f04159010 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.717+0000 7f3f02ffd700 1 --2- 172.21.15.29:0/2558465329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 0x7f3f0406aca0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3f040cd8b0 tx=0x7f3ef8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adc7dd9f8244267 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f027fc700 1 -- 172.21.15.29:0/2558465329 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef800b860 con 0x7f3f04159010 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f027fc700 1 -- 172.21.15.29:0/2558465329 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef800b9c0 con 0x7f3f04159010 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f027fc700 1 -- 172.21.15.29:0/2558465329 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef800bd60 con 0x7f3f04159010 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 -- 172.21.15.29:0/2558465329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 msgr2=0x7f3f0406aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 --2- 172.21.15.29:0/2558465329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 0x7f3f0406aca0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3f040cd8b0 tx=0x7f3ef8009250 comp rx=0 tx=0).stop 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 -- 172.21.15.29:0/2558465329 shutdown_connections 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 --2- 172.21.15.29:0/2558465329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 0x7f3f0406aca0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 --2- 172.21.15.29:0/2558465329 >> v2:172.21.15.173:3300/0 conn(0x7f3f04158c40 0x7f3f040d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 -- 172.21.15.29:0/2558465329 >> 172.21.15.29:0/2558465329 conn(0x7f3f040670a0 msgr2=0x7f3f040674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 -- 172.21.15.29:0/2558465329 shutdown_connections 2023-10-06T05:29:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 -- 172.21.15.29:0/2558465329 wait complete. 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 Processor -- start 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.721+0000 7f3f08954700 1 -- start start 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f08954700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f040ce320 0x7f3f040c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f08954700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f04158c40 0x7f3f0415cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f08954700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 0x7f3f0415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f08954700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0415d2a0 con 0x7f3f04159010 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f08954700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0415d540 con 0x7f3f040ce320 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f08954700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0415d820 con 0x7f3f04158c40 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f03fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 0x7f3f0415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f03fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 0x7f3f0415aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40124/0 (socket says 172.21.15.29:40124) 2023-10-06T05:29:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f03fff700 1 -- 172.21.15.29:0/4197534748 learned_addr learned my addr 172.21.15.29:0/4197534748 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f037fe700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f040ce320 0x7f3f040c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f02ffd700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f04158c40 0x7f3f0415cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f03fff700 1 -- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f04158c40 msgr2=0x7f3f0415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f03fff700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f04158c40 0x7f3f0415cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f03fff700 1 -- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f040ce320 msgr2=0x7f3f040c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f03fff700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f040ce320 0x7f3f040c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f03fff700 1 -- 172.21.15.29:0/4197534748 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80094f0 con 0x7f3f04159010 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f037fe700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f040ce320 0x7f3f040c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f03fff700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 0x7f3f0415aef0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00c8e0 tx=0x7f3efc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3eeb7fe700 1 -- 172.21.15.29:0/4197534748 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc012630 con 0x7f3f04159010 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3eeb7fe700 1 -- 172.21.15.29:0/4197534748 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc012790 con 0x7f3f04159010 2023-10-06T05:29:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3eeb7fe700 1 -- 172.21.15.29:0/4197534748 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc012b50 con 0x7f3f04159010 2023-10-06T05:29:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0415db00 con 0x7f3f04159010 2023-10-06T05:29:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0415e0c0 con 0x7f3f04159010 2023-10-06T05:29:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.725+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0415e2b0 con 0x7f3f04159010 2023-10-06T05:29:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.729+0000 7f3eeb7fe700 1 -- 172.21.15.29:0/4197534748 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3efc00a3b0 con 0x7f3f04159010 2023-10-06T05:29:42.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.729+0000 7f3eeb7fe700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3ef0060550 0x7f3ef0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:42.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.729+0000 7f3eeb7fe700 1 -- 172.21.15.29:0/4197534748 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f3efc07cd40 con 0x7f3f04159010 2023-10-06T05:29:42.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.729+0000 7f3f037fe700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3ef0060550 0x7f3ef0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:42.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.729+0000 7f3f037fe700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3ef0060550 0x7f3ef0062a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4006fd0 tx=0x7f3ef4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:42.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.737+0000 7f3eeb7fe700 1 -- 172.21.15.29:0/4197534748 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3efc04d090 con 0x7f3f04159010 2023-10-06T05:29:42.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:42.937+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3f0404be00 con 0x7f3f04159010 2023-10-06T05:29:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.601+0000 7f3eeb7fe700 1 -- 172.21.15.29:0/4197534748 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3efc0506b0 con 0x7f3f04159010 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3ef0060550 msgr2=0x7f3ef0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3ef0060550 0x7f3ef0062a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4006fd0 tx=0x7f3ef4008040 comp rx=0 tx=0).stop 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 msgr2=0x7f3f0415aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 0x7f3f0415aef0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00c8e0 tx=0x7f3efc001710 comp rx=0 tx=0).stop 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 shutdown_connections 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f04159010 0x7f3f0415aef0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f04158c40 0x7f3f0415cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3ef0060550 0x7f3ef0062a00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 --2- 172.21.15.29:0/4197534748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f040ce320 0x7f3f040c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 >> 172.21.15.29:0/4197534748 conn(0x7f3f040670a0 msgr2=0x7f3f040d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:43.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 shutdown_connections 2023-10-06T05:29:43.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.605+0000 7f3f08954700 1 -- 172.21.15.29:0/4197534748 wait complete. 2023-10-06T05:29:43.626 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T05:29:43.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fe4a0700 1 Processor -- start 2023-10-06T05:29:43.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fe4a0700 1 -- start start 2023-10-06T05:29:43.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fe4a0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21f8156f20 0x7f21f80ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:43.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fe4a0700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f21f80cabd0 0x7f21f80ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:43.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fe4a0700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80cb030 con 0x7f21f8156b50 2023-10-06T05:29:43.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fe4a0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80c4380 con 0x7f21f8156f20 2023-10-06T05:29:43.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fe4a0700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80c4810 con 0x7f21f80cabd0 2023-10-06T05:29:43.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fcc9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21f8156f20 0x7f21f80ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:43.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fcc9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21f8156f20 0x7f21f80ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40140/0 (socket says 172.21.15.29:40140) 2023-10-06T05:29:43.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fcc9d700 1 -- 172.21.15.29:0/2293892083 learned_addr learned my addr 172.21.15.29:0/2293892083 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:43.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.741+0000 7f21fdc9f700 1 --2- 172.21.15.29:0/2293892083 >> v2:172.21.15.173:3300/0 conn(0x7f21f80cabd0 0x7f21f80ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:43.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fcc9d700 1 -- 172.21.15.29:0/2293892083 >> v2:172.21.15.173:3300/0 conn(0x7f21f80cabd0 msgr2=0x7f21f80ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:43.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fcc9d700 1 --2- 172.21.15.29:0/2293892083 >> v2:172.21.15.173:3300/0 conn(0x7f21f80cabd0 0x7f21f80ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:43.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fcc9d700 1 -- 172.21.15.29:0/2293892083 >> v1:172.21.15.173:6789/0 conn(0x7f21f8156b50 legacy=0x7f21f80c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:43.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fcc9d700 1 -- 172.21.15.29:0/2293892083 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f80c3770 con 0x7f21f8156f20 2023-10-06T05:29:43.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fcc9d700 1 --2- 172.21.15.29:0/2293892083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f8156f20 0x7f21f80ca690 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f21f806ce80 tx=0x7f21e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15125107f6c2db94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21effff700 1 -- 172.21.15.29:0/2293892083 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8009e70 con 0x7f21f8156f20 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21effff700 1 -- 172.21.15.29:0/2293892083 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800b860 con 0x7f21f8156f20 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21effff700 1 -- 172.21.15.29:0/2293892083 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800bc00 con 0x7f21f8156f20 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fe4a0700 1 -- 172.21.15.29:0/2293892083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f8156f20 msgr2=0x7f21f80ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fe4a0700 1 --2- 172.21.15.29:0/2293892083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f8156f20 0x7f21f80ca690 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f21f806ce80 tx=0x7f21e8009250 comp rx=0 tx=0).stop 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fe4a0700 1 -- 172.21.15.29:0/2293892083 shutdown_connections 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fe4a0700 1 --2- 172.21.15.29:0/2293892083 >> v2:172.21.15.173:3300/0 conn(0x7f21f80cabd0 0x7f21f80ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fe4a0700 1 --2- 172.21.15.29:0/2293892083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f8156f20 0x7f21f80ca690 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fe4a0700 1 -- 172.21.15.29:0/2293892083 >> 172.21.15.29:0/2293892083 conn(0x7f21f8069d50 msgr2=0x7f21f806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fe4a0700 1 -- 172.21.15.29:0/2293892083 shutdown_connections 2023-10-06T05:29:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.745+0000 7f21fe4a0700 1 -- 172.21.15.29:0/2293892083 wait complete. 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 Processor -- start 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 -- start start 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f80cabd0 0x7f21f80c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f8156b50 0x7f21f81478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21f8156f20 0x7f21f8154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8154390 con 0x7f21f80cabd0 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80c5280 con 0x7f21f8156b50 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80c8010 con 0x7f21f8156f20 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fd49e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f80cabd0 0x7f21f80c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:43.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fd49e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f80cabd0 0x7f21f80c4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40156/0 (socket says 172.21.15.29:40156) 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fd49e700 1 -- 172.21.15.29:0/1263471017 learned_addr learned my addr 172.21.15.29:0/1263471017 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fdc9f700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21f8156f20 0x7f21f8154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fcc9d700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f8156b50 0x7f21f81478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fd49e700 1 -- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21f8156f20 msgr2=0x7f21f8154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fd49e700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21f8156f20 0x7f21f8154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fd49e700 1 -- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f8156b50 msgr2=0x7f21f81478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fd49e700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f8156b50 0x7f21f81478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fd49e700 1 -- 172.21.15.29:0/1263471017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80094f0 con 0x7f21f80cabd0 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fd49e700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f80cabd0 0x7f21f80c4d40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f21f400cb40 tx=0x7f21f40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21ed7fa700 1 -- 172.21.15.29:0/1263471017 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f400a7a0 con 0x7f21f80cabd0 2023-10-06T05:29:43.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21ed7fa700 1 -- 172.21.15.29:0/1263471017 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f400a920 con 0x7f21f80cabd0 2023-10-06T05:29:43.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f8147e20 con 0x7f21f80cabd0 2023-10-06T05:29:43.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21ed7fa700 1 -- 172.21.15.29:0/1263471017 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f400ace0 con 0x7f21f80cabd0 2023-10-06T05:29:43.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.749+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f8167ab0 con 0x7f21f80cabd0 2023-10-06T05:29:43.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.753+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f804be00 con 0x7f21f80cabd0 2023-10-06T05:29:43.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.753+0000 7f21ed7fa700 1 -- 172.21.15.29:0/1263471017 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f21f4003030 con 0x7f21f80cabd0 2023-10-06T05:29:43.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.753+0000 7f21ed7fa700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f21dc060550 0x7f21dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:43.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.753+0000 7f21ed7fa700 1 -- 172.21.15.29:0/1263471017 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f21f407ca20 con 0x7f21f80cabd0 2023-10-06T05:29:43.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.753+0000 7f21fcc9d700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f21dc060550 0x7f21dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:43.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.757+0000 7f21fcc9d700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f21dc060550 0x7f21dc062a00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f21f806ce80 tx=0x7f21e8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:43.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.761+0000 7f21ed7fa700 1 -- 172.21.15.29:0/1263471017 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f21f404ccd0 con 0x7f21f80cabd0 2023-10-06T05:29:43.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:43.917+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21f80cb030 con 0x7f21f80cabd0 2023-10-06T05:29:44.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.604+0000 7f21ed7fa700 1 -- 172.21.15.29:0/1263471017 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) v1 ==== 181+0+0 (secure 0 0 0) 0x7f21f80cb030 con 0x7f21f80cabd0 2023-10-06T05:29:44.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f21dc060550 msgr2=0x7f21dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:44.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f21dc060550 0x7f21dc062a00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f21f806ce80 tx=0x7f21e8017000 comp rx=0 tx=0).stop 2023-10-06T05:29:44.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f80cabd0 msgr2=0x7f21f80c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:44.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f80cabd0 0x7f21f80c4d40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f21f400cb40 tx=0x7f21f40017b0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 shutdown_connections 2023-10-06T05:29:44.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21f8156f20 0x7f21f8154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f21dc060550 0x7f21dc062a00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f8156b50 0x7f21f81478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 --2- 172.21.15.29:0/1263471017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f80cabd0 0x7f21f80c4d40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 >> 172.21.15.29:0/1263471017 conn(0x7f21f8069d50 msgr2=0x7f21f8155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:44.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 shutdown_connections 2023-10-06T05:29:44.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.612+0000 7f21fe4a0700 1 -- 172.21.15.29:0/1263471017 wait complete. 2023-10-06T05:29:44.620 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2023-10-06T05:29:44.634 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T05:29:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.740+0000 7f52b0931700 1 Processor -- start 2023-10-06T05:29:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.740+0000 7f52b0931700 1 -- start start 2023-10-06T05:29:44.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52ac159010 0x7f52ac0d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:44.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52ac0ce320 0x7f52ac0ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:44.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac0cae30 con 0x7f52ac158c40 2023-10-06T05:29:44.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac0cecb0 con 0x7f52ac0ce320 2023-10-06T05:29:44.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac06ba70 con 0x7f52ac159010 2023-10-06T05:29:44.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52aad9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f52ac158c40 0x7f52ac06aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49420/0 (socket says 172.21.15.29:49420) 2023-10-06T05:29:44.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52aad9d700 1 -- 172.21.15.29:0/1221857287 learned_addr learned my addr 172.21.15.29:0/1221857287 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:44.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52ab59e700 1 --2- 172.21.15.29:0/1221857287 >> v2:172.21.15.29:3300/0 conn(0x7f52ac0ce320 0x7f52ac0ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:44.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52aa59c700 1 --2- 172.21.15.29:0/1221857287 >> v2:172.21.15.173:3300/0 conn(0x7f52ac159010 0x7f52ac0d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:44.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52a9d9b700 1 -- 172.21.15.29:0/1221857287 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484089952 0 0) 0x7f52ac0cae30 con 0x7f52ac158c40 2023-10-06T05:29:44.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52a9d9b700 1 -- 172.21.15.29:0/1221857287 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5298003570 con 0x7f52ac158c40 2023-10-06T05:29:44.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52ab59e700 1 -- 172.21.15.29:0/1221857287 >> v2:172.21.15.173:3300/0 conn(0x7f52ac159010 msgr2=0x7f52ac0d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:44.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52ab59e700 1 --2- 172.21.15.29:0/1221857287 >> v2:172.21.15.173:3300/0 conn(0x7f52ac159010 0x7f52ac0d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52ab59e700 1 -- 172.21.15.29:0/1221857287 >> v1:172.21.15.29:6789/0 conn(0x7f52ac158c40 legacy=0x7f52ac06aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:44.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52ab59e700 1 -- 172.21.15.29:0/1221857287 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac06b4b0 con 0x7f52ac0ce320 2023-10-06T05:29:44.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52ab59e700 1 --2- 172.21.15.29:0/1221857287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 0x7f52ac0ce770 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f52ac069b10 tx=0x7f52a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d4a351cb0beac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:44.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52a9d9b700 1 -- 172.21.15.29:0/1221857287 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a400e070 con 0x7f52ac0ce320 2023-10-06T05:29:44.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52a9d9b700 1 -- 172.21.15.29:0/1221857287 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a400bab0 con 0x7f52ac0ce320 2023-10-06T05:29:44.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52a9d9b700 1 -- 172.21.15.29:0/1221857287 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a400be70 con 0x7f52ac0ce320 2023-10-06T05:29:44.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 -- 172.21.15.29:0/1221857287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 msgr2=0x7f52ac0ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:44.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 --2- 172.21.15.29:0/1221857287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 0x7f52ac0ce770 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f52ac069b10 tx=0x7f52a4009780 comp rx=0 tx=0).stop 2023-10-06T05:29:44.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 -- 172.21.15.29:0/1221857287 shutdown_connections 2023-10-06T05:29:44.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 --2- 172.21.15.29:0/1221857287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 0x7f52ac0ce770 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 --2- 172.21.15.29:0/1221857287 >> v2:172.21.15.173:3300/0 conn(0x7f52ac159010 0x7f52ac0d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 -- 172.21.15.29:0/1221857287 >> 172.21.15.29:0/1221857287 conn(0x7f52ac0670a0 msgr2=0x7f52ac0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:44.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 -- 172.21.15.29:0/1221857287 shutdown_connections 2023-10-06T05:29:44.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.744+0000 7f52b0931700 1 -- 172.21.15.29:0/1221857287 wait complete. 2023-10-06T05:29:44.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 Processor -- start 2023-10-06T05:29:44.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 -- start start 2023-10-06T05:29:44.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 0x7f52ac151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:44.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52ac158c40 0x7f52ac147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:44.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52ac159010 0x7f52ac15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:44.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac151b40 con 0x7f52ac0ce320 2023-10-06T05:29:44.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac150f30 con 0x7f52ac159010 2023-10-06T05:29:44.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac151210 con 0x7f52ac158c40 2023-10-06T05:29:44.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 0x7f52ac151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:44.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 0x7f52ac151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59980/0 (socket says 172.21.15.29:59980) 2023-10-06T05:29:44.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aad9d700 1 -- 172.21.15.29:0/3387757089 learned_addr learned my addr 172.21.15.29:0/3387757089 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:44.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52ab59e700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52ac159010 0x7f52ac15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:44.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aa59c700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52ac158c40 0x7f52ac147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:44.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aad9d700 1 -- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52ac158c40 msgr2=0x7f52ac147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aad9d700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52ac158c40 0x7f52ac147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aad9d700 1 -- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52ac159010 msgr2=0x7f52ac15ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aad9d700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52ac159010 0x7f52ac15ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aad9d700 1 -- 172.21.15.29:0/3387757089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4009a20 con 0x7f52ac0ce320 2023-10-06T05:29:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52ab59e700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52ac159010 0x7f52ac15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52aad9d700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 0x7f52ac151fd0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c7c0 tx=0x7f529c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:44.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52a2ffd700 1 -- 172.21.15.29:0/3387757089 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c005b30 con 0x7f52ac0ce320 2023-10-06T05:29:44.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52a2ffd700 1 -- 172.21.15.29:0/3387757089 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c005c90 con 0x7f52ac0ce320 2023-10-06T05:29:44.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ac1514f0 con 0x7f52ac0ce320 2023-10-06T05:29:44.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52a2ffd700 1 -- 172.21.15.29:0/3387757089 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c007340 con 0x7f52ac0ce320 2023-10-06T05:29:44.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.748+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac148060 con 0x7f52ac0ce320 2023-10-06T05:29:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.752+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac04be00 con 0x7f52ac0ce320 2023-10-06T05:29:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.752+0000 7f52a2ffd700 1 -- 172.21.15.29:0/3387757089 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f529c01b400 con 0x7f52ac0ce320 2023-10-06T05:29:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.752+0000 7f52a2ffd700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f528c060550 0x7f528c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.752+0000 7f52a2ffd700 1 -- 172.21.15.29:0/3387757089 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5908+0+0 (secure 0 0 0) 0x7f529c07c430 con 0x7f52ac0ce320 2023-10-06T05:29:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.752+0000 7f52aa59c700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f528c060550 0x7f528c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:44.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.756+0000 7f52aa59c700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f528c060550 0x7f528c062a00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f52ac15c770 tx=0x7f5294008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:44.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.760+0000 7f52a2ffd700 1 -- 172.21.15.29:0/3387757089 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f529c04c9d0 con 0x7f52ac0ce320 2023-10-06T05:29:44.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:44.928+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52ac06b790 con 0x7f52ac0ce320 2023-10-06T05:29:45.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.624+0000 7f52a2ffd700 1 -- 172.21.15.29:0/3387757089 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) v1 ==== 169+0+0 (secure 0 0 0) 0x7f529c04fff0 con 0x7f52ac0ce320 2023-10-06T05:29:45.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f528c060550 msgr2=0x7f528c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f528c060550 0x7f528c062a00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f52ac15c770 tx=0x7f5294008040 comp rx=0 tx=0).stop 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 msgr2=0x7f52ac151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 0x7f52ac151fd0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c7c0 tx=0x7f529c007e00 comp rx=0 tx=0).stop 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 shutdown_connections 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f528c060550 0x7f528c062a00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52ac159010 0x7f52ac15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52ac158c40 0x7f52ac147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 --2- 172.21.15.29:0/3387757089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52ac0ce320 0x7f52ac151fd0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 >> 172.21.15.29:0/3387757089 conn(0x7f52ac0670a0 msgr2=0x7f52ac0c63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 shutdown_connections 2023-10-06T05:29:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.632+0000 7f52b0931700 1 -- 172.21.15.29:0/3387757089 wait complete. 2023-10-06T05:29:45.638 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2023-10-06T05:29:45.654 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T05:29:45.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.768+0000 7f4a2e1d5700 1 Processor -- start 2023-10-06T05:29:45.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.768+0000 7f4a2e1d5700 1 -- start start 2023-10-06T05:29:45.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4a281569e0 0x7f4a28156db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:45.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a280cc200 0x7f4a280ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:45.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2806b200 con 0x7f4a280c6ca0 2023-10-06T05:29:45.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2806a5f0 con 0x7f4a280cc200 2023-10-06T05:29:45.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2806a8d0 con 0x7f4a281569e0 2023-10-06T05:29:45.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a27fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a280cc200 0x7f4a280ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:45.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a1effd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4a280c6ca0 0x7f4a280cbaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49426/0 (socket says 172.21.15.29:49426) 2023-10-06T05:29:45.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a1effd700 1 -- 172.21.15.29:0/27681189 learned_addr learned my addr 172.21.15.29:0/27681189 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:45.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a277fe700 1 --2- 172.21.15.29:0/27681189 >> v2:172.21.15.173:3300/0 conn(0x7f4a281569e0 0x7f4a28156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:45.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a27fff700 1 -- 172.21.15.29:0/27681189 >> v2:172.21.15.173:3300/0 conn(0x7f4a281569e0 msgr2=0x7f4a28156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:45.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a27fff700 1 --2- 172.21.15.29:0/27681189 >> v2:172.21.15.173:3300/0 conn(0x7f4a281569e0 0x7f4a28156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a27fff700 1 -- 172.21.15.29:0/27681189 >> v1:172.21.15.29:6789/0 conn(0x7f4a280c6ca0 legacy=0x7f4a280cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:45.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a26ffd700 1 -- 172.21.15.29:0/27681189 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596479865 0 0) 0x7f4a2806b200 con 0x7f4a280c6ca0 2023-10-06T05:29:45.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a27fff700 1 -- 172.21.15.29:0/27681189 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2806abb0 con 0x7f4a280cc200 2023-10-06T05:29:45.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a27fff700 1 --2- 172.21.15.29:0/27681189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 0x7f4a280ab880 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4a280ccba0 tx=0x7f4a20009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffee17ccd104a0ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:45.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a26ffd700 1 -- 172.21.15.29:0/27681189 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000e070 con 0x7f4a280cc200 2023-10-06T05:29:45.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a26ffd700 1 -- 172.21.15.29:0/27681189 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2000bb60 con 0x7f4a280cc200 2023-10-06T05:29:45.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a26ffd700 1 -- 172.21.15.29:0/27681189 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20012430 con 0x7f4a280cc200 2023-10-06T05:29:45.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/27681189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 msgr2=0x7f4a280ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:45.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 --2- 172.21.15.29:0/27681189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 0x7f4a280ab880 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4a280ccba0 tx=0x7f4a20009780 comp rx=0 tx=0).stop 2023-10-06T05:29:45.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/27681189 shutdown_connections 2023-10-06T05:29:45.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 --2- 172.21.15.29:0/27681189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 0x7f4a280ab880 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 --2- 172.21.15.29:0/27681189 >> v2:172.21.15.173:3300/0 conn(0x7f4a281569e0 0x7f4a28156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/27681189 >> 172.21.15.29:0/27681189 conn(0x7f4a280670a0 msgr2=0x7f4a280674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:45.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/27681189 shutdown_connections 2023-10-06T05:29:45.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.772+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/27681189 wait complete. 2023-10-06T05:29:45.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a2e1d5700 1 Processor -- start 2023-10-06T05:29:45.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a2e1d5700 1 -- start start 2023-10-06T05:29:45.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a2e1d5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a280c6ca0 0x7f4a28169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:45.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a2e1d5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 0x7f4a280c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:45.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a2e1d5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a281569e0 0x7f4a28146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:45.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a2e1d5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280cab20 con 0x7f4a280cc200 2023-10-06T05:29:45.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a2e1d5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280c9c70 con 0x7f4a280c6ca0 2023-10-06T05:29:45.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a2e1d5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280c9f10 con 0x7f4a281569e0 2023-10-06T05:29:45.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a1effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 0x7f4a280c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:45.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a1effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 0x7f4a280c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60002/0 (socket says 172.21.15.29:60002) 2023-10-06T05:29:45.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a1effd700 1 -- 172.21.15.29:0/2479510604 learned_addr learned my addr 172.21.15.29:0/2479510604 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:45.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a277fe700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a280c6ca0 0x7f4a28169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:45.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a27fff700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a281569e0 0x7f4a28146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:45.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a1effd700 1 -- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a281569e0 msgr2=0x7f4a28146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:45.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a1effd700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a281569e0 0x7f4a28146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a1effd700 1 -- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a280c6ca0 msgr2=0x7f4a28169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:45.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a1effd700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a280c6ca0 0x7f4a28169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.776+0000 7f4a1effd700 1 -- 172.21.15.29:0/2479510604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a20009a20 con 0x7f4a280cc200 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a1effd700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 0x7f4a280c9730 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c7e0 tx=0x7f4a10007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a1ffff700 1 -- 172.21.15.29:0/2479510604 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10005b30 con 0x7f4a280cc200 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a1ffff700 1 -- 172.21.15.29:0/2479510604 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10005c90 con 0x7f4a280cc200 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a280ca1f0 con 0x7f4a280cc200 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a1ffff700 1 -- 172.21.15.29:0/2479510604 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10007300 con 0x7f4a280cc200 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a280ca7b0 con 0x7f4a280cc200 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a1ffff700 1 -- 172.21.15.29:0/2479510604 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4a1001b3b0 con 0x7f4a280cc200 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a28071120 con 0x7f4a280cc200 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a1ffff700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a08060550 0x7f4a08062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:45.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a1ffff700 1 -- 172.21.15.29:0/2479510604 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f4a1007bbd0 con 0x7f4a280cc200 2023-10-06T05:29:45.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a277fe700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a08060550 0x7f4a08062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:45.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.780+0000 7f4a277fe700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a08060550 0x7f4a08062a00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009d10 tx=0x7f4a180091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:45.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.788+0000 7f4a1ffff700 1 -- 172.21.15.29:0/2479510604 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4a1004c300 con 0x7f4a280cc200 2023-10-06T05:29:45.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.952+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4a2806ae90 con 0x7f4a280cc200 2023-10-06T05:29:45.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.960+0000 7f4a1ffff700 1 -- 172.21.15.29:0/2479510604 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a10001d60 con 0x7f4a280cc200 2023-10-06T05:29:45.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a08060550 msgr2=0x7f4a08062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a08060550 0x7f4a08062a00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009d10 tx=0x7f4a180091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 msgr2=0x7f4a280c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 0x7f4a280c9730 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c7e0 tx=0x7f4a10007df0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 shutdown_connections 2023-10-06T05:29:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a281569e0 0x7f4a28146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a280cc200 0x7f4a280c9730 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4a08060550 0x7f4a08062a00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 --2- 172.21.15.29:0/2479510604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a280c6ca0 0x7f4a28169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 >> 172.21.15.29:0/2479510604 conn(0x7f4a280670a0 msgr2=0x7f4a280c0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 shutdown_connections 2023-10-06T05:29:45.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:45.964+0000 7f4a2e1d5700 1 -- 172.21.15.29:0/2479510604 wait complete. 2023-10-06T05:29:45.983 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2023-10-06T05:29:46.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265f492700 1 Processor -- start 2023-10-06T05:29:46.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265f492700 1 -- start start 2023-10-06T05:29:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265f492700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2658158ac0 0x7f2658158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265f492700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f26580c9710 0x7f265815c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265f492700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26580cc8d0 con 0x7f265815d700 2023-10-06T05:29:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265f492700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26580c8950 con 0x7f2658158ac0 2023-10-06T05:29:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265f492700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26580c8c30 con 0x7f26580c9710 2023-10-06T05:29:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265e490700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2658158ac0 0x7f2658158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265e490700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2658158ac0 0x7f2658158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60004/0 (socket says 172.21.15.29:60004) 2023-10-06T05:29:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265e490700 1 -- 172.21.15.29:0/1560578303 learned_addr learned my addr 172.21.15.29:0/1560578303 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265ec91700 1 --2- 172.21.15.29:0/1560578303 >> v2:172.21.15.173:3300/0 conn(0x7f26580c9710 0x7f265815c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265d48e700 1 -- 172.21.15.29:0/1560578303 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745708628 0 0) 0x7f26580cc8d0 con 0x7f265815d700 2023-10-06T05:29:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265e490700 1 -- 172.21.15.29:0/1560578303 >> v2:172.21.15.173:3300/0 conn(0x7f26580c9710 msgr2=0x7f265815c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265e490700 1 --2- 172.21.15.29:0/1560578303 >> v2:172.21.15.173:3300/0 conn(0x7f26580c9710 0x7f265815c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265e490700 1 -- 172.21.15.29:0/1560578303 >> v1:172.21.15.173:6789/0 conn(0x7f265815d700 legacy=0x7f26580cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265e490700 1 -- 172.21.15.29:0/1560578303 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26580c8f10 con 0x7f2658158ac0 2023-10-06T05:29:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.088+0000 7f265e490700 1 --2- 172.21.15.29:0/1560578303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 0x7f2658158e90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f26580c81b0 tx=0x7f2654009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9ef36bd28612fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265d48e700 1 -- 172.21.15.29:0/1560578303 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654009e70 con 0x7f2658158ac0 2023-10-06T05:29:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265d48e700 1 -- 172.21.15.29:0/1560578303 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265400b860 con 0x7f2658158ac0 2023-10-06T05:29:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265d48e700 1 -- 172.21.15.29:0/1560578303 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400bc20 con 0x7f2658158ac0 2023-10-06T05:29:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 -- 172.21.15.29:0/1560578303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 msgr2=0x7f2658158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 --2- 172.21.15.29:0/1560578303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 0x7f2658158e90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f26580c81b0 tx=0x7f2654009250 comp rx=0 tx=0).stop 2023-10-06T05:29:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 -- 172.21.15.29:0/1560578303 shutdown_connections 2023-10-06T05:29:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 --2- 172.21.15.29:0/1560578303 >> v2:172.21.15.173:3300/0 conn(0x7f26580c9710 0x7f265815c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 --2- 172.21.15.29:0/1560578303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 0x7f2658158e90 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 -- 172.21.15.29:0/1560578303 >> 172.21.15.29:0/1560578303 conn(0x7f2658069d80 msgr2=0x7f265806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 -- 172.21.15.29:0/1560578303 shutdown_connections 2023-10-06T05:29:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 -- 172.21.15.29:0/1560578303 wait complete. 2023-10-06T05:29:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 Processor -- start 2023-10-06T05:29:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.092+0000 7f265f492700 1 -- start start 2023-10-06T05:29:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265f492700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26580c9710 0x7f26580c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265f492700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 0x7f26581507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265f492700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f265815d700 0x7f265814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265f492700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26580c51d0 con 0x7f2658158ac0 2023-10-06T05:29:46.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265f492700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26580c5480 con 0x7f26580c9710 2023-10-06T05:29:46.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265f492700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26580c5760 con 0x7f265815d700 2023-10-06T05:29:46.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265dc8f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 0x7f26581507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265dc8f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 0x7f26581507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60014/0 (socket says 172.21.15.29:60014) 2023-10-06T05:29:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265dc8f700 1 -- 172.21.15.29:0/2553673053 learned_addr learned my addr 172.21.15.29:0/2553673053 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265e490700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26580c9710 0x7f26580c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265ec91700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f265815d700 0x7f265814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265dc8f700 1 -- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f265815d700 msgr2=0x7f265814b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265dc8f700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f265815d700 0x7f265814b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265dc8f700 1 -- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26580c9710 msgr2=0x7f26580c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265dc8f700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26580c9710 0x7f26580c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265dc8f700 1 -- 172.21.15.29:0/2553673053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26540094f0 con 0x7f2658158ac0 2023-10-06T05:29:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265e490700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26580c9710 0x7f26580c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265dc8f700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 0x7f26581507f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c530 tx=0x7f264c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f264a7fc700 1 -- 172.21.15.29:0/2553673053 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c011590 con 0x7f2658158ac0 2023-10-06T05:29:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f264a7fc700 1 -- 172.21.15.29:0/2553673053 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c011710 con 0x7f2658158ac0 2023-10-06T05:29:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f264a7fc700 1 -- 172.21.15.29:0/2553673053 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c011ad0 con 0x7f2658158ac0 2023-10-06T05:29:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26580c5a40 con 0x7f2658158ac0 2023-10-06T05:29:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26580c6000 con 0x7f2658158ac0 2023-10-06T05:29:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.096+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26580c61f0 con 0x7f2658158ac0 2023-10-06T05:29:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.100+0000 7f264a7fc700 1 -- 172.21.15.29:0/2553673053 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f264c01b3b0 con 0x7f2658158ac0 2023-10-06T05:29:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.100+0000 7f264a7fc700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f263c060580 0x7f263c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.100+0000 7f264a7fc700 1 -- 172.21.15.29:0/2553673053 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f264c07bb10 con 0x7f2658158ac0 2023-10-06T05:29:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.100+0000 7f265e490700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f263c060580 0x7f263c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.100+0000 7f265e490700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f263c060580 0x7f263c062a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f26580c81b0 tx=0x7f2654017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.104+0000 7f264a7fc700 1 -- 172.21.15.29:0/2553673053 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f264c04c240 con 0x7f2658158ac0 2023-10-06T05:29:46.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.324+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f265804be00 con 0x7f2658158ac0 2023-10-06T05:29:46.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.636+0000 7f264a7fc700 1 -- 172.21.15.29:0/2553673053 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v205) v1 ==== 146+0+0 (secure 0 0 0) 0x7f264c017020 con 0x7f2658158ac0 2023-10-06T05:29:46.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f263c060580 msgr2=0x7f263c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f263c060580 0x7f263c062a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f26580c81b0 tx=0x7f2654017000 comp rx=0 tx=0).stop 2023-10-06T05:29:46.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 msgr2=0x7f26581507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 0x7f26581507f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c530 tx=0x7f264c00c840 comp rx=0 tx=0).stop 2023-10-06T05:29:46.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 shutdown_connections 2023-10-06T05:29:46.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f265815d700 0x7f265814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2658158ac0 0x7f26581507f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f263c060580 0x7f263c062a30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 --2- 172.21.15.29:0/2553673053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26580c9710 0x7f26580c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 >> 172.21.15.29:0/2553673053 conn(0x7f2658069d80 msgr2=0x7f265806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:46.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 shutdown_connections 2023-10-06T05:29:46.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.640+0000 7f265f492700 1 -- 172.21.15.29:0/2553673053 wait complete. 2023-10-06T05:29:46.658 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-10-06T05:29:46.659 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-10-06T05:29:46.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2023-10-06T05:29:46.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.756+0000 7fbd2d805700 1 Processor -- start 2023-10-06T05:29:46.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.756+0000 7fbd2d805700 1 -- start start 2023-10-06T05:29:46.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.756+0000 7fbd2d805700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbd280c8100 0x7fbd2806ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.756+0000 7fbd2d805700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd28159bf0 con 0x7fbd2806e960 2023-10-06T05:29:46.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.756+0000 7fbd2d805700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd28156930 con 0x7fbd2815a080 2023-10-06T05:29:46.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.756+0000 7fbd2d805700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd281598c0 con 0x7fbd280c8100 2023-10-06T05:29:46.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.756+0000 7fbd26ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbd2806e960 0x7fbd28156220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49438/0 (socket says 172.21.15.29:49438) 2023-10-06T05:29:46.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.756+0000 7fbd26ffd700 1 -- 172.21.15.29:0/4201648772 learned_addr learned my addr 172.21.15.29:0/4201648772 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.756+0000 7fbd1ffff700 1 --2- 172.21.15.29:0/4201648772 >> v2:172.21.15.173:3300/0 conn(0x7fbd280c8100 0x7fbd2806ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd267fc700 1 -- 172.21.15.29:0/4201648772 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881447460 0 0) 0x7fbd28159bf0 con 0x7fbd2806e960 2023-10-06T05:29:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd267fc700 1 -- 172.21.15.29:0/4201648772 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd08003570 con 0x7fbd2806e960 2023-10-06T05:29:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd267fc700 1 -- 172.21.15.29:0/4201648772 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229470933 0 0) 0x7fbd28156930 con 0x7fbd2815a080 2023-10-06T05:29:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd267fc700 1 -- 172.21.15.29:0/4201648772 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd28159bf0 con 0x7fbd2815a080 2023-10-06T05:29:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd267fc700 1 -- 172.21.15.29:0/4201648772 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 289259910 0 0) 0x7fbd08003570 con 0x7fbd2806e960 2023-10-06T05:29:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd1ffff700 1 -- 172.21.15.29:0/4201648772 >> v1:172.21.15.173:6789/0 conn(0x7fbd2815a080 legacy=0x7fbd2814fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd1ffff700 1 -- 172.21.15.29:0/4201648772 >> v1:172.21.15.29:6789/0 conn(0x7fbd2806e960 legacy=0x7fbd28156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd1ffff700 1 -- 172.21.15.29:0/4201648772 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd28156b90 con 0x7fbd280c8100 2023-10-06T05:29:46.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd1ffff700 1 --2- 172.21.15.29:0/4201648772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 0x7fbd2806ed30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd100098e0 tx=0x7fbd100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f33f4886326b5461 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:46.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd267fc700 1 -- 172.21.15.29:0/4201648772 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18001470 con 0x7fbd280c8100 2023-10-06T05:29:46.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd267fc700 1 -- 172.21.15.29:0/4201648772 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10011420 con 0x7fbd280c8100 2023-10-06T05:29:46.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd267fc700 1 -- 172.21.15.29:0/4201648772 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100117c0 con 0x7fbd280c8100 2023-10-06T05:29:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd2d805700 1 -- 172.21.15.29:0/4201648772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 msgr2=0x7fbd2806ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd2d805700 1 --2- 172.21.15.29:0/4201648772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 0x7fbd2806ed30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd100098e0 tx=0x7fbd100091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd2d805700 1 -- 172.21.15.29:0/4201648772 shutdown_connections 2023-10-06T05:29:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd2d805700 1 --2- 172.21.15.29:0/4201648772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 0x7fbd2806ed30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd2d805700 1 -- 172.21.15.29:0/4201648772 >> 172.21.15.29:0/4201648772 conn(0x7fbd28067b70 msgr2=0x7fbd2806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:46.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd2d805700 1 -- 172.21.15.29:0/4201648772 shutdown_connections 2023-10-06T05:29:46.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.760+0000 7fbd2d805700 1 -- 172.21.15.29:0/4201648772 wait complete. 2023-10-06T05:29:46.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 Processor -- start 2023-10-06T05:29:46.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 -- start start 2023-10-06T05:29:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2806e960 0x7fbd28158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 0x7fbd2815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd2815a080 0x7fbd28150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2815c780 con 0x7fbd2806e960 2023-10-06T05:29:46.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28167640 con 0x7fbd280c8100 2023-10-06T05:29:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2815c4b0 con 0x7fbd2815a080 2023-10-06T05:29:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd26ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2806e960 0x7fbd28158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd1ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 0x7fbd2815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd1ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 0x7fbd2815bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:49148/0 (socket says 172.21.15.29:49148) 2023-10-06T05:29:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd1ffff700 1 -- 172.21.15.29:0/1826670514 learned_addr learned my addr 172.21.15.29:0/1826670514 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:46.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd277fe700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd2815a080 0x7fbd28150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd26ffd700 1 -- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd2815a080 msgr2=0x7fbd28150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd26ffd700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd2815a080 0x7fbd28150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd26ffd700 1 -- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 msgr2=0x7fbd2815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd26ffd700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 0x7fbd2815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd26ffd700 1 -- 172.21.15.29:0/1826670514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10009420 con 0x7fbd2806e960 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd1ffff700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 0x7fbd2815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd26ffd700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2806e960 0x7fbd28158010 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c7e0 tx=0x7fbd18001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd1effd700 1 -- 172.21.15.29:0/1826670514 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18007360 con 0x7fbd2806e960 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd1effd700 1 -- 172.21.15.29:0/1826670514 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180074e0 con 0x7fbd2806e960 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd280a8970 con 0x7fbd2806e960 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd1effd700 1 -- 172.21.15.29:0/1826670514 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18004830 con 0x7fbd2806e960 2023-10-06T05:29:46.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.764+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd280a8f30 con 0x7fbd2806e960 2023-10-06T05:29:46.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.768+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2804be00 con 0x7fbd2806e960 2023-10-06T05:29:46.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.768+0000 7fbd1effd700 1 -- 172.21.15.29:0/1826670514 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbd18004ba0 con 0x7fbd2806e960 2023-10-06T05:29:46.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.768+0000 7fbd1effd700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd0c060550 0x7fbd0c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:46.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.768+0000 7fbd1effd700 1 -- 172.21.15.29:0/1826670514 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fbd1807c610 con 0x7fbd2806e960 2023-10-06T05:29:46.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.768+0000 7fbd1ffff700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd0c060550 0x7fbd0c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:46.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.772+0000 7fbd1ffff700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd0c060550 0x7fbd0c062a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbd2816ad70 tx=0x7fbd10016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:46.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.776+0000 7fbd1effd700 1 -- 172.21.15.29:0/1826670514 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbd180507b0 con 0x7fbd2806e960 2023-10-06T05:29:47.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:46.996+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7fbd28069db0 con 0x7fbd2806e960 2023-10-06T05:29:47.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.640+0000 7fbd1effd700 1 -- 172.21.15.29:0/1826670514 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v206) v1 ==== 147+0+0 (secure 0 0 0) 0x7fbd18050340 con 0x7fbd2806e960 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd0c060550 msgr2=0x7fbd0c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd0c060550 0x7fbd0c062a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbd2816ad70 tx=0x7fbd10016000 comp rx=0 tx=0).stop 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2806e960 msgr2=0x7fbd28158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2806e960 0x7fbd28158010 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c7e0 tx=0x7fbd18001a30 comp rx=0 tx=0).stop 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 shutdown_connections 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd2815a080 0x7fbd28150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd0c060550 0x7fbd0c062a00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd280c8100 0x7fbd2815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 --2- 172.21.15.29:0/1826670514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd2806e960 0x7fbd28158010 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 >> 172.21.15.29:0/1826670514 conn(0x7fbd28067b70 msgr2=0x7fbd28153e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:47.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 shutdown_connections 2023-10-06T05:29:47.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.648+0000 7fbd2d805700 1 -- 172.21.15.29:0/1826670514 wait complete. 2023-10-06T05:29:47.669 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T05:29:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bf59e700 1 Processor -- start 2023-10-06T05:29:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bf59e700 1 -- start start 2023-10-06T05:29:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bf59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f08c006a370 0x7f08c00c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bf59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 0x7f08c00c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bf59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c006b540 con 0x7f08c0156870 2023-10-06T05:29:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bf59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c006a930 con 0x7f08c006a370 2023-10-06T05:29:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bf59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c006ac10 con 0x7f08c0156c40 2023-10-06T05:29:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08be59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f08c0156870 0x7f08c015b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49442/0 (socket says 172.21.15.29:49442) 2023-10-06T05:29:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08be59c700 1 -- 172.21.15.29:0/3386522307 learned_addr learned my addr 172.21.15.29:0/3386522307 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bdd9b700 1 --2- 172.21.15.29:0/3386522307 >> v2:172.21.15.173:3300/0 conn(0x7f08c006a370 0x7f08c00c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bed9d700 1 --2- 172.21.15.29:0/3386522307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 0x7f08c00c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:47.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.784+0000 7f08bd59a700 1 -- 172.21.15.29:0/3386522307 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265250708 0 0) 0x7f08c006b540 con 0x7f08c0156870 2023-10-06T05:29:47.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bd59a700 1 -- 172.21.15.29:0/3386522307 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a8003570 con 0x7f08c0156870 2023-10-06T05:29:47.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bdd9b700 1 -- 172.21.15.29:0/3386522307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 msgr2=0x7f08c00c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:47.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bdd9b700 1 --2- 172.21.15.29:0/3386522307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 0x7f08c00c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bdd9b700 1 -- 172.21.15.29:0/3386522307 >> v1:172.21.15.29:6789/0 conn(0x7f08c0156870 legacy=0x7f08c015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bd59a700 1 -- 172.21.15.29:0/3386522307 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3661152997 0 0) 0x7f08a8003570 con 0x7f08c0156870 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bdd9b700 1 -- 172.21.15.29:0/3386522307 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c006aef0 con 0x7f08c006a370 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bdd9b700 1 --2- 172.21.15.29:0/3386522307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c006a370 0x7f08c00c83e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009e60 tx=0x7f08b0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca9b6f1a1ae1d9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bd59a700 1 -- 172.21.15.29:0/3386522307 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b000e070 con 0x7f08c006a370 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bd59a700 1 -- 172.21.15.29:0/3386522307 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b000b7a0 con 0x7f08c006a370 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bd59a700 1 -- 172.21.15.29:0/3386522307 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4001470 con 0x7f08c006a370 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bf59e700 1 -- 172.21.15.29:0/3386522307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c006a370 msgr2=0x7f08c00c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bf59e700 1 --2- 172.21.15.29:0/3386522307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c006a370 0x7f08c00c83e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009e60 tx=0x7f08b0009780 comp rx=0 tx=0).stop 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bf59e700 1 -- 172.21.15.29:0/3386522307 shutdown_connections 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bf59e700 1 --2- 172.21.15.29:0/3386522307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 0x7f08c00c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bf59e700 1 --2- 172.21.15.29:0/3386522307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c006a370 0x7f08c00c83e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bf59e700 1 -- 172.21.15.29:0/3386522307 >> 172.21.15.29:0/3386522307 conn(0x7f08c006c6c0 msgr2=0x7f08c006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:47.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bf59e700 1 -- 172.21.15.29:0/3386522307 shutdown_connections 2023-10-06T05:29:47.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.788+0000 7f08bf59e700 1 -- 172.21.15.29:0/3386522307 wait complete. 2023-10-06T05:29:47.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 Processor -- start 2023-10-06T05:29:47.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 -- start start 2023-10-06T05:29:47.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c006a370 0x7f08c01687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:47.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08c0156870 0x7f08c00b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:47.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 0x7f08c00c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:47.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00ab390 con 0x7f08c0156870 2023-10-06T05:29:47.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00ca8c0 con 0x7f08c006a370 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00c9cb0 con 0x7f08c0156c40 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bdd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08c0156870 0x7f08c00b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bdd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08c0156870 0x7f08c00b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60032/0 (socket says 172.21.15.29:60032) 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bdd9b700 1 -- 172.21.15.29:0/3462097919 learned_addr learned my addr 172.21.15.29:0/3462097919 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bed9d700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 0x7f08c00c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08be59c700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c006a370 0x7f08c01687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bdd9b700 1 -- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 msgr2=0x7f08c00c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bdd9b700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 0x7f08c00c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bdd9b700 1 -- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c006a370 msgr2=0x7f08c01687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bdd9b700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c006a370 0x7f08c01687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bdd9b700 1 -- 172.21.15.29:0/3462097919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0009a20 con 0x7f08c0156870 2023-10-06T05:29:47.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bed9d700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 0x7f08c00c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:47.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bdd9b700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08c0156870 0x7f08c00b0f10 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f08b000b610 tx=0x7f08b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:47.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08ae7fc700 1 -- 172.21.15.29:0/3462097919 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0012ae0 con 0x7f08c0156870 2023-10-06T05:29:47.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08ae7fc700 1 -- 172.21.15.29:0/3462097919 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b0012c60 con 0x7f08c0156870 2023-10-06T05:29:47.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c00c9f90 con 0x7f08c0156870 2023-10-06T05:29:47.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08ae7fc700 1 -- 172.21.15.29:0/3462097919 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0027470 con 0x7f08c0156870 2023-10-06T05:29:47.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.792+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c00ca550 con 0x7f08c0156870 2023-10-06T05:29:47.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.796+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c004be00 con 0x7f08c0156870 2023-10-06T05:29:47.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.796+0000 7f08ae7fc700 1 -- 172.21.15.29:0/3462097919 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f08b0024070 con 0x7f08c0156870 2023-10-06T05:29:47.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.796+0000 7f08ae7fc700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f08a0060550 0x7f08a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:47.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.796+0000 7f08ae7fc700 1 -- 172.21.15.29:0/3462097919 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f08b007ea10 con 0x7f08c0156870 2023-10-06T05:29:47.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.796+0000 7f08be59c700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f08a0060550 0x7f08a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:47.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.800+0000 7f08be59c700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f08a0060550 0x7f08a0062a00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f08c00cb190 tx=0x7f08b4001540 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:47.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.804+0000 7f08ae7fc700 1 -- 172.21.15.29:0/3462097919 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f08b004f140 con 0x7f08c0156870 2023-10-06T05:29:47.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.968+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f08c00caa00 con 0x7f08c0156870 2023-10-06T05:29:47.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.976+0000 7f08ae7fc700 1 -- 172.21.15.29:0/3462097919 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f08b0025e90 con 0x7f08c0156870 2023-10-06T05:29:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f08a0060550 msgr2=0x7f08a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f08a0060550 0x7f08a0062a00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f08c00cb190 tx=0x7f08b4001540 comp rx=0 tx=0).stop 2023-10-06T05:29:47.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08c0156870 msgr2=0x7f08c00b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08c0156870 0x7f08c00b0f10 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f08b000b610 tx=0x7f08b0018000 comp rx=0 tx=0).stop 2023-10-06T05:29:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 shutdown_connections 2023-10-06T05:29:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c0156c40 0x7f08c00c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08c0156870 0x7f08c00b0f10 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f08a0060550 0x7f08a0062a00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 --2- 172.21.15.29:0/3462097919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c006a370 0x7f08c01687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 >> 172.21.15.29:0/3462097919 conn(0x7f08c006c6c0 msgr2=0x7f08c015a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 shutdown_connections 2023-10-06T05:29:47.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:47.980+0000 7f08bf59e700 1 -- 172.21.15.29:0/3462097919 wait complete. 2023-10-06T05:29:47.999 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T05:29:48.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:29:48.019 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:29:48.039 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T05:29:48.039 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T05:29:48.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:29:48.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2e32c700 1 Processor -- start 2023-10-06T05:29:48.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2e32c700 1 -- start start 2023-10-06T05:29:48.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2e32c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8e280aeb00 0x7f8e280d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2e32c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e2815bf20 0x7f8e2815c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2e32c700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e280cb150 con 0x7f8e280cff90 2023-10-06T05:29:48.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2e32c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e280cb5e0 con 0x7f8e2815bf20 2023-10-06T05:29:48.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2e32c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2815c890 con 0x7f8e280aeb00 2023-10-06T05:29:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2db2b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e2815bf20 0x7f8e2815c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2db2b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e2815bf20 0x7f8e2815c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60040/0 (socket says 172.21.15.29:60040) 2023-10-06T05:29:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2db2b700 1 -- 172.21.15.29:0/943943756 learned_addr learned my addr 172.21.15.29:0/943943756 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2cb29700 1 --2- 172.21.15.29:0/943943756 >> v2:172.21.15.173:3300/0 conn(0x7f8e280aeb00 0x7f8e280d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2db2b700 1 -- 172.21.15.29:0/943943756 >> v2:172.21.15.173:3300/0 conn(0x7f8e280aeb00 msgr2=0x7f8e280d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2db2b700 1 --2- 172.21.15.29:0/943943756 >> v2:172.21.15.173:3300/0 conn(0x7f8e280aeb00 0x7f8e280d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2db2b700 1 -- 172.21.15.29:0/943943756 >> v1:172.21.15.173:6789/0 conn(0x7f8e280cff90 legacy=0x7f8e2815d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2db2b700 1 -- 172.21.15.29:0/943943756 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280ca540 con 0x7f8e2815bf20 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2db2b700 1 --2- 172.21.15.29:0/943943756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2815bf20 0x7f8e2815c350 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8e280649a0 tx=0x7f8e20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859811faef2af822 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e1ffff700 1 -- 172.21.15.29:0/943943756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000e070 con 0x7f8e2815bf20 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e1ffff700 1 -- 172.21.15.29:0/943943756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000ba20 con 0x7f8e2815bf20 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e1ffff700 1 -- 172.21.15.29:0/943943756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200092e0 con 0x7f8e2815bf20 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2e32c700 1 -- 172.21.15.29:0/943943756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2815bf20 msgr2=0x7f8e2815c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.144+0000 7f8e2e32c700 1 --2- 172.21.15.29:0/943943756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2815bf20 0x7f8e2815c350 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8e280649a0 tx=0x7f8e20009840 comp rx=0 tx=0).stop 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 -- 172.21.15.29:0/943943756 shutdown_connections 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 --2- 172.21.15.29:0/943943756 >> v2:172.21.15.173:3300/0 conn(0x7f8e280aeb00 0x7f8e280d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 --2- 172.21.15.29:0/943943756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2815bf20 0x7f8e2815c350 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 -- 172.21.15.29:0/943943756 >> 172.21.15.29:0/943943756 conn(0x7f8e280670a0 msgr2=0x7f8e280674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 -- 172.21.15.29:0/943943756 shutdown_connections 2023-10-06T05:29:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 -- 172.21.15.29:0/943943756 wait complete. 2023-10-06T05:29:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 Processor -- start 2023-10-06T05:29:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 -- start start 2023-10-06T05:29:48.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e280aeb00 0x7f8e280b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e280cff90 0x7f8e2815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e2815bf20 0x7f8e2815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2815e800 con 0x7f8e280aeb00 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2815ca60 con 0x7f8e280cff90 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.148+0000 7f8e2e32c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2816d720 con 0x7f8e2815bf20 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2d32a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e280aeb00 0x7f8e280b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2d32a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e280aeb00 0x7f8e280b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60052/0 (socket says 172.21.15.29:60052) 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2d32a700 1 -- 172.21.15.29:0/232665295 learned_addr learned my addr 172.21.15.29:0/232665295 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2cb29700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e280cff90 0x7f8e2815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2db2b700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e2815bf20 0x7f8e2815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2d32a700 1 -- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e2815bf20 msgr2=0x7f8e2815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2d32a700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e2815bf20 0x7f8e2815e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2d32a700 1 -- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e280cff90 msgr2=0x7f8e2815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2d32a700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e280cff90 0x7f8e2815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2d32a700 1 -- 172.21.15.29:0/232665295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20009ae0 con 0x7f8e280aeb00 2023-10-06T05:29:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2d32a700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e280aeb00 0x7f8e280b4790 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400c590 tx=0x7f8e2400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e1d7fa700 1 -- 172.21.15.29:0/232665295 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24011590 con 0x7f8e280aeb00 2023-10-06T05:29:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e1d7fa700 1 -- 172.21.15.29:0/232665295 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e24011710 con 0x7f8e280aeb00 2023-10-06T05:29:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2815ccb0 con 0x7f8e280aeb00 2023-10-06T05:29:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e1d7fa700 1 -- 172.21.15.29:0/232665295 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24011ad0 con 0x7f8e280aeb00 2023-10-06T05:29:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2815d270 con 0x7f8e280aeb00 2023-10-06T05:29:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2804be00 con 0x7f8e280aeb00 2023-10-06T05:29:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.152+0000 7f8e1d7fa700 1 -- 172.21.15.29:0/232665295 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8e2401b3b0 con 0x7f8e280aeb00 2023-10-06T05:29:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.156+0000 7f8e1d7fa700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e0c060550 0x7f8e0c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.156+0000 7f8e1d7fa700 1 -- 172.21.15.29:0/232665295 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f8e2407bbd0 con 0x7f8e280aeb00 2023-10-06T05:29:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.156+0000 7f8e2cb29700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e0c060550 0x7f8e0c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.156+0000 7f8e2cb29700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e0c060550 0x7f8e0c062a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e280c33b0 tx=0x7f8e180091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:48.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.164+0000 7f8e1d7fa700 1 -- 172.21.15.29:0/232665295 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8e2404c300 con 0x7f8e280aeb00 2023-10-06T05:29:48.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.360+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e280ca820 con 0x7f8e280aeb00 2023-10-06T05:29:48.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e1d7fa700 1 -- 172.21.15.29:0/232665295 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f8e24017020 con 0x7f8e280aeb00 2023-10-06T05:29:48.368 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:48.369 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/755115916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":755115916},{"type":"v1","addr":"172.21.15.173:6835","nonce":755115916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/792242795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":792242795},{"type":"v1","addr":"172.21.15.173:6837","nonce":792242795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/2531772685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2531772685},{"type":"v1","addr":"172.21.15.29:6833","nonce":2531772685}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6360,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2681982923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2681982923},{"type":"v1","addr":"172.21.15.29:6835","nonce":2681982923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-10-06T05:29:48.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e0c060550 msgr2=0x7f8e0c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:48.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e0c060550 0x7f8e0c062a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e280c33b0 tx=0x7f8e180091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e280aeb00 msgr2=0x7f8e280b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e280aeb00 0x7f8e280b4790 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400c590 tx=0x7f8e2400c8a0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 shutdown_connections 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e2815bf20 0x7f8e2815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8e0c060550 0x7f8e0c062a00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e280cff90 0x7f8e2815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 --2- 172.21.15.29:0/232665295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e280aeb00 0x7f8e280b4790 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 >> 172.21.15.29:0/232665295 conn(0x7f8e280670a0 msgr2=0x7f8e2806b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 shutdown_connections 2023-10-06T05:29:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.364+0000 7f8e2e32c700 1 -- 172.21.15.29:0/232665295 wait complete. 2023-10-06T05:29:48.373 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 37 2023-10-06T05:29:48.383 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T05:29:48.383 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T05:29:48.384 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T05:29:48.384 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:29:48.384 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T05:29:48.384 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T05:29:48.384 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T05:29:48.384 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:29:48.384 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T05:29:48.384 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T05:29:48.385 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T05:29:48.385 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:29:48.385 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T05:29:48.385 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T05:29:48.385 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T05:29:48.385 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:29:48.395 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T05:29:48.395 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T05:29:48.398 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T05:29:48.398 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T05:29:48.399 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T05:29:48.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T05:29:48.401 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T05:29:48.401 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T05:29:48.441 INFO:tasks.ceph.mds.c:Started 2023-10-06T05:29:48.441 DEBUG:teuthology.parallel:result is None 2023-10-06T05:29:48.443 INFO:tasks.ceph.mds.a:Started 2023-10-06T05:29:48.443 DEBUG:teuthology.parallel:result is None 2023-10-06T05:29:48.446 INFO:tasks.ceph.mds.b:Started 2023-10-06T05:29:48.446 DEBUG:teuthology.parallel:result is None 2023-10-06T05:29:48.447 INFO:tasks.ceph.mds.d:Started 2023-10-06T05:29:48.448 DEBUG:teuthology.parallel:result is None 2023-10-06T05:29:48.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T05:29:48.508 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-06T05:29:48.512 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:29:48.524 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-10-06T05:29:48.525 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-10-06T05:29:48.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467e2fd700 1 Processor -- start 2023-10-06T05:29:48.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467e2fd700 1 -- start start 2023-10-06T05:29:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467e2fd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4678155930 0x7f46780c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467e2fd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4678155d00 0x7f467806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467e2fd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 0x7f467806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467e2fd700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46780b18f0 con 0x7f4678155d00 2023-10-06T05:29:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467e2fd700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467806ce40 con 0x7f4678155930 2023-10-06T05:29:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467e2fd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46780c9d20 con 0x7f46780b1050 2023-10-06T05:29:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467cafa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4678155d00 0x7f467806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467cafa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4678155d00 0x7f467806d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60088/0 (socket says 172.21.15.29:60088) 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467cafa700 1 -- 172.21.15.29:0/102348607 learned_addr learned my addr 172.21.15.29:0/102348607 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467dafc700 1 --2- 172.21.15.29:0/102348607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 0x7f467806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467d2fb700 1 --2- 172.21.15.29:0/102348607 >> v2:172.21.15.173:3300/0 conn(0x7f4678155930 0x7f46780c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467cafa700 1 -- 172.21.15.29:0/102348607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 msgr2=0x7f467806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467cafa700 1 --2- 172.21.15.29:0/102348607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 0x7f467806d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467cafa700 1 -- 172.21.15.29:0/102348607 >> v2:172.21.15.173:3300/0 conn(0x7f4678155930 msgr2=0x7f46780c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467cafa700 1 --2- 172.21.15.29:0/102348607 >> v2:172.21.15.173:3300/0 conn(0x7f4678155930 0x7f46780c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467cafa700 1 -- 172.21.15.29:0/102348607 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46780b1610 con 0x7f4678155d00 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f467cafa700 1 --2- 172.21.15.29:0/102348607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 0x7f467806d2d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f467806f4d0 tx=0x7f466800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52fac68a5040656 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.544+0000 7f466ffff700 1 -- 172.21.15.29:0/102348607 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800dc50 con 0x7f4678155d00 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f466ffff700 1 -- 172.21.15.29:0/102348607 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466800ddb0 con 0x7f4678155d00 2023-10-06T05:29:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f466ffff700 1 -- 172.21.15.29:0/102348607 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46680196d0 con 0x7f4678155d00 2023-10-06T05:29:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 -- 172.21.15.29:0/102348607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 msgr2=0x7f467806d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 --2- 172.21.15.29:0/102348607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 0x7f467806d2d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f467806f4d0 tx=0x7f466800b4f0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 -- 172.21.15.29:0/102348607 shutdown_connections 2023-10-06T05:29:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 --2- 172.21.15.29:0/102348607 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 0x7f467806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 --2- 172.21.15.29:0/102348607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 0x7f467806d2d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 --2- 172.21.15.29:0/102348607 >> v2:172.21.15.173:3300/0 conn(0x7f4678155930 0x7f46780c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 -- 172.21.15.29:0/102348607 >> 172.21.15.29:0/102348607 conn(0x7f467806abc0 msgr2=0x7f46780adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 -- 172.21.15.29:0/102348607 shutdown_connections 2023-10-06T05:29:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 -- 172.21.15.29:0/102348607 wait complete. 2023-10-06T05:29:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 Processor -- start 2023-10-06T05:29:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.548+0000 7f467e2fd700 1 -- start start 2023-10-06T05:29:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467e2fd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 0x7f46780adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467e2fd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678155930 0x7f46780a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467e2fd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 0x7f46781534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467e2fd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780a57b0 con 0x7f4678155d00 2023-10-06T05:29:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467e2fd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780a4f10 con 0x7f4678155930 2023-10-06T05:29:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467e2fd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46780a51f0 con 0x7f46780b1050 2023-10-06T05:29:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467d2fb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 0x7f46780adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467cafa700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678155930 0x7f46780a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467dafc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 0x7f46781534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467cafa700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678155930 0x7f46780a44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:49252/0 (socket says 172.21.15.29:49252) 2023-10-06T05:29:48.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467cafa700 1 -- 172.21.15.29:0/2985906844 learned_addr learned my addr 172.21.15.29:0/2985906844 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467dafc700 1 -- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 msgr2=0x7f46780adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467dafc700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 0x7f46780adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467dafc700 1 -- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678155930 msgr2=0x7f46780a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467dafc700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678155930 0x7f46780a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467dafc700 1 -- 172.21.15.29:0/2985906844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466800b790 con 0x7f4678155d00 2023-10-06T05:29:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467cafa700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678155930 0x7f46780a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467d2fb700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 0x7f46780adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467dafc700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 0x7f46781534f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4670007ed0 tx=0x7f4670009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f466d7fa700 1 -- 172.21.15.29:0/2985906844 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670018070 con 0x7f4678155d00 2023-10-06T05:29:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f466d7fa700 1 -- 172.21.15.29:0/2985906844 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467000eb90 con 0x7f4678155d00 2023-10-06T05:29:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46780a54d0 con 0x7f4678155d00 2023-10-06T05:29:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f466d7fa700 1 -- 172.21.15.29:0/2985906844 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670014420 con 0x7f4678155d00 2023-10-06T05:29:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.552+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46780a5d40 con 0x7f4678155d00 2023-10-06T05:29:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.556+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46780a5ed0 con 0x7f4678155d00 2023-10-06T05:29:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.556+0000 7f466d7fa700 1 -- 172.21.15.29:0/2985906844 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4670003020 con 0x7f4678155d00 2023-10-06T05:29:48.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.556+0000 7f466d7fa700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f465c060550 0x7f465c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.556+0000 7f466d7fa700 1 -- 172.21.15.29:0/2985906844 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f467007c750 con 0x7f4678155d00 2023-10-06T05:29:48.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.556+0000 7f467d2fb700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f465c060550 0x7f465c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.556+0000 7f467d2fb700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f465c060550 0x7f465c062a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4674006fd0 tx=0x7f4674008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.564+0000 7f466d7fa700 1 -- 172.21.15.29:0/2985906844 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f46780a5ed0 con 0x7f4678155d00 2023-10-06T05:29:48.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-06T05:29:48.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:48.744+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f46780a5ed0 con 0x7f4678155d00 2023-10-06T05:29:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.680+0000 7f466d7fa700 1 -- 172.21.15.29:0/2985906844 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7f46780a5ed0 con 0x7f4678155d00 2023-10-06T05:29:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f465c060550 msgr2=0x7f465c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f465c060550 0x7f465c062a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4674006fd0 tx=0x7f4674008040 comp rx=0 tx=0).stop 2023-10-06T05:29:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 msgr2=0x7f46781534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 0x7f46781534f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4670007ed0 tx=0x7f4670009850 comp rx=0 tx=0).stop 2023-10-06T05:29:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 shutdown_connections 2023-10-06T05:29:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4678155d00 0x7f46781534f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f465c060550 0x7f465c062a00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678155930 0x7f46780a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 --2- 172.21.15.29:0/2985906844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46780b1050 0x7f46780adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 >> 172.21.15.29:0/2985906844 conn(0x7f467806abc0 msgr2=0x7f46780afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 shutdown_connections 2023-10-06T05:29:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.684+0000 7f467e2fd700 1 -- 172.21.15.29:0/2985906844 wait complete. 2023-10-06T05:29:49.690 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2023-10-06T05:29:49.704 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T05:29:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fea7f700 1 Processor -- start 2023-10-06T05:29:49.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fea7f700 1 -- start start 2023-10-06T05:29:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fea7f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f88f8152b50 0x7f88f8159830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fea7f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f806dde0 0x7f88f8068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fea7f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80c9e00 con 0x7f88f8152f20 2023-10-06T05:29:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fea7f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f8159d70 con 0x7f88f8152b50 2023-10-06T05:29:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fea7f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8155bc0 con 0x7f88f806dde0 2023-10-06T05:29:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fda7d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f88f8152b50 0x7f88f8159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:49.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fe27e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f806dde0 0x7f88f8068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:49.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fd27c700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f88f8152f20 0x7f88f806d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:60016/0 (socket says 172.21.15.29:60016) 2023-10-06T05:29:49.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fd27c700 1 -- 172.21.15.29:0/21075753 learned_addr learned my addr 172.21.15.29:0/21075753 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fe27e700 1 -- 172.21.15.29:0/21075753 >> v2:172.21.15.173:3300/0 conn(0x7f88f8152b50 msgr2=0x7f88f8159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fe27e700 1 --2- 172.21.15.29:0/21075753 >> v2:172.21.15.173:3300/0 conn(0x7f88f8152b50 0x7f88f8159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.816+0000 7f88fe27e700 1 -- 172.21.15.29:0/21075753 >> v1:172.21.15.173:6789/0 conn(0x7f88f8152f20 legacy=0x7f88f806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fe27e700 1 -- 172.21.15.29:0/21075753 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f81567d0 con 0x7f88f806dde0 2023-10-06T05:29:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fe27e700 1 --2- 172.21.15.29:0/21075753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f806dde0 0x7f88f8068390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009e60 tx=0x7f88f0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdd94dcf33a4ce79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fca7b700 1 -- 172.21.15.29:0/21075753 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f000e070 con 0x7f88f806dde0 2023-10-06T05:29:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fca7b700 1 -- 172.21.15.29:0/21075753 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f000bb60 con 0x7f88f806dde0 2023-10-06T05:29:49.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fca7b700 1 -- 172.21.15.29:0/21075753 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0012430 con 0x7f88f806dde0 2023-10-06T05:29:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fea7f700 1 -- 172.21.15.29:0/21075753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f806dde0 msgr2=0x7f88f8068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fea7f700 1 --2- 172.21.15.29:0/21075753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f806dde0 0x7f88f8068390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009e60 tx=0x7f88f0009780 comp rx=0 tx=0).stop 2023-10-06T05:29:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fea7f700 1 -- 172.21.15.29:0/21075753 shutdown_connections 2023-10-06T05:29:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fea7f700 1 --2- 172.21.15.29:0/21075753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f806dde0 0x7f88f8068390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fea7f700 1 --2- 172.21.15.29:0/21075753 >> v2:172.21.15.173:3300/0 conn(0x7f88f8152b50 0x7f88f8159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fea7f700 1 -- 172.21.15.29:0/21075753 >> 172.21.15.29:0/21075753 conn(0x7f88f806aaf0 msgr2=0x7f88f806aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fea7f700 1 -- 172.21.15.29:0/21075753 shutdown_connections 2023-10-06T05:29:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.820+0000 7f88fea7f700 1 -- 172.21.15.29:0/21075753 wait complete. 2023-10-06T05:29:49.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.824+0000 7f88fea7f700 1 Processor -- start 2023-10-06T05:29:49.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.824+0000 7f88fea7f700 1 -- start start 2023-10-06T05:29:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.824+0000 7f88fea7f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88f806dde0 0x7f88f8167ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.824+0000 7f88fea7f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f8152b50 0x7f88f816aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.824+0000 7f88fea7f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8152f20 0x7f88f80c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.824+0000 7f88fea7f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8157ac0 con 0x7f88f806dde0 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.824+0000 7f88fea7f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f816b3e0 con 0x7f88f8152f20 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.824+0000 7f88fea7f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f81536b0 con 0x7f88f8152b50 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.824+0000 7f88fda7d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88f806dde0 0x7f88f8167ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fda7d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88f806dde0 0x7f88f8167ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60112/0 (socket says 172.21.15.29:60112) 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fda7d700 1 -- 172.21.15.29:0/3344906421 learned_addr learned my addr 172.21.15.29:0/3344906421 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fe27e700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8152f20 0x7f88f80c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fd27c700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f8152b50 0x7f88f816aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fda7d700 1 -- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f8152b50 msgr2=0x7f88f816aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fda7d700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f8152b50 0x7f88f816aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:49.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fda7d700 1 -- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8152f20 msgr2=0x7f88f80c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:49.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fda7d700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8152f20 0x7f88f80c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:49.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fda7d700 1 -- 172.21.15.29:0/3344906421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f0009a20 con 0x7f88f806dde0 2023-10-06T05:29:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fda7d700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88f806dde0 0x7f88f8167ff0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f88f400ea50 tx=0x7f88f400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88edffb700 1 -- 172.21.15.29:0/3344906421 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400a7a0 con 0x7f88f806dde0 2023-10-06T05:29:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88edffb700 1 -- 172.21.15.29:0/3344906421 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f400c6e0 con 0x7f88f806dde0 2023-10-06T05:29:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88edffb700 1 -- 172.21.15.29:0/3344906421 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400ca80 con 0x7f88f806dde0 2023-10-06T05:29:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f81577e0 con 0x7f88f806dde0 2023-10-06T05:29:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f8153d50 con 0x7f88f806dde0 2023-10-06T05:29:49.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f81538d0 con 0x7f88f806dde0 2023-10-06T05:29:49.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.828+0000 7f88edffb700 1 -- 172.21.15.29:0/3344906421 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f88f40113f0 con 0x7f88f806dde0 2023-10-06T05:29:49.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.832+0000 7f88edffb700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f88dc060550 0x7f88dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:49.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.832+0000 7f88edffb700 1 -- 172.21.15.29:0/3344906421 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f88f4015030 con 0x7f88f806dde0 2023-10-06T05:29:49.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.832+0000 7f88fd27c700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f88dc060550 0x7f88dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:49.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.832+0000 7f88fd27c700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f88dc060550 0x7f88dc062a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f88f80c85a0 tx=0x7f88e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:49.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:49.836+0000 7f88edffb700 1 -- 172.21.15.29:0/3344906421 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f88f81538d0 con 0x7f88f806dde0 2023-10-06T05:29:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.052+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f88f81538d0 con 0x7f88f806dde0 2023-10-06T05:29:50.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88edffb700 1 -- 172.21.15.29:0/3344906421 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f88f81538d0 con 0x7f88f806dde0 2023-10-06T05:29:50.061 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:50.061 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:29:50.061 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2023-10-06T05:29:50.061 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.061 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lmmo6OBAAQpP+gZa78MNtTT1c5tK+vw==", 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.062 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lOCLABhAA38TEJqLAC+ccT54rGKcRHQ==", 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lLN0yABAAa4pRtt5i1VwRUls37iQ6Ng==", 2023-10-06T05:29:50.063 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9l/IkZChAAA0KqF/fQdw+Lvfgt3G7D1Q==", 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:29:50.064 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9liLI7OhAA2q9u7NoYTihYVqDD6feWqg==", 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.065 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAdmh9lVgGUABAAT+KgCiblIExCBVOWaW1KTQ==", 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAgmh9lTun5BhAAhxhwULNJol5kiIMd6cr4EQ==", 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAjmh9lJRz4DBAAPs7JW7cj58uGIh0CXjTPOA==", 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.067 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAomh9lF4v2MRAA6d30MwZe8jaJE2/KZ2v2fg==", 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:29:50.068 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAsmh9lLsIbCRAAW0z6kOmd/cRdSMyGXB43cA==", 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.069 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAvmh9lBdCTDhAACXtGHMjlSZ4mDObzP73SCw==", 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2023-10-06T05:29:50.070 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAymh9lpfyEExAAKfZ7994WtblLHuzw9X2CjA==", 2023-10-06T05:29:50.071 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.071 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-06T05:29:50.071 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-06T05:29:50.071 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.071 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.071 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.071 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9l/dfwDBAAyd4qv0io8GSbP8ukYr6WaQ==", 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow r", 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2023-10-06T05:29:50.072 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lhSm7EhAA//AImYYn3pBpCmwsOv9X8g==", 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.2", 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lLAPFDxAA0M9C3WbeOYjQvGGIqPRrSw==", 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:29:50.073 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.3", 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAZmh9lYEpMFRAAgFoS4+VPWcjT0TgyNTDFFA==", 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-06T05:29:50.074 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lrcA0KxAAl4GK+rF0VWq9nkzu1RXN1A==", 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.075 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9l0ABYNRAAjZ6Ji5Q1o0HKn3oDYZaZ+w==", 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2023-10-06T05:29:50.076 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQAYmh9lCDNrMhAA/2ymYL+jXTRPLjyoHbWzPg==", 2023-10-06T05:29:50.077 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-06T05:29:50.077 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-06T05:29:50.077 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-06T05:29:50.077 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-06T05:29:50.077 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.077 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:50.077 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-06T05:29:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:29:50.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f88dc060550 msgr2=0x7f88dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f88dc060550 0x7f88dc062a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f88f80c85a0 tx=0x7f88e8009040 comp rx=0 tx=0).stop 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88f806dde0 msgr2=0x7f88f8167ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88f806dde0 0x7f88f8167ff0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f88f400ea50 tx=0x7f88f400a330 comp rx=0 tx=0).stop 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 shutdown_connections 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f88dc060550 0x7f88dc062a00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88f8152f20 0x7f88f80c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88f8152b50 0x7f88f816aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 --2- 172.21.15.29:0/3344906421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88f806dde0 0x7f88f8167ff0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 >> 172.21.15.29:0/3344906421 conn(0x7f88f806aaf0 msgr2=0x7f88f80c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:50.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 shutdown_connections 2023-10-06T05:29:50.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.056+0000 7f88fea7f700 1 -- 172.21.15.29:0/3344906421 wait complete. 2023-10-06T05:29:50.080 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:29:50.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6a65f700 1 Processor -- start 2023-10-06T05:29:50.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6a65f700 1 -- start start 2023-10-06T05:29:50.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6a65f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efe64158c00 0x7efe6406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6a65f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efe640cebc0 0x7efe64159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6a65f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6406b250 con 0x7efe640ce740 2023-10-06T05:29:50.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6a65f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6406a640 con 0x7efe640cebc0 2023-10-06T05:29:50.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6a65f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6406a920 con 0x7efe64158c00 2023-10-06T05:29:50.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe69e5e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efe640cebc0 0x7efe64159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6965d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efe64158c00 0x7efe6406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe69e5e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efe640cebc0 0x7efe64159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60114/0 (socket says 172.21.15.29:60114) 2023-10-06T05:29:50.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe69e5e700 1 -- 172.21.15.29:0/2948523408 learned_addr learned my addr 172.21.15.29:0/2948523408 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe69e5e700 1 -- 172.21.15.29:0/2948523408 >> v2:172.21.15.173:3300/0 conn(0x7efe64158c00 msgr2=0x7efe6406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe69e5e700 1 --2- 172.21.15.29:0/2948523408 >> v2:172.21.15.173:3300/0 conn(0x7efe64158c00 0x7efe6406b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe69e5e700 1 -- 172.21.15.29:0/2948523408 >> v1:172.21.15.173:6789/0 conn(0x7efe640ce740 legacy=0x7efe640cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe69e5e700 1 -- 172.21.15.29:0/2948523408 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6406ac00 con 0x7efe640cebc0 2023-10-06T05:29:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe69e5e700 1 --2- 172.21.15.29:0/2948523408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640cebc0 0x7efe64159fe0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efe64069a30 tx=0x7efe5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ecb987215e53ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe5bfff700 1 -- 172.21.15.29:0/2948523408 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c00e070 con 0x7efe640cebc0 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe5bfff700 1 -- 172.21.15.29:0/2948523408 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c00ba20 con 0x7efe640cebc0 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe5bfff700 1 -- 172.21.15.29:0/2948523408 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c0092e0 con 0x7efe640cebc0 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6a65f700 1 -- 172.21.15.29:0/2948523408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640cebc0 msgr2=0x7efe64159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.180+0000 7efe6a65f700 1 --2- 172.21.15.29:0/2948523408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640cebc0 0x7efe64159fe0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efe64069a30 tx=0x7efe5c009840 comp rx=0 tx=0).stop 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 -- 172.21.15.29:0/2948523408 shutdown_connections 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 --2- 172.21.15.29:0/2948523408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640cebc0 0x7efe64159fe0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 --2- 172.21.15.29:0/2948523408 >> v2:172.21.15.173:3300/0 conn(0x7efe64158c00 0x7efe6406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 -- 172.21.15.29:0/2948523408 >> 172.21.15.29:0/2948523408 conn(0x7efe640670a0 msgr2=0x7efe64067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 -- 172.21.15.29:0/2948523408 shutdown_connections 2023-10-06T05:29:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 -- 172.21.15.29:0/2948523408 wait complete. 2023-10-06T05:29:50.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 Processor -- start 2023-10-06T05:29:50.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 -- start start 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640ce740 0x7efe64149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efe640cebc0 0x7efe640b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe64158c00 0x7efe640b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640b4250 con 0x7efe640ce740 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64149e90 con 0x7efe64158c00 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6a65f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe640b3640 con 0x7efe640cebc0 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.184+0000 7efe6965d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640ce740 0x7efe64149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6965d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640ce740 0x7efe64149950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60128/0 (socket says 172.21.15.29:60128) 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6965d700 1 -- 172.21.15.29:0/3032676752 learned_addr learned my addr 172.21.15.29:0/3032676752 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe69e5e700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe64158c00 0x7efe640b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe68e5c700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efe640cebc0 0x7efe640b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6965d700 1 -- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efe640cebc0 msgr2=0x7efe640b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6965d700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efe640cebc0 0x7efe640b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6965d700 1 -- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe64158c00 msgr2=0x7efe640b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6965d700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe64158c00 0x7efe640b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6965d700 1 -- 172.21.15.29:0/3032676752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c009ae0 con 0x7efe640ce740 2023-10-06T05:29:50.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe68e5c700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efe640cebc0 0x7efe640b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:50.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6965d700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640ce740 0x7efe64149950 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efe6000e930 tx=0x7efe600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:50.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe597fa700 1 -- 172.21.15.29:0/3032676752 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6000eed0 con 0x7efe640ce740 2023-10-06T05:29:50.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe597fa700 1 -- 172.21.15.29:0/3032676752 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6000c850 con 0x7efe640ce740 2023-10-06T05:29:50.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe640b3920 con 0x7efe640ce740 2023-10-06T05:29:50.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe597fa700 1 -- 172.21.15.29:0/3032676752 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6000cbf0 con 0x7efe640ce740 2023-10-06T05:29:50.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe640b3ee0 con 0x7efe640ce740 2023-10-06T05:29:50.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6404be00 con 0x7efe640ce740 2023-10-06T05:29:50.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.188+0000 7efe597fa700 1 -- 172.21.15.29:0/3032676752 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efe60013470 con 0x7efe640ce740 2023-10-06T05:29:50.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.192+0000 7efe597fa700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe48060550 0x7efe48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.192+0000 7efe597fa700 1 -- 172.21.15.29:0/3032676752 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efe6007c850 con 0x7efe640ce740 2023-10-06T05:29:50.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.192+0000 7efe68e5c700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe48060550 0x7efe48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.192+0000 7efe68e5c700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe48060550 0x7efe48062a00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efe6415e4c0 tx=0x7efe54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:50.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.200+0000 7efe597fa700 1 -- 172.21.15.29:0/3032676752 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efe6004cf90 con 0x7efe640ce740 2023-10-06T05:29:50.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.352+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe6406aee0 con 0x7efe640ce740 2023-10-06T05:29:50.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.352+0000 7efe597fa700 1 -- 172.21.15.29:0/3032676752 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+13651 (secure 0 0 0) 0x7efe600505b0 con 0x7efe640ce740 2023-10-06T05:29:50.360 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:50.360 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":73,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:29:49.674764+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:29:50.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe48060550 msgr2=0x7efe48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe48060550 0x7efe48062a00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efe6415e4c0 tx=0x7efe54009040 comp rx=0 tx=0).stop 2023-10-06T05:29:50.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640ce740 msgr2=0x7efe64149950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640ce740 0x7efe64149950 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efe6000e930 tx=0x7efe600091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 shutdown_connections 2023-10-06T05:29:50.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe48060550 0x7efe48062a00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe64158c00 0x7efe640b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efe640cebc0 0x7efe640b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 --2- 172.21.15.29:0/3032676752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe640ce740 0x7efe64149950 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 >> 172.21.15.29:0/3032676752 conn(0x7efe640670a0 msgr2=0x7efe6415a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:50.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 shutdown_connections 2023-10-06T05:29:50.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.356+0000 7efe6a65f700 1 -- 172.21.15.29:0/3032676752 wait complete. 2023-10-06T05:29:50.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T05:29:50.375 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:29:50.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.480+0000 7fca9b59e700 1 Processor -- start 2023-10-06T05:29:50.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.480+0000 7fca9b59e700 1 -- start start 2023-10-06T05:29:50.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca9c156870 0x7fca9c15b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 0x7fca9c0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c06b540 con 0x7fca9c156c40 2023-10-06T05:29:50.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c15b650 con 0x7fca9c156870 2023-10-06T05:29:50.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c06a930 con 0x7fca9c06a370 2023-10-06T05:29:50.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9ad9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fca9c156c40 0x7fca9c0670a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49462/0 (socket says 172.21.15.29:49462) 2023-10-06T05:29:50.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9ad9d700 1 -- 172.21.15.29:0/1683238813 learned_addr learned my addr 172.21.15.29:0/1683238813 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:50.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9a59c700 1 --2- 172.21.15.29:0/1683238813 >> v2:172.21.15.173:3300/0 conn(0x7fca9c156870 0x7fca9c15b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca99d9b700 1 --2- 172.21.15.29:0/1683238813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 0x7fca9c0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9959a700 1 -- 172.21.15.29:0/1683238813 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766298782 0 0) 0x7fca9c06b540 con 0x7fca9c156c40 2023-10-06T05:29:50.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9959a700 1 -- 172.21.15.29:0/1683238813 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca88003570 con 0x7fca9c156c40 2023-10-06T05:29:50.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9a59c700 1 -- 172.21.15.29:0/1683238813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 msgr2=0x7fca9c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:50.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9a59c700 1 --2- 172.21.15.29:0/1683238813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 0x7fca9c0c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9a59c700 1 -- 172.21.15.29:0/1683238813 >> v1:172.21.15.29:6789/0 conn(0x7fca9c156c40 legacy=0x7fca9c0670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9a59c700 1 -- 172.21.15.29:0/1683238813 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c06ac10 con 0x7fca9c156870 2023-10-06T05:29:50.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9a59c700 1 --2- 172.21.15.29:0/1683238813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca9c156870 0x7fca9c15b110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0098e0 tx=0x7fca8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=746ae5075a1aca54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:50.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9959a700 1 -- 172.21.15.29:0/1683238813 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c011630 con 0x7fca9c156870 2023-10-06T05:29:50.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9959a700 1 -- 172.21.15.29:0/1683238813 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c011790 con 0x7fca9c156870 2023-10-06T05:29:50.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9959a700 1 -- 172.21.15.29:0/1683238813 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c011b30 con 0x7fca9c156870 2023-10-06T05:29:50.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 -- 172.21.15.29:0/1683238813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca9c156870 msgr2=0x7fca9c15b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 --2- 172.21.15.29:0/1683238813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca9c156870 0x7fca9c15b110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0098e0 tx=0x7fca8c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 -- 172.21.15.29:0/1683238813 shutdown_connections 2023-10-06T05:29:50.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 --2- 172.21.15.29:0/1683238813 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 0x7fca9c0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 --2- 172.21.15.29:0/1683238813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca9c156870 0x7fca9c15b110 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 -- 172.21.15.29:0/1683238813 >> 172.21.15.29:0/1683238813 conn(0x7fca9c06c6c0 msgr2=0x7fca9c06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:50.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 -- 172.21.15.29:0/1683238813 shutdown_connections 2023-10-06T05:29:50.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.484+0000 7fca9b59e700 1 -- 172.21.15.29:0/1683238813 wait complete. 2023-10-06T05:29:50.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 Processor -- start 2023-10-06T05:29:50.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 -- start start 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 0x7fca9c15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca9c156870 0x7fca9c0aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca9c156c40 0x7fca9c14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c15cc40 con 0x7fca9c156c40 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0c95d0 con 0x7fca9c156870 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c15ce70 con 0x7fca9c06a370 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca9c156c40 0x7fca9c14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca9c156c40 0x7fca9c14d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60132/0 (socket says 172.21.15.29:60132) 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9ad9d700 1 -- 172.21.15.29:0/2923228448 learned_addr learned my addr 172.21.15.29:0/2923228448 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:50.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca99d9b700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca9c156870 0x7fca9c0aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9a59c700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 0x7fca9c15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9ad9d700 1 -- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 msgr2=0x7fca9c15c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9ad9d700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 0x7fca9c15c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9ad9d700 1 -- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca9c156870 msgr2=0x7fca9c0aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9ad9d700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca9c156870 0x7fca9c0aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9ad9d700 1 -- 172.21.15.29:0/2923228448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c009420 con 0x7fca9c156c40 2023-10-06T05:29:50.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9ad9d700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca9c156c40 0x7fca9c14d1c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fca940010e0 tx=0x7fca94007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca927fc700 1 -- 172.21.15.29:0/2923228448 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94005b30 con 0x7fca9c156c40 2023-10-06T05:29:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca927fc700 1 -- 172.21.15.29:0/2923228448 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94005c90 con 0x7fca9c156c40 2023-10-06T05:29:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca927fc700 1 -- 172.21.15.29:0/2923228448 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940072e0 con 0x7fca9c156c40 2023-10-06T05:29:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c15d130 con 0x7fca9c156c40 2023-10-06T05:29:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.488+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c0c9b00 con 0x7fca9c156c40 2023-10-06T05:29:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.492+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c04be00 con 0x7fca9c156c40 2023-10-06T05:29:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.492+0000 7fca927fc700 1 -- 172.21.15.29:0/2923228448 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fca94012400 con 0x7fca9c156c40 2023-10-06T05:29:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.492+0000 7fca927fc700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca7c060550 0x7fca7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.492+0000 7fca927fc700 1 -- 172.21.15.29:0/2923228448 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fca9407b8b0 con 0x7fca9c156c40 2023-10-06T05:29:50.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.492+0000 7fca9a59c700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca7c060550 0x7fca7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.492+0000 7fca9a59c700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca7c060550 0x7fca7c062a00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0091e0 tx=0x7fca8c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:50.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.500+0000 7fca927fc700 1 -- 172.21.15.29:0/2923228448 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca94049be0 con 0x7fca9c156c40 2023-10-06T05:29:50.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.664+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca9c06aef0 con 0x7fca9c156c40 2023-10-06T05:29:50.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca927fc700 1 -- 172.21.15.29:0/2923228448 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca940170a0 con 0x7fca9c156c40 2023-10-06T05:29:50.672 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:29:50.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca7c060550 msgr2=0x7fca7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca7c060550 0x7fca7c062a00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0091e0 tx=0x7fca8c017000 comp rx=0 tx=0).stop 2023-10-06T05:29:50.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca9c156c40 msgr2=0x7fca9c14d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca9c156c40 0x7fca9c14d1c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fca940010e0 tx=0x7fca94007dd0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 shutdown_connections 2023-10-06T05:29:50.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca9c156c40 0x7fca9c14d1c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fca7c060550 0x7fca7c062a00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca9c156870 0x7fca9c0aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 --2- 172.21.15.29:0/2923228448 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9c06a370 0x7fca9c15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 >> 172.21.15.29:0/2923228448 conn(0x7fca9c06c6c0 msgr2=0x7fca9c1502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:50.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 shutdown_connections 2023-10-06T05:29:50.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.668+0000 7fca9b59e700 1 -- 172.21.15.29:0/2923228448 wait complete. 2023-10-06T05:29:50.687 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:29:50.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.788+0000 7f851abc0700 1 Processor -- start 2023-10-06T05:29:50.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.788+0000 7f851abc0700 1 -- start start 2023-10-06T05:29:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851abc0700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8514159e00 0x7f85140c8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851abc0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140ca6b0 0x7f85140c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851abc0700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851415d580 con 0x7f851415a1d0 2023-10-06T05:29:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851abc0700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851415da10 con 0x7f8514159e00 2023-10-06T05:29:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851abc0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851415cc50 con 0x7f85140ca6b0 2023-10-06T05:29:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f8513fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f851415a1d0 0x7f85140c9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49472/0 (socket says 172.21.15.29:49472) 2023-10-06T05:29:50.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f8513fff700 1 -- 172.21.15.29:0/4271070286 learned_addr learned my addr 172.21.15.29:0/4271070286 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851915d700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140ca6b0 0x7f85140c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927308801 0 0) 0x7f851415d580 con 0x7f851415a1d0 2023-10-06T05:29:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851895c700 1 --2- 172.21.15.29:0/4271070286 >> v2:172.21.15.173:3300/0 conn(0x7f8514159e00 0x7f85140c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8500003570 con 0x7f851415a1d0 2023-10-06T05:29:50.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1334793310 0 0) 0x7f8500003570 con 0x7f851415a1d0 2023-10-06T05:29:50.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140ca6b0 msgr2=0x7f85140c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:50.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140ca6b0 0x7f85140c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 >> v2:172.21.15.173:3300/0 conn(0x7f8514159e00 msgr2=0x7f85140c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:50.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 --2- 172.21.15.29:0/4271070286 >> v2:172.21.15.173:3300/0 conn(0x7f8514159e00 0x7f85140c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851415cf30 con 0x7f851415a1d0 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f85040017f0 con 0x7f851415a1d0 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 >> v1:172.21.15.29:6789/0 conn(0x7f851415a1d0 legacy=0x7f85140c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8500003a60 0x7f8500003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140ca6b0 0x7f8500004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8500004d50 0x7f85000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851415da10 con 0x7f8500003a60 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851415cc50 con 0x7f8500004d50 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850000bae0 con 0x7f85140ca6b0 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851895c700 1 --2- 172.21.15.29:0/4271070286 >> v2:172.21.15.173:3300/0 conn(0x7f8514159e00 0x7f85140c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851895c700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8500003a60 0x7f8500003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f8513fff700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140ca6b0 0x7f8500004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851915d700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8500004d50 0x7f85000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851895c700 1 -- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140ca6b0 msgr2=0x7f8500004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:50.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851895c700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140ca6b0 0x7f8500004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851895c700 1 -- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8500004d50 msgr2=0x7f85000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:50.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851895c700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8500004d50 0x7f85000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851895c700 1 -- 172.21.15.29:0/4271070286 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500003570 con 0x7f8500003a60 2023-10-06T05:29:50.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f851895c700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8500003a60 0x7f8500003e70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009ba0 tx=0x7f84fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187727b18bc1a88e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:50.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00c070 con 0x7f8500003a60 2023-10-06T05:29:50.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc00e5e0 con 0x7f8500003a60 2023-10-06T05:29:50.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.792+0000 7f85137fe700 1 -- 172.21.15.29:0/4271070286 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00e790 con 0x7f8500003a60 2023-10-06T05:29:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.796+0000 7f851abc0700 1 -- 172.21.15.29:0/4271070286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8500003a60 msgr2=0x7f8500003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.796+0000 7f851abc0700 1 --2- 172.21.15.29:0/4271070286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8500003a60 0x7f8500003e70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009ba0 tx=0x7f84fc008040 comp rx=0 tx=0).stop 2023-10-06T05:29:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.796+0000 7f851915d700 1 -- 172.21.15.29:0/4271070286 reap_dead start 2023-10-06T05:29:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.796+0000 7f851abc0700 1 -- 172.21.15.29:0/4271070286 shutdown_connections 2023-10-06T05:29:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.796+0000 7f851abc0700 1 -- 172.21.15.29:0/4271070286 >> 172.21.15.29:0/4271070286 conn(0x7f85140670a0 msgr2=0x7f85140674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.796+0000 7f851abc0700 1 -- 172.21.15.29:0/4271070286 shutdown_connections 2023-10-06T05:29:50.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.796+0000 7f851abc0700 1 -- 172.21.15.29:0/4271070286 wait complete. 2023-10-06T05:29:50.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.796+0000 7f851abc0700 1 Processor -- start 2023-10-06T05:29:50.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.796+0000 7f851abc0700 1 -- start start 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851abc0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8514152d50 0x7f8514156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851abc0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514156890 0x7f85140c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851abc0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140c14b0 0x7f851415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851abc0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140c1920 con 0x7f8514156890 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851abc0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140aafc0 con 0x7f8514152d50 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851abc0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85140aa3b0 con 0x7f85140c14b0 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8513fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514156890 0x7f85140c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8513fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514156890 0x7f85140c0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60156/0 (socket says 172.21.15.29:60156) 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8513fff700 1 -- 172.21.15.29:0/2799989577 learned_addr learned my addr 172.21.15.29:0/2799989577 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851895c700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8514152d50 0x7f8514156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851915d700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140c14b0 0x7f851415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8513fff700 1 -- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140c14b0 msgr2=0x7f851415db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8513fff700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140c14b0 0x7f851415db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8513fff700 1 -- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8514152d50 msgr2=0x7f8514156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8513fff700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8514152d50 0x7f8514156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8513fff700 1 -- 172.21.15.29:0/2799989577 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85140aa690 con 0x7f8514156890 2023-10-06T05:29:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851895c700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8514152d50 0x7f8514156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8513fff700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514156890 0x7f85140c0f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8504007c90 tx=0x7f8504002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8510ff9700 1 -- 172.21.15.29:0/2799989577 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85040133f0 con 0x7f8514156890 2023-10-06T05:29:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8510ff9700 1 -- 172.21.15.29:0/2799989577 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8504013550 con 0x7f8514156890 2023-10-06T05:29:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f8510ff9700 1 -- 172.21.15.29:0/2799989577 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504013910 con 0x7f8514156890 2023-10-06T05:29:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85140aa970 con 0x7f8514156890 2023-10-06T05:29:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.800+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85140a9fd0 con 0x7f8514156890 2023-10-06T05:29:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.804+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85140ab3b0 con 0x7f8514156890 2023-10-06T05:29:50.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.804+0000 7f8510ff9700 1 -- 172.21.15.29:0/2799989577 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8504013cc0 con 0x7f8514156890 2023-10-06T05:29:50.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.804+0000 7f8510ff9700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84f4060550 0x7f84f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:50.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.804+0000 7f8510ff9700 1 -- 172.21.15.29:0/2799989577 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f850407d620 con 0x7f8514156890 2023-10-06T05:29:50.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.804+0000 7f851895c700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84f4060550 0x7f84f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:50.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.808+0000 7f851895c700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84f4060550 0x7f84f4062a00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009310 tx=0x7f84fc01a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:50.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.812+0000 7f8510ff9700 1 -- 172.21.15.29:0/2799989577 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f850404de00 con 0x7f8514156890 2023-10-06T05:29:50.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.972+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8514071120 con 0x7f8514156890 2023-10-06T05:29:50.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.972+0000 7f8510ff9700 1 -- 172.21.15.29:0/2799989577 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8504017020 con 0x7f8514156890 2023-10-06T05:29:50.980 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:29:50.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84f4060550 msgr2=0x7f84f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84f4060550 0x7f84f4062a00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009310 tx=0x7f84fc01a000 comp rx=0 tx=0).stop 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514156890 msgr2=0x7f85140c0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514156890 0x7f85140c0f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8504007c90 tx=0x7f8504002210 comp rx=0 tx=0).stop 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 shutdown_connections 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85140c14b0 0x7f851415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514156890 0x7f85140c0f70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f84f4060550 0x7f84f4062a00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 --2- 172.21.15.29:0/2799989577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8514152d50 0x7f8514156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 >> 172.21.15.29:0/2799989577 conn(0x7f85140670a0 msgr2=0x7f85140c66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 shutdown_connections 2023-10-06T05:29:50.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:50.976+0000 7f851abc0700 1 -- 172.21.15.29:0/2799989577 wait complete. 2023-10-06T05:29:50.995 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T05:29:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 Processor -- start 2023-10-06T05:29:51.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 -- start start 2023-10-06T05:29:51.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5f0c0c6540 0x7f5f0c0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c0c2980 con 0x7f5f0c1605e0 2023-10-06T05:29:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c0ca630 con 0x7f5f0c0ca1f0 2023-10-06T05:29:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c0c69c0 con 0x7f5f0c0c6540 2023-10-06T05:29:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f10ac8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5f0c1605e0 0x7f5f0c06b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49478/0 (socket says 172.21.15.29:49478) 2023-10-06T05:29:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f10ac8700 1 -- 172.21.15.29:0/4224160625 learned_addr learned my addr 172.21.15.29:0/4224160625 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:51.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0bfff700 1 --2- 172.21.15.29:0/4224160625 >> v2:172.21.15.173:3300/0 conn(0x7f5f0c0c6540 0x7f5f0c0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0b7fe700 1 -- 172.21.15.29:0/4224160625 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477789853 0 0) 0x7f5f0c0c2980 con 0x7f5f0c1605e0 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0b7fe700 1 -- 172.21.15.29:0/4224160625 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5efc003570 con 0x7f5f0c1605e0 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0bfff700 1 -- 172.21.15.29:0/4224160625 >> v1:172.21.15.173:6789/0 conn(0x7f5f0c0ca1f0 legacy=0x7f5f0c0c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0bfff700 1 -- 172.21.15.29:0/4224160625 >> v1:172.21.15.29:6789/0 conn(0x7f5f0c1605e0 legacy=0x7f5f0c06b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0bfff700 1 -- 172.21.15.29:0/4224160625 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0c6bb0 con 0x7f5f0c0c6540 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0bfff700 1 --2- 172.21.15.29:0/4224160625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0c0c6540 0x7f5f0c0c9cb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80098e0 tx=0x7f5ef80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1db32d7f463ac01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0b7fe700 1 -- 172.21.15.29:0/4224160625 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800b640 con 0x7f5f0c0c6540 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0b7fe700 1 -- 172.21.15.29:0/4224160625 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef800b7a0 con 0x7f5f0c0c6540 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f0b7fe700 1 -- 172.21.15.29:0/4224160625 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800bb40 con 0x7f5f0c0c6540 2023-10-06T05:29:51.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 -- 172.21.15.29:0/4224160625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0c0c6540 msgr2=0x7f5f0c0c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 --2- 172.21.15.29:0/4224160625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0c0c6540 0x7f5f0c0c9cb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80098e0 tx=0x7f5ef80091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 -- 172.21.15.29:0/4224160625 shutdown_connections 2023-10-06T05:29:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 --2- 172.21.15.29:0/4224160625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0c0c6540 0x7f5f0c0c9cb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 -- 172.21.15.29:0/4224160625 >> 172.21.15.29:0/4224160625 conn(0x7f5f0c0670a0 msgr2=0x7f5f0c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 -- 172.21.15.29:0/4224160625 shutdown_connections 2023-10-06T05:29:51.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.100+0000 7f5f11aca700 1 -- 172.21.15.29:0/4224160625 wait complete. 2023-10-06T05:29:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f11aca700 1 Processor -- start 2023-10-06T05:29:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f11aca700 1 -- start start 2023-10-06T05:29:51.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f11aca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0c6540 0x7f5f0c158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f11aca700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0c0ca1f0 0x7f5f0c157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f11aca700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f0c1605e0 0x7f5f0c0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f11aca700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0b0420 con 0x7f5f0c0c6540 2023-10-06T05:29:51.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f11aca700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c158200 con 0x7f5f0c0ca1f0 2023-10-06T05:29:51.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f11aca700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c1584e0 con 0x7f5f0c1605e0 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f10ac8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0c6540 0x7f5f0c158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f10ac8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0c6540 0x7f5f0c158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60162/0 (socket says 172.21.15.29:60162) 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.104+0000 7f5f10ac8700 1 -- 172.21.15.29:0/1551810550 learned_addr learned my addr 172.21.15.29:0/1551810550 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f112c9700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f0c1605e0 0x7f5f0c0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f0bfff700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0c0ca1f0 0x7f5f0c157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f10ac8700 1 -- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f0c1605e0 msgr2=0x7f5f0c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f10ac8700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f0c1605e0 0x7f5f0c0afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f10ac8700 1 -- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0c0ca1f0 msgr2=0x7f5f0c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f10ac8700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0c0ca1f0 0x7f5f0c157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f10ac8700 1 -- 172.21.15.29:0/1551810550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8009420 con 0x7f5f0c0c6540 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f112c9700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f0c1605e0 0x7f5f0c0afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:51.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f10ac8700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0c6540 0x7f5f0c158ce0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000c590 tx=0x7f5f00007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f08ff9700 1 -- 172.21.15.29:0/1551810550 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00005b30 con 0x7f5f0c0c6540 2023-10-06T05:29:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f08ff9700 1 -- 172.21.15.29:0/1551810550 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f00005cb0 con 0x7f5f0c0c6540 2023-10-06T05:29:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f08ff9700 1 -- 172.21.15.29:0/1551810550 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00007320 con 0x7f5f0c0c6540 2023-10-06T05:29:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c1587c0 con 0x7f5f0c0c6540 2023-10-06T05:29:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c0b0110 con 0x7f5f0c0c6540 2023-10-06T05:29:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c04be00 con 0x7f5f0c0c6540 2023-10-06T05:29:51.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.108+0000 7f5f08ff9700 1 -- 172.21.15.29:0/1551810550 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5f0001b3b0 con 0x7f5f0c0c6540 2023-10-06T05:29:51.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.112+0000 7f5f08ff9700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5ef0060550 0x7f5ef0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.112+0000 7f5f08ff9700 1 -- 172.21.15.29:0/1551810550 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5f0007bc30 con 0x7f5f0c0c6540 2023-10-06T05:29:51.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.112+0000 7f5f0bfff700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5ef0060550 0x7f5ef0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.112+0000 7f5f0bfff700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5ef0060550 0x7f5ef0062a00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80093f0 tx=0x7f5ef8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.120+0000 7f5f08ff9700 1 -- 172.21.15.29:0/1551810550 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5f0004c410 con 0x7f5f0c0c6540 2023-10-06T05:29:51.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.280+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5f0c0c6e90 con 0x7f5f0c0c6540 2023-10-06T05:29:51.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.280+0000 7f5f08ff9700 1 -- 172.21.15.29:0/1551810550 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5f00017070 con 0x7f5f0c0c6540 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 2, 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": "rbd" 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:29:51.287 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-06T05:29:51.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5ef0060550 msgr2=0x7f5ef0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5ef0060550 0x7f5ef0062a00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80093f0 tx=0x7f5ef8017000 comp rx=0 tx=0).stop 2023-10-06T05:29:51.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0c6540 msgr2=0x7f5f0c158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0c6540 0x7f5f0c158ce0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000c590 tx=0x7f5f00007e00 comp rx=0 tx=0).stop 2023-10-06T05:29:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 shutdown_connections 2023-10-06T05:29:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f0c1605e0 0x7f5f0c0afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5ef0060550 0x7f5ef0062a00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0c0ca1f0 0x7f5f0c157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 --2- 172.21.15.29:0/1551810550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0c6540 0x7f5f0c158ce0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 >> 172.21.15.29:0/1551810550 conn(0x7f5f0c0670a0 msgr2=0x7f5f0c0cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 shutdown_connections 2023-10-06T05:29:51.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.284+0000 7f5f11aca700 1 -- 172.21.15.29:0/1551810550 wait complete. 2023-10-06T05:29:51.307 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T05:29:51.307 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T05:29:51.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.412+0000 7f6bcf668700 1 Processor -- start 2023-10-06T05:29:51.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.412+0000 7f6bcf668700 1 -- start start 2023-10-06T05:29:51.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6bc8158c30 0x7f6bc8159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bc806b810 0x7f6bc80cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc806b380 con 0x7f6bc815d890 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc806bc50 con 0x7f6bc806b810 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc806a770 con 0x7f6bc8158c30 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcdc05700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bc806b810 0x7f6bc80cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bccc03700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6bc815d890 0x7f6bc80ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49486/0 (socket says 172.21.15.29:49486) 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcdc05700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bc806b810 0x7f6bc80cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60168/0 (socket says 172.21.15.29:60168) 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bccc03700 1 -- 172.21.15.29:0/2825760909 learned_addr learned my addr 172.21.15.29:0/2825760909 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcd404700 1 --2- 172.21.15.29:0/2825760909 >> v2:172.21.15.173:3300/0 conn(0x7f6bc8158c30 0x7f6bc8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcdc05700 1 -- 172.21.15.29:0/2825760909 >> v2:172.21.15.173:3300/0 conn(0x7f6bc8158c30 msgr2=0x7f6bc8159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcdc05700 1 --2- 172.21.15.29:0/2825760909 >> v2:172.21.15.173:3300/0 conn(0x7f6bc8158c30 0x7f6bc8159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcdc05700 1 -- 172.21.15.29:0/2825760909 >> v1:172.21.15.29:6789/0 conn(0x7f6bc815d890 legacy=0x7f6bc80ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcdc05700 1 -- 172.21.15.29:0/2825760909 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc806aa50 con 0x7f6bc806b810 2023-10-06T05:29:51.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcd404700 1 --2- 172.21.15.29:0/2825760909 >> v2:172.21.15.173:3300/0 conn(0x7f6bc8158c30 0x7f6bc8159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:51.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcdc05700 1 --2- 172.21.15.29:0/2825760909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc806b810 0x7f6bc80cfd60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6bc806a250 tx=0x7f6bc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e09f22265e23e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:51.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bbffff700 1 -- 172.21.15.29:0/2825760909 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000e070 con 0x7f6bc806b810 2023-10-06T05:29:51.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bbffff700 1 -- 172.21.15.29:0/2825760909 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc000bc30 con 0x7f6bc806b810 2023-10-06T05:29:51.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bbffff700 1 -- 172.21.15.29:0/2825760909 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0012430 con 0x7f6bc806b810 2023-10-06T05:29:51.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 -- 172.21.15.29:0/2825760909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc806b810 msgr2=0x7f6bc80cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 --2- 172.21.15.29:0/2825760909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc806b810 0x7f6bc80cfd60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6bc806a250 tx=0x7f6bc0009780 comp rx=0 tx=0).stop 2023-10-06T05:29:51.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 -- 172.21.15.29:0/2825760909 shutdown_connections 2023-10-06T05:29:51.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 --2- 172.21.15.29:0/2825760909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc806b810 0x7f6bc80cfd60 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 --2- 172.21.15.29:0/2825760909 >> v2:172.21.15.173:3300/0 conn(0x7f6bc8158c30 0x7f6bc8159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 -- 172.21.15.29:0/2825760909 >> 172.21.15.29:0/2825760909 conn(0x7f6bc80670a0 msgr2=0x7f6bc80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:51.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 -- 172.21.15.29:0/2825760909 shutdown_connections 2023-10-06T05:29:51.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.416+0000 7f6bcf668700 1 -- 172.21.15.29:0/2825760909 wait complete. 2023-10-06T05:29:51.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 Processor -- start 2023-10-06T05:29:51.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 -- start start 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc806b810 0x7f6bc80c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc8158c30 0x7f6bc80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc815d890 0x7f6bc8151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8151940 con 0x7f6bc815d890 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80b2ea0 con 0x7f6bc8158c30 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80b21c0 con 0x7f6bc806b810 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcd404700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc806b810 0x7f6bc80c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcdc05700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc815d890 0x7f6bc8151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bccc03700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc8158c30 0x7f6bc80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcd404700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc806b810 0x7f6bc80c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:53174/0 (socket says 172.21.15.29:53174) 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcd404700 1 -- 172.21.15.29:0/2027570642 learned_addr learned my addr 172.21.15.29:0/2027570642 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcd404700 1 -- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc8158c30 msgr2=0x7f6bc80b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcd404700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc8158c30 0x7f6bc80b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcd404700 1 -- 172.21.15.29:0/2027570642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc815d890 msgr2=0x7f6bc8151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcd404700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc815d890 0x7f6bc8151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcd404700 1 -- 172.21.15.29:0/2027570642 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009a20 con 0x7f6bc806b810 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcdc05700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc815d890 0x7f6bc8151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcd404700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc806b810 0x7f6bc80c9240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c830 tx=0x7f6bc4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bbd7fa700 1 -- 172.21.15.29:0/2027570642 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011600 con 0x7f6bc806b810 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc80c7b60 con 0x7f6bc806b810 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bbd7fa700 1 -- 172.21.15.29:0/2027570642 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc4011760 con 0x7f6bc806b810 2023-10-06T05:29:51.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bbd7fa700 1 -- 172.21.15.29:0/2027570642 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011b20 con 0x7f6bc806b810 2023-10-06T05:29:51.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.420+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc80c7e00 con 0x7f6bc806b810 2023-10-06T05:29:51.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.424+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc8071120 con 0x7f6bc806b810 2023-10-06T05:29:51.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.424+0000 7f6bbd7fa700 1 -- 172.21.15.29:0/2027570642 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6bc401a450 con 0x7f6bc806b810 2023-10-06T05:29:51.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.424+0000 7f6bbd7fa700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6bac060550 0x7f6bac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:51.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.424+0000 7f6bbd7fa700 1 -- 172.21.15.29:0/2027570642 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6bc407cb00 con 0x7f6bc806b810 2023-10-06T05:29:51.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.424+0000 7f6bccc03700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6bac060550 0x7f6bac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:51.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.428+0000 7f6bccc03700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6bac060550 0x7f6bac062a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80c9df0 tx=0x7f6bb8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:51.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.436+0000 7f6bbd7fa700 1 -- 172.21.15.29:0/2027570642 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6bc404d2c0 con 0x7f6bc806b810 2023-10-06T05:29:51.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:51.596+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6bc806ad30 con 0x7f6bc806b810 2023-10-06T05:29:52.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.476+0000 7f6bbd7fa700 1 -- 172.21.15.29:0/2027570642 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6bc40508e0 con 0x7f6bc806b810 2023-10-06T05:29:52.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.488+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6bac060550 msgr2=0x7f6bac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.488+0000 7f6bcf668700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6bac060550 0x7f6bac062a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80c9df0 tx=0x7f6bb8009040 comp rx=0 tx=0).stop 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.488+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc806b810 msgr2=0x7f6bc80c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.488+0000 7f6bcf668700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc806b810 0x7f6bc80c9240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c830 tx=0x7f6bc4008040 comp rx=0 tx=0).stop 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.492+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 shutdown_connections 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.492+0000 7f6bcf668700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc815d890 0x7f6bc8151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.492+0000 7f6bcf668700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6bac060550 0x7f6bac062a00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.492+0000 7f6bcf668700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc8158c30 0x7f6bc80b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.492+0000 7f6bcf668700 1 --2- 172.21.15.29:0/2027570642 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc806b810 0x7f6bc80c9240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.492+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 >> 172.21.15.29:0/2027570642 conn(0x7f6bc80670a0 msgr2=0x7f6bc80cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.492+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 shutdown_connections 2023-10-06T05:29:52.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.492+0000 7f6bcf668700 1 -- 172.21.15.29:0/2027570642 wait complete. 2023-10-06T05:29:52.498 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-06T05:29:52.510 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T05:29:52.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.624+0000 7fbd2f59e700 1 Processor -- start 2023-10-06T05:29:52.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.624+0000 7fbd2f59e700 1 -- start start 2023-10-06T05:29:52.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.624+0000 7fbd2f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd30158c40 0x7fbd300d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:52.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.624+0000 7fbd2f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd300cae30 con 0x7fbd300ce320 2023-10-06T05:29:52.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.624+0000 7fbd2f59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3006ba70 con 0x7fbd30159010 2023-10-06T05:29:52.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.624+0000 7fbd2f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3006b4b0 con 0x7fbd30158c40 2023-10-06T05:29:52.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.624+0000 7fbd2ed9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbd300ce320 0x7fbd300cb2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49502/0 (socket says 172.21.15.29:49502) 2023-10-06T05:29:52.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.624+0000 7fbd2ed9d700 1 -- 172.21.15.29:0/1833832289 learned_addr learned my addr 172.21.15.29:0/1833832289 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:52.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.624+0000 7fbd2e59c700 1 --2- 172.21.15.29:0/1833832289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd30158c40 0x7fbd300d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:52.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2d59a700 1 -- 172.21.15.29:0/1833832289 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428687453 0 0) 0x7fbd300cae30 con 0x7fbd300ce320 2023-10-06T05:29:52.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2d59a700 1 -- 172.21.15.29:0/1833832289 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd18003570 con 0x7fbd300ce320 2023-10-06T05:29:52.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2d59a700 1 -- 172.21.15.29:0/1833832289 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192433872 0 0) 0x7fbd3006ba70 con 0x7fbd30159010 2023-10-06T05:29:52.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2e59c700 1 -- 172.21.15.29:0/1833832289 >> v1:172.21.15.173:6789/0 conn(0x7fbd30159010 legacy=0x7fbd3006aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:52.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2e59c700 1 -- 172.21.15.29:0/1833832289 >> v1:172.21.15.29:6789/0 conn(0x7fbd300ce320 legacy=0x7fbd300cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:52.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2e59c700 1 -- 172.21.15.29:0/1833832289 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3006b790 con 0x7fbd30158c40 2023-10-06T05:29:52.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2e59c700 1 --2- 172.21.15.29:0/1833832289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd30158c40 0x7fbd300d0570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009910 tx=0x7fbd240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85bc68b6121110d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:52.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2d59a700 1 -- 172.21.15.29:0/1833832289 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400b680 con 0x7fbd30158c40 2023-10-06T05:29:52.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2d59a700 1 -- 172.21.15.29:0/1833832289 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2400b7e0 con 0x7fbd30158c40 2023-10-06T05:29:52.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2d59a700 1 -- 172.21.15.29:0/1833832289 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400bb60 con 0x7fbd30158c40 2023-10-06T05:29:52.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2f59e700 1 -- 172.21.15.29:0/1833832289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd30158c40 msgr2=0x7fbd300d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:52.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2f59e700 1 --2- 172.21.15.29:0/1833832289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd30158c40 0x7fbd300d0570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009910 tx=0x7fbd240091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:52.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2f59e700 1 -- 172.21.15.29:0/1833832289 shutdown_connections 2023-10-06T05:29:52.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2f59e700 1 --2- 172.21.15.29:0/1833832289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd30158c40 0x7fbd300d0570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:52.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2f59e700 1 -- 172.21.15.29:0/1833832289 >> 172.21.15.29:0/1833832289 conn(0x7fbd300670a0 msgr2=0x7fbd300674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:52.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2f59e700 1 -- 172.21.15.29:0/1833832289 shutdown_connections 2023-10-06T05:29:52.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.628+0000 7fbd2f59e700 1 -- 172.21.15.29:0/1833832289 wait complete. 2023-10-06T05:29:52.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 Processor -- start 2023-10-06T05:29:52.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 -- start start 2023-10-06T05:29:52.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd300ce320 0x7fbd30148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd30158c40 0x7fbd300c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd30159010 0x7fbd300c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c5de0 con 0x7fbd30158c40 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c60c0 con 0x7fbd30159010 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c63a0 con 0x7fbd300ce320 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd30158c40 0x7fbd300c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd30158c40 0x7fbd300c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60184/0 (socket says 172.21.15.29:60184) 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2dd9b700 1 -- 172.21.15.29:0/2726964384 learned_addr learned my addr 172.21.15.29:0/2726964384 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2ed9d700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd30159010 0x7fbd300c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2e59c700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd300ce320 0x7fbd30148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:52.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2dd9b700 1 -- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd300ce320 msgr2=0x7fbd30148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:52.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2dd9b700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd300ce320 0x7fbd30148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:52.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2dd9b700 1 -- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd30159010 msgr2=0x7fbd300c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:52.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2dd9b700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd30159010 0x7fbd300c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:52.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2dd9b700 1 -- 172.21.15.29:0/2726964384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd24009420 con 0x7fbd30158c40 2023-10-06T05:29:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2dd9b700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd30158c40 0x7fbd300c75b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c530 tx=0x7fbd2000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd1e7fc700 1 -- 172.21.15.29:0/2726964384 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20011590 con 0x7fbd30158c40 2023-10-06T05:29:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd1e7fc700 1 -- 172.21.15.29:0/2726964384 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20011710 con 0x7fbd30158c40 2023-10-06T05:29:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd300c6680 con 0x7fbd30158c40 2023-10-06T05:29:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd1e7fc700 1 -- 172.21.15.29:0/2726964384 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20011ad0 con 0x7fbd30158c40 2023-10-06T05:29:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.632+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd30148dd0 con 0x7fbd30158c40 2023-10-06T05:29:52.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.636+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3004be00 con 0x7fbd30158c40 2023-10-06T05:29:52.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.636+0000 7fbd1e7fc700 1 -- 172.21.15.29:0/2726964384 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbd2001b3b0 con 0x7fbd30158c40 2023-10-06T05:29:52.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.636+0000 7fbd1e7fc700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd10060550 0x7fbd10062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:52.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.636+0000 7fbd1e7fc700 1 -- 172.21.15.29:0/2726964384 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fbd2007bc80 con 0x7fbd30158c40 2023-10-06T05:29:52.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.636+0000 7fbd2e59c700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd10060550 0x7fbd10062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:52.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.636+0000 7fbd2e59c700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd10060550 0x7fbd10062a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd240093f0 tx=0x7fbd24017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:52.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.644+0000 7fbd1e7fc700 1 -- 172.21.15.29:0/2726964384 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbd2004c250 con 0x7fbd30158c40 2023-10-06T05:29:52.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:52.808+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbd300caac0 con 0x7fbd30158c40 2023-10-06T05:29:53.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.488+0000 7fbd1e7fc700 1 -- 172.21.15.29:0/2726964384 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbd20017020 con 0x7fbd30158c40 2023-10-06T05:29:53.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.500+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd10060550 msgr2=0x7fbd10062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:53.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.500+0000 7fbd2f59e700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd10060550 0x7fbd10062a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd240093f0 tx=0x7fbd24017000 comp rx=0 tx=0).stop 2023-10-06T05:29:53.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.500+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd30158c40 msgr2=0x7fbd300c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:53.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.500+0000 7fbd2f59e700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd30158c40 0x7fbd300c75b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c530 tx=0x7fbd2000c840 comp rx=0 tx=0).stop 2023-10-06T05:29:53.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.500+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 shutdown_connections 2023-10-06T05:29:53.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.504+0000 7fbd2f59e700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbd10060550 0x7fbd10062a00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:53.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.504+0000 7fbd2f59e700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd30159010 0x7fbd300c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:53.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.504+0000 7fbd2f59e700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd30158c40 0x7fbd300c75b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:53.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.504+0000 7fbd2f59e700 1 --2- 172.21.15.29:0/2726964384 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd300ce320 0x7fbd30148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:53.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.504+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 >> 172.21.15.29:0/2726964384 conn(0x7fbd300670a0 msgr2=0x7fbd300cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.508+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 shutdown_connections 2023-10-06T05:29:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.508+0000 7fbd2f59e700 1 -- 172.21.15.29:0/2726964384 wait complete. 2023-10-06T05:29:53.517 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-06T05:29:53.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T05:29:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.632+0000 7f167f4b3700 1 Processor -- start 2023-10-06T05:29:53.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.632+0000 7f167f4b3700 1 -- start start 2023-10-06T05:29:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.632+0000 7f167f4b3700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f167806c8f0 0x7f167806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.632+0000 7f167f4b3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16780afce0 0x7f1678158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.632+0000 7f167f4b3700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16780cb620 con 0x7f1678158dd0 2023-10-06T05:29:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.632+0000 7f167f4b3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167806aad0 con 0x7f16780afce0 2023-10-06T05:29:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.632+0000 7f167f4b3700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16780cb340 con 0x7f167806c8f0 2023-10-06T05:29:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167dcb0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16780afce0 0x7f1678158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167dcb0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16780afce0 0x7f1678158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60194/0 (socket says 172.21.15.29:60194) 2023-10-06T05:29:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167dcb0700 1 -- 172.21.15.29:0/3087774915 learned_addr learned my addr 172.21.15.29:0/3087774915 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167e4b1700 1 --2- 172.21.15.29:0/3087774915 >> v2:172.21.15.173:3300/0 conn(0x7f167806c8f0 0x7f167806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167dcb0700 1 -- 172.21.15.29:0/3087774915 >> v2:172.21.15.173:3300/0 conn(0x7f167806c8f0 msgr2=0x7f167806ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167dcb0700 1 --2- 172.21.15.29:0/3087774915 >> v2:172.21.15.173:3300/0 conn(0x7f167806c8f0 0x7f167806ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167dcb0700 1 -- 172.21.15.29:0/3087774915 >> v1:172.21.15.173:6789/0 conn(0x7f1678158dd0 legacy=0x7f16780ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167dcb0700 1 -- 172.21.15.29:0/3087774915 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167806a480 con 0x7f16780afce0 2023-10-06T05:29:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167dcb0700 1 --2- 172.21.15.29:0/3087774915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 0x7f1678158890 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f16780b5f40 tx=0x7f166c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e940d20f983ff25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:53.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167d4af700 1 -- 172.21.15.29:0/3087774915 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c00b860 con 0x7f16780afce0 2023-10-06T05:29:53.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167d4af700 1 -- 172.21.15.29:0/3087774915 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c00b9c0 con 0x7f16780afce0 2023-10-06T05:29:53.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167d4af700 1 -- 172.21.15.29:0/3087774915 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c00bd60 con 0x7f16780afce0 2023-10-06T05:29:53.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167f4b3700 1 -- 172.21.15.29:0/3087774915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 msgr2=0x7f1678158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:53.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167f4b3700 1 --2- 172.21.15.29:0/3087774915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 0x7f1678158890 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f16780b5f40 tx=0x7f166c009250 comp rx=0 tx=0).stop 2023-10-06T05:29:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167f4b3700 1 -- 172.21.15.29:0/3087774915 shutdown_connections 2023-10-06T05:29:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167f4b3700 1 --2- 172.21.15.29:0/3087774915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 0x7f1678158890 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167f4b3700 1 --2- 172.21.15.29:0/3087774915 >> v2:172.21.15.173:3300/0 conn(0x7f167806c8f0 0x7f167806ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167f4b3700 1 -- 172.21.15.29:0/3087774915 >> 172.21.15.29:0/3087774915 conn(0x7f1678062b60 msgr2=0x7f1678062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167f4b3700 1 -- 172.21.15.29:0/3087774915 shutdown_connections 2023-10-06T05:29:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.636+0000 7f167f4b3700 1 -- 172.21.15.29:0/3087774915 wait complete. 2023-10-06T05:29:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 Processor -- start 2023-10-06T05:29:53.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 -- start start 2023-10-06T05:29:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f167806c8f0 0x7f16780c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 0x7f167815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1678158dd0 0x7f16780c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:53.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1678151ad0 con 0x7f16780afce0 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16780c47d0 con 0x7f167806c8f0 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16780c4210 con 0x7f1678158dd0 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167dcb0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 0x7f167815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167dcb0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 0x7f167815ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60208/0 (socket says 172.21.15.29:60208) 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167dcb0700 1 -- 172.21.15.29:0/4205338026 learned_addr learned my addr 172.21.15.29:0/4205338026 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167e4b1700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f167806c8f0 0x7f16780c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167ecb2700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1678158dd0 0x7f16780c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167dcb0700 1 -- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1678158dd0 msgr2=0x7f16780c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167dcb0700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1678158dd0 0x7f16780c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167dcb0700 1 -- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f167806c8f0 msgr2=0x7f16780c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:53.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167dcb0700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f167806c8f0 0x7f16780c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:53.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167dcb0700 1 -- 172.21.15.29:0/4205338026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c0094f0 con 0x7f16780afce0 2023-10-06T05:29:53.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167ecb2700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1678158dd0 0x7f16780c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:29:53.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167dcb0700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 0x7f167815ec20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f166c006fd0 tx=0x7f166c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:53.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f16767fc700 1 -- 172.21.15.29:0/4205338026 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c011e20 con 0x7f16780afce0 2023-10-06T05:29:53.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f16767fc700 1 -- 172.21.15.29:0/4205338026 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c01a630 con 0x7f16780afce0 2023-10-06T05:29:53.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f16767fc700 1 -- 172.21.15.29:0/4205338026 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c01a9f0 con 0x7f16780afce0 2023-10-06T05:29:53.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16780c44f0 con 0x7f16780afce0 2023-10-06T05:29:53.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.640+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1678153510 con 0x7f16780afce0 2023-10-06T05:29:53.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.644+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16781515c0 con 0x7f16780afce0 2023-10-06T05:29:53.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.644+0000 7f16767fc700 1 -- 172.21.15.29:0/4205338026 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f166c02d440 con 0x7f16780afce0 2023-10-06T05:29:53.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.644+0000 7f16767fc700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1664060580 0x7f1664062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:53.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.644+0000 7f16767fc700 1 -- 172.21.15.29:0/4205338026 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f166c07e430 con 0x7f16780afce0 2023-10-06T05:29:53.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.644+0000 7f167e4b1700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1664060580 0x7f1664062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:53.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.648+0000 7f167e4b1700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1664060580 0x7f1664062a30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16680075a0 tx=0x7f16680097a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:53.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.652+0000 7f16767fc700 1 -- 172.21.15.29:0/4205338026 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f16781515c0 con 0x7f16780afce0 2023-10-06T05:29:53.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:53.852+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f16781515c0 con 0x7f16780afce0 2023-10-06T05:29:54.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.500+0000 7f16767fc700 1 -- 172.21.15.29:0/4205338026 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v39) v1 ==== 174+0+0 (secure 0 0 0) 0x7f16781515c0 con 0x7f16780afce0 2023-10-06T05:29:54.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.508+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1664060580 msgr2=0x7f1664062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.508+0000 7f167f4b3700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1664060580 0x7f1664062a30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16680075a0 tx=0x7f16680097a0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.508+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 msgr2=0x7f167815ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.508+0000 7f167f4b3700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 0x7f167815ec20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f166c006fd0 tx=0x7f166c017000 comp rx=0 tx=0).stop 2023-10-06T05:29:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.512+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 shutdown_connections 2023-10-06T05:29:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.512+0000 7f167f4b3700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1678158dd0 0x7f16780c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.512+0000 7f167f4b3700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16780afce0 0x7f167815ec20 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.512+0000 7f167f4b3700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1664060580 0x7f1664062a30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.512+0000 7f167f4b3700 1 --2- 172.21.15.29:0/4205338026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f167806c8f0 0x7f16780c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.512+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 >> 172.21.15.29:0/4205338026 conn(0x7f1678062b60 msgr2=0x7f16780b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.512+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 shutdown_connections 2023-10-06T05:29:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.512+0000 7f167f4b3700 1 -- 172.21.15.29:0/4205338026 wait complete. 2023-10-06T05:29:54.519 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 11 and data pool 12 2023-10-06T05:29:54.546 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:29:54.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f81014cf700 1 Processor -- start 2023-10-06T05:29:54.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f81014cf700 1 -- start start 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f81014cf700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc158bd0 0x7f80fc158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f81014cf700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f80fc06b2a0 0x7f80fc0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f81014cf700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80fc0c7090 con 0x7f80fc0acc40 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f81014cf700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc06bc80 con 0x7f80fc06b2a0 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f81014cf700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc06bf60 con 0x7f80fc158bd0 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f8100cce700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f80fc0acc40 0x7f80fc0c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56212/0 (socket says 172.21.15.29:56212) 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f8100cce700 1 -- 172.21.15.29:0/3365983125 learned_addr learned my addr 172.21.15.29:0/3365983125 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80fb7fe700 1 --2- 172.21.15.29:0/3365983125 >> v2:172.21.15.29:3300/0 conn(0x7f80fc06b2a0 0x7f80fc0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80fbfff700 1 --2- 172.21.15.29:0/3365983125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc158bd0 0x7f80fc158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80faffd700 1 -- 172.21.15.29:0/3365983125 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536506131 0 0) 0x7f80fc0c7090 con 0x7f80fc0acc40 2023-10-06T05:29:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80faffd700 1 -- 172.21.15.29:0/3365983125 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80e4003570 con 0x7f80fc0acc40 2023-10-06T05:29:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80fb7fe700 1 -- 172.21.15.29:0/3365983125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc158bd0 msgr2=0x7f80fc158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80fb7fe700 1 --2- 172.21.15.29:0/3365983125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc158bd0 0x7f80fc158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80fb7fe700 1 -- 172.21.15.29:0/3365983125 >> v1:172.21.15.29:6789/0 conn(0x7f80fc0acc40 legacy=0x7f80fc0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80fb7fe700 1 -- 172.21.15.29:0/3365983125 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0c7300 con 0x7f80fc06b2a0 2023-10-06T05:29:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80fb7fe700 1 --2- 172.21.15.29:0/3365983125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc06b2a0 0x7f80fc0ac700 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f80f00098e0 tx=0x7f80f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d37c43b7b8a91ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.640+0000 7f80faffd700 1 -- 172.21.15.29:0/3365983125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000b640 con 0x7f80fc06b2a0 2023-10-06T05:29:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f80faffd700 1 -- 172.21.15.29:0/3365983125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f000b7a0 con 0x7f80fc06b2a0 2023-10-06T05:29:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f80faffd700 1 -- 172.21.15.29:0/3365983125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000bb40 con 0x7f80fc06b2a0 2023-10-06T05:29:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 -- 172.21.15.29:0/3365983125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc06b2a0 msgr2=0x7f80fc0ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 --2- 172.21.15.29:0/3365983125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc06b2a0 0x7f80fc0ac700 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f80f00098e0 tx=0x7f80f00091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 -- 172.21.15.29:0/3365983125 shutdown_connections 2023-10-06T05:29:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 --2- 172.21.15.29:0/3365983125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc06b2a0 0x7f80fc0ac700 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 --2- 172.21.15.29:0/3365983125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc158bd0 0x7f80fc158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 -- 172.21.15.29:0/3365983125 >> 172.21.15.29:0/3365983125 conn(0x7f80fc06d7d0 msgr2=0x7f80fc06dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 -- 172.21.15.29:0/3365983125 shutdown_connections 2023-10-06T05:29:54.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 -- 172.21.15.29:0/3365983125 wait complete. 2023-10-06T05:29:54.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 Processor -- start 2023-10-06T05:29:54.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 -- start start 2023-10-06T05:29:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc06b2a0 0x7f80fc155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc0acc40 0x7f80fc168cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80fc158bd0 0x7f80fc169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0c3b90 con 0x7f80fc0acc40 2023-10-06T05:29:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0c4fd0 con 0x7f80fc158bd0 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f81014cf700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc169330 con 0x7f80fc06b2a0 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f80fb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc0acc40 0x7f80fc168cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f80fb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc0acc40 0x7f80fc168cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44642/0 (socket says 172.21.15.29:44642) 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.644+0000 7f80fb7fe700 1 -- 172.21.15.29:0/766675850 learned_addr learned my addr 172.21.15.29:0/766675850 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80fbfff700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc06b2a0 0x7f80fc155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f8100cce700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80fc158bd0 0x7f80fc169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80fb7fe700 1 -- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc06b2a0 msgr2=0x7f80fc155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80fb7fe700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc06b2a0 0x7f80fc155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80fb7fe700 1 -- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80fc158bd0 msgr2=0x7f80fc169eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80fb7fe700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80fc158bd0 0x7f80fc169eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80fb7fe700 1 -- 172.21.15.29:0/766675850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0009420 con 0x7f80fc0acc40 2023-10-06T05:29:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80fbfff700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc06b2a0 0x7f80fc155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80fb7fe700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc0acc40 0x7f80fc168cb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0636e0 tx=0x7f80f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80e3fff700 1 -- 172.21.15.29:0/766675850 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f001bda0 con 0x7f80fc0acc40 2023-10-06T05:29:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80e3fff700 1 -- 172.21.15.29:0/766675850 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0011420 con 0x7f80fc0acc40 2023-10-06T05:29:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc169610 con 0x7f80fc0acc40 2023-10-06T05:29:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f80e3fff700 1 -- 172.21.15.29:0/766675850 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f00117e0 con 0x7f80fc0acc40 2023-10-06T05:29:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc169bd0 con 0x7f80fc0acc40 2023-10-06T05:29:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.648+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc0c38a0 con 0x7f80fc0acc40 2023-10-06T05:29:54.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.652+0000 7f80e3fff700 1 -- 172.21.15.29:0/766675850 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f80f0011b90 con 0x7f80fc0acc40 2023-10-06T05:29:54.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.652+0000 7f80e3fff700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e8060580 0x7f80e8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.652+0000 7f80e3fff700 1 -- 172.21.15.29:0/766675850 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f80f007df40 con 0x7f80fc0acc40 2023-10-06T05:29:54.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.652+0000 7f80fbfff700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e8060580 0x7f80e8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.652+0000 7f80fbfff700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e8060580 0x7f80e8062a30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009fd0 tx=0x7f80f4009740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.656+0000 7f80e3fff700 1 -- 172.21.15.29:0/766675850 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80fc0c38a0 con 0x7f80fc0acc40 2023-10-06T05:29:54.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.820+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80fc0c38a0 con 0x7f80fc0acc40 2023-10-06T05:29:54.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f80e3fff700 1 -- 172.21.15.29:0/766675850 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16882 (secure 0 0 0) 0x7f80fc0c38a0 con 0x7f80fc0acc40 2023-10-06T05:29:54.829 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:54.829 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":76,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:29:53.859088+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:29:51.644444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T05:29:52.853119+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:29:54.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e8060580 msgr2=0x7f80e8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e8060580 0x7f80e8062a30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009fd0 tx=0x7f80f4009740 comp rx=0 tx=0).stop 2023-10-06T05:29:54.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc0acc40 msgr2=0x7f80fc168cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc0acc40 0x7f80fc168cb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0636e0 tx=0x7f80f0017000 comp rx=0 tx=0).stop 2023-10-06T05:29:54.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 shutdown_connections 2023-10-06T05:29:54.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f80e8060580 0x7f80e8062a30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80fc158bd0 0x7f80fc169eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80fc0acc40 0x7f80fc168cb0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 --2- 172.21.15.29:0/766675850 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80fc06b2a0 0x7f80fc155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 >> 172.21.15.29:0/766675850 conn(0x7f80fc06d7d0 msgr2=0x7f80fc157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:54.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 shutdown_connections 2023-10-06T05:29:54.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.824+0000 7f81014cf700 1 -- 172.21.15.29:0/766675850 wait complete. 2023-10-06T05:29:54.844 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:29:54.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.944+0000 7ffaaebbb700 1 Processor -- start 2023-10-06T05:29:54.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.944+0000 7ffaaebbb700 1 -- start start 2023-10-06T05:29:54.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaaebbb700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffaa8156b50 0x7ffaa8156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaaebbb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffaa80c6ff0 0x7ffaa80c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaaebbb700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa81566c0 con 0x7ffaa81556a0 2023-10-06T05:29:54.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaaebbb700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa81599c0 con 0x7ffaa80c6ff0 2023-10-06T05:29:54.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaaebbb700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa80c7b40 con 0x7ffaa8156b50 2023-10-06T05:29:54.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaae3ba700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffaa80c6ff0 0x7ffaa80c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaae3ba700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffaa80c6ff0 0x7ffaa80c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44656/0 (socket says 172.21.15.29:44656) 2023-10-06T05:29:54.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaae3ba700 1 -- 172.21.15.29:0/2794442886 learned_addr learned my addr 172.21.15.29:0/2794442886 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:54.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaad3b8700 1 --2- 172.21.15.29:0/2794442886 >> v2:172.21.15.173:3300/0 conn(0x7ffaa8156b50 0x7ffaa8156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaae3ba700 1 -- 172.21.15.29:0/2794442886 >> v2:172.21.15.173:3300/0 conn(0x7ffaa8156b50 msgr2=0x7ffaa8156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:54.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaae3ba700 1 --2- 172.21.15.29:0/2794442886 >> v2:172.21.15.173:3300/0 conn(0x7ffaa8156b50 0x7ffaa8156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaae3ba700 1 -- 172.21.15.29:0/2794442886 >> v1:172.21.15.173:6789/0 conn(0x7ffaa81556a0 legacy=0x7ffaa8155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaacbb7700 1 -- 172.21.15.29:0/2794442886 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538328601 0 0) 0x7ffaa81566c0 con 0x7ffaa81556a0 2023-10-06T05:29:54.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaae3ba700 1 -- 172.21.15.29:0/2794442886 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa80c7e20 con 0x7ffaa80c6ff0 2023-10-06T05:29:54.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaad3b8700 1 --2- 172.21.15.29:0/2794442886 >> v2:172.21.15.173:3300/0 conn(0x7ffaa8156b50 0x7ffaa8156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:54.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaae3ba700 1 --2- 172.21.15.29:0/2794442886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa80c6ff0 0x7ffaa80c7430 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80639c0 tx=0x7ffaa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b124d4e20d97f239 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:54.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaacbb7700 1 -- 172.21.15.29:0/2794442886 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000e070 con 0x7ffaa80c6ff0 2023-10-06T05:29:54.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaacbb7700 1 -- 172.21.15.29:0/2794442886 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa000ba20 con 0x7ffaa80c6ff0 2023-10-06T05:29:54.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaacbb7700 1 -- 172.21.15.29:0/2794442886 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00092e0 con 0x7ffaa80c6ff0 2023-10-06T05:29:54.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaaebbb700 1 -- 172.21.15.29:0/2794442886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa80c6ff0 msgr2=0x7ffaa80c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.948+0000 7ffaaebbb700 1 --2- 172.21.15.29:0/2794442886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa80c6ff0 0x7ffaa80c7430 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80639c0 tx=0x7ffaa0009840 comp rx=0 tx=0).stop 2023-10-06T05:29:54.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 -- 172.21.15.29:0/2794442886 shutdown_connections 2023-10-06T05:29:54.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 --2- 172.21.15.29:0/2794442886 >> v2:172.21.15.173:3300/0 conn(0x7ffaa8156b50 0x7ffaa8156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 --2- 172.21.15.29:0/2794442886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa80c6ff0 0x7ffaa80c7430 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 -- 172.21.15.29:0/2794442886 >> 172.21.15.29:0/2794442886 conn(0x7ffaa806d7d0 msgr2=0x7ffaa806dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:54.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 -- 172.21.15.29:0/2794442886 shutdown_connections 2023-10-06T05:29:54.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 -- 172.21.15.29:0/2794442886 wait complete. 2023-10-06T05:29:54.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 Processor -- start 2023-10-06T05:29:54.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 -- start start 2023-10-06T05:29:54.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80c6ff0 0x7ffaa8153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa81556a0 0x7ffaa80c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa8156b50 0x7ffaa8152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80c6920 con 0x7ffaa8156b50 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80c4ec0 con 0x7ffaa80c6ff0 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaaebbb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80c60c0 con 0x7ffaa81556a0 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaae3ba700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa8156b50 0x7ffaa8152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaadbb9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80c6ff0 0x7ffaa8153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaadbb9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80c6ff0 0x7ffaa8153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:46938/0 (socket says 172.21.15.29:46938) 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaadbb9700 1 -- 172.21.15.29:0/1450829839 learned_addr learned my addr 172.21.15.29:0/1450829839 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.952+0000 7ffaad3b8700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa81556a0 0x7ffaa80c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaae3ba700 1 -- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa81556a0 msgr2=0x7ffaa80c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaae3ba700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa81556a0 0x7ffaa80c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaae3ba700 1 -- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80c6ff0 msgr2=0x7ffaa8153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaae3ba700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80c6ff0 0x7ffaa8153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaae3ba700 1 -- 172.21.15.29:0/1450829839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98009420 con 0x7ffaa8156b50 2023-10-06T05:29:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaad3b8700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa81556a0 0x7ffaa80c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaae3ba700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa8156b50 0x7ffaa8152fa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0015000 tx=0x7ffaa0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffa9dffb700 1 -- 172.21.15.29:0/1450829839 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0008b70 con 0x7ffaa8156b50 2023-10-06T05:29:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffa9dffb700 1 -- 172.21.15.29:0/1450829839 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0008cd0 con 0x7ffaa8156b50 2023-10-06T05:29:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa0009ae0 con 0x7ffaa8156b50 2023-10-06T05:29:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffa9dffb700 1 -- 172.21.15.29:0/1450829839 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa001c660 con 0x7ffaa8156b50 2023-10-06T05:29:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa80c63e0 con 0x7ffaa8156b50 2023-10-06T05:29:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.956+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa804be00 con 0x7ffaa8156b50 2023-10-06T05:29:54.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.960+0000 7ffa9dffb700 1 -- 172.21.15.29:0/1450829839 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffaa0003040 con 0x7ffaa8156b50 2023-10-06T05:29:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.960+0000 7ffa9dffb700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa8c060550 0x7ffa8c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.960+0000 7ffa9dffb700 1 -- 172.21.15.29:0/1450829839 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffaa007e3f0 con 0x7ffaa8156b50 2023-10-06T05:29:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.960+0000 7ffaadbb9700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa8c060550 0x7ffa8c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:54.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.960+0000 7ffaadbb9700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa8c060550 0x7ffa8c062a00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400cd10 tx=0x7ffaa400c300 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:54.968+0000 7ffa9dffb700 1 -- 172.21.15.29:0/1450829839 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffaa004e880 con 0x7ffaa8156b50 2023-10-06T05:29:55.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.128+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaa8155f60 con 0x7ffaa8156b50 2023-10-06T05:29:55.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffa9dffb700 1 -- 172.21.15.29:0/1450829839 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16882 (secure 0 0 0) 0x7ffaa0051ea0 con 0x7ffaa8156b50 2023-10-06T05:29:55.165 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:55.166 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":76,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:29:53.859088+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:29:51.644444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T05:29:52.853119+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:29:55.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa8c060550 msgr2=0x7ffa8c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa8c060550 0x7ffa8c062a00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400cd10 tx=0x7ffaa400c300 comp rx=0 tx=0).stop 2023-10-06T05:29:55.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa8156b50 msgr2=0x7ffaa8152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa8156b50 0x7ffaa8152fa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0015000 tx=0x7ffaa0018000 comp rx=0 tx=0).stop 2023-10-06T05:29:55.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 shutdown_connections 2023-10-06T05:29:55.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffaa8156b50 0x7ffaa8152fa0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa81556a0 0x7ffaa80c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffa8c060550 0x7ffa8c062a00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 --2- 172.21.15.29:0/1450829839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80c6ff0 0x7ffaa8153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 >> 172.21.15.29:0/1450829839 conn(0x7ffaa806d7d0 msgr2=0x7ffaa80c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:55.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 shutdown_connections 2023-10-06T05:29:55.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.132+0000 7ffaaebbb700 1 -- 172.21.15.29:0/1450829839 wait complete. 2023-10-06T05:29:55.169 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T05:29:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.280+0000 7f970ae2b700 1 Processor -- start 2023-10-06T05:29:55.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.280+0000 7f970ae2b700 1 -- start start 2023-10-06T05:29:55.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.280+0000 7f970ae2b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9704159010 0x7f97040d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.280+0000 7f970ae2b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97040ce320 0x7f97040ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.280+0000 7f970ae2b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97040cae30 con 0x7f9704158c40 2023-10-06T05:29:55.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.280+0000 7f970ae2b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97040cecb0 con 0x7f97040ce320 2023-10-06T05:29:55.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.280+0000 7f970ae2b700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970406ba70 con 0x7f9704159010 2023-10-06T05:29:55.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970a62a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97040ce320 0x7f97040ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f9709628700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9704159010 0x7f97040d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970a62a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97040ce320 0x7f97040ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44670/0 (socket says 172.21.15.29:44670) 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970a62a700 1 -- 172.21.15.29:0/734544686 learned_addr learned my addr 172.21.15.29:0/734544686 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f9709e29700 1 --1- 172.21.15.29:0/734544686 >> v1:172.21.15.173:6789/0 conn(0x7f9704158c40 0x7f970406aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:58314/0 (socket says 172.21.15.29:58314) 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970a62a700 1 -- 172.21.15.29:0/734544686 >> v2:172.21.15.173:3300/0 conn(0x7f9704159010 msgr2=0x7f97040d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970a62a700 1 --2- 172.21.15.29:0/734544686 >> v2:172.21.15.173:3300/0 conn(0x7f9704159010 0x7f97040d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970a62a700 1 -- 172.21.15.29:0/734544686 >> v1:172.21.15.173:6789/0 conn(0x7f9704158c40 legacy=0x7f970406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970a62a700 1 -- 172.21.15.29:0/734544686 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970406b4b0 con 0x7f97040ce320 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970a62a700 1 --2- 172.21.15.29:0/734544686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97040ce320 0x7f97040ce770 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9704069b10 tx=0x7f96fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4b1fc90afc6e51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f9708e27700 1 -- 172.21.15.29:0/734544686 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00e070 con 0x7f97040ce320 2023-10-06T05:29:55.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f9708e27700 1 -- 172.21.15.29:0/734544686 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc00ba20 con 0x7f97040ce320 2023-10-06T05:29:55.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f9708e27700 1 -- 172.21.15.29:0/734544686 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0092e0 con 0x7f97040ce320 2023-10-06T05:29:55.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970ae2b700 1 -- 172.21.15.29:0/734544686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97040ce320 msgr2=0x7f97040ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970ae2b700 1 --2- 172.21.15.29:0/734544686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97040ce320 0x7f97040ce770 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9704069b10 tx=0x7f96fc009840 comp rx=0 tx=0).stop 2023-10-06T05:29:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970ae2b700 1 -- 172.21.15.29:0/734544686 shutdown_connections 2023-10-06T05:29:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970ae2b700 1 --2- 172.21.15.29:0/734544686 >> v2:172.21.15.173:3300/0 conn(0x7f9704159010 0x7f97040d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970ae2b700 1 --2- 172.21.15.29:0/734544686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97040ce320 0x7f97040ce770 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970ae2b700 1 -- 172.21.15.29:0/734544686 >> 172.21.15.29:0/734544686 conn(0x7f97040670a0 msgr2=0x7f97040674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970ae2b700 1 -- 172.21.15.29:0/734544686 shutdown_connections 2023-10-06T05:29:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.284+0000 7f970ae2b700 1 -- 172.21.15.29:0/734544686 wait complete. 2023-10-06T05:29:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 Processor -- start 2023-10-06T05:29:55.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 -- start start 2023-10-06T05:29:55.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97040ce320 0x7f9704150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9704158c40 0x7f9704150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9704159010 0x7f97040b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970415b950 con 0x7f9704158c40 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9704153af0 con 0x7f9704159010 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9704153dd0 con 0x7f97040ce320 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709628700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9704158c40 0x7f9704150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709628700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9704158c40 0x7f9704150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44672/0 (socket says 172.21.15.29:44672) 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709628700 1 -- 172.21.15.29:0/1236148055 learned_addr learned my addr 172.21.15.29:0/1236148055 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709e29700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97040ce320 0x7f9704150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970a62a700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9704159010 0x7f97040b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709628700 1 -- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97040ce320 msgr2=0x7f9704150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709628700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97040ce320 0x7f9704150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709628700 1 -- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9704159010 msgr2=0x7f97040b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709628700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9704159010 0x7f97040b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709628700 1 -- 172.21.15.29:0/1236148055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc009ae0 con 0x7f9704158c40 2023-10-06T05:29:55.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f9709628700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9704158c40 0x7f9704150190 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f970000e900 tx=0x7f97000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:55.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f96f9ffb700 1 -- 172.21.15.29:0/1236148055 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000eea0 con 0x7f9704158c40 2023-10-06T05:29:55.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f96f9ffb700 1 -- 172.21.15.29:0/1236148055 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970000c850 con 0x7f9704158c40 2023-10-06T05:29:55.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97041540b0 con 0x7f9704158c40 2023-10-06T05:29:55.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f96f9ffb700 1 -- 172.21.15.29:0/1236148055 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000cc10 con 0x7f9704158c40 2023-10-06T05:29:55.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.288+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970415ac20 con 0x7f9704158c40 2023-10-06T05:29:55.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.292+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970404be00 con 0x7f9704158c40 2023-10-06T05:29:55.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.292+0000 7f96f9ffb700 1 -- 172.21.15.29:0/1236148055 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9700013470 con 0x7f9704158c40 2023-10-06T05:29:55.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.292+0000 7f96f9ffb700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f96e8060580 0x7f96e8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.292+0000 7f96f9ffb700 1 -- 172.21.15.29:0/1236148055 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f970007cb20 con 0x7f9704158c40 2023-10-06T05:29:55.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.292+0000 7f9709e29700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f96e8060580 0x7f96e8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.292+0000 7f9709e29700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f96e8060580 0x7f96e8062a30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f96f4007fd0 tx=0x7f96f4007d70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:55.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.300+0000 7f96f9ffb700 1 -- 172.21.15.29:0/1236148055 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f970004cf10 con 0x7f9704158c40 2023-10-06T05:29:55.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-06T05:29:55.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.496+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f970406b790 con 0x7f9704158c40 2023-10-06T05:29:55.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.532+0000 7f96f9ffb700 1 -- 172.21.15.29:0/1236148055 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9700050530 con 0x7f9704158c40 2023-10-06T05:29:55.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f96e8060580 msgr2=0x7f96e8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f96e8060580 0x7f96e8062a30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f96f4007fd0 tx=0x7f96f4007d70 comp rx=0 tx=0).stop 2023-10-06T05:29:55.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9704158c40 msgr2=0x7f9704150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9704158c40 0x7f9704150190 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f970000e900 tx=0x7f97000091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 shutdown_connections 2023-10-06T05:29:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f96e8060580 0x7f96e8062a30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9704159010 0x7f97040b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9704158c40 0x7f9704150190 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 --2- 172.21.15.29:0/1236148055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97040ce320 0x7f9704150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.536+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 >> 172.21.15.29:0/1236148055 conn(0x7f97040670a0 msgr2=0x7f97040cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.540+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 shutdown_connections 2023-10-06T05:29:55.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.540+0000 7f970ae2b700 1 -- 172.21.15.29:0/1236148055 wait complete. 2023-10-06T05:29:55.558 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T05:29:55.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.672+0000 7f776ffff700 1 Processor -- start 2023-10-06T05:29:55.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.672+0000 7f776ffff700 1 -- start start 2023-10-06T05:29:55.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776ffff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7770159200 0x7f77700c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777006bf90 con 0x7f77700c72f0 2023-10-06T05:29:55.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776ffff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777006b6f0 con 0x7f7770158e30 2023-10-06T05:29:55.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776ffff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777006b9d0 con 0x7f7770159200 2023-10-06T05:29:55.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f77700c72f0 0x7f77700676f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56224/0 (socket says 172.21.15.29:56224) 2023-10-06T05:29:55.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776f7fe700 1 -- 172.21.15.29:0/40925401 learned_addr learned my addr 172.21.15.29:0/40925401 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:55.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f77667fc700 1 --2- 172.21.15.29:0/40925401 >> v2:172.21.15.173:3300/0 conn(0x7f7770159200 0x7f77700c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022740785 0 0) 0x7f777006bf90 con 0x7f77700c72f0 2023-10-06T05:29:55.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f775c003570 con 0x7f77700c72f0 2023-10-06T05:29:55.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010332563 0 0) 0x7f777006b6f0 con 0x7f7770158e30 2023-10-06T05:29:55.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f777006bf90 con 0x7f7770158e30 2023-10-06T05:29:55.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3383603199 0 0) 0x7f775c003570 con 0x7f77700c72f0 2023-10-06T05:29:55.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 >> v2:172.21.15.173:3300/0 conn(0x7f7770159200 msgr2=0x7f77700c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:55.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 --2- 172.21.15.29:0/40925401 >> v2:172.21.15.173:3300/0 conn(0x7f7770159200 0x7f77700c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 >> v1:172.21.15.173:6789/0 conn(0x7f7770158e30 legacy=0x7f7770068260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777006bcb0 con 0x7f77700c72f0 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f77680017f0 con 0x7f77700c72f0 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 >> v1:172.21.15.29:6789/0 conn(0x7f77700c72f0 legacy=0x7f77700676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f775c003c40 0x7f775c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f775c004810 0x7f775c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f775c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777006b9d0 con 0x7f775c005210 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c00c1b0 con 0x7f775c003c40 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c00c370 con 0x7f775c004810 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776f7fe700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f775c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776effd700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f775c003c40 0x7f775c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f77667fc700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f775c004810 0x7f775c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776f7fe700 1 -- 172.21.15.29:0/40925401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f775c004810 msgr2=0x7f775c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776f7fe700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f775c004810 0x7f775c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776f7fe700 1 -- 172.21.15.29:0/40925401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f775c003c40 msgr2=0x7f775c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776f7fe700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f775c003c40 0x7f775c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776f7fe700 1 -- 172.21.15.29:0/40925401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c003570 con 0x7f775c005210 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776effd700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f775c003c40 0x7f775c004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.676+0000 7f776f7fe700 1 -- 172.21.15.29:0/40925401 reap_dead start 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776f7fe700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f775c00ba60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f776800a7d0 tx=0x7f77680020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9608c4205ae7b856 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680070d0 con 0x7f775c005210 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768007230 con 0x7f775c005210 2023-10-06T05:29:55.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776e7fc700 1 -- 172.21.15.29:0/40925401 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680075f0 con 0x7f775c005210 2023-10-06T05:29:55.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776ffff700 1 -- 172.21.15.29:0/40925401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 msgr2=0x7f775c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776ffff700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f775c00ba60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f776800a7d0 tx=0x7f77680020c0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776ffff700 1 -- 172.21.15.29:0/40925401 shutdown_connections 2023-10-06T05:29:55.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776ffff700 1 --2- 172.21.15.29:0/40925401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f775c00ba60 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776ffff700 1 -- 172.21.15.29:0/40925401 >> 172.21.15.29:0/40925401 conn(0x7f77700c9830 msgr2=0x7f777006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:55.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776ffff700 1 -- 172.21.15.29:0/40925401 shutdown_connections 2023-10-06T05:29:55.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.680+0000 7f776ffff700 1 -- 172.21.15.29:0/40925401 wait complete. 2023-10-06T05:29:55.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 Processor -- start 2023-10-06T05:29:55.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 -- start start 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f7770147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77700af090 0x7f777015e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77700af500 0x7f777015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77700b0080 con 0x7f775c005210 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77700b0930 con 0x7f77700af090 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7770148380 con 0x7f77700af500 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f7770147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f7770147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44682/0 (socket says 172.21.15.29:44682) 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776effd700 1 -- 172.21.15.29:0/2116767654 learned_addr learned my addr 172.21.15.29:0/2116767654 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f77667fc700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77700af090 0x7f777015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776f7fe700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77700af500 0x7f777015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776effd700 1 -- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77700af500 msgr2=0x7f777015ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776effd700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77700af500 0x7f777015ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776effd700 1 -- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77700af090 msgr2=0x7f777015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:55.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776effd700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77700af090 0x7f777015e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:55.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776effd700 1 -- 172.21.15.29:0/2116767654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700afac0 con 0x7f775c005210 2023-10-06T05:29:55.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776effd700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f7770147e40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f776000fc00 tx=0x7f7760007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:55.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f77677fe700 1 -- 172.21.15.29:0/2116767654 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760006820 con 0x7f775c005210 2023-10-06T05:29:55.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f77677fe700 1 -- 172.21.15.29:0/2116767654 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7760006980 con 0x7f775c005210 2023-10-06T05:29:55.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77700afda0 con 0x7f775c005210 2023-10-06T05:29:55.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f77677fe700 1 -- 172.21.15.29:0/2116767654 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760006d00 con 0x7f775c005210 2023-10-06T05:29:55.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.684+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77701690e0 con 0x7f775c005210 2023-10-06T05:29:55.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.688+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77700adbb0 con 0x7f775c005210 2023-10-06T05:29:55.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.688+0000 7f77677fe700 1 -- 172.21.15.29:0/2116767654 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f776000da60 con 0x7f775c005210 2023-10-06T05:29:55.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.688+0000 7f77677fe700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7750060550 0x7f7750062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:55.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.688+0000 7f77677fe700 1 -- 172.21.15.29:0/2116767654 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f776007c910 con 0x7f775c005210 2023-10-06T05:29:55.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.688+0000 7f77667fc700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7750060550 0x7f7750062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:55.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.688+0000 7f77667fc700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7750060550 0x7f7750062a00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77700ab8b0 tx=0x7f77580091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:55.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.696+0000 7f77677fe700 1 -- 172.21.15.29:0/2116767654 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f77700adbb0 con 0x7f775c005210 2023-10-06T05:29:55.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:55.896+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f77700adbb0 con 0x7f775c005210 2023-10-06T05:29:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.536+0000 7f77677fe700 1 -- 172.21.15.29:0/2116767654 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) v1 ==== 122+0+0 (secure 0 0 0) 0x7f77700adbb0 con 0x7f775c005210 2023-10-06T05:29:56.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.540+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7750060550 msgr2=0x7f7750062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:56.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.540+0000 7f776ffff700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7750060550 0x7f7750062a00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77700ab8b0 tx=0x7f77580091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 msgr2=0x7f7770147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:56.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f7770147e40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f776000fc00 tx=0x7f7760007d30 comp rx=0 tx=0).stop 2023-10-06T05:29:56.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 shutdown_connections 2023-10-06T05:29:56.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77700af500 0x7f777015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7750060550 0x7f7750062a00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77700af090 0x7f777015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 --2- 172.21.15.29:0/2116767654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f775c005210 0x7f7770147e40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 >> 172.21.15.29:0/2116767654 conn(0x7f77700c9830 msgr2=0x7f7770157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:56.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 shutdown_connections 2023-10-06T05:29:56.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.544+0000 7f776ffff700 1 -- 172.21.15.29:0/2116767654 wait complete. 2023-10-06T05:29:56.566 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:29:56.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.668+0000 7fc69bfff700 1 Processor -- start 2023-10-06T05:29:56.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.668+0000 7fc69bfff700 1 -- start start 2023-10-06T05:29:56.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.668+0000 7fc69bfff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc69c158c00 0x7fc69c06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:56.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.668+0000 7fc69bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c06b250 con 0x7fc69c0cebc0 2023-10-06T05:29:56.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.668+0000 7fc69bfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c06a640 con 0x7fc69c0ce740 2023-10-06T05:29:56.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.668+0000 7fc69bfff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69c06a920 con 0x7fc69c158c00 2023-10-06T05:29:56.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.668+0000 7fc69b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc69c0cebc0 0x7fc69c15a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56234/0 (socket says 172.21.15.29:56234) 2023-10-06T05:29:56.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.668+0000 7fc69b7fe700 1 -- 172.21.15.29:0/3831519207 learned_addr learned my addr 172.21.15.29:0/3831519207 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:56.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69affd700 1 --2- 172.21.15.29:0/3831519207 >> v2:172.21.15.173:3300/0 conn(0x7fc69c158c00 0x7fc69c06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:56.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133427050 0 0) 0x7fc69c06b250 con 0x7fc69c0cebc0 2023-10-06T05:29:56.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc688003570 con 0x7fc69c0cebc0 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145791442 0 0) 0x7fc69c06a640 con 0x7fc69c0ce740 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc69c06b250 con 0x7fc69c0ce740 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2279936049 0 0) 0x7fc688003570 con 0x7fc69c0cebc0 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 >> v2:172.21.15.173:3300/0 conn(0x7fc69c158c00 msgr2=0x7fc69c06b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 --2- 172.21.15.29:0/3831519207 >> v2:172.21.15.173:3300/0 conn(0x7fc69c158c00 0x7fc69c06b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 >> v1:172.21.15.173:6789/0 conn(0x7fc69c0ce740 legacy=0x7fc69c0cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c06ac00 con 0x7fc69c0cebc0 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fc694001470 con 0x7fc69c0cebc0 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 >> v1:172.21.15.29:6789/0 conn(0x7fc69c0cebc0 legacy=0x7fc69c15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:56.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688003c40 0x7fc688004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc688004810 0x7fc688004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688005210 0x7fc68800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c06a920 con 0x7fc688005210 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68800c1b0 con 0x7fc688003c40 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68800c370 con 0x7fc688004810 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69b7fe700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688005210 0x7fc68800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69affd700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688003c40 0x7fc688004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69a7fc700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc688004810 0x7fc688004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69b7fe700 1 -- 172.21.15.29:0/3831519207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc688004810 msgr2=0x7fc688004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69b7fe700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc688004810 0x7fc688004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69b7fe700 1 -- 172.21.15.29:0/3831519207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688003c40 msgr2=0x7fc688004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:56.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69b7fe700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688003c40 0x7fc688004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69b7fe700 1 -- 172.21.15.29:0/3831519207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc688003570 con 0x7fc688005210 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69b7fe700 1 -- 172.21.15.29:0/3831519207 reap_dead start 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69b7fe700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688005210 0x7fc68800ba60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0cefc0 tx=0x7fc694001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764e05b61f7b8a34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400ca50 con 0x7fc688005210 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69400cbb0 con 0x7fc688005210 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc699ffb700 1 -- 172.21.15.29:0/3831519207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694005920 con 0x7fc688005210 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69bfff700 1 -- 172.21.15.29:0/3831519207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688005210 msgr2=0x7fc68800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69bfff700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688005210 0x7fc68800ba60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0cefc0 tx=0x7fc694001d40 comp rx=0 tx=0).stop 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69bfff700 1 -- 172.21.15.29:0/3831519207 shutdown_connections 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69bfff700 1 --2- 172.21.15.29:0/3831519207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688005210 0x7fc68800ba60 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69bfff700 1 -- 172.21.15.29:0/3831519207 >> 172.21.15.29:0/3831519207 conn(0x7fc69c0670a0 msgr2=0x7fc69c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69bfff700 1 -- 172.21.15.29:0/3831519207 shutdown_connections 2023-10-06T05:29:56.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.672+0000 7fc69bfff700 1 -- 172.21.15.29:0/3831519207 wait complete. 2023-10-06T05:29:56.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69bfff700 1 Processor -- start 2023-10-06T05:29:56.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69bfff700 1 -- start start 2023-10-06T05:29:56.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688005210 0x7fc69c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:56.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69c15b740 0x7fc69c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:56.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69bfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69c14bbf0 0x7fc69c0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:56.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c15d430 con 0x7fc69c15b740 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69bfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c14c050 con 0x7fc688005210 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69bfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c15c820 con 0x7fc69c14bbf0 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69c15b740 0x7fc69c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69c15b740 0x7fc69c14b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44692/0 (socket says 172.21.15.29:44692) 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69affd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688005210 0x7fc69c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69a7fc700 1 -- 172.21.15.29:0/694106882 learned_addr learned my addr 172.21.15.29:0/694106882 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69b7fe700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69c14bbf0 0x7fc69c0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69a7fc700 1 -- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69c14bbf0 msgr2=0x7fc69c0b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69a7fc700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69c14bbf0 0x7fc69c0b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69a7fc700 1 -- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688005210 msgr2=0x7fc69c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69a7fc700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688005210 0x7fc69c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.676+0000 7fc69a7fc700 1 -- 172.21.15.29:0/694106882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c15cb00 con 0x7fc69c15b740 2023-10-06T05:29:56.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.680+0000 7fc69a7fc700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69c15b740 0x7fc69c14b6b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc684002b80 tx=0x7fc684007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:56.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.680+0000 7fc692ffd700 1 -- 172.21.15.29:0/694106882 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68400f8d0 con 0x7fc69c15b740 2023-10-06T05:29:56.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.680+0000 7fc692ffd700 1 -- 172.21.15.29:0/694106882 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68400fa30 con 0x7fc69c15b740 2023-10-06T05:29:56.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.680+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69c15cde0 con 0x7fc69c15b740 2023-10-06T05:29:56.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.680+0000 7fc692ffd700 1 -- 172.21.15.29:0/694106882 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68400fdf0 con 0x7fc69c15b740 2023-10-06T05:29:56.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.680+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c0c6e60 con 0x7fc69c15b740 2023-10-06T05:29:56.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.680+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c15d5e0 con 0x7fc69c15b740 2023-10-06T05:29:56.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.680+0000 7fc692ffd700 1 -- 172.21.15.29:0/694106882 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc6840133f0 con 0x7fc69c15b740 2023-10-06T05:29:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.680+0000 7fc692ffd700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc67c060580 0x7fc67c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.684+0000 7fc692ffd700 1 -- 172.21.15.29:0/694106882 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc68407ca70 con 0x7fc69c15b740 2023-10-06T05:29:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.684+0000 7fc69affd700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc67c060580 0x7fc67c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:56.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.684+0000 7fc69affd700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc67c060580 0x7fc67c062a30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009fd0 tx=0x7fc68c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:56.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.688+0000 7fc692ffd700 1 -- 172.21.15.29:0/694106882 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc69c15d5e0 con 0x7fc69c15b740 2023-10-06T05:29:56.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.888+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc69c04be00 con 0x7fc69c15b740 2023-10-06T05:29:56.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc692ffd700 1 -- 172.21.15.29:0/694106882 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fc68404cf00 con 0x7fc69c15b740 2023-10-06T05:29:56.897 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:56.897 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:29:56.535189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3515782118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3515782118},{"type":"v1","addr":"172.21.15.29:6835","nonce":3515782118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc67c060580 msgr2=0x7fc67c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc67c060580 0x7fc67c062a30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009fd0 tx=0x7fc68c00b040 comp rx=0 tx=0).stop 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69c15b740 msgr2=0x7fc69c14b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69c15b740 0x7fc69c14b6b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc684002b80 tx=0x7fc684007d30 comp rx=0 tx=0).stop 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 shutdown_connections 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69c14bbf0 0x7fc69c0b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69c15b740 0x7fc69c14b6b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc67c060580 0x7fc67c062a30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 --2- 172.21.15.29:0/694106882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688005210 0x7fc69c15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:56.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 >> 172.21.15.29:0/694106882 conn(0x7fc69c0670a0 msgr2=0x7fc69c06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:56.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 shutdown_connections 2023-10-06T05:29:56.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:56.892+0000 7fc69bfff700 1 -- 172.21.15.29:0/694106882 wait complete. 2023-10-06T05:29:56.902 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 41 2023-10-06T05:29:56.916 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:29:57.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f1706097700 1 Processor -- start 2023-10-06T05:29:57.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f1706097700 1 -- start start 2023-10-06T05:29:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f1706097700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f17000af5c0 0x7f17000af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f1706097700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f170015cd80 0x7f170015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f1706097700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17001614c0 con 0x7f1700161950 2023-10-06T05:29:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f1706097700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1700160f40 con 0x7f170015cd80 2023-10-06T05:29:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f1706097700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170006d420 con 0x7f17000af5c0 2023-10-06T05:29:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16feffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1700161950 0x7f170006a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56236/0 (socket says 172.21.15.29:56236) 2023-10-06T05:29:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16feffd700 1 -- 172.21.15.29:0/3255012959 learned_addr learned my addr 172.21.15.29:0/3255012959 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:57.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fffff700 1 --2- 172.21.15.29:0/3255012959 >> v2:172.21.15.29:3300/0 conn(0x7f170015cd80 0x7f170015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16ff7fe700 1 --2- 172.21.15.29:0/3255012959 >> v2:172.21.15.173:3300/0 conn(0x7f17000af5c0 0x7f17000af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fe7fc700 1 -- 172.21.15.29:0/3255012959 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822859718 0 0) 0x7f17001614c0 con 0x7f1700161950 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fe7fc700 1 -- 172.21.15.29:0/3255012959 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e8003570 con 0x7f1700161950 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fffff700 1 -- 172.21.15.29:0/3255012959 >> v2:172.21.15.173:3300/0 conn(0x7f17000af5c0 msgr2=0x7f17000af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fffff700 1 --2- 172.21.15.29:0/3255012959 >> v2:172.21.15.173:3300/0 conn(0x7f17000af5c0 0x7f17000af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fffff700 1 -- 172.21.15.29:0/3255012959 >> v1:172.21.15.29:6789/0 conn(0x7f1700161950 legacy=0x7f170006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fffff700 1 -- 172.21.15.29:0/3255012959 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170006af20 con 0x7f170015cd80 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fffff700 1 --2- 172.21.15.29:0/3255012959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f170015cd80 0x7f170015d1a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1700068030 tx=0x7f16f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbeea113ef6ba056 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fe7fc700 1 -- 172.21.15.29:0/3255012959 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8011630 con 0x7f170015cd80 2023-10-06T05:29:57.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fe7fc700 1 -- 172.21.15.29:0/3255012959 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f80117b0 con 0x7f170015cd80 2023-10-06T05:29:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.012+0000 7f16fe7fc700 1 -- 172.21.15.29:0/3255012959 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8011b70 con 0x7f170015cd80 2023-10-06T05:29:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 -- 172.21.15.29:0/3255012959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f170015cd80 msgr2=0x7f170015d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 --2- 172.21.15.29:0/3255012959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f170015cd80 0x7f170015d1a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1700068030 tx=0x7f16f80091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 -- 172.21.15.29:0/3255012959 shutdown_connections 2023-10-06T05:29:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 --2- 172.21.15.29:0/3255012959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f170015cd80 0x7f170015d1a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 --2- 172.21.15.29:0/3255012959 >> v2:172.21.15.173:3300/0 conn(0x7f17000af5c0 0x7f17000af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 -- 172.21.15.29:0/3255012959 >> 172.21.15.29:0/3255012959 conn(0x7f1700067b70 msgr2=0x7f170006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 -- 172.21.15.29:0/3255012959 shutdown_connections 2023-10-06T05:29:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 -- 172.21.15.29:0/3255012959 wait complete. 2023-10-06T05:29:57.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 Processor -- start 2023-10-06T05:29:57.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.016+0000 7f1706097700 1 -- start start 2023-10-06T05:29:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f1706097700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17000af5c0 0x7f170015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f1706097700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f170015cd80 0x7f17000a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f1706097700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1700161950 0x7f17000a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f1706097700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000a7720 con 0x7f1700161950 2023-10-06T05:29:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f1706097700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000a6b10 con 0x7f17000af5c0 2023-10-06T05:29:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f1706097700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000a6df0 con 0x7f170015cd80 2023-10-06T05:29:57.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16fffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1700161950 0x7f17000a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16fffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1700161950 0x7f17000a9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44700/0 (socket says 172.21.15.29:44700) 2023-10-06T05:29:57.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16fffff700 1 -- 172.21.15.29:0/2529456083 learned_addr learned my addr 172.21.15.29:0/2529456083 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:57.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16ff7fe700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17000af5c0 0x7f170015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16feffd700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f170015cd80 0x7f17000a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16fffff700 1 -- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f170015cd80 msgr2=0x7f17000a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16fffff700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f170015cd80 0x7f17000a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16fffff700 1 -- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17000af5c0 msgr2=0x7f170015aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16fffff700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17000af5c0 0x7f170015aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16fffff700 1 -- 172.21.15.29:0/2529456083 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009420 con 0x7f1700161950 2023-10-06T05:29:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16fffff700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1700161950 0x7f17000a9000 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f16f80093f0 tx=0x7f16f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16e77fe700 1 -- 172.21.15.29:0/2529456083 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f801f070 con 0x7f1700161950 2023-10-06T05:29:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16e77fe700 1 -- 172.21.15.29:0/2529456083 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8011b30 con 0x7f1700161950 2023-10-06T05:29:57.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f16e77fe700 1 -- 172.21.15.29:0/2529456083 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8023660 con 0x7f1700161950 2023-10-06T05:29:57.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17000a70d0 con 0x7f1700161950 2023-10-06T05:29:57.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.020+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170015b430 con 0x7f1700161950 2023-10-06T05:29:57.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.024+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1700064770 con 0x7f1700161950 2023-10-06T05:29:57.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.024+0000 7f16e77fe700 1 -- 172.21.15.29:0/2529456083 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f16f80223b0 con 0x7f1700161950 2023-10-06T05:29:57.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.024+0000 7f16e77fe700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f16ec060550 0x7f16ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.024+0000 7f16e77fe700 1 -- 172.21.15.29:0/2529456083 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f16f807dfb0 con 0x7f1700161950 2023-10-06T05:29:57.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.024+0000 7f16ff7fe700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f16ec060550 0x7f16ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.024+0000 7f16ff7fe700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f16ec060550 0x7f16ec062a00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009db0 tx=0x7f16f40091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:57.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.036+0000 7f16e77fe700 1 -- 172.21.15.29:0/2529456083 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1700064770 con 0x7f1700161950 2023-10-06T05:29:57.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.196+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1700064770 con 0x7f1700161950 2023-10-06T05:29:57.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f16e77fe700 1 -- 172.21.15.29:0/2529456083 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16869 (secure 0 0 0) 0x7f1700064770 con 0x7f1700161950 2023-10-06T05:29:57.205 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:57.205 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":77,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:29:55.491816+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:29:51.644444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T05:29:52.853119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:29:57.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f16ec060550 msgr2=0x7f16ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f16ec060550 0x7f16ec062a00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009db0 tx=0x7f16f40091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1700161950 msgr2=0x7f17000a9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1700161950 0x7f17000a9000 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f16f80093f0 tx=0x7f16f8017000 comp rx=0 tx=0).stop 2023-10-06T05:29:57.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 shutdown_connections 2023-10-06T05:29:57.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1700161950 0x7f17000a9000 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f170015cd80 0x7f17000a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f16ec060550 0x7f16ec062a00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 --2- 172.21.15.29:0/2529456083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17000af5c0 0x7f170015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 >> 172.21.15.29:0/2529456083 conn(0x7f1700067b70 msgr2=0x7f17000ab380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:57.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 shutdown_connections 2023-10-06T05:29:57.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.200+0000 7f1706097700 1 -- 172.21.15.29:0/2529456083 wait complete. 2023-10-06T05:29:57.220 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T05:29:57.220 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:29:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f1400fb1700 1 Processor -- start 2023-10-06T05:29:57.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f1400fb1700 1 -- start start 2023-10-06T05:29:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f1400fb1700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f13fc1605e0 0x7f13fc0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f1400fb1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f13fc06b320 0x7f13fc0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f1400fb1700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13fc0c2980 con 0x7f13fc0ca1f0 2023-10-06T05:29:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f1400fb1700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13fc0ca630 con 0x7f13fc06b320 2023-10-06T05:29:57.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f1400fb1700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13fc0c6bb0 con 0x7f13fc1605e0 2023-10-06T05:29:57.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f13faffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f13fc06b320 0x7f13fc0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f13faffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f13fc06b320 0x7f13fc0c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44716/0 (socket says 172.21.15.29:44716) 2023-10-06T05:29:57.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f13faffd700 1 -- 172.21.15.29:0/2548349575 learned_addr learned my addr 172.21.15.29:0/2548349575 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:57.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f13fb7fe700 1 --2- 172.21.15.29:0/2548349575 >> v2:172.21.15.173:3300/0 conn(0x7f13fc1605e0 0x7f13fc0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f13faffd700 1 -- 172.21.15.29:0/2548349575 >> v2:172.21.15.173:3300/0 conn(0x7f13fc1605e0 msgr2=0x7f13fc0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f13faffd700 1 --2- 172.21.15.29:0/2548349575 >> v2:172.21.15.173:3300/0 conn(0x7f13fc1605e0 0x7f13fc0c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f13faffd700 1 -- 172.21.15.29:0/2548349575 >> v1:172.21.15.173:6789/0 conn(0x7f13fc0ca1f0 legacy=0x7f13fc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f13faffd700 1 -- 172.21.15.29:0/2548349575 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc0c6e90 con 0x7f13fc06b320 2023-10-06T05:29:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.324+0000 7f13faffd700 1 --2- 172.21.15.29:0/2548349575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc06b320 0x7f13fc0c9cb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f13fc06d780 tx=0x7f13e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03a2e257671ed6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f13fa7fc700 1 -- 172.21.15.29:0/2548349575 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400b860 con 0x7f13fc06b320 2023-10-06T05:29:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f13fa7fc700 1 -- 172.21.15.29:0/2548349575 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e400b9c0 con 0x7f13fc06b320 2023-10-06T05:29:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f13fa7fc700 1 -- 172.21.15.29:0/2548349575 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400bd60 con 0x7f13fc06b320 2023-10-06T05:29:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f1400fb1700 1 -- 172.21.15.29:0/2548349575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc06b320 msgr2=0x7f13fc0c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f1400fb1700 1 --2- 172.21.15.29:0/2548349575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc06b320 0x7f13fc0c9cb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f13fc06d780 tx=0x7f13e4009250 comp rx=0 tx=0).stop 2023-10-06T05:29:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f1400fb1700 1 -- 172.21.15.29:0/2548349575 shutdown_connections 2023-10-06T05:29:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f1400fb1700 1 --2- 172.21.15.29:0/2548349575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc06b320 0x7f13fc0c9cb0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f1400fb1700 1 --2- 172.21.15.29:0/2548349575 >> v2:172.21.15.173:3300/0 conn(0x7f13fc1605e0 0x7f13fc0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f1400fb1700 1 -- 172.21.15.29:0/2548349575 >> 172.21.15.29:0/2548349575 conn(0x7f13fc0670a0 msgr2=0x7f13fc0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:57.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f1400fb1700 1 -- 172.21.15.29:0/2548349575 shutdown_connections 2023-10-06T05:29:57.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.328+0000 7f1400fb1700 1 -- 172.21.15.29:0/2548349575 wait complete. 2023-10-06T05:29:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 Processor -- start 2023-10-06T05:29:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 -- start start 2023-10-06T05:29:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13fc06b320 0x7f13fc152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13fc0ca1f0 0x7f13fc1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc1605e0 0x7f13fc16d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0ae870 con 0x7f13fc1605e0 2023-10-06T05:29:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0af3f0 con 0x7f13fc06b320 2023-10-06T05:29:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0aeac0 con 0x7f13fc0ca1f0 2023-10-06T05:29:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc1605e0 0x7f13fc16d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc1605e0 0x7f13fc16d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44718/0 (socket says 172.21.15.29:44718) 2023-10-06T05:29:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fbfff700 1 -- 172.21.15.29:0/469725648 learned_addr learned my addr 172.21.15.29:0/469725648 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13faffd700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13fc0ca1f0 0x7f13fc1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fb7fe700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13fc06b320 0x7f13fc152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fbfff700 1 -- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13fc0ca1f0 msgr2=0x7f13fc1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fbfff700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13fc0ca1f0 0x7f13fc1555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fbfff700 1 -- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13fc06b320 msgr2=0x7f13fc152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fbfff700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13fc06b320 0x7f13fc152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fbfff700 1 -- 172.21.15.29:0/469725648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40094f0 con 0x7f13fc1605e0 2023-10-06T05:29:57.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13faffd700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13fc0ca1f0 0x7f13fc1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:57.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13fbfff700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc1605e0 0x7f13fc16d7f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c8e0 tx=0x7f13f4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:57.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13f37fe700 1 -- 172.21.15.29:0/469725648 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400ce80 con 0x7f13fc1605e0 2023-10-06T05:29:57.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13f37fe700 1 -- 172.21.15.29:0/469725648 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f400a7e0 con 0x7f13fc1605e0 2023-10-06T05:29:57.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc0aeda0 con 0x7f13fc1605e0 2023-10-06T05:29:57.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f13f37fe700 1 -- 172.21.15.29:0/469725648 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400aba0 con 0x7f13fc1605e0 2023-10-06T05:29:57.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.332+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13fc153450 con 0x7f13fc1605e0 2023-10-06T05:29:57.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.336+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13fc04be00 con 0x7f13fc1605e0 2023-10-06T05:29:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.336+0000 7f13f37fe700 1 -- 172.21.15.29:0/469725648 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f13f4003030 con 0x7f13fc1605e0 2023-10-06T05:29:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.336+0000 7f13f37fe700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f13dc060550 0x7f13dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.336+0000 7f13f37fe700 1 -- 172.21.15.29:0/469725648 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13f407c960 con 0x7f13fc1605e0 2023-10-06T05:29:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.336+0000 7f13fb7fe700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f13dc060550 0x7f13dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.336+0000 7f13fb7fe700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f13dc060550 0x7f13dc062a00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f13ec006fd0 tx=0x7f13ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:57.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.344+0000 7f13f37fe700 1 -- 172.21.15.29:0/469725648 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f13f404cd50 con 0x7f13fc1605e0 2023-10-06T05:29:57.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.500+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13fc0c7170 con 0x7f13dc060550 2023-10-06T05:29:57.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.520+0000 7f13f37fe700 1 -- 172.21.15.29:0/469725648 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299162 (secure 0 0 0) 0x7f13fc0c7170 con 0x7f13dc060550 2023-10-06T05:29:57.528 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f13dc060550 msgr2=0x7f13dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f13dc060550 0x7f13dc062a00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f13ec006fd0 tx=0x7f13ec008040 comp rx=0 tx=0).stop 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc1605e0 msgr2=0x7f13fc16d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc1605e0 0x7f13fc16d7f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c8e0 tx=0x7f13f4001710 comp rx=0 tx=0).stop 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 shutdown_connections 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13fc1605e0 0x7f13fc16d7f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13fc0ca1f0 0x7f13fc1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f13dc060550 0x7f13dc062a00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 --2- 172.21.15.29:0/469725648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13fc06b320 0x7f13fc152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 >> 172.21.15.29:0/469725648 conn(0x7f13fc0670a0 msgr2=0x7f13fc0c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:57.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 shutdown_connections 2023-10-06T05:29:57.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.524+0000 7f1400fb1700 1 -- 172.21.15.29:0/469725648 wait complete. 2023-10-06T05:29:57.532 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:29:57.548 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-10-06T05:29:56.740734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2411008,"kb_used_data":8128,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752563712,"statfs":{"total":773094113280,"available":770625241088,"internally_reserved":0,"allocated":8323072,"data_stored":4323124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.262238"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.491131+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.354636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486743+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:02.572983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486698+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:19.053299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488862+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:03.816191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.481409+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:51.939537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.481842+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:02.572983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488954+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:52.402311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.492577+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:04.134839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.485530+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:43.025672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.483377+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.491669+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:56.370863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488278+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:45.206856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.482088+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:42.402290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.485078+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:56.580080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.493320+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:18.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488393+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.483148+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488884+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.485261+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:04.695796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.484742+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:36.374566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487630+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:01.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.490784+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:36.083734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487533+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:53.199688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486436+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.001283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.489956+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:30.380770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685368+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:29:49.685368+0000","last_peered":"2023-10-06T05:29:49.685368+0000","last_clean":"2023-10-06T05:29:49.685368+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:29:49.685368+0000","last_undegraded":"2023-10-06T05:29:49.685368+0000","last_fullsized":"2023-10-06T05:29:49.685368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685488+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:29:49.685488+0000","last_peered":"2023-10-06T05:29:49.685488+0000","last_clean":"2023-10-06T05:29:49.685488+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:29:49.685488+0000","last_undegraded":"2023-10-06T05:29:49.685488+0000","last_fullsized":"2023-10-06T05:29:49.685488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487856+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:42.098747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685166+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:29:49.685166+0000","last_peered":"2023-10-06T05:29:49.685166+0000","last_clean":"2023-10-06T05:29:49.685166+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:29:49.685166+0000","last_undegraded":"2023-10-06T05:29:49.685166+0000","last_fullsized":"2023-10-06T05:29:49.685166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487724+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:15.292487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:50.180480+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:29:50.180480+0000","last_peered":"2023-10-06T05:29:50.180480+0000","last_clean":"2023-10-06T05:29:50.180480+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:29:50.180480+0000","last_undegraded":"2023-10-06T05:29:50.180480+0000","last_fullsized":"2023-10-06T05:29:50.180480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487891+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:17.096964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685244+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:29:49.685244+0000","last_peered":"2023-10-06T05:29:49.685244+0000","last_clean":"2023-10-06T05:29:49.685244+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:29:49.685244+0000","last_undegraded":"2023-10-06T05:29:49.685244+0000","last_fullsized":"2023-10-06T05:29:49.685244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.490664+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:02.394654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:50.161646+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:29:50.161646+0000","last_peered":"2023-10-06T05:29:50.161646+0000","last_clean":"2023-10-06T05:29:50.161646+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:29:50.161646+0000","last_undegraded":"2023-10-06T05:29:50.161646+0000","last_fullsized":"2023-10-06T05:29:50.161646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486272+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:45.206856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685269+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:29:49.685269+0000","last_peered":"2023-10-06T05:29:49.685269+0000","last_clean":"2023-10-06T05:29:49.685269+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:29:49.685269+0000","last_undegraded":"2023-10-06T05:29:49.685269+0000","last_fullsized":"2023-10-06T05:29:49.685269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.484777+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:41.126449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:50.161649+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:29:50.161649+0000","last_peered":"2023-10-06T05:29:50.161649+0000","last_clean":"2023-10-06T05:29:50.161649+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:29:50.161649+0000","last_undegraded":"2023-10-06T05:29:50.161649+0000","last_fullsized":"2023-10-06T05:29:50.161649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.481394+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:40.665196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.689129+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:29:49.689129+0000","last_peered":"2023-10-06T05:29:49.689129+0000","last_clean":"2023-10-06T05:29:49.689129+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:29:49.689129+0000","last_undegraded":"2023-10-06T05:29:49.689129+0000","last_fullsized":"2023-10-06T05:29:49.689129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":981627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86099999999999999,"15min":0.84499999999999997},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.89700000000000002,"15min":0.92800000000000005},"min":{"1min":0.68000000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.03,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88400000000000001,"15min":0.86899999999999999},"min":{"1min":0.61899999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.65700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1659999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.89900000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.64000000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1599999999999999,"5min":1.276,"15min":1.276},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2509999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95999999999999996,"15min":0.96199999999999997},"min":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.70799999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3160000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90800000000000003,"15min":0.92300000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1719999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.111,"15min":1.113},"min":{"1min":0.89600000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.294,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.008,"15min":0.99299999999999999},"min":{"1min":0.75800000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.25,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1839999999999999,"15min":1.2030000000000001},"min":{"1min":0.96199999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.3979999999999999,"5min":1.859,"15min":1.859},"last":1.107}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.119,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3260000000000001,"5min":1.611,"15min":1.611},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.76100000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.038}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.81499999999999995},"min":{"1min":0.51300000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.2050000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.67700000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98599999999999999,"15min":0.95899999999999996},"min":{"1min":0.61699999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4430000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.997},{"interface":"front","average":{"1min":1.028,"5min":0.98099999999999998,"15min":0.96699999999999997},"min":{"1min":0.66600000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6659999999999999,"5min":1.679,"15min":1.679},"last":1.0249999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.872,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.339,"5min":1.643,"15min":1.643},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.95299999999999996,"15min":0.88700000000000001},"min":{"1min":0.69999999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5509999999999999,"5min":1.784,"15min":1.784},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.70899999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.876},{"interface":"front","average":{"1min":1.161,"5min":1.1120000000000001,"15min":1.0800000000000001},"min":{"1min":0.89200000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5009999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96099999999999997},"min":{"1min":0.59999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.71,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.524,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.63300000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.097,"15min":1.069},"min":{"1min":0.78500000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7509999999999999,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.155}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.016,"15min":1.01},"min":{"1min":0.754,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.1180000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.0720000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":901120,"data_stored":397417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89200000000000002,"15min":0.85999999999999999},"min":{"1min":0.61499999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.294,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.96199999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.61699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2210000000000001,"5min":1.409,"15min":1.409},"last":0.998},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.242,"5min":1.411,"15min":1.411},"last":0.81000000000000005}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.67300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.175,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.046},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98599999999999999,"15min":0.96499999999999997},"min":{"1min":0.70299999999999996,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.244,"5min":1.54,"15min":1.54},"last":0.628}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.97099999999999997,"15min":0.95099999999999996},"min":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2769999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.77300000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.349,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.119}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":1.0089999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.204,"5min":1.419,"15min":1.419},"last":1.077},{"interface":"front","average":{"1min":1.091,"5min":1.143,"15min":1.179},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.05,"15min":1.1040000000000001},"min":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.327,"5min":1.508,"15min":1.508},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.022,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.3140000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.115,"15min":1.141},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.339,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.119,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.302,"5min":1.732,"15min":1.732},"last":1.1899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":901120,"data_stored":397417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.85199999999999998,"15min":0.79800000000000004},"min":{"1min":0.66600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.079},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.64500000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3180000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.98399999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85999999999999999,"15min":0.81599999999999995},"min":{"1min":0.70799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.006},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2649999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.90000000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.75700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.202,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.746,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1950000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.167}]},{"osd":3,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.69999999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2230000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.997,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.80100000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.26,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.995,"15min":1.0509999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1639999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.0249999999999999,"15min":1.04},"min":{"1min":0.69899999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.163,"5min":1.458,"15min":1.458},"last":1.0309999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.99399999999999999,"15min":0.998},"min":{"1min":0.66500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.429,"15min":1.429},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.151,"15min":1.1719999999999999},"min":{"1min":0.83999999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.387,"5min":1.548,"15min":1.548},"last":1.24}]},{"osd":7,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1339999999999999,"15min":1.1359999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.351,"5min":1.75,"15min":1.75},"last":1.0549999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069588,"statfs":{"total":96636764160,"available":96327258112,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.47199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.85099999999999998,"5min":1.379,"15min":1.379},"last":0.82399999999999995}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.54700000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0640000000000001,"5min":1.389,"15min":1.389},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79300000000000004,"15min":0.76500000000000001},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.107,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0649999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2390000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.099},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.57899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.222,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.093,"15min":1.1180000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":1.3260000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.095,"15min":1.117},"min":{"1min":0.80800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5009999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.413},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1100000000000001,"15min":1.0960000000000001},"min":{"1min":0.85399999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1579999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.069,"15min":1.079},"min":{"1min":0.748,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3009999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1910000000000001,"15min":1.196},"min":{"1min":0.81799999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":1.968,"15min":1.968},"last":1.5149999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.173,"15min":1.1639999999999999},"min":{"1min":0.80000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.663,"5min":1.762,"15min":1.762},"last":1.27},{"interface":"front","average":{"1min":1.107,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.88800000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4039999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1950000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069588,"statfs":{"total":96636764160,"available":96327258112,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.49299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.014},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.629,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2649999999999999,"5min":1.29,"15min":1.29},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.60299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.278,"5min":1.383,"15min":1.383},"last":1.153},{"interface":"front","average":{"1min":0.87,"5min":0.84499999999999997,"15min":0.874},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.2649999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.85099999999999998},"min":{"1min":0.63800000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0389999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0089999999999999,"15min":1.1040000000000001},"min":{"1min":0.69999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2410000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.9119999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1890000000000001,"15min":1.2350000000000001},"min":{"1min":0.89200000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4430000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.3859999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1319999999999999,"15min":1.1859999999999999},"min":{"1min":0.80800000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4019999999999999,"5min":1.829,"15min":1.829},"last":1.752},{"interface":"front","average":{"1min":1.095,"5min":1.1319999999999999,"15min":1.1819999999999999},"min":{"1min":0.80500000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.4339999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.8109999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.246,"15min":1.276},"min":{"1min":0.91600000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":2.0880000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1830000000000001,"15min":1.2250000000000001},"min":{"1min":0.94299999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4690000000000001,"5min":1.708,"15min":1.708},"last":1.978}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.208,"15min":1.268},"min":{"1min":0.86399999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4039999999999999,"5min":1.972,"15min":1.972},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.333,"15min":1.377},"min":{"1min":1.0249999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.9059999999999999,"5min":2.04,"15min":2.04},"last":1.859}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069588,"statfs":{"total":96636764160,"available":96327258112,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0609999999999999,"5min":1.468,"15min":1.468},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.752,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.63400000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.28,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.81599999999999995,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.236,"5min":1.419,"15min":1.419},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.59899999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.117,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":3.7429999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.78900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":3.6890000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1619999999999999},"min":{"1min":0.78500000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4630000000000001,"5min":1.899,"15min":1.899},"last":3.956}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1379999999999999,"15min":1.1930000000000001},"min":{"1min":0.875,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.367,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":4.1260000000000003},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1799999999999999,"15min":1.228},"min":{"1min":0.94399999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.458,"5min":2.02,"15min":2.02},"last":0.92600000000000005}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.83899999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4990000000000001,"5min":1.804,"15min":1.804},"last":4.2210000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2230000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5720000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":4.2000000000000002}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2509999999999999,"15min":1.2929999999999999},"min":{"1min":1.034,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.6819999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.208,"15min":1.206},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":4.2709999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":981627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.54400000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.57099999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98599999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.59999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96599999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0880000000000001,"5min":1.208,"15min":1.208},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.59399999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.89000000000000001},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1339999999999999,"5min":1.204,"15min":1.204},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0249999999999999,"15min":1.0189999999999999},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.359,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.81899999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.357,"5min":1.49,"15min":1.49},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.171,"5min":1.155,"15min":1.157},"min":{"1min":0.72199999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.877}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.212,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.665,"5min":1.696,"15min":1.696},"last":1.137},{"interface":"front","average":{"1min":1.135,"5min":1.1950000000000001,"15min":1.2110000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.5229999999999999,"5min":1.738,"15min":1.738},"last":1.0860000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.4430000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.2110000000000001,"15min":1.2370000000000001},"min":{"1min":0.97799999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.468,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0329999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:29:57.555 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:29:57.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.656+0000 7f2371b2f700 1 Processor -- start 2023-10-06T05:29:57.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.656+0000 7f2371b2f700 1 -- start start 2023-10-06T05:29:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.656+0000 7f2371b2f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f236c1605e0 0x7f236c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.656+0000 7f2371b2f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f236c0ca3c0 0x7f236c0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.656+0000 7f2371b2f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c0c2980 con 0x7f236c06b320 2023-10-06T05:29:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.656+0000 7f2371b2f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236c0c6bb0 con 0x7f236c1605e0 2023-10-06T05:29:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.656+0000 7f2371b2f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236c0c6e90 con 0x7f236c0ca3c0 2023-10-06T05:29:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.656+0000 7f2370b2d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f236c1605e0 0x7f236c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.656+0000 7f2370b2d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f236c1605e0 0x7f236c0c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44726/0 (socket says 172.21.15.29:44726) 2023-10-06T05:29:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2370b2d700 1 -- 172.21.15.29:0/2031441815 learned_addr learned my addr 172.21.15.29:0/2031441815 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f237132e700 1 --2- 172.21.15.29:0/2031441815 >> v2:172.21.15.173:3300/0 conn(0x7f236c0ca3c0 0x7f236c0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f236b7fe700 1 -- 172.21.15.29:0/2031441815 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699069977 0 0) 0x7f236c0c2980 con 0x7f236c06b320 2023-10-06T05:29:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2370b2d700 1 -- 172.21.15.29:0/2031441815 >> v2:172.21.15.173:3300/0 conn(0x7f236c0ca3c0 msgr2=0x7f236c0c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2370b2d700 1 --2- 172.21.15.29:0/2031441815 >> v2:172.21.15.173:3300/0 conn(0x7f236c0ca3c0 0x7f236c0c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2370b2d700 1 -- 172.21.15.29:0/2031441815 >> v1:172.21.15.173:6789/0 conn(0x7f236c06b320 legacy=0x7f236c0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2370b2d700 1 -- 172.21.15.29:0/2031441815 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0c7170 con 0x7f236c1605e0 2023-10-06T05:29:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2370b2d700 1 --2- 172.21.15.29:0/2031441815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c1605e0 0x7f236c0c6540 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f236c0cb220 tx=0x7f2354009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e263f5a49a38b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f236b7fe700 1 -- 172.21.15.29:0/2031441815 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354009e70 con 0x7f236c1605e0 2023-10-06T05:29:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f236b7fe700 1 -- 172.21.15.29:0/2031441815 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235400b860 con 0x7f236c1605e0 2023-10-06T05:29:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f236b7fe700 1 -- 172.21.15.29:0/2031441815 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400bc00 con 0x7f236c1605e0 2023-10-06T05:29:57.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2371b2f700 1 -- 172.21.15.29:0/2031441815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c1605e0 msgr2=0x7f236c0c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2371b2f700 1 --2- 172.21.15.29:0/2031441815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c1605e0 0x7f236c0c6540 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f236c0cb220 tx=0x7f2354009250 comp rx=0 tx=0).stop 2023-10-06T05:29:57.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2371b2f700 1 -- 172.21.15.29:0/2031441815 shutdown_connections 2023-10-06T05:29:57.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2371b2f700 1 --2- 172.21.15.29:0/2031441815 >> v2:172.21.15.173:3300/0 conn(0x7f236c0ca3c0 0x7f236c0c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2371b2f700 1 --2- 172.21.15.29:0/2031441815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c1605e0 0x7f236c0c6540 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2371b2f700 1 -- 172.21.15.29:0/2031441815 >> 172.21.15.29:0/2031441815 conn(0x7f236c0670a0 msgr2=0x7f236c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:57.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2371b2f700 1 -- 172.21.15.29:0/2031441815 shutdown_connections 2023-10-06T05:29:57.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2371b2f700 1 -- 172.21.15.29:0/2031441815 wait complete. 2023-10-06T05:29:57.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.660+0000 7f2371b2f700 1 Processor -- start 2023-10-06T05:29:57.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2371b2f700 1 -- start start 2023-10-06T05:29:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2371b2f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c06b320 0x7f236c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2371b2f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f236c0ca3c0 0x7f236c0c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2371b2f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f236c1605e0 0x7f236c0c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2371b2f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0b0140 con 0x7f236c06b320 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2371b2f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0b0420 con 0x7f236c1605e0 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2371b2f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0b0700 con 0x7f236c0ca3c0 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2370b2d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c06b320 0x7f236c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2370b2d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c06b320 0x7f236c155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44738/0 (socket says 172.21.15.29:44738) 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2370b2d700 1 -- 172.21.15.29:0/1169325300 learned_addr learned my addr 172.21.15.29:0/1169325300 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f237132e700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f236c1605e0 0x7f236c0c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f236bfff700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f236c0ca3c0 0x7f236c0c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2370b2d700 1 -- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f236c0ca3c0 msgr2=0x7f236c0c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2370b2d700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f236c0ca3c0 0x7f236c0c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2370b2d700 1 -- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f236c1605e0 msgr2=0x7f236c0c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2370b2d700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f236c1605e0 0x7f236c0c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2370b2d700 1 -- 172.21.15.29:0/1169325300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23540094f0 con 0x7f236c06b320 2023-10-06T05:29:57.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f236bfff700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f236c0ca3c0 0x7f236c0c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:57.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f237132e700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f236c1605e0 0x7f236c0c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:29:57.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2370b2d700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c06b320 0x7f236c155bf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f23540094c0 tx=0x7f2354017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2368ff9700 1 -- 172.21.15.29:0/1169325300 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400bbe0 con 0x7f236c06b320 2023-10-06T05:29:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2368ff9700 1 -- 172.21.15.29:0/1169325300 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354011420 con 0x7f236c06b320 2023-10-06T05:29:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c16d5c0 con 0x7f236c06b320 2023-10-06T05:29:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2368ff9700 1 -- 172.21.15.29:0/1169325300 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354011800 con 0x7f236c06b320 2023-10-06T05:29:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.664+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c156130 con 0x7f236c06b320 2023-10-06T05:29:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.668+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c16d7d0 con 0x7f236c06b320 2023-10-06T05:29:57.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.668+0000 7f2368ff9700 1 -- 172.21.15.29:0/1169325300 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2354011bb0 con 0x7f236c06b320 2023-10-06T05:29:57.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.668+0000 7f2368ff9700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f234c060550 0x7f234c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.668+0000 7f2368ff9700 1 -- 172.21.15.29:0/1169325300 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f235407e0e0 con 0x7f236c06b320 2023-10-06T05:29:57.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.668+0000 7f236bfff700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f234c060550 0x7f234c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:57.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.672+0000 7f236bfff700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f234c060550 0x7f234c062a00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f235c007e90 tx=0x7f235c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:57.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.676+0000 7f2368ff9700 1 -- 172.21.15.29:0/1169325300 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f235404e570 con 0x7f236c06b320 2023-10-06T05:29:57.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.836+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f236c16d440 con 0x7f234c060550 2023-10-06T05:29:57.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.856+0000 7f2368ff9700 1 -- 172.21.15.29:0/1169325300 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299162 (secure 0 0 0) 0x7f235c00e9c0 con 0x7f234c060550 2023-10-06T05:29:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f234c060550 msgr2=0x7f234c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f234c060550 0x7f234c062a00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f235c007e90 tx=0x7f235c009040 comp rx=0 tx=0).stop 2023-10-06T05:29:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c06b320 msgr2=0x7f236c155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c06b320 0x7f236c155bf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f23540094c0 tx=0x7f2354017000 comp rx=0 tx=0).stop 2023-10-06T05:29:57.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 shutdown_connections 2023-10-06T05:29:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f234c060550 0x7f234c062a00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f236c1605e0 0x7f236c0c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f236c0ca3c0 0x7f236c0c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 --2- 172.21.15.29:0/1169325300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f236c06b320 0x7f236c155bf0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 >> 172.21.15.29:0/1169325300 conn(0x7f236c0670a0 msgr2=0x7f236c156490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 shutdown_connections 2023-10-06T05:29:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.860+0000 7f2371b2f700 1 -- 172.21.15.29:0/1169325300 wait complete. 2023-10-06T05:29:57.868 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:29:57.881 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-10-06T05:29:56.740734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2411008,"kb_used_data":8128,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752563712,"statfs":{"total":773094113280,"available":770625241088,"internally_reserved":0,"allocated":8323072,"data_stored":4323124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.262238"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.491131+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.354636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486743+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:02.572983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486698+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:19.053299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488862+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:03.816191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.481409+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:51.939537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.481842+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:02.572983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488954+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:52.402311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.492577+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:04.134839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.485530+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:43.025672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.483377+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.491669+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:56.370863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488278+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:45.206856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.482088+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:42.402290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.485078+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:56.580080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.493320+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:18.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488393+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.483148+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488884+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.485261+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:04.695796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.484742+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:36.374566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487630+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:01.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.490784+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:36.083734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487533+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:53.199688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486436+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.001283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.489956+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:30.380770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685368+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:29:49.685368+0000","last_peered":"2023-10-06T05:29:49.685368+0000","last_clean":"2023-10-06T05:29:49.685368+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:29:49.685368+0000","last_undegraded":"2023-10-06T05:29:49.685368+0000","last_fullsized":"2023-10-06T05:29:49.685368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685488+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:29:49.685488+0000","last_peered":"2023-10-06T05:29:49.685488+0000","last_clean":"2023-10-06T05:29:49.685488+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:29:49.685488+0000","last_undegraded":"2023-10-06T05:29:49.685488+0000","last_fullsized":"2023-10-06T05:29:49.685488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487856+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:42.098747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685166+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:29:49.685166+0000","last_peered":"2023-10-06T05:29:49.685166+0000","last_clean":"2023-10-06T05:29:49.685166+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:29:49.685166+0000","last_undegraded":"2023-10-06T05:29:49.685166+0000","last_fullsized":"2023-10-06T05:29:49.685166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487724+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:15.292487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:50.180480+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:29:50.180480+0000","last_peered":"2023-10-06T05:29:50.180480+0000","last_clean":"2023-10-06T05:29:50.180480+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:29:50.180480+0000","last_undegraded":"2023-10-06T05:29:50.180480+0000","last_fullsized":"2023-10-06T05:29:50.180480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487891+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:17.096964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685244+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:29:49.685244+0000","last_peered":"2023-10-06T05:29:49.685244+0000","last_clean":"2023-10-06T05:29:49.685244+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:29:49.685244+0000","last_undegraded":"2023-10-06T05:29:49.685244+0000","last_fullsized":"2023-10-06T05:29:49.685244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.490664+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:02.394654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:50.161646+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:29:50.161646+0000","last_peered":"2023-10-06T05:29:50.161646+0000","last_clean":"2023-10-06T05:29:50.161646+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:29:50.161646+0000","last_undegraded":"2023-10-06T05:29:50.161646+0000","last_fullsized":"2023-10-06T05:29:50.161646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486272+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:45.206856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685269+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:29:49.685269+0000","last_peered":"2023-10-06T05:29:49.685269+0000","last_clean":"2023-10-06T05:29:49.685269+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:29:49.685269+0000","last_undegraded":"2023-10-06T05:29:49.685269+0000","last_fullsized":"2023-10-06T05:29:49.685269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.484777+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:41.126449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:50.161649+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:29:50.161649+0000","last_peered":"2023-10-06T05:29:50.161649+0000","last_clean":"2023-10-06T05:29:50.161649+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:29:50.161649+0000","last_undegraded":"2023-10-06T05:29:50.161649+0000","last_fullsized":"2023-10-06T05:29:50.161649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.481394+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:40.665196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.689129+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:29:49.689129+0000","last_peered":"2023-10-06T05:29:49.689129+0000","last_clean":"2023-10-06T05:29:49.689129+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:29:49.689129+0000","last_undegraded":"2023-10-06T05:29:49.689129+0000","last_fullsized":"2023-10-06T05:29:49.689129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":981627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86099999999999999,"15min":0.84499999999999997},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.89700000000000002,"15min":0.92800000000000005},"min":{"1min":0.68000000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.03,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88400000000000001,"15min":0.86899999999999999},"min":{"1min":0.61899999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.65700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1659999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.89900000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.64000000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1599999999999999,"5min":1.276,"15min":1.276},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2509999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95999999999999996,"15min":0.96199999999999997},"min":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.70799999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3160000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90800000000000003,"15min":0.92300000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1719999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.111,"15min":1.113},"min":{"1min":0.89600000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.294,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.008,"15min":0.99299999999999999},"min":{"1min":0.75800000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.25,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1839999999999999,"15min":1.2030000000000001},"min":{"1min":0.96199999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.3979999999999999,"5min":1.859,"15min":1.859},"last":1.107}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.119,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3260000000000001,"5min":1.611,"15min":1.611},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.76100000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.038}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.81499999999999995},"min":{"1min":0.51300000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.2050000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.67700000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98599999999999999,"15min":0.95899999999999996},"min":{"1min":0.61699999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4430000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.997},{"interface":"front","average":{"1min":1.028,"5min":0.98099999999999998,"15min":0.96699999999999997},"min":{"1min":0.66600000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6659999999999999,"5min":1.679,"15min":1.679},"last":1.0249999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.872,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.339,"5min":1.643,"15min":1.643},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.95299999999999996,"15min":0.88700000000000001},"min":{"1min":0.69999999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5509999999999999,"5min":1.784,"15min":1.784},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.70899999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.876},{"interface":"front","average":{"1min":1.161,"5min":1.1120000000000001,"15min":1.0800000000000001},"min":{"1min":0.89200000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5009999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96099999999999997},"min":{"1min":0.59999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.71,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.524,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.63300000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.097,"15min":1.069},"min":{"1min":0.78500000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7509999999999999,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.155}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.016,"15min":1.01},"min":{"1min":0.754,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.1180000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.0720000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":901120,"data_stored":397417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89200000000000002,"15min":0.85999999999999999},"min":{"1min":0.61499999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.294,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.96199999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.61699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2210000000000001,"5min":1.409,"15min":1.409},"last":0.998},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.242,"5min":1.411,"15min":1.411},"last":0.81000000000000005}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.67300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.175,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.046},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98599999999999999,"15min":0.96499999999999997},"min":{"1min":0.70299999999999996,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.244,"5min":1.54,"15min":1.54},"last":0.628}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.97099999999999997,"15min":0.95099999999999996},"min":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2769999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.77300000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.349,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.119}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":1.0089999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.204,"5min":1.419,"15min":1.419},"last":1.077},{"interface":"front","average":{"1min":1.091,"5min":1.143,"15min":1.179},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.05,"15min":1.1040000000000001},"min":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.327,"5min":1.508,"15min":1.508},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.022,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.3140000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.115,"15min":1.141},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.339,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.119,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.302,"5min":1.732,"15min":1.732},"last":1.1899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":901120,"data_stored":397417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.85199999999999998,"15min":0.79800000000000004},"min":{"1min":0.66600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.079},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.64500000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3180000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.98399999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85999999999999999,"15min":0.81599999999999995},"min":{"1min":0.70799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.006},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2649999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.90000000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.75700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.202,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.746,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1950000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.167}]},{"osd":3,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.69999999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2230000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.997,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.80100000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.26,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.995,"15min":1.0509999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1639999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.0249999999999999,"15min":1.04},"min":{"1min":0.69899999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.163,"5min":1.458,"15min":1.458},"last":1.0309999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.99399999999999999,"15min":0.998},"min":{"1min":0.66500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.429,"15min":1.429},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.151,"15min":1.1719999999999999},"min":{"1min":0.83999999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.387,"5min":1.548,"15min":1.548},"last":1.24}]},{"osd":7,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1339999999999999,"15min":1.1359999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.351,"5min":1.75,"15min":1.75},"last":1.0549999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069588,"statfs":{"total":96636764160,"available":96327258112,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.47199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.85099999999999998,"5min":1.379,"15min":1.379},"last":0.82399999999999995}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.54700000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0640000000000001,"5min":1.389,"15min":1.389},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79300000000000004,"15min":0.76500000000000001},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.107,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0649999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2390000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.099},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.57899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.222,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.093,"15min":1.1180000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":1.3260000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.095,"15min":1.117},"min":{"1min":0.80800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5009999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.413},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1100000000000001,"15min":1.0960000000000001},"min":{"1min":0.85399999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1579999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.069,"15min":1.079},"min":{"1min":0.748,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3009999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1910000000000001,"15min":1.196},"min":{"1min":0.81799999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":1.968,"15min":1.968},"last":1.5149999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.173,"15min":1.1639999999999999},"min":{"1min":0.80000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.663,"5min":1.762,"15min":1.762},"last":1.27},{"interface":"front","average":{"1min":1.107,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.88800000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4039999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1950000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069588,"statfs":{"total":96636764160,"available":96327258112,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.49299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.014},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.629,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2649999999999999,"5min":1.29,"15min":1.29},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.60299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.278,"5min":1.383,"15min":1.383},"last":1.153},{"interface":"front","average":{"1min":0.87,"5min":0.84499999999999997,"15min":0.874},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.2649999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.85099999999999998},"min":{"1min":0.63800000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0389999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0089999999999999,"15min":1.1040000000000001},"min":{"1min":0.69999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2410000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.9119999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1890000000000001,"15min":1.2350000000000001},"min":{"1min":0.89200000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4430000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.3859999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1319999999999999,"15min":1.1859999999999999},"min":{"1min":0.80800000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4019999999999999,"5min":1.829,"15min":1.829},"last":1.752},{"interface":"front","average":{"1min":1.095,"5min":1.1319999999999999,"15min":1.1819999999999999},"min":{"1min":0.80500000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.4339999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.8109999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.246,"15min":1.276},"min":{"1min":0.91600000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":2.0880000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1830000000000001,"15min":1.2250000000000001},"min":{"1min":0.94299999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4690000000000001,"5min":1.708,"15min":1.708},"last":1.978}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.208,"15min":1.268},"min":{"1min":0.86399999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4039999999999999,"5min":1.972,"15min":1.972},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.333,"15min":1.377},"min":{"1min":1.0249999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.9059999999999999,"5min":2.04,"15min":2.04},"last":1.859}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069588,"statfs":{"total":96636764160,"available":96327258112,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0609999999999999,"5min":1.468,"15min":1.468},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.752,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.63400000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.28,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.81599999999999995,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.236,"5min":1.419,"15min":1.419},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.59899999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.117,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":3.7429999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.78900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":3.6890000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1619999999999999},"min":{"1min":0.78500000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4630000000000001,"5min":1.899,"15min":1.899},"last":3.956}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1379999999999999,"15min":1.1930000000000001},"min":{"1min":0.875,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.367,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":4.1260000000000003},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1799999999999999,"15min":1.228},"min":{"1min":0.94399999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.458,"5min":2.02,"15min":2.02},"last":0.92600000000000005}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.83899999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4990000000000001,"5min":1.804,"15min":1.804},"last":4.2210000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2230000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5720000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":4.2000000000000002}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2509999999999999,"15min":1.2929999999999999},"min":{"1min":1.034,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.6819999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.208,"15min":1.206},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":4.2709999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":981627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.54400000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.57099999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98599999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.59999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96599999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0880000000000001,"5min":1.208,"15min":1.208},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.59399999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.89000000000000001},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1339999999999999,"5min":1.204,"15min":1.204},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0249999999999999,"15min":1.0189999999999999},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.359,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.81899999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.357,"5min":1.49,"15min":1.49},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.171,"5min":1.155,"15min":1.157},"min":{"1min":0.72199999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.877}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.212,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.665,"5min":1.696,"15min":1.696},"last":1.137},{"interface":"front","average":{"1min":1.135,"5min":1.1950000000000001,"15min":1.2110000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.5229999999999999,"5min":1.738,"15min":1.738},"last":1.0860000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.4430000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.2110000000000001,"15min":1.2370000000000001},"min":{"1min":0.97799999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.468,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0329999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:29:57.889 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:29:57.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.988+0000 7f15fe29f700 1 Processor -- start 2023-10-06T05:29:57.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.988+0000 7f15fe29f700 1 -- start start 2023-10-06T05:29:57.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fe29f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f15f806b380 0x7f15f806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:57.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fe29f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f806aef0 con 0x7f15f8159750 2023-10-06T05:29:57.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fe29f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f80c8080 con 0x7f15f806c8f0 2023-10-06T05:29:57.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fe29f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f806a2e0 con 0x7f15f806b380 2023-10-06T05:29:57.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fda9e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f15f8159750 0x7f15f80c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56238/0 (socket says 172.21.15.29:56238) 2023-10-06T05:29:57.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fda9e700 1 -- 172.21.15.29:0/1434066548 learned_addr learned my addr 172.21.15.29:0/1434066548 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:58.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fca9c700 1 --2- 172.21.15.29:0/1434066548 >> v2:172.21.15.173:3300/0 conn(0x7f15f806b380 0x7f15f806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220410849 0 0) 0x7f15f806aef0 con 0x7f15f8159750 2023-10-06T05:29:58.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e4003570 con 0x7f15f8159750 2023-10-06T05:29:58.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163611438 0 0) 0x7f15e4003570 con 0x7f15f8159750 2023-10-06T05:29:58.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 >> v2:172.21.15.173:3300/0 conn(0x7f15f806b380 msgr2=0x7f15f806ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:58.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 --2- 172.21.15.29:0/1434066548 >> v2:172.21.15.173:3300/0 conn(0x7f15f806b380 0x7f15f806ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 >> v1:172.21.15.173:6789/0 conn(0x7f15f806c8f0 legacy=0x7f15f80c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f806a5c0 con 0x7f15f8159750 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f15f00017f0 con 0x7f15f8159750 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 >> v1:172.21.15.29:6789/0 conn(0x7f15f8159750 legacy=0x7f15f80c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4003a60 0x7f15e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15e40051c0 0x7f15e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f806a2e0 con 0x7f15e4004810 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e400c160 con 0x7f15e4003a60 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e400c320 con 0x7f15e40051c0 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fca9c700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fda9e700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15e40051c0 0x7f15e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fd29d700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4003a60 0x7f15e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fca9c700 1 -- 172.21.15.29:0/1434066548 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15e40051c0 msgr2=0x7f15e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fca9c700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15e40051c0 0x7f15e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fca9c700 1 -- 172.21.15.29:0/1434066548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4003a60 msgr2=0x7f15e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fca9c700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4003a60 0x7f15e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fda9e700 1 -- 172.21.15.29:0/1434066548 reap_dead start 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fca9c700 1 -- 172.21.15.29:0/1434066548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e4003570 con 0x7f15e4004810 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15fca9c700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15e4004c80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009c00 tx=0x7f15e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb69c50b2c8beb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800e710 con 0x7f15e4004810 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e800e870 con 0x7f15e4004810 2023-10-06T05:29:58.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.992+0000 7f15effff700 1 -- 172.21.15.29:0/1434066548 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800ec30 con 0x7f15e4004810 2023-10-06T05:29:58.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.996+0000 7f15fe29f700 1 -- 172.21.15.29:0/1434066548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 msgr2=0x7f15e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.996+0000 7f15fe29f700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15e4004c80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009c00 tx=0x7f15e80091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.996+0000 7f15fe29f700 1 -- 172.21.15.29:0/1434066548 shutdown_connections 2023-10-06T05:29:58.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.996+0000 7f15fe29f700 1 --2- 172.21.15.29:0/1434066548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15e4004c80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.996+0000 7f15fe29f700 1 -- 172.21.15.29:0/1434066548 >> 172.21.15.29:0/1434066548 conn(0x7f15f80670a0 msgr2=0x7f15f80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:58.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.996+0000 7f15fe29f700 1 -- 172.21.15.29:0/1434066548 shutdown_connections 2023-10-06T05:29:58.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:57.996+0000 7f15fe29f700 1 -- 172.21.15.29:0/1434066548 wait complete. 2023-10-06T05:29:58.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 Processor -- start 2023-10-06T05:29:58.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 -- start start 2023-10-06T05:29:58.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15f8147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f81479a0 0x7f15f80b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15f80c1c90 0x7f15f80c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80c2640 con 0x7f15e4004810 2023-10-06T05:29:58.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8149da0 con 0x7f15f81479a0 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80af830 con 0x7f15f80c1c90 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fd29d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15f8147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fd29d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15f8147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44754/0 (socket says 172.21.15.29:44754) 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fd29d700 1 -- 172.21.15.29:0/3305940363 learned_addr learned my addr 172.21.15.29:0/3305940363 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fca9c700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f81479a0 0x7f15f80b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fda9e700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15f80c1c90 0x7f15f80c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fd29d700 1 -- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15f80c1c90 msgr2=0x7f15f80c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fd29d700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15f80c1c90 0x7f15f80c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fd29d700 1 -- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f81479a0 msgr2=0x7f15f80b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fd29d700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f81479a0 0x7f15f80b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fd29d700 1 -- 172.21.15.29:0/3305940363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80afb10 con 0x7f15e4004810 2023-10-06T05:29:58.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fd29d700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15f8147180 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f15f4002950 tx=0x7f15f4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:58.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15ed7fa700 1 -- 172.21.15.29:0/3305940363 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4003390 con 0x7f15e4004810 2023-10-06T05:29:58.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15ed7fa700 1 -- 172.21.15.29:0/3305940363 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f4006820 con 0x7f15e4004810 2023-10-06T05:29:58.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f8149a30 con 0x7f15e4004810 2023-10-06T05:29:58.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15ed7fa700 1 -- 172.21.15.29:0/3305940363 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4006bc0 con 0x7f15e4004810 2023-10-06T05:29:58.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.000+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f8149670 con 0x7f15e4004810 2023-10-06T05:29:58.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.004+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f804be00 con 0x7f15e4004810 2023-10-06T05:29:58.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.004+0000 7f15ed7fa700 1 -- 172.21.15.29:0/3305940363 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f15f4007020 con 0x7f15e4004810 2023-10-06T05:29:58.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.004+0000 7f15ed7fa700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15dc060580 0x7f15dc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.004+0000 7f15ed7fa700 1 -- 172.21.15.29:0/3305940363 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f15f407c8c0 con 0x7f15e4004810 2023-10-06T05:29:58.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.004+0000 7f15fca9c700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15dc060580 0x7f15dc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.004+0000 7f15fca9c700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15dc060580 0x7f15dc062a30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f15e80091e0 tx=0x7f15e801a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.008+0000 7f15ed7fa700 1 -- 172.21.15.29:0/3305940363 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f15f404cd50 con 0x7f15e4004810 2023-10-06T05:29:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.168+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15f806a8a0 con 0x7f15dc060580 2023-10-06T05:29:58.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.184+0000 7f15ed7fa700 1 -- 172.21.15.29:0/3305940363 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299162 (secure 0 0 0) 0x7f15f806a8a0 con 0x7f15dc060580 2023-10-06T05:29:58.199 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:58.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15dc060580 msgr2=0x7f15dc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15dc060580 0x7f15dc062a30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f15e80091e0 tx=0x7f15e801a000 comp rx=0 tx=0).stop 2023-10-06T05:29:58.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 msgr2=0x7f15f8147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15f8147180 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f15f4002950 tx=0x7f15f4007d30 comp rx=0 tx=0).stop 2023-10-06T05:29:58.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 shutdown_connections 2023-10-06T05:29:58.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f15f80c1c90 0x7f15f80c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15dc060580 0x7f15dc062a30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15f81479a0 0x7f15f80b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 --2- 172.21.15.29:0/3305940363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15e4004810 0x7f15f8147180 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 >> 172.21.15.29:0/3305940363 conn(0x7f15f80670a0 msgr2=0x7f15f80c0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:58.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 shutdown_connections 2023-10-06T05:29:58.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.192+0000 7f15fe29f700 1 -- 172.21.15.29:0/3305940363 wait complete. 2023-10-06T05:29:58.202 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:29:58.212 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-10-06T05:29:56.740734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2411008,"kb_used_data":8128,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752563712,"statfs":{"total":773094113280,"available":770625241088,"internally_reserved":0,"allocated":8323072,"data_stored":4323124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.262238"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.491131+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:06.354636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486743+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:02.572983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486698+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:19.053299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488862+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:03.816191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.481409+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:51.939537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.481842+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:02.572983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488954+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:52.402311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.492577+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:04.134839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.485530+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:43.025672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.483377+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.491669+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:56.370863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488278+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:45.206856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.482088+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:42.402290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.485078+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:56.580080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.493320+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:18.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488393+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.483148+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.488884+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.485261+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:04.695796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.484742+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:36.374566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487630+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:01.883328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.490784+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:36.083734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487533+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:53.199688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486436+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.001283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.489956+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:30.380770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685368+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:29:49.685368+0000","last_peered":"2023-10-06T05:29:49.685368+0000","last_clean":"2023-10-06T05:29:49.685368+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:29:49.685368+0000","last_undegraded":"2023-10-06T05:29:49.685368+0000","last_fullsized":"2023-10-06T05:29:49.685368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685488+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:29:49.685488+0000","last_peered":"2023-10-06T05:29:49.685488+0000","last_clean":"2023-10-06T05:29:49.685488+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:29:49.685488+0000","last_undegraded":"2023-10-06T05:29:49.685488+0000","last_fullsized":"2023-10-06T05:29:49.685488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487856+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:42.098747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685166+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:29:49.685166+0000","last_peered":"2023-10-06T05:29:49.685166+0000","last_clean":"2023-10-06T05:29:49.685166+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:29:49.685166+0000","last_undegraded":"2023-10-06T05:29:49.685166+0000","last_fullsized":"2023-10-06T05:29:49.685166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487724+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:15.292487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:50.180480+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:29:50.180480+0000","last_peered":"2023-10-06T05:29:50.180480+0000","last_clean":"2023-10-06T05:29:50.180480+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:29:50.180480+0000","last_undegraded":"2023-10-06T05:29:50.180480+0000","last_fullsized":"2023-10-06T05:29:50.180480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.487891+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:17.096964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685244+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:29:49.685244+0000","last_peered":"2023-10-06T05:29:49.685244+0000","last_clean":"2023-10-06T05:29:49.685244+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:29:49.685244+0000","last_undegraded":"2023-10-06T05:29:49.685244+0000","last_fullsized":"2023-10-06T05:29:49.685244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.490664+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:02.394654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:50.161646+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:29:50.161646+0000","last_peered":"2023-10-06T05:29:50.161646+0000","last_clean":"2023-10-06T05:29:50.161646+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:29:50.161646+0000","last_undegraded":"2023-10-06T05:29:50.161646+0000","last_fullsized":"2023-10-06T05:29:50.161646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.486272+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:45.206856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.685269+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:29:49.685269+0000","last_peered":"2023-10-06T05:29:49.685269+0000","last_clean":"2023-10-06T05:29:49.685269+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:29:49.685269+0000","last_undegraded":"2023-10-06T05:29:49.685269+0000","last_fullsized":"2023-10-06T05:29:49.685269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.484777+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:41.126449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:50.161649+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:29:50.161649+0000","last_peered":"2023-10-06T05:29:50.161649+0000","last_clean":"2023-10-06T05:29:50.161649+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:29:50.161649+0000","last_undegraded":"2023-10-06T05:29:50.161649+0000","last_fullsized":"2023-10-06T05:29:50.161649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T05:29:53.475044+0000","last_change":"2023-10-06T05:29:53.475044+0000","last_active":"2023-10-06T05:29:53.475044+0000","last_peered":"2023-10-06T05:29:53.475044+0000","last_clean":"2023-10-06T05:29:53.475044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:53.475044+0000","last_undegraded":"2023-10-06T05:29:53.475044+0000","last_fullsized":"2023-10-06T05:29:53.475044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T05:29:52.470216+0000","last_change":"2023-10-06T05:29:52.481394+0000","last_active":"2023-10-06T05:29:52.470216+0000","last_peered":"2023-10-06T05:29:52.470216+0000","last_clean":"2023-10-06T05:29:52.470216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T05:29:52.470216+0000","last_undegraded":"2023-10-06T05:29:52.470216+0000","last_fullsized":"2023-10-06T05:29:52.470216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:40.665196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T05:29:49.689129+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:29:49.689129+0000","last_peered":"2023-10-06T05:29:49.689129+0000","last_clean":"2023-10-06T05:29:49.689129+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:29:49.689129+0000","last_undegraded":"2023-10-06T05:29:49.689129+0000","last_fullsized":"2023-10-06T05:29:49.689129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":981627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86099999999999999,"15min":0.84499999999999997},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.89700000000000002,"15min":0.92800000000000005},"min":{"1min":0.68000000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.03,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88400000000000001,"15min":0.86899999999999999},"min":{"1min":0.61899999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.65700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1659999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.89900000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.64000000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1599999999999999,"5min":1.276,"15min":1.276},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2509999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95999999999999996,"15min":0.96199999999999997},"min":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.70799999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3160000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90800000000000003,"15min":0.92300000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1719999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.111,"15min":1.113},"min":{"1min":0.89600000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.294,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.008,"15min":0.99299999999999999},"min":{"1min":0.75800000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.25,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1839999999999999,"15min":1.2030000000000001},"min":{"1min":0.96199999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.3979999999999999,"5min":1.859,"15min":1.859},"last":1.107}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.119,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3260000000000001,"5min":1.611,"15min":1.611},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.76100000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.038}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.81499999999999995},"min":{"1min":0.51300000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.2050000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.67700000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98599999999999999,"15min":0.95899999999999996},"min":{"1min":0.61699999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4430000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.997},{"interface":"front","average":{"1min":1.028,"5min":0.98099999999999998,"15min":0.96699999999999997},"min":{"1min":0.66600000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6659999999999999,"5min":1.679,"15min":1.679},"last":1.0249999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.872,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.339,"5min":1.643,"15min":1.643},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.95299999999999996,"15min":0.88700000000000001},"min":{"1min":0.69999999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5509999999999999,"5min":1.784,"15min":1.784},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.70899999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.876},{"interface":"front","average":{"1min":1.161,"5min":1.1120000000000001,"15min":1.0800000000000001},"min":{"1min":0.89200000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5009999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96099999999999997},"min":{"1min":0.59999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.71,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.524,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.63300000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.097,"15min":1.069},"min":{"1min":0.78500000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7509999999999999,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.155}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.016,"15min":1.01},"min":{"1min":0.754,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.1180000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.0720000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":901120,"data_stored":397417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89200000000000002,"15min":0.85999999999999999},"min":{"1min":0.61499999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.294,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.96199999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.61699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2210000000000001,"5min":1.409,"15min":1.409},"last":0.998},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.242,"5min":1.411,"15min":1.411},"last":0.81000000000000005}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.67300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.175,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.046},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98599999999999999,"15min":0.96499999999999997},"min":{"1min":0.70299999999999996,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.244,"5min":1.54,"15min":1.54},"last":0.628}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.97099999999999997,"15min":0.95099999999999996},"min":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2769999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.77300000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.349,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.119}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":1.0089999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.204,"5min":1.419,"15min":1.419},"last":1.077},{"interface":"front","average":{"1min":1.091,"5min":1.143,"15min":1.179},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.05,"15min":1.1040000000000001},"min":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.327,"5min":1.508,"15min":1.508},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.022,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.3140000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.115,"15min":1.141},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.339,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.119,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.302,"5min":1.732,"15min":1.732},"last":1.1899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":901120,"data_stored":397417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.85199999999999998,"15min":0.79800000000000004},"min":{"1min":0.66600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.079},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.64500000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3180000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.98399999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85999999999999999,"15min":0.81599999999999995},"min":{"1min":0.70799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.006},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2649999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.90000000000000002}]},{"osd":2,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.75700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.202,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.746,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1950000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.167}]},{"osd":3,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.69999999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2230000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.997,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.80100000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.26,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.995,"15min":1.0509999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1639999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.0249999999999999,"15min":1.04},"min":{"1min":0.69899999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.163,"5min":1.458,"15min":1.458},"last":1.0309999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.99399999999999999,"15min":0.998},"min":{"1min":0.66500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.429,"15min":1.429},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.151,"15min":1.1719999999999999},"min":{"1min":0.83999999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.387,"5min":1.548,"15min":1.548},"last":1.24}]},{"osd":7,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1339999999999999,"15min":1.1359999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.351,"5min":1.75,"15min":1.75},"last":1.0549999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069588,"statfs":{"total":96636764160,"available":96327258112,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.47199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.85099999999999998,"5min":1.379,"15min":1.379},"last":0.82399999999999995}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.54700000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0640000000000001,"5min":1.389,"15min":1.389},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79300000000000004,"15min":0.76500000000000001},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.107,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0649999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2390000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.099},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.57899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.222,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.093,"15min":1.1180000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":1.3260000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.095,"15min":1.117},"min":{"1min":0.80800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5009999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.413},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1100000000000001,"15min":1.0960000000000001},"min":{"1min":0.85399999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1579999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.069,"15min":1.079},"min":{"1min":0.748,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3009999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1910000000000001,"15min":1.196},"min":{"1min":0.81799999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":1.968,"15min":1.968},"last":1.5149999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.173,"15min":1.1639999999999999},"min":{"1min":0.80000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.663,"5min":1.762,"15min":1.762},"last":1.27},{"interface":"front","average":{"1min":1.107,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.88800000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4039999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1950000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069588,"statfs":{"total":96636764160,"available":96327258112,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.49299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.014},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.629,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2649999999999999,"5min":1.29,"15min":1.29},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.60299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.278,"5min":1.383,"15min":1.383},"last":1.153},{"interface":"front","average":{"1min":0.87,"5min":0.84499999999999997,"15min":0.874},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.2649999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.85099999999999998},"min":{"1min":0.63800000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0389999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0089999999999999,"15min":1.1040000000000001},"min":{"1min":0.69999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2410000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.9119999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1890000000000001,"15min":1.2350000000000001},"min":{"1min":0.89200000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4430000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.3859999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1319999999999999,"15min":1.1859999999999999},"min":{"1min":0.80800000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4019999999999999,"5min":1.829,"15min":1.829},"last":1.752},{"interface":"front","average":{"1min":1.095,"5min":1.1319999999999999,"15min":1.1819999999999999},"min":{"1min":0.80500000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.4339999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.8109999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.246,"15min":1.276},"min":{"1min":0.91600000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":2.0880000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1830000000000001,"15min":1.2250000000000001},"min":{"1min":0.94299999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4690000000000001,"5min":1.708,"15min":1.708},"last":1.978}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.208,"15min":1.268},"min":{"1min":0.86399999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4039999999999999,"5min":1.972,"15min":1.972},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.333,"15min":1.377},"min":{"1min":1.0249999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.9059999999999999,"5min":2.04,"15min":2.04},"last":1.859}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302252,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069588,"statfs":{"total":96636764160,"available":96327258112,"internally_reserved":0,"allocated":888832,"data_stored":391259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0609999999999999,"5min":1.468,"15min":1.468},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.752,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.63400000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.28,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.81599999999999995,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.236,"5min":1.419,"15min":1.419},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.59899999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.117,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":3.7429999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.78900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":3.6890000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1619999999999999},"min":{"1min":0.78500000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4630000000000001,"5min":1.899,"15min":1.899},"last":3.956}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1379999999999999,"15min":1.1930000000000001},"min":{"1min":0.875,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.367,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":4.1260000000000003},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1799999999999999,"15min":1.228},"min":{"1min":0.94399999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.458,"5min":2.02,"15min":2.02},"last":0.92600000000000005}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.83899999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4990000000000001,"5min":1.804,"15min":1.804},"last":4.2210000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2230000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5720000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":4.2000000000000002}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2509999999999999,"15min":1.2929999999999999},"min":{"1min":1.034,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.6819999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.208,"15min":1.206},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":4.2709999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302832,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069008,"statfs":{"total":96636764160,"available":96326664192,"internally_reserved":0,"allocated":1482752,"data_stored":981627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.54400000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.57099999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98599999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.59999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96599999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0880000000000001,"5min":1.208,"15min":1.208},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.59399999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.89000000000000001},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1339999999999999,"5min":1.204,"15min":1.204},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0249999999999999,"15min":1.0189999999999999},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.359,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.81899999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.357,"5min":1.49,"15min":1.49},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.171,"5min":1.155,"15min":1.157},"min":{"1min":0.72199999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.877}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.212,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.665,"5min":1.696,"15min":1.696},"last":1.137},{"interface":"front","average":{"1min":1.135,"5min":1.1950000000000001,"15min":1.2110000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.5229999999999999,"5min":1.738,"15min":1.738},"last":1.0860000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.4430000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.2110000000000001,"15min":1.2370000000000001},"min":{"1min":0.97799999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.468,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0329999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:29:58.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-10-06T05:29:58.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-10-06T05:29:58.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-10-06T05:29:58.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-10-06T05:29:58.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-10-06T05:29:58.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-10-06T05:29:58.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-10-06T05:29:58.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-10-06T05:29:58.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-10-06T05:29:58.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-10-06T05:29:58.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-10-06T05:29:58.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-10-06T05:29:58.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-10-06T05:29:58.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-10-06T05:29:58.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-10-06T05:29:58.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-10-06T05:29:58.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-10-06T05:29:58.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-10-06T05:29:58.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-10-06T05:29:58.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-10-06T05:29:58.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-10-06T05:29:58.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-10-06T05:29:58.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-10-06T05:29:58.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-10-06T05:29:58.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-10-06T05:29:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-10-06T05:29:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-10-06T05:29:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-10-06T05:29:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-10-06T05:29:58.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.491131+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:10:06.354636+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T05:29:58.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-10-06T05:29:58.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-06T05:29:58.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.486743+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:13:02.572983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:29:58.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-10-06T05:29:58.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-06T05:29:58.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.486698+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:50:19.053299+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:29:58.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-10-06T05:29:58.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-06T05:29:58.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.488862+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:27:03.816191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:29:58.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-10-06T05:29:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-06T05:29:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.481409+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:59:51.939537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T05:29:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-10-06T05:29:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-06T05:29:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.481842+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:13:02.572983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:29:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-10-06T05:29:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-10-06T05:29:58.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.488954+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:36:52.402311+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:29:58.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-10-06T05:29:58.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-10-06T05:29:58.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.492577+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:57:04.134839+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T05:29:58.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-10-06T05:29:58.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-06T05:29:58.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.485530+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:44:43.025672+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:29:58.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-10-06T05:29:58.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-06T05:29:58.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.483377+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:29:58.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-10-06T05:29:58.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-10-06T05:29:58.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.491669+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:08:56.370863+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T05:29:58.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-10-06T05:29:58.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-06T05:29:58.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.488278+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:31:45.206856+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.482088+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:11:42.402290+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.485078+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:44:56.580080+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-10-06T05:29:58.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-10-06T05:29:58.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.493320+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:36:18.946072+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T05:29:58.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-10-06T05:29:58.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-10-06T05:29:58.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.488393+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:29:58.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-10-06T05:29:58.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.483148+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.488884+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-06T05:29:58.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.485261+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:44:04.695796+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:29:58.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-10-06T05:29:58.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-06T05:29:58.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.484742+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:31:36.374566+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:29:58.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-10-06T05:29:58.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-06T05:29:58.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.487630+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:56:01.883328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:29:58.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-10-06T05:29:58.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-10-06T05:29:58.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.490784+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:23:36.083734+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T05:29:58.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-10-06T05:29:58.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-06T05:29:58.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.487533+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:13:53.199688+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T05:29:58.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-10-06T05:29:58.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-10-06T05:29:58.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.486436+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:34:42.001283+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T05:29:58.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.489956+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:02:30.380770+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.487856+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:15:42.098747+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-10-06T05:29:58.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.487724+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:05:15.292487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:29:58.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-10-06T05:29:58.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-10-06T05:29:58.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.487891+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:55:17.096964+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T05:29:58.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-10-06T05:29:58.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-10-06T05:29:58.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.490664+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:34:02.394654+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T05:29:58.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-10-06T05:29:58.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-10-06T05:29:58.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.486272+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:31:45.206856+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T05:29:58.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-10-06T05:29:58.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-06T05:29:58.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.484777+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:20:41.126449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T05:29:58.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-10-06T05:29:58.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T05:29:53.475044+0000', 'last_change': '2023-10-06T05:29:53.475044+0000', 'last_active': '2023-10-06T05:29:53.475044+0000', 'last_peered': '2023-10-06T05:29:53.475044+0000', 'last_clean': '2023-10-06T05:29:53.475044+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:53.475044+0000', 'last_undegraded': '2023-10-06T05:29:53.475044+0000', 'last_fullsized': '2023-10-06T05:29:53.475044+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:53.475044+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T05:29:58.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-06T05:29:58.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T05:29:52.470216+0000', 'last_change': '2023-10-06T05:29:52.481394+0000', 'last_active': '2023-10-06T05:29:52.470216+0000', 'last_peered': '2023-10-06T05:29:52.470216+0000', 'last_clean': '2023-10-06T05:29:52.470216+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T05:29:52.470216+0000', 'last_undegraded': '2023-10-06T05:29:52.470216+0000', 'last_fullsized': '2023-10-06T05:29:52.470216+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'last_clean_scrub_stamp': '2023-10-06T05:29:52.470216+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:42:40.665196+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T05:29:58.752 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T05:29:58.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.856+0000 7fc78dcee700 1 Processor -- start 2023-10-06T05:29:58.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.856+0000 7fc78dcee700 1 -- start start 2023-10-06T05:29:58.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 0x7fc7880ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc7880d0850 0x7fc78806b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7880cb390 con 0x7fc788158a30 2023-10-06T05:29:58.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7880cad80 con 0x7fc7880d0850 2023-10-06T05:29:58.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78806b900 con 0x7fc7880ce740 2023-10-06T05:29:58.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc787fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc788158a30 0x7fc788158eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56242/0 (socket says 172.21.15.29:56242) 2023-10-06T05:29:58.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc787fff700 1 -- 172.21.15.29:0/1827055405 learned_addr learned my addr 172.21.15.29:0/1827055405 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:58.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc786ffd700 1 --2- 172.21.15.29:0/1827055405 >> v2:172.21.15.173:3300/0 conn(0x7fc7880d0850 0x7fc78806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc7877fe700 1 --2- 172.21.15.29:0/1827055405 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 0x7fc7880ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc7867fc700 1 -- 172.21.15.29:0/1827055405 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661340334 0 0) 0x7fc7880cb390 con 0x7fc788158a30 2023-10-06T05:29:58.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc7867fc700 1 -- 172.21.15.29:0/1827055405 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc774003570 con 0x7fc788158a30 2023-10-06T05:29:58.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc786ffd700 1 -- 172.21.15.29:0/1827055405 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 msgr2=0x7fc7880ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:58.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc786ffd700 1 --2- 172.21.15.29:0/1827055405 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 0x7fc7880ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc786ffd700 1 -- 172.21.15.29:0/1827055405 >> v1:172.21.15.29:6789/0 conn(0x7fc788158a30 legacy=0x7fc788158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc786ffd700 1 -- 172.21.15.29:0/1827055405 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880cb020 con 0x7fc7880d0850 2023-10-06T05:29:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc786ffd700 1 --2- 172.21.15.29:0/1827055405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7880d0850 0x7fc78806b050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc7700098e0 tx=0x7fc7700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61c440252f8f2639 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc7867fc700 1 -- 172.21.15.29:0/1827055405 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770011630 con 0x7fc7880d0850 2023-10-06T05:29:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc7867fc700 1 -- 172.21.15.29:0/1827055405 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc770011790 con 0x7fc7880d0850 2023-10-06T05:29:58.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc7867fc700 1 -- 172.21.15.29:0/1827055405 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770011b30 con 0x7fc7880d0850 2023-10-06T05:29:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 -- 172.21.15.29:0/1827055405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7880d0850 msgr2=0x7fc78806b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 --2- 172.21.15.29:0/1827055405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7880d0850 0x7fc78806b050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc7700098e0 tx=0x7fc7700091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 -- 172.21.15.29:0/1827055405 shutdown_connections 2023-10-06T05:29:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 --2- 172.21.15.29:0/1827055405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7880d0850 0x7fc78806b050 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 --2- 172.21.15.29:0/1827055405 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 0x7fc7880ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 -- 172.21.15.29:0/1827055405 >> 172.21.15.29:0/1827055405 conn(0x7fc7880670a0 msgr2=0x7fc788067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 -- 172.21.15.29:0/1827055405 shutdown_connections 2023-10-06T05:29:58.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.860+0000 7fc78dcee700 1 -- 172.21.15.29:0/1827055405 wait complete. 2023-10-06T05:29:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 Processor -- start 2023-10-06T05:29:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 -- start start 2023-10-06T05:29:58.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 0x7fc7880c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7880d0850 0x7fc78815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc788158a30 0x7fc788142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc788143470 con 0x7fc7880d0850 2023-10-06T05:29:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78815c220 con 0x7fc788158a30 2023-10-06T05:29:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78815bc60 con 0x7fc7880ce740 2023-10-06T05:29:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc786ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7880d0850 0x7fc78815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc786ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7880d0850 0x7fc78815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44768/0 (socket says 172.21.15.29:44768) 2023-10-06T05:29:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc786ffd700 1 -- 172.21.15.29:0/3498513052 learned_addr learned my addr 172.21.15.29:0/3498513052 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc787fff700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc788158a30 0x7fc788142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc7877fe700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 0x7fc7880c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc786ffd700 1 -- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 msgr2=0x7fc7880c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc786ffd700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 0x7fc7880c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc786ffd700 1 -- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc788158a30 msgr2=0x7fc788142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc786ffd700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc788158a30 0x7fc788142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc786ffd700 1 -- 172.21.15.29:0/3498513052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc770009420 con 0x7fc7880d0850 2023-10-06T05:29:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc786ffd700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7880d0850 0x7fc78815b230 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc78806e080 tx=0x7fc770017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc77f7fe700 1 -- 172.21.15.29:0/3498513052 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770011900 con 0x7fc7880d0850 2023-10-06T05:29:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78815bf40 con 0x7fc7880d0850 2023-10-06T05:29:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc77f7fe700 1 -- 172.21.15.29:0/3498513052 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc770011a60 con 0x7fc7880d0850 2023-10-06T05:29:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7881567c0 con 0x7fc7880d0850 2023-10-06T05:29:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.864+0000 7fc77f7fe700 1 -- 172.21.15.29:0/3498513052 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770025600 con 0x7fc7880d0850 2023-10-06T05:29:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.868+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7881435e0 con 0x7fc7880d0850 2023-10-06T05:29:58.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.868+0000 7fc77f7fe700 1 -- 172.21.15.29:0/3498513052 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc7700259b0 con 0x7fc7880d0850 2023-10-06T05:29:58.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.868+0000 7fc77f7fe700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc768060550 0x7fc768062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:58.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.868+0000 7fc77f7fe700 1 -- 172.21.15.29:0/3498513052 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc77007e8f0 con 0x7fc7880d0850 2023-10-06T05:29:58.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.868+0000 7fc7877fe700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc768060550 0x7fc768062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:58.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.868+0000 7fc7877fe700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc768060550 0x7fc768062a00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc778009d20 tx=0x7fc7780091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:58.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:58.876+0000 7fc77f7fe700 1 -- 172.21.15.29:0/3498513052 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc77004ed20 con 0x7fc7880d0850 2023-10-06T05:29:58.994 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:29:58.988+0000 7f935f112700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:29:59.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.096+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc78804be00 con 0x7fc7880d0850 2023-10-06T05:29:59.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.100+0000 7fc77f7fe700 1 -- 172.21.15.29:0/3498513052 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1113 (secure 0 0 0) 0x7fc770015470 con 0x7fc7880d0850 2023-10-06T05:29:59.106 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:59.106 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":282,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":77,"num_osds":8,"num_up_osds":8,"osd_up_since":1696569927,"num_in_osds":8,"osd_in_since":1696569918,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2468872192,"bytes_avail":770625241088,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":41,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6501}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-10-06T05:29:38.735121+0000","services":{}},"progress_events":{}} 2023-10-06T05:29:59.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc768060550 msgr2=0x7fc768062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:59.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc768060550 0x7fc768062a00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc778009d20 tx=0x7fc7780091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7880d0850 msgr2=0x7fc78815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:59.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7880d0850 0x7fc78815b230 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc78806e080 tx=0x7fc770017000 comp rx=0 tx=0).stop 2023-10-06T05:29:59.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 shutdown_connections 2023-10-06T05:29:59.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc768060550 0x7fc768062a00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc788158a30 0x7fc788142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7880d0850 0x7fc78815b230 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 --2- 172.21.15.29:0/3498513052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc7880ce740 0x7fc7880c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 >> 172.21.15.29:0/3498513052 conn(0x7fc7880670a0 msgr2=0x7fc7880ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:59.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 shutdown_connections 2023-10-06T05:29:59.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.104+0000 7fc78dcee700 1 -- 172.21.15.29:0/3498513052 wait complete. 2023-10-06T05:29:59.126 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T05:29:59.126 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:29:59.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.228+0000 7fa99ffff700 1 Processor -- start 2023-10-06T05:29:59.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.228+0000 7fa99ffff700 1 -- start start 2023-10-06T05:29:59.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.228+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a006dde0 0x7fa9a0067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:59.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.228+0000 7fa99ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a0068770 con 0x7fa9a0159070 2023-10-06T05:29:59.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.228+0000 7fa99ffff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a00c68b0 con 0x7fa9a0158ca0 2023-10-06T05:29:59.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.228+0000 7fa99ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00c7430 con 0x7fa9a006dde0 2023-10-06T05:29:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.228+0000 7fa99f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa9a0159070 0x7fa9a00c78c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56250/0 (socket says 172.21.15.29:56250) 2023-10-06T05:29:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99f7fe700 1 -- 172.21.15.29:0/4126106182 learned_addr learned my addr 172.21.15.29:0/4126106182 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:29:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99e7fc700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a006dde0 0x7fa9a0067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745590972 0 0) 0x7fa9a0068770 con 0x7fa9a0159070 2023-10-06T05:29:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa980003570 con 0x7fa9a0159070 2023-10-06T05:29:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408676356 0 0) 0x7fa9a00c68b0 con 0x7fa9a0158ca0 2023-10-06T05:29:59.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a0068770 con 0x7fa9a0158ca0 2023-10-06T05:29:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178692547 0 0) 0x7fa980003570 con 0x7fa9a0159070 2023-10-06T05:29:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a006dde0 msgr2=0x7fa9a0067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a006dde0 0x7fa9a0067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 >> v1:172.21.15.173:6789/0 conn(0x7fa9a0158ca0 legacy=0x7fa9a006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a00ac140 con 0x7fa9a0159070 2023-10-06T05:29:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fa9980017f0 con 0x7fa9a0159070 2023-10-06T05:29:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99e7fc700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a006dde0 0x7fa9a0067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:29:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 >> v1:172.21.15.29:6789/0 conn(0x7fa9a0159070 legacy=0x7fa9a00c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:59.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a006dde0 0x7fa980003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:59.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa980004160 0x7fa980004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:59.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:59.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00c7430 con 0x7fa980004d50 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98000bba0 con 0x7fa980004160 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98000bd60 con 0x7fa9a006dde0 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99f7fe700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99e7fc700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa980004160 0x7fa980004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99effd700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a006dde0 0x7fa980003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99f7fe700 1 -- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a006dde0 msgr2=0x7fa980003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99f7fe700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a006dde0 0x7fa980003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99f7fe700 1 -- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa980004160 msgr2=0x7fa980004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99f7fe700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa980004160 0x7fa980004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99f7fe700 1 -- 172.21.15.29:0/4126106182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988009420 con 0x7fa980004d50 2023-10-06T05:29:59.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99f7fe700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9800051c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa99800a8c0 tx=0x7fa9a00c7570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b82f1e495db35d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:59.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980070d0 con 0x7fa980004d50 2023-10-06T05:29:59.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa998007250 con 0x7fa980004d50 2023-10-06T05:29:59.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99dffb700 1 -- 172.21.15.29:0/4126106182 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998007610 con 0x7fa980004d50 2023-10-06T05:29:59.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99ffff700 1 -- 172.21.15.29:0/4126106182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 msgr2=0x7fa9800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:59.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99ffff700 1 --2- 172.21.15.29:0/4126106182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9800051c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa99800a8c0 tx=0x7fa9a00c7570 comp rx=0 tx=0).stop 2023-10-06T05:29:59.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99f7fe700 1 -- 172.21.15.29:0/4126106182 reap_dead start 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99ffff700 1 -- 172.21.15.29:0/4126106182 shutdown_connections 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99ffff700 1 -- 172.21.15.29:0/4126106182 >> 172.21.15.29:0/4126106182 conn(0x7fa9a006abc0 msgr2=0x7fa9a006af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99ffff700 1 -- 172.21.15.29:0/4126106182 shutdown_connections 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.232+0000 7fa99ffff700 1 -- 172.21.15.29:0/4126106182 wait complete. 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 Processor -- start 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 -- start start 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9a014b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a0152220 0x7fa9a014c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a0152690 0x7fa9a014c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:59.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a01514f0 con 0x7fa980004d50 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a0151d90 con 0x7fa9a0152220 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00a96c0 con 0x7fa9a0152690 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9a014b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9a014b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44788/0 (socket says 172.21.15.29:44788) 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99effd700 1 -- 172.21.15.29:0/1609259531 learned_addr learned my addr 172.21.15.29:0/1609259531 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99e7fc700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a0152220 0x7fa9a014c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99f7fe700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a0152690 0x7fa9a014c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99effd700 1 -- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a0152690 msgr2=0x7fa9a014c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99effd700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a0152690 0x7fa9a014c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99effd700 1 -- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a0152220 msgr2=0x7fa9a014c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99effd700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a0152220 0x7fa9a014c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99effd700 1 -- 172.21.15.29:0/1609259531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0151740 con 0x7fa980004d50 2023-10-06T05:29:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99effd700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9a014b770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e780 tx=0x7fa990009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa996ffd700 1 -- 172.21.15.29:0/1609259531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990001570 con 0x7fa980004d50 2023-10-06T05:29:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa996ffd700 1 -- 172.21.15.29:0/1609259531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990010040 con 0x7fa980004d50 2023-10-06T05:29:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a0151a20 con 0x7fa980004d50 2023-10-06T05:29:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa996ffd700 1 -- 172.21.15.29:0/1609259531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990001940 con 0x7fa980004d50 2023-10-06T05:29:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.236+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a00a8950 con 0x7fa980004d50 2023-10-06T05:29:59.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.240+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a004be00 con 0x7fa980004d50 2023-10-06T05:29:59.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.240+0000 7fa996ffd700 1 -- 172.21.15.29:0/1609259531 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa990001d30 con 0x7fa980004d50 2023-10-06T05:29:59.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.240+0000 7fa996ffd700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa984060550 0x7fa984062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:29:59.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.240+0000 7fa996ffd700 1 -- 172.21.15.29:0/1609259531 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa99007c5f0 con 0x7fa980004d50 2023-10-06T05:29:59.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.240+0000 7fa99e7fc700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa984060550 0x7fa984062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:29:59.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.240+0000 7fa99e7fc700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa984060550 0x7fa984062a00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa9a016c880 tx=0x7fa9880091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:29:59.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.248+0000 7fa996ffd700 1 -- 172.21.15.29:0/1609259531 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa99004cb30 con 0x7fa980004d50 2023-10-06T05:29:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.408+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9a00c6b00 con 0x7fa984060550 2023-10-06T05:29:59.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.428+0000 7fa996ffd700 1 -- 172.21.15.29:0/1609259531 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309805 (secure 0 0 0) 0x7fa9a00c6b00 con 0x7fa984060550 2023-10-06T05:29:59.503 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:29:59.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa984060550 msgr2=0x7fa984062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:59.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa984060550 0x7fa984062a00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa9a016c880 tx=0x7fa9880091a0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 msgr2=0x7fa9a014b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:29:59.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9a014b770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e780 tx=0x7fa990009040 comp rx=0 tx=0).stop 2023-10-06T05:29:59.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 shutdown_connections 2023-10-06T05:29:59.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9a0152690 0x7fa9a014c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa984060550 0x7fa984062a00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9a0152220 0x7fa9a014c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 --2- 172.21.15.29:0/1609259531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa980004d50 0x7fa9a014b770 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:29:59.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 >> 172.21.15.29:0/1609259531 conn(0x7fa9a006abc0 msgr2=0x7fa9a006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:29:59.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 shutdown_connections 2023-10-06T05:29:59.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:29:59.432+0000 7fa99ffff700 1 -- 172.21.15.29:0/1609259531 wait complete. 2023-10-06T05:29:59.507 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:29:59.508 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2023-10-06T05:29:58.741370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415516,"kb_used_data":8540,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752559204,"statfs":{"total":773094113280,"available":770620624896,"internally_reserved":0,"allocated":8744960,"data_stored":4521027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002061"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.518715+0000","last_change":"2023-10-06T05:29:54.513162+0000","last_active":"2023-10-06T05:29:54.518715+0000","last_peered":"2023-10-06T05:29:54.518715+0000","last_clean":"2023-10-06T05:29:54.518715+0000","last_became_active":"2023-10-06T05:29:54.512831+0000","last_became_peered":"2023-10-06T05:29:54.512831+0000","last_unstale":"2023-10-06T05:29:54.518715+0000","last_undegraded":"2023-10-06T05:29:54.518715+0000","last_fullsized":"2023-10-06T05:29:54.518715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:27.646401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539119+0000","last_change":"2023-10-06T05:29:54.532966+0000","last_active":"2023-10-06T05:29:54.539119+0000","last_peered":"2023-10-06T05:29:54.539119+0000","last_clean":"2023-10-06T05:29:54.539119+0000","last_became_active":"2023-10-06T05:29:54.532240+0000","last_became_peered":"2023-10-06T05:29:54.532240+0000","last_unstale":"2023-10-06T05:29:54.539119+0000","last_undegraded":"2023-10-06T05:29:54.539119+0000","last_fullsized":"2023-10-06T05:29:54.539119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:42.346883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.535986+0000","last_change":"2023-10-06T05:29:54.534176+0000","last_active":"2023-10-06T05:29:54.535986+0000","last_peered":"2023-10-06T05:29:54.535986+0000","last_clean":"2023-10-06T05:29:54.535986+0000","last_became_active":"2023-10-06T05:29:54.533894+0000","last_became_peered":"2023-10-06T05:29:54.533894+0000","last_unstale":"2023-10-06T05:29:54.535986+0000","last_undegraded":"2023-10-06T05:29:54.535986+0000","last_fullsized":"2023-10-06T05:29:54.535986+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:20.058127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.513589+0000","last_change":"2023-10-06T05:29:54.509334+0000","last_active":"2023-10-06T05:29:54.513589+0000","last_peered":"2023-10-06T05:29:54.513589+0000","last_clean":"2023-10-06T05:29:54.513589+0000","last_became_active":"2023-10-06T05:29:54.506377+0000","last_became_peered":"2023-10-06T05:29:54.506377+0000","last_unstale":"2023-10-06T05:29:54.513589+0000","last_undegraded":"2023-10-06T05:29:54.513589+0000","last_fullsized":"2023-10-06T05:29:54.513589+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:31.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.521485+0000","last_change":"2023-10-06T05:29:54.515555+0000","last_active":"2023-10-06T05:29:54.521485+0000","last_peered":"2023-10-06T05:29:54.521485+0000","last_clean":"2023-10-06T05:29:54.521485+0000","last_became_active":"2023-10-06T05:29:54.515262+0000","last_became_peered":"2023-10-06T05:29:54.515262+0000","last_unstale":"2023-10-06T05:29:54.521485+0000","last_undegraded":"2023-10-06T05:29:54.521485+0000","last_fullsized":"2023-10-06T05:29:54.521485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:15.948263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.534548+0000","last_change":"2023-10-06T05:29:54.526011+0000","last_active":"2023-10-06T05:29:54.534548+0000","last_peered":"2023-10-06T05:29:54.534548+0000","last_clean":"2023-10-06T05:29:54.534548+0000","last_became_active":"2023-10-06T05:29:54.525708+0000","last_became_peered":"2023-10-06T05:29:54.525708+0000","last_unstale":"2023-10-06T05:29:54.534548+0000","last_undegraded":"2023-10-06T05:29:54.534548+0000","last_fullsized":"2023-10-06T05:29:54.534548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:42.346883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526111+0000","last_change":"2023-10-06T05:29:54.522737+0000","last_active":"2023-10-06T05:29:54.526111+0000","last_peered":"2023-10-06T05:29:54.526111+0000","last_clean":"2023-10-06T05:29:54.526111+0000","last_became_active":"2023-10-06T05:29:54.522458+0000","last_became_peered":"2023-10-06T05:29:54.522458+0000","last_unstale":"2023-10-06T05:29:54.526111+0000","last_undegraded":"2023-10-06T05:29:54.526111+0000","last_fullsized":"2023-10-06T05:29:54.526111+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:53.407139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.520790+0000","last_change":"2023-10-06T05:29:54.515566+0000","last_active":"2023-10-06T05:29:54.520790+0000","last_peered":"2023-10-06T05:29:54.520790+0000","last_clean":"2023-10-06T05:29:54.520790+0000","last_became_active":"2023-10-06T05:29:54.515310+0000","last_became_peered":"2023-10-06T05:29:54.515310+0000","last_unstale":"2023-10-06T05:29:54.520790+0000","last_undegraded":"2023-10-06T05:29:54.520790+0000","last_fullsized":"2023-10-06T05:29:54.520790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:55.374288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528702+0000","last_change":"2023-10-06T05:29:54.523814+0000","last_active":"2023-10-06T05:29:54.528702+0000","last_peered":"2023-10-06T05:29:54.528702+0000","last_clean":"2023-10-06T05:29:54.528702+0000","last_became_active":"2023-10-06T05:29:54.523504+0000","last_became_peered":"2023-10-06T05:29:54.523504+0000","last_unstale":"2023-10-06T05:29:54.528702+0000","last_undegraded":"2023-10-06T05:29:54.528702+0000","last_fullsized":"2023-10-06T05:29:54.528702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:05.783502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.530455+0000","last_change":"2023-10-06T05:29:54.524526+0000","last_active":"2023-10-06T05:29:54.530455+0000","last_peered":"2023-10-06T05:29:54.530455+0000","last_clean":"2023-10-06T05:29:54.530455+0000","last_became_active":"2023-10-06T05:29:54.524195+0000","last_became_peered":"2023-10-06T05:29:54.524195+0000","last_unstale":"2023-10-06T05:29:54.530455+0000","last_undegraded":"2023-10-06T05:29:54.530455+0000","last_fullsized":"2023-10-06T05:29:54.530455+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:27.646401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539204+0000","last_change":"2023-10-06T05:29:54.532990+0000","last_active":"2023-10-06T05:29:54.539204+0000","last_peered":"2023-10-06T05:29:54.539204+0000","last_clean":"2023-10-06T05:29:54.539204+0000","last_became_active":"2023-10-06T05:29:54.532231+0000","last_became_peered":"2023-10-06T05:29:54.532231+0000","last_unstale":"2023-10-06T05:29:54.539204+0000","last_undegraded":"2023-10-06T05:29:54.539204+0000","last_fullsized":"2023-10-06T05:29:54.539204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:00.511156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537764+0000","last_change":"2023-10-06T05:29:54.533931+0000","last_active":"2023-10-06T05:29:54.537764+0000","last_peered":"2023-10-06T05:29:54.537764+0000","last_clean":"2023-10-06T05:29:54.537764+0000","last_became_active":"2023-10-06T05:29:54.533649+0000","last_became_peered":"2023-10-06T05:29:54.533649+0000","last_unstale":"2023-10-06T05:29:54.537764+0000","last_undegraded":"2023-10-06T05:29:54.537764+0000","last_fullsized":"2023-10-06T05:29:54.537764+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:23.458976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529100+0000","last_change":"2023-10-06T05:29:54.523662+0000","last_active":"2023-10-06T05:29:54.529100+0000","last_peered":"2023-10-06T05:29:54.529100+0000","last_clean":"2023-10-06T05:29:54.529100+0000","last_became_active":"2023-10-06T05:29:54.523239+0000","last_became_peered":"2023-10-06T05:29:54.523239+0000","last_unstale":"2023-10-06T05:29:54.529100+0000","last_undegraded":"2023-10-06T05:29:54.529100+0000","last_fullsized":"2023-10-06T05:29:54.529100+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:35.356479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.534525+0000","last_change":"2023-10-06T05:29:54.525974+0000","last_active":"2023-10-06T05:29:54.534525+0000","last_peered":"2023-10-06T05:29:54.534525+0000","last_clean":"2023-10-06T05:29:54.534525+0000","last_became_active":"2023-10-06T05:29:54.525690+0000","last_became_peered":"2023-10-06T05:29:54.525690+0000","last_unstale":"2023-10-06T05:29:54.534525+0000","last_undegraded":"2023-10-06T05:29:54.534525+0000","last_fullsized":"2023-10-06T05:29:54.534525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:54.542473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.536795+0000","last_change":"2023-10-06T05:29:54.530404+0000","last_active":"2023-10-06T05:29:54.536795+0000","last_peered":"2023-10-06T05:29:54.536795+0000","last_clean":"2023-10-06T05:29:54.536795+0000","last_became_active":"2023-10-06T05:29:54.530041+0000","last_became_peered":"2023-10-06T05:29:54.530041+0000","last_unstale":"2023-10-06T05:29:54.536795+0000","last_undegraded":"2023-10-06T05:29:54.536795+0000","last_fullsized":"2023-10-06T05:29:54.536795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:36:08.526974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527057+0000","last_change":"2023-10-06T05:29:54.515107+0000","last_active":"2023-10-06T05:29:54.527057+0000","last_peered":"2023-10-06T05:29:54.527057+0000","last_clean":"2023-10-06T05:29:54.527057+0000","last_became_active":"2023-10-06T05:29:54.514832+0000","last_became_peered":"2023-10-06T05:29:54.514832+0000","last_unstale":"2023-10-06T05:29:54.527057+0000","last_undegraded":"2023-10-06T05:29:54.527057+0000","last_fullsized":"2023-10-06T05:29:54.527057+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:31.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529241+0000","last_change":"2023-10-06T05:29:54.525206+0000","last_active":"2023-10-06T05:29:54.529241+0000","last_peered":"2023-10-06T05:29:54.529241+0000","last_clean":"2023-10-06T05:29:54.529241+0000","last_became_active":"2023-10-06T05:29:54.524424+0000","last_became_peered":"2023-10-06T05:29:54.524424+0000","last_unstale":"2023-10-06T05:29:54.529241+0000","last_undegraded":"2023-10-06T05:29:54.529241+0000","last_fullsized":"2023-10-06T05:29:54.529241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:55:03.475085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525329+0000","last_change":"2023-10-06T05:29:54.520151+0000","last_active":"2023-10-06T05:29:54.525329+0000","last_peered":"2023-10-06T05:29:54.525329+0000","last_clean":"2023-10-06T05:29:54.525329+0000","last_became_active":"2023-10-06T05:29:54.518845+0000","last_became_peered":"2023-10-06T05:29:54.518845+0000","last_unstale":"2023-10-06T05:29:54.525329+0000","last_undegraded":"2023-10-06T05:29:54.525329+0000","last_fullsized":"2023-10-06T05:29:54.525329+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:05.700624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525497+0000","last_change":"2023-10-06T05:29:54.521962+0000","last_active":"2023-10-06T05:29:54.525497+0000","last_peered":"2023-10-06T05:29:54.525497+0000","last_clean":"2023-10-06T05:29:54.525497+0000","last_became_active":"2023-10-06T05:29:54.521564+0000","last_became_peered":"2023-10-06T05:29:54.521564+0000","last_unstale":"2023-10-06T05:29:54.525497+0000","last_undegraded":"2023-10-06T05:29:54.525497+0000","last_fullsized":"2023-10-06T05:29:54.525497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:44.474526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.523023+0000","last_change":"2023-10-06T05:29:54.516571+0000","last_active":"2023-10-06T05:29:54.523023+0000","last_peered":"2023-10-06T05:29:54.523023+0000","last_clean":"2023-10-06T05:29:54.523023+0000","last_became_active":"2023-10-06T05:29:54.516286+0000","last_became_peered":"2023-10-06T05:29:54.516286+0000","last_unstale":"2023-10-06T05:29:54.523023+0000","last_undegraded":"2023-10-06T05:29:54.523023+0000","last_fullsized":"2023-10-06T05:29:54.523023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:07.610035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526306+0000","last_change":"2023-10-06T05:29:54.520475+0000","last_active":"2023-10-06T05:29:54.526306+0000","last_peered":"2023-10-06T05:29:54.526306+0000","last_clean":"2023-10-06T05:29:54.526306+0000","last_became_active":"2023-10-06T05:29:54.520146+0000","last_became_peered":"2023-10-06T05:29:54.520146+0000","last_unstale":"2023-10-06T05:29:54.526306+0000","last_undegraded":"2023-10-06T05:29:54.526306+0000","last_fullsized":"2023-10-06T05:29:54.526306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:06.755837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529220+0000","last_change":"2023-10-06T05:29:54.524953+0000","last_active":"2023-10-06T05:29:54.529220+0000","last_peered":"2023-10-06T05:29:54.529220+0000","last_clean":"2023-10-06T05:29:54.529220+0000","last_became_active":"2023-10-06T05:29:54.524656+0000","last_became_peered":"2023-10-06T05:29:54.524656+0000","last_unstale":"2023-10-06T05:29:54.529220+0000","last_undegraded":"2023-10-06T05:29:54.529220+0000","last_fullsized":"2023-10-06T05:29:54.529220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:40.379472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.508461+0000","last_change":"2023-10-06T05:29:54.506643+0000","last_active":"2023-10-06T05:29:54.508461+0000","last_peered":"2023-10-06T05:29:54.508461+0000","last_clean":"2023-10-06T05:29:54.508461+0000","last_became_active":"2023-10-06T05:29:54.506290+0000","last_became_peered":"2023-10-06T05:29:54.506290+0000","last_unstale":"2023-10-06T05:29:54.508461+0000","last_undegraded":"2023-10-06T05:29:54.508461+0000","last_fullsized":"2023-10-06T05:29:54.508461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:29.207931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539239+0000","last_change":"2023-10-06T05:29:54.534292+0000","last_active":"2023-10-06T05:29:54.539239+0000","last_peered":"2023-10-06T05:29:54.539239+0000","last_clean":"2023-10-06T05:29:54.539239+0000","last_became_active":"2023-10-06T05:29:54.531552+0000","last_became_peered":"2023-10-06T05:29:54.531552+0000","last_unstale":"2023-10-06T05:29:54.539239+0000","last_undegraded":"2023-10-06T05:29:54.539239+0000","last_fullsized":"2023-10-06T05:29:54.539239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:15.330784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539013+0000","last_change":"2023-10-06T05:29:54.532510+0000","last_active":"2023-10-06T05:29:54.539013+0000","last_peered":"2023-10-06T05:29:54.539013+0000","last_clean":"2023-10-06T05:29:54.539013+0000","last_became_active":"2023-10-06T05:29:54.531267+0000","last_became_peered":"2023-10-06T05:29:54.531267+0000","last_unstale":"2023-10-06T05:29:54.539013+0000","last_undegraded":"2023-10-06T05:29:54.539013+0000","last_fullsized":"2023-10-06T05:29:54.539013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:46.198628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537834+0000","last_change":"2023-10-06T05:29:54.534551+0000","last_active":"2023-10-06T05:29:54.537834+0000","last_peered":"2023-10-06T05:29:54.537834+0000","last_clean":"2023-10-06T05:29:54.537834+0000","last_became_active":"2023-10-06T05:29:54.534225+0000","last_became_peered":"2023-10-06T05:29:54.534225+0000","last_unstale":"2023-10-06T05:29:54.537834+0000","last_undegraded":"2023-10-06T05:29:54.537834+0000","last_fullsized":"2023-10-06T05:29:54.537834+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:15.861483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527030+0000","last_change":"2023-10-06T05:29:54.514846+0000","last_active":"2023-10-06T05:29:54.527030+0000","last_peered":"2023-10-06T05:29:54.527030+0000","last_clean":"2023-10-06T05:29:54.527030+0000","last_became_active":"2023-10-06T05:29:54.514317+0000","last_became_peered":"2023-10-06T05:29:54.514317+0000","last_unstale":"2023-10-06T05:29:54.527030+0000","last_undegraded":"2023-10-06T05:29:54.527030+0000","last_fullsized":"2023-10-06T05:29:54.527030+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:43.103575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.520724+0000","last_change":"2023-10-06T05:29:54.513332+0000","last_active":"2023-10-06T05:29:54.520724+0000","last_peered":"2023-10-06T05:29:54.520724+0000","last_clean":"2023-10-06T05:29:54.520724+0000","last_became_active":"2023-10-06T05:29:54.513021+0000","last_became_peered":"2023-10-06T05:29:54.513021+0000","last_unstale":"2023-10-06T05:29:54.520724+0000","last_undegraded":"2023-10-06T05:29:54.520724+0000","last_fullsized":"2023-10-06T05:29:54.520724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:52.851641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539274+0000","last_change":"2023-10-06T05:29:54.534626+0000","last_active":"2023-10-06T05:29:54.539274+0000","last_peered":"2023-10-06T05:29:54.539274+0000","last_clean":"2023-10-06T05:29:54.539274+0000","last_became_active":"2023-10-06T05:29:54.531971+0000","last_became_peered":"2023-10-06T05:29:54.531971+0000","last_unstale":"2023-10-06T05:29:54.539274+0000","last_undegraded":"2023-10-06T05:29:54.539274+0000","last_fullsized":"2023-10-06T05:29:54.539274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.039388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.538121+0000","last_change":"2023-10-06T05:29:54.536018+0000","last_active":"2023-10-06T05:29:54.538121+0000","last_peered":"2023-10-06T05:29:54.538121+0000","last_clean":"2023-10-06T05:29:54.538121+0000","last_became_active":"2023-10-06T05:29:54.535691+0000","last_became_peered":"2023-10-06T05:29:54.535691+0000","last_unstale":"2023-10-06T05:29:54.538121+0000","last_undegraded":"2023-10-06T05:29:54.538121+0000","last_fullsized":"2023-10-06T05:29:54.538121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:24.780925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527298+0000","last_change":"2023-10-06T05:29:54.523021+0000","last_active":"2023-10-06T05:29:54.527298+0000","last_peered":"2023-10-06T05:29:54.527298+0000","last_clean":"2023-10-06T05:29:54.527298+0000","last_became_active":"2023-10-06T05:29:54.522675+0000","last_became_peered":"2023-10-06T05:29:54.522675+0000","last_unstale":"2023-10-06T05:29:54.527298+0000","last_undegraded":"2023-10-06T05:29:54.527298+0000","last_fullsized":"2023-10-06T05:29:54.527298+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:42.131276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527163+0000","last_change":"2023-10-06T05:29:54.515655+0000","last_active":"2023-10-06T05:29:54.527163+0000","last_peered":"2023-10-06T05:29:54.527163+0000","last_clean":"2023-10-06T05:29:54.527163+0000","last_became_active":"2023-10-06T05:29:54.515371+0000","last_became_peered":"2023-10-06T05:29:54.515371+0000","last_unstale":"2023-10-06T05:29:54.527163+0000","last_undegraded":"2023-10-06T05:29:54.527163+0000","last_fullsized":"2023-10-06T05:29:54.527163+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.039388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.521768+0000","last_change":"2023-10-06T05:29:54.518844+0000","last_active":"2023-10-06T05:29:54.521768+0000","last_peered":"2023-10-06T05:29:54.521768+0000","last_clean":"2023-10-06T05:29:54.521768+0000","last_became_active":"2023-10-06T05:29:54.518363+0000","last_became_peered":"2023-10-06T05:29:54.518363+0000","last_unstale":"2023-10-06T05:29:54.521768+0000","last_undegraded":"2023-10-06T05:29:54.521768+0000","last_fullsized":"2023-10-06T05:29:54.521768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:57.584908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"76'4","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528974+0000","last_change":"2023-10-06T05:29:53.520623+0000","last_active":"2023-10-06T05:29:54.528974+0000","last_peered":"2023-10-06T05:29:54.528974+0000","last_clean":"2023-10-06T05:29:54.528974+0000","last_became_active":"2023-10-06T05:29:53.520266+0000","last_became_peered":"2023-10-06T05:29:53.520266+0000","last_unstale":"2023-10-06T05:29:54.528974+0000","last_undegraded":"2023-10-06T05:29:54.528974+0000","last_fullsized":"2023-10-06T05:29:54.528974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:12.061838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539108+0000","last_change":"2023-10-06T05:29:54.532957+0000","last_active":"2023-10-06T05:29:54.539108+0000","last_peered":"2023-10-06T05:29:54.539108+0000","last_clean":"2023-10-06T05:29:54.539108+0000","last_became_active":"2023-10-06T05:29:54.531123+0000","last_became_peered":"2023-10-06T05:29:54.531123+0000","last_unstale":"2023-10-06T05:29:54.539108+0000","last_undegraded":"2023-10-06T05:29:54.539108+0000","last_fullsized":"2023-10-06T05:29:54.539108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:15.763800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527299+0000","last_change":"2023-10-06T05:29:53.511934+0000","last_active":"2023-10-06T05:29:54.527299+0000","last_peered":"2023-10-06T05:29:54.527299+0000","last_clean":"2023-10-06T05:29:54.527299+0000","last_became_active":"2023-10-06T05:29:53.511617+0000","last_became_peered":"2023-10-06T05:29:53.511617+0000","last_unstale":"2023-10-06T05:29:54.527299+0000","last_undegraded":"2023-10-06T05:29:54.527299+0000","last_fullsized":"2023-10-06T05:29:54.527299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:52.402311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528682+0000","last_change":"2023-10-06T05:29:54.524984+0000","last_active":"2023-10-06T05:29:54.528682+0000","last_peered":"2023-10-06T05:29:54.528682+0000","last_clean":"2023-10-06T05:29:54.528682+0000","last_became_active":"2023-10-06T05:29:54.524688+0000","last_became_peered":"2023-10-06T05:29:54.524688+0000","last_unstale":"2023-10-06T05:29:54.528682+0000","last_undegraded":"2023-10-06T05:29:54.528682+0000","last_fullsized":"2023-10-06T05:29:54.528682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:57.342705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537431+0000","last_change":"2023-10-06T05:29:53.517791+0000","last_active":"2023-10-06T05:29:54.537431+0000","last_peered":"2023-10-06T05:29:54.537431+0000","last_clean":"2023-10-06T05:29:54.537431+0000","last_became_active":"2023-10-06T05:29:53.517525+0000","last_became_peered":"2023-10-06T05:29:53.517525+0000","last_unstale":"2023-10-06T05:29:54.537431+0000","last_undegraded":"2023-10-06T05:29:54.537431+0000","last_fullsized":"2023-10-06T05:29:54.537431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:04.778675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526327+0000","last_change":"2023-10-06T05:29:54.520514+0000","last_active":"2023-10-06T05:29:54.526327+0000","last_peered":"2023-10-06T05:29:54.526327+0000","last_clean":"2023-10-06T05:29:54.526327+0000","last_became_active":"2023-10-06T05:29:54.520198+0000","last_became_peered":"2023-10-06T05:29:54.520198+0000","last_unstale":"2023-10-06T05:29:54.526327+0000","last_undegraded":"2023-10-06T05:29:54.526327+0000","last_fullsized":"2023-10-06T05:29:54.526327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:26.766248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529569+0000","last_change":"2023-10-06T05:29:53.515523+0000","last_active":"2023-10-06T05:29:54.529569+0000","last_peered":"2023-10-06T05:29:54.529569+0000","last_clean":"2023-10-06T05:29:54.529569+0000","last_became_active":"2023-10-06T05:29:53.515200+0000","last_became_peered":"2023-10-06T05:29:53.515200+0000","last_unstale":"2023-10-06T05:29:54.529569+0000","last_undegraded":"2023-10-06T05:29:54.529569+0000","last_fullsized":"2023-10-06T05:29:54.529569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:07.558499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.536851+0000","last_change":"2023-10-06T05:29:54.531889+0000","last_active":"2023-10-06T05:29:54.536851+0000","last_peered":"2023-10-06T05:29:54.536851+0000","last_clean":"2023-10-06T05:29:54.536851+0000","last_became_active":"2023-10-06T05:29:54.531108+0000","last_became_peered":"2023-10-06T05:29:54.531108+0000","last_unstale":"2023-10-06T05:29:54.536851+0000","last_undegraded":"2023-10-06T05:29:54.536851+0000","last_fullsized":"2023-10-06T05:29:54.536851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:44.474526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527545+0000","last_change":"2023-10-06T05:29:53.515187+0000","last_active":"2023-10-06T05:29:54.527545+0000","last_peered":"2023-10-06T05:29:54.527545+0000","last_clean":"2023-10-06T05:29:54.527545+0000","last_became_active":"2023-10-06T05:29:53.514889+0000","last_became_peered":"2023-10-06T05:29:53.514889+0000","last_unstale":"2023-10-06T05:29:54.527545+0000","last_undegraded":"2023-10-06T05:29:54.527545+0000","last_fullsized":"2023-10-06T05:29:54.527545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:36.374566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539231+0000","last_change":"2023-10-06T05:29:54.534255+0000","last_active":"2023-10-06T05:29:54.539231+0000","last_peered":"2023-10-06T05:29:54.539231+0000","last_clean":"2023-10-06T05:29:54.539231+0000","last_became_active":"2023-10-06T05:29:54.532585+0000","last_became_peered":"2023-10-06T05:29:54.532585+0000","last_unstale":"2023-10-06T05:29:54.539231+0000","last_undegraded":"2023-10-06T05:29:54.539231+0000","last_fullsized":"2023-10-06T05:29:54.539231+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:31.175342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525217+0000","last_change":"2023-10-06T05:29:53.512021+0000","last_active":"2023-10-06T05:29:54.525217+0000","last_peered":"2023-10-06T05:29:54.525217+0000","last_clean":"2023-10-06T05:29:54.525217+0000","last_became_active":"2023-10-06T05:29:53.511674+0000","last_became_peered":"2023-10-06T05:29:53.511674+0000","last_unstale":"2023-10-06T05:29:54.525217+0000","last_undegraded":"2023-10-06T05:29:54.525217+0000","last_fullsized":"2023-10-06T05:29:54.525217+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:04.778675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528674+0000","last_change":"2023-10-06T05:29:54.524150+0000","last_active":"2023-10-06T05:29:54.528674+0000","last_peered":"2023-10-06T05:29:54.528674+0000","last_clean":"2023-10-06T05:29:54.528674+0000","last_became_active":"2023-10-06T05:29:54.523854+0000","last_became_peered":"2023-10-06T05:29:54.523854+0000","last_unstale":"2023-10-06T05:29:54.528674+0000","last_undegraded":"2023-10-06T05:29:54.528674+0000","last_fullsized":"2023-10-06T05:29:54.528674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:32.044286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.501278+0000","last_change":"2023-10-06T05:29:53.512682+0000","last_active":"2023-10-06T05:29:54.501278+0000","last_peered":"2023-10-06T05:29:54.501278+0000","last_clean":"2023-10-06T05:29:54.501278+0000","last_became_active":"2023-10-06T05:29:53.512371+0000","last_became_peered":"2023-10-06T05:29:53.512371+0000","last_unstale":"2023-10-06T05:29:54.501278+0000","last_undegraded":"2023-10-06T05:29:54.501278+0000","last_fullsized":"2023-10-06T05:29:54.501278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:04.778675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528768+0000","last_change":"2023-10-06T05:29:54.525581+0000","last_active":"2023-10-06T05:29:54.528768+0000","last_peered":"2023-10-06T05:29:54.528768+0000","last_clean":"2023-10-06T05:29:54.528768+0000","last_became_active":"2023-10-06T05:29:54.525144+0000","last_became_peered":"2023-10-06T05:29:54.525144+0000","last_unstale":"2023-10-06T05:29:54.528768+0000","last_undegraded":"2023-10-06T05:29:54.528768+0000","last_fullsized":"2023-10-06T05:29:54.528768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:45.459246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.505135+0000","last_change":"2023-10-06T05:29:53.513090+0000","last_active":"2023-10-06T05:29:54.505135+0000","last_peered":"2023-10-06T05:29:54.505135+0000","last_clean":"2023-10-06T05:29:54.505135+0000","last_became_active":"2023-10-06T05:29:53.512791+0000","last_became_peered":"2023-10-06T05:29:53.512791+0000","last_unstale":"2023-10-06T05:29:54.505135+0000","last_undegraded":"2023-10-06T05:29:54.505135+0000","last_fullsized":"2023-10-06T05:29:54.505135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:54.403099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.536803+0000","last_change":"2023-10-06T05:29:54.529858+0000","last_active":"2023-10-06T05:29:54.536803+0000","last_peered":"2023-10-06T05:29:54.536803+0000","last_clean":"2023-10-06T05:29:54.536803+0000","last_became_active":"2023-10-06T05:29:54.526000+0000","last_became_peered":"2023-10-06T05:29:54.526000+0000","last_unstale":"2023-10-06T05:29:54.536803+0000","last_undegraded":"2023-10-06T05:29:54.536803+0000","last_fullsized":"2023-10-06T05:29:54.536803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:02.294278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507266+0000","last_change":"2023-10-06T05:29:53.512669+0000","last_active":"2023-10-06T05:29:54.507266+0000","last_peered":"2023-10-06T05:29:54.507266+0000","last_clean":"2023-10-06T05:29:54.507266+0000","last_became_active":"2023-10-06T05:29:53.511995+0000","last_became_peered":"2023-10-06T05:29:53.511995+0000","last_unstale":"2023-10-06T05:29:54.507266+0000","last_undegraded":"2023-10-06T05:29:54.507266+0000","last_fullsized":"2023-10-06T05:29:54.507266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.513866+0000","last_change":"2023-10-06T05:29:54.509641+0000","last_active":"2023-10-06T05:29:54.513866+0000","last_peered":"2023-10-06T05:29:54.513866+0000","last_clean":"2023-10-06T05:29:54.513866+0000","last_became_active":"2023-10-06T05:29:54.506915+0000","last_became_peered":"2023-10-06T05:29:54.506915+0000","last_unstale":"2023-10-06T05:29:54.513866+0000","last_undegraded":"2023-10-06T05:29:54.513866+0000","last_fullsized":"2023-10-06T05:29:54.513866+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.039388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.505008+0000","last_change":"2023-10-06T05:29:53.512341+0000","last_active":"2023-10-06T05:29:54.505008+0000","last_peered":"2023-10-06T05:29:54.505008+0000","last_clean":"2023-10-06T05:29:54.505008+0000","last_became_active":"2023-10-06T05:29:53.511506+0000","last_became_peered":"2023-10-06T05:29:53.511506+0000","last_unstale":"2023-10-06T05:29:54.505008+0000","last_undegraded":"2023-10-06T05:29:54.505008+0000","last_fullsized":"2023-10-06T05:29:54.505008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:58.589389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528352+0000","last_change":"2023-10-06T05:29:54.522338+0000","last_active":"2023-10-06T05:29:54.528352+0000","last_peered":"2023-10-06T05:29:54.528352+0000","last_clean":"2023-10-06T05:29:54.528352+0000","last_became_active":"2023-10-06T05:29:54.522008+0000","last_became_peered":"2023-10-06T05:29:54.522008+0000","last_unstale":"2023-10-06T05:29:54.528352+0000","last_undegraded":"2023-10-06T05:29:54.528352+0000","last_fullsized":"2023-10-06T05:29:54.528352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:00.511156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"76'3","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527712+0000","last_change":"2023-10-06T05:29:53.519538+0000","last_active":"2023-10-06T05:29:54.527712+0000","last_peered":"2023-10-06T05:29:54.527712+0000","last_clean":"2023-10-06T05:29:54.527712+0000","last_became_active":"2023-10-06T05:29:53.518865+0000","last_became_peered":"2023-10-06T05:29:53.518865+0000","last_unstale":"2023-10-06T05:29:54.527712+0000","last_undegraded":"2023-10-06T05:29:54.527712+0000","last_fullsized":"2023-10-06T05:29:54.527712+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:18.027432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.538749+0000","last_change":"2023-10-06T05:29:54.537788+0000","last_active":"2023-10-06T05:29:54.538749+0000","last_peered":"2023-10-06T05:29:54.538749+0000","last_clean":"2023-10-06T05:29:54.538749+0000","last_became_active":"2023-10-06T05:29:54.537395+0000","last_became_peered":"2023-10-06T05:29:54.537395+0000","last_unstale":"2023-10-06T05:29:54.538749+0000","last_undegraded":"2023-10-06T05:29:54.538749+0000","last_fullsized":"2023-10-06T05:29:54.538749+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:03.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"76'6","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.534643+0000","last_change":"2023-10-06T05:29:53.511583+0000","last_active":"2023-10-06T05:29:54.534643+0000","last_peered":"2023-10-06T05:29:54.534643+0000","last_clean":"2023-10-06T05:29:54.534643+0000","last_became_active":"2023-10-06T05:29:53.511304+0000","last_became_peered":"2023-10-06T05:29:53.511304+0000","last_unstale":"2023-10-06T05:29:54.534643+0000","last_undegraded":"2023-10-06T05:29:54.534643+0000","last_fullsized":"2023-10-06T05:29:54.534643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:10.792865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.524787+0000","last_change":"2023-10-06T05:29:54.523112+0000","last_active":"2023-10-06T05:29:54.524787+0000","last_peered":"2023-10-06T05:29:54.524787+0000","last_clean":"2023-10-06T05:29:54.524787+0000","last_became_active":"2023-10-06T05:29:54.522828+0000","last_became_peered":"2023-10-06T05:29:54.522828+0000","last_unstale":"2023-10-06T05:29:54.524787+0000","last_undegraded":"2023-10-06T05:29:54.524787+0000","last_fullsized":"2023-10-06T05:29:54.524787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:43.103575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528941+0000","last_change":"2023-10-06T05:29:53.511025+0000","last_active":"2023-10-06T05:29:54.528941+0000","last_peered":"2023-10-06T05:29:54.528941+0000","last_clean":"2023-10-06T05:29:54.528941+0000","last_became_active":"2023-10-06T05:29:53.510675+0000","last_became_peered":"2023-10-06T05:29:53.510675+0000","last_unstale":"2023-10-06T05:29:54.528941+0000","last_undegraded":"2023-10-06T05:29:54.528941+0000","last_fullsized":"2023-10-06T05:29:54.528941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:52.402311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526039+0000","last_change":"2023-10-06T05:29:54.522231+0000","last_active":"2023-10-06T05:29:54.526039+0000","last_peered":"2023-10-06T05:29:54.526039+0000","last_clean":"2023-10-06T05:29:54.526039+0000","last_became_active":"2023-10-06T05:29:54.521920+0000","last_became_peered":"2023-10-06T05:29:54.521920+0000","last_unstale":"2023-10-06T05:29:54.526039+0000","last_undegraded":"2023-10-06T05:29:54.526039+0000","last_fullsized":"2023-10-06T05:29:54.526039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:59.594216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507426+0000","last_change":"2023-10-06T05:29:53.511251+0000","last_active":"2023-10-06T05:29:54.507426+0000","last_peered":"2023-10-06T05:29:54.507426+0000","last_clean":"2023-10-06T05:29:54.507426+0000","last_became_active":"2023-10-06T05:29:53.510970+0000","last_became_peered":"2023-10-06T05:29:53.510970+0000","last_unstale":"2023-10-06T05:29:54.507426+0000","last_undegraded":"2023-10-06T05:29:54.507426+0000","last_fullsized":"2023-10-06T05:29:54.507426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:58.589389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528553+0000","last_change":"2023-10-06T05:29:54.524067+0000","last_active":"2023-10-06T05:29:54.528553+0000","last_peered":"2023-10-06T05:29:54.528553+0000","last_clean":"2023-10-06T05:29:54.528553+0000","last_became_active":"2023-10-06T05:29:54.523674+0000","last_became_peered":"2023-10-06T05:29:54.523674+0000","last_unstale":"2023-10-06T05:29:54.528553+0000","last_undegraded":"2023-10-06T05:29:54.528553+0000","last_fullsized":"2023-10-06T05:29:54.528553+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:20.058127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.505301+0000","last_change":"2023-10-06T05:29:53.511313+0000","last_active":"2023-10-06T05:29:54.505301+0000","last_peered":"2023-10-06T05:29:54.505301+0000","last_clean":"2023-10-06T05:29:54.505301+0000","last_became_active":"2023-10-06T05:29:53.510973+0000","last_became_peered":"2023-10-06T05:29:53.510973+0000","last_unstale":"2023-10-06T05:29:54.505301+0000","last_undegraded":"2023-10-06T05:29:54.505301+0000","last_fullsized":"2023-10-06T05:29:54.505301+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529354+0000","last_change":"2023-10-06T05:29:54.526574+0000","last_active":"2023-10-06T05:29:54.529354+0000","last_peered":"2023-10-06T05:29:54.529354+0000","last_clean":"2023-10-06T05:29:54.529354+0000","last_became_active":"2023-10-06T05:29:54.526064+0000","last_became_peered":"2023-10-06T05:29:54.526064+0000","last_unstale":"2023-10-06T05:29:54.529354+0000","last_undegraded":"2023-10-06T05:29:54.529354+0000","last_fullsized":"2023-10-06T05:29:54.529354+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:03.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"76'8","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537530+0000","last_change":"2023-10-06T05:29:53.510913+0000","last_active":"2023-10-06T05:29:54.537530+0000","last_peered":"2023-10-06T05:29:54.537530+0000","last_clean":"2023-10-06T05:29:54.537530+0000","last_became_active":"2023-10-06T05:29:53.510588+0000","last_became_peered":"2023-10-06T05:29:53.510588+0000","last_unstale":"2023-10-06T05:29:54.537530+0000","last_undegraded":"2023-10-06T05:29:54.537530+0000","last_fullsized":"2023-10-06T05:29:54.537530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:28.203103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528533+0000","last_change":"2023-10-06T05:29:54.522541+0000","last_active":"2023-10-06T05:29:54.528533+0000","last_peered":"2023-10-06T05:29:54.528533+0000","last_clean":"2023-10-06T05:29:54.528533+0000","last_became_active":"2023-10-06T05:29:54.522223+0000","last_became_peered":"2023-10-06T05:29:54.522223+0000","last_unstale":"2023-10-06T05:29:54.528533+0000","last_undegraded":"2023-10-06T05:29:54.528533+0000","last_fullsized":"2023-10-06T05:29:54.528533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:59.594216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526638+0000","last_change":"2023-10-06T05:29:53.513871+0000","last_active":"2023-10-06T05:29:54.526638+0000","last_peered":"2023-10-06T05:29:54.526638+0000","last_clean":"2023-10-06T05:29:54.526638+0000","last_became_active":"2023-10-06T05:29:53.513548+0000","last_became_peered":"2023-10-06T05:29:53.513548+0000","last_unstale":"2023-10-06T05:29:54.526638+0000","last_undegraded":"2023-10-06T05:29:54.526638+0000","last_fullsized":"2023-10-06T05:29:54.526638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:28.203103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528724+0000","last_change":"2023-10-06T05:29:54.525588+0000","last_active":"2023-10-06T05:29:54.528724+0000","last_peered":"2023-10-06T05:29:54.528724+0000","last_clean":"2023-10-06T05:29:54.528724+0000","last_became_active":"2023-10-06T05:29:54.524624+0000","last_became_peered":"2023-10-06T05:29:54.524624+0000","last_unstale":"2023-10-06T05:29:54.528724+0000","last_undegraded":"2023-10-06T05:29:54.528724+0000","last_fullsized":"2023-10-06T05:29:54.528724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:29.207931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.501996+0000","last_change":"2023-10-06T05:29:53.518153+0000","last_active":"2023-10-06T05:29:54.501996+0000","last_peered":"2023-10-06T05:29:54.501996+0000","last_clean":"2023-10-06T05:29:54.501996+0000","last_became_active":"2023-10-06T05:29:53.517866+0000","last_became_peered":"2023-10-06T05:29:53.517866+0000","last_unstale":"2023-10-06T05:29:54.501996+0000","last_undegraded":"2023-10-06T05:29:54.501996+0000","last_fullsized":"2023-10-06T05:29:54.501996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:58.589389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528663+0000","last_change":"2023-10-06T05:29:54.523839+0000","last_active":"2023-10-06T05:29:54.528663+0000","last_peered":"2023-10-06T05:29:54.528663+0000","last_clean":"2023-10-06T05:29:54.528663+0000","last_became_active":"2023-10-06T05:29:54.523522+0000","last_became_peered":"2023-10-06T05:29:54.523522+0000","last_unstale":"2023-10-06T05:29:54.528663+0000","last_undegraded":"2023-10-06T05:29:54.528663+0000","last_fullsized":"2023-10-06T05:29:54.528663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:16:26.036776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507642+0000","last_change":"2023-10-06T05:29:53.510393+0000","last_active":"2023-10-06T05:29:54.507642+0000","last_peered":"2023-10-06T05:29:54.507642+0000","last_clean":"2023-10-06T05:29:54.507642+0000","last_became_active":"2023-10-06T05:29:53.509188+0000","last_became_peered":"2023-10-06T05:29:53.509188+0000","last_unstale":"2023-10-06T05:29:54.507642+0000","last_undegraded":"2023-10-06T05:29:54.507642+0000","last_fullsized":"2023-10-06T05:29:54.507642+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539257+0000","last_change":"2023-10-06T05:29:54.534429+0000","last_active":"2023-10-06T05:29:54.539257+0000","last_peered":"2023-10-06T05:29:54.539257+0000","last_clean":"2023-10-06T05:29:54.539257+0000","last_became_active":"2023-10-06T05:29:54.531410+0000","last_became_peered":"2023-10-06T05:29:54.531410+0000","last_unstale":"2023-10-06T05:29:54.539257+0000","last_undegraded":"2023-10-06T05:29:54.539257+0000","last_fullsized":"2023-10-06T05:29:54.539257+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:43.103575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507119+0000","last_change":"2023-10-06T05:29:53.511934+0000","last_active":"2023-10-06T05:29:54.507119+0000","last_peered":"2023-10-06T05:29:54.507119+0000","last_clean":"2023-10-06T05:29:54.507119+0000","last_became_active":"2023-10-06T05:29:53.511552+0000","last_became_peered":"2023-10-06T05:29:53.511552+0000","last_unstale":"2023-10-06T05:29:54.507119+0000","last_undegraded":"2023-10-06T05:29:54.507119+0000","last_fullsized":"2023-10-06T05:29:54.507119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:28.203103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528784+0000","last_change":"2023-10-06T05:29:54.525544+0000","last_active":"2023-10-06T05:29:54.528784+0000","last_peered":"2023-10-06T05:29:54.528784+0000","last_clean":"2023-10-06T05:29:54.528784+0000","last_became_active":"2023-10-06T05:29:54.525216+0000","last_became_peered":"2023-10-06T05:29:54.525216+0000","last_unstale":"2023-10-06T05:29:54.528784+0000","last_undegraded":"2023-10-06T05:29:54.528784+0000","last_fullsized":"2023-10-06T05:29:54.528784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.303523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.512852+0000","last_change":"2023-10-06T05:29:53.515415+0000","last_active":"2023-10-06T05:29:54.512852+0000","last_peered":"2023-10-06T05:29:54.512852+0000","last_clean":"2023-10-06T05:29:54.512852+0000","last_became_active":"2023-10-06T05:29:53.515127+0000","last_became_peered":"2023-10-06T05:29:53.515127+0000","last_unstale":"2023-10-06T05:29:54.512852+0000","last_undegraded":"2023-10-06T05:29:54.512852+0000","last_fullsized":"2023-10-06T05:29:54.512852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.001283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526203+0000","last_change":"2023-10-06T05:29:54.523188+0000","last_active":"2023-10-06T05:29:54.526203+0000","last_peered":"2023-10-06T05:29:54.526203+0000","last_clean":"2023-10-06T05:29:54.526203+0000","last_became_active":"2023-10-06T05:29:54.522875+0000","last_became_peered":"2023-10-06T05:29:54.522875+0000","last_unstale":"2023-10-06T05:29:54.526203+0000","last_undegraded":"2023-10-06T05:29:54.526203+0000","last_fullsized":"2023-10-06T05:29:54.526203+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:43.407118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.506578+0000","last_change":"2023-10-06T05:29:53.511934+0000","last_active":"2023-10-06T05:29:54.506578+0000","last_peered":"2023-10-06T05:29:54.506578+0000","last_clean":"2023-10-06T05:29:54.506578+0000","last_became_active":"2023-10-06T05:29:53.511646+0000","last_became_peered":"2023-10-06T05:29:53.511646+0000","last_unstale":"2023-10-06T05:29:54.506578+0000","last_undegraded":"2023-10-06T05:29:54.506578+0000","last_fullsized":"2023-10-06T05:29:54.506578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:18.056226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.535984+0000","last_change":"2023-10-06T05:29:54.533581+0000","last_active":"2023-10-06T05:29:54.535984+0000","last_peered":"2023-10-06T05:29:54.535984+0000","last_clean":"2023-10-06T05:29:54.535984+0000","last_became_active":"2023-10-06T05:29:54.533306+0000","last_became_peered":"2023-10-06T05:29:54.533306+0000","last_unstale":"2023-10-06T05:29:54.535984+0000","last_undegraded":"2023-10-06T05:29:54.535984+0000","last_fullsized":"2023-10-06T05:29:54.535984+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:44.030500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.515044+0000","last_change":"2023-10-06T05:29:53.518726+0000","last_active":"2023-10-06T05:29:54.515044+0000","last_peered":"2023-10-06T05:29:54.515044+0000","last_clean":"2023-10-06T05:29:54.515044+0000","last_became_active":"2023-10-06T05:29:53.518316+0000","last_became_peered":"2023-10-06T05:29:53.518316+0000","last_unstale":"2023-10-06T05:29:54.515044+0000","last_undegraded":"2023-10-06T05:29:54.515044+0000","last_fullsized":"2023-10-06T05:29:54.515044+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:23.407812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525106+0000","last_change":"2023-10-06T05:29:54.519233+0000","last_active":"2023-10-06T05:29:54.525106+0000","last_peered":"2023-10-06T05:29:54.525106+0000","last_clean":"2023-10-06T05:29:54.525106+0000","last_became_active":"2023-10-06T05:29:54.518931+0000","last_became_peered":"2023-10-06T05:29:54.518931+0000","last_unstale":"2023-10-06T05:29:54.525106+0000","last_undegraded":"2023-10-06T05:29:54.525106+0000","last_fullsized":"2023-10-06T05:29:54.525106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:37.379394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.510839+0000","last_change":"2023-10-06T05:29:53.511526+0000","last_active":"2023-10-06T05:29:54.510839+0000","last_peered":"2023-10-06T05:29:54.510839+0000","last_clean":"2023-10-06T05:29:54.510839+0000","last_became_active":"2023-10-06T05:29:53.511218+0000","last_became_peered":"2023-10-06T05:29:53.511218+0000","last_unstale":"2023-10-06T05:29:54.510839+0000","last_undegraded":"2023-10-06T05:29:54.510839+0000","last_fullsized":"2023-10-06T05:29:54.510839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:03.816191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527402+0000","last_change":"2023-10-06T05:29:54.520400+0000","last_active":"2023-10-06T05:29:54.527402+0000","last_peered":"2023-10-06T05:29:54.527402+0000","last_clean":"2023-10-06T05:29:54.527402+0000","last_became_active":"2023-10-06T05:29:54.520083+0000","last_became_peered":"2023-10-06T05:29:54.520083+0000","last_unstale":"2023-10-06T05:29:54.527402+0000","last_undegraded":"2023-10-06T05:29:54.527402+0000","last_fullsized":"2023-10-06T05:29:54.527402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:15.861483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.516228+0000","last_change":"2023-10-06T05:29:53.510507+0000","last_active":"2023-10-06T05:29:54.516228+0000","last_peered":"2023-10-06T05:29:54.516228+0000","last_clean":"2023-10-06T05:29:54.516228+0000","last_became_active":"2023-10-06T05:29:53.510206+0000","last_became_peered":"2023-10-06T05:29:53.510206+0000","last_unstale":"2023-10-06T05:29:54.516228+0000","last_undegraded":"2023-10-06T05:29:54.516228+0000","last_fullsized":"2023-10-06T05:29:54.516228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:14.856655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.508485+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:29:54.508485+0000","last_peered":"2023-10-06T05:29:54.508485+0000","last_clean":"2023-10-06T05:29:54.508485+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:29:54.508485+0000","last_undegraded":"2023-10-06T05:29:54.508485+0000","last_fullsized":"2023-10-06T05:29:54.508485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.501316+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:29:54.501316+0000","last_peered":"2023-10-06T05:29:54.501316+0000","last_clean":"2023-10-06T05:29:54.501316+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:29:54.501316+0000","last_undegraded":"2023-10-06T05:29:54.501316+0000","last_fullsized":"2023-10-06T05:29:54.501316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539155+0000","last_change":"2023-10-06T05:29:54.534329+0000","last_active":"2023-10-06T05:29:54.539155+0000","last_peered":"2023-10-06T05:29:54.539155+0000","last_clean":"2023-10-06T05:29:54.539155+0000","last_became_active":"2023-10-06T05:29:54.532561+0000","last_became_peered":"2023-10-06T05:29:54.532561+0000","last_unstale":"2023-10-06T05:29:54.539155+0000","last_undegraded":"2023-10-06T05:29:54.539155+0000","last_fullsized":"2023-10-06T05:29:54.539155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:03.987016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.513391+0000","last_change":"2023-10-06T05:29:53.511635+0000","last_active":"2023-10-06T05:29:54.513391+0000","last_peered":"2023-10-06T05:29:54.513391+0000","last_clean":"2023-10-06T05:29:54.513391+0000","last_became_active":"2023-10-06T05:29:53.511349+0000","last_became_peered":"2023-10-06T05:29:53.511349+0000","last_unstale":"2023-10-06T05:29:54.513391+0000","last_undegraded":"2023-10-06T05:29:54.513391+0000","last_fullsized":"2023-10-06T05:29:54.513391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:22.454148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.508397+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:29:54.508397+0000","last_peered":"2023-10-06T05:29:54.508397+0000","last_clean":"2023-10-06T05:29:54.508397+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:29:54.508397+0000","last_undegraded":"2023-10-06T05:29:54.508397+0000","last_fullsized":"2023-10-06T05:29:54.508397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528747+0000","last_change":"2023-10-06T05:29:54.523863+0000","last_active":"2023-10-06T05:29:54.528747+0000","last_peered":"2023-10-06T05:29:54.528747+0000","last_clean":"2023-10-06T05:29:54.528747+0000","last_became_active":"2023-10-06T05:29:54.523441+0000","last_became_peered":"2023-10-06T05:29:54.523441+0000","last_unstale":"2023-10-06T05:29:54.528747+0000","last_undegraded":"2023-10-06T05:29:54.528747+0000","last_fullsized":"2023-10-06T05:29:54.528747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:57.584908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.512407+0000","last_change":"2023-10-06T05:29:53.512239+0000","last_active":"2023-10-06T05:29:54.512407+0000","last_peered":"2023-10-06T05:29:54.512407+0000","last_clean":"2023-10-06T05:29:54.512407+0000","last_became_active":"2023-10-06T05:29:53.511935+0000","last_became_peered":"2023-10-06T05:29:53.511935+0000","last_unstale":"2023-10-06T05:29:54.512407+0000","last_undegraded":"2023-10-06T05:29:54.512407+0000","last_fullsized":"2023-10-06T05:29:54.512407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:26.641573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.505409+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:29:54.505409+0000","last_peered":"2023-10-06T05:29:54.505409+0000","last_clean":"2023-10-06T05:29:54.505409+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:29:54.505409+0000","last_undegraded":"2023-10-06T05:29:54.505409+0000","last_fullsized":"2023-10-06T05:29:54.505409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.538998+0000","last_change":"2023-10-06T05:29:54.532488+0000","last_active":"2023-10-06T05:29:54.538998+0000","last_peered":"2023-10-06T05:29:54.538998+0000","last_clean":"2023-10-06T05:29:54.538998+0000","last_became_active":"2023-10-06T05:29:54.532186+0000","last_became_peered":"2023-10-06T05:29:54.532186+0000","last_unstale":"2023-10-06T05:29:54.538998+0000","last_undegraded":"2023-10-06T05:29:54.538998+0000","last_fullsized":"2023-10-06T05:29:54.538998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:58.424208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528609+0000","last_change":"2023-10-06T05:29:53.518334+0000","last_active":"2023-10-06T05:29:54.528609+0000","last_peered":"2023-10-06T05:29:54.528609+0000","last_clean":"2023-10-06T05:29:54.528609+0000","last_became_active":"2023-10-06T05:29:53.518040+0000","last_became_peered":"2023-10-06T05:29:53.518040+0000","last_unstale":"2023-10-06T05:29:54.528609+0000","last_undegraded":"2023-10-06T05:29:54.528609+0000","last_fullsized":"2023-10-06T05:29:54.528609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:48.034560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.501455+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:29:54.501455+0000","last_peered":"2023-10-06T05:29:54.501455+0000","last_clean":"2023-10-06T05:29:54.501455+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:29:54.501455+0000","last_undegraded":"2023-10-06T05:29:54.501455+0000","last_fullsized":"2023-10-06T05:29:54.501455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537336+0000","last_change":"2023-10-06T05:29:54.536471+0000","last_active":"2023-10-06T05:29:54.537336+0000","last_peered":"2023-10-06T05:29:54.537336+0000","last_clean":"2023-10-06T05:29:54.537336+0000","last_became_active":"2023-10-06T05:29:54.536184+0000","last_became_peered":"2023-10-06T05:29:54.536184+0000","last_unstale":"2023-10-06T05:29:54.537336+0000","last_undegraded":"2023-10-06T05:29:54.537336+0000","last_fullsized":"2023-10-06T05:29:54.537336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:05.851407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526248+0000","last_change":"2023-10-06T05:29:53.516093+0000","last_active":"2023-10-06T05:29:54.526248+0000","last_peered":"2023-10-06T05:29:54.526248+0000","last_clean":"2023-10-06T05:29:54.526248+0000","last_became_active":"2023-10-06T05:29:53.515779+0000","last_became_peered":"2023-10-06T05:29:53.515779+0000","last_unstale":"2023-10-06T05:29:54.526248+0000","last_undegraded":"2023-10-06T05:29:54.526248+0000","last_fullsized":"2023-10-06T05:29:54.526248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:41.271792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.510942+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:29:54.510942+0000","last_peered":"2023-10-06T05:29:54.510942+0000","last_clean":"2023-10-06T05:29:54.510942+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:29:54.510942+0000","last_undegraded":"2023-10-06T05:29:54.510942+0000","last_fullsized":"2023-10-06T05:29:54.510942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525768+0000","last_change":"2023-10-06T05:29:54.522828+0000","last_active":"2023-10-06T05:29:54.525768+0000","last_peered":"2023-10-06T05:29:54.525768+0000","last_clean":"2023-10-06T05:29:54.525768+0000","last_became_active":"2023-10-06T05:29:54.522480+0000","last_became_peered":"2023-10-06T05:29:54.522480+0000","last_unstale":"2023-10-06T05:29:54.525768+0000","last_undegraded":"2023-10-06T05:29:54.525768+0000","last_fullsized":"2023-10-06T05:29:54.525768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:31.175342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.510839+0000","last_change":"2023-10-06T05:29:53.516368+0000","last_active":"2023-10-06T05:29:54.510839+0000","last_peered":"2023-10-06T05:29:54.510839+0000","last_clean":"2023-10-06T05:29:54.510839+0000","last_became_active":"2023-10-06T05:29:53.516039+0000","last_became_peered":"2023-10-06T05:29:53.516039+0000","last_unstale":"2023-10-06T05:29:54.510839+0000","last_undegraded":"2023-10-06T05:29:54.510839+0000","last_fullsized":"2023-10-06T05:29:54.510839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:10.792865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507747+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:29:54.507747+0000","last_peered":"2023-10-06T05:29:54.507747+0000","last_clean":"2023-10-06T05:29:54.507747+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:29:54.507747+0000","last_undegraded":"2023-10-06T05:29:54.507747+0000","last_fullsized":"2023-10-06T05:29:54.507747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525617+0000","last_change":"2023-10-06T05:29:54.522186+0000","last_active":"2023-10-06T05:29:54.525617+0000","last_peered":"2023-10-06T05:29:54.525617+0000","last_clean":"2023-10-06T05:29:54.525617+0000","last_became_active":"2023-10-06T05:29:54.521586+0000","last_became_peered":"2023-10-06T05:29:54.521586+0000","last_unstale":"2023-10-06T05:29:54.525617+0000","last_undegraded":"2023-10-06T05:29:54.525617+0000","last_fullsized":"2023-10-06T05:29:54.525617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:36:08.526974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527367+0000","last_change":"2023-10-06T05:29:53.516781+0000","last_active":"2023-10-06T05:29:54.527367+0000","last_peered":"2023-10-06T05:29:54.527367+0000","last_clean":"2023-10-06T05:29:54.527367+0000","last_became_active":"2023-10-06T05:29:53.516478+0000","last_became_peered":"2023-10-06T05:29:53.516478+0000","last_unstale":"2023-10-06T05:29:54.527367+0000","last_undegraded":"2023-10-06T05:29:54.527367+0000","last_fullsized":"2023-10-06T05:29:54.527367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:42.402290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.512505+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:29:54.512505+0000","last_peered":"2023-10-06T05:29:54.512505+0000","last_clean":"2023-10-06T05:29:54.512505+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:29:54.512505+0000","last_undegraded":"2023-10-06T05:29:54.512505+0000","last_fullsized":"2023-10-06T05:29:54.512505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529276+0000","last_change":"2023-10-06T05:29:54.524594+0000","last_active":"2023-10-06T05:29:54.529276+0000","last_peered":"2023-10-06T05:29:54.529276+0000","last_clean":"2023-10-06T05:29:54.529276+0000","last_became_active":"2023-10-06T05:29:54.524218+0000","last_became_peered":"2023-10-06T05:29:54.524218+0000","last_unstale":"2023-10-06T05:29:54.529276+0000","last_undegraded":"2023-10-06T05:29:54.529276+0000","last_fullsized":"2023-10-06T05:29:54.529276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:15.720460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526202+0000","last_change":"2023-10-06T05:29:53.520527+0000","last_active":"2023-10-06T05:29:54.526202+0000","last_peered":"2023-10-06T05:29:54.526202+0000","last_clean":"2023-10-06T05:29:54.526202+0000","last_became_active":"2023-10-06T05:29:53.520201+0000","last_became_peered":"2023-10-06T05:29:53.520201+0000","last_unstale":"2023-10-06T05:29:54.526202+0000","last_undegraded":"2023-10-06T05:29:54.526202+0000","last_fullsized":"2023-10-06T05:29:54.526202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:41.126449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.514019+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:29:54.514019+0000","last_peered":"2023-10-06T05:29:54.514019+0000","last_clean":"2023-10-06T05:29:54.514019+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:29:54.514019+0000","last_undegraded":"2023-10-06T05:29:54.514019+0000","last_fullsized":"2023-10-06T05:29:54.514019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1536000,"data_stored":1008180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86099999999999999,"15min":0.84499999999999997},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.8500000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.89700000000000002,"15min":0.92800000000000005},"min":{"1min":0.68000000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.03,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0489999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88400000000000001,"15min":0.86899999999999999},"min":{"1min":0.61899999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.018},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.65700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1659999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.101}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.64000000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1599999999999999,"5min":1.276,"15min":1.276},"last":1.6919999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2509999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95999999999999996,"15min":0.96199999999999997},"min":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.70799999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3160000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90800000000000003,"15min":0.92300000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1719999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.111,"15min":1.113},"min":{"1min":0.89600000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.294,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.0649999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.008,"15min":0.99299999999999999},"min":{"1min":0.75800000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.25,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1839999999999999,"15min":1.2030000000000001},"min":{"1min":0.96199999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.3979999999999999,"5min":1.859,"15min":1.859},"last":1.196}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.119,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3260000000000001,"5min":1.611,"15min":1.611},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.76100000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.9019999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":950272,"data_stored":419326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.81499999999999995},"min":{"1min":0.51300000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.67700000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.72299999999999998}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98599999999999999,"15min":0.95899999999999996},"min":{"1min":0.61699999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4430000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.028,"5min":0.98099999999999998,"15min":0.96699999999999997},"min":{"1min":0.66600000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6659999999999999,"5min":1.679,"15min":1.679},"last":1.1719999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.872,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.339,"5min":1.643,"15min":1.643},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.95299999999999996,"15min":0.88700000000000001},"min":{"1min":0.69999999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5509999999999999,"5min":1.784,"15min":1.784},"last":1.103}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.70899999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.161,"5min":1.1120000000000001,"15min":1.0800000000000001},"min":{"1min":0.89200000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5009999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.98999999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96099999999999997},"min":{"1min":0.59999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.71,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.524,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.0669999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.63300000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.75},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.097,"15min":1.069},"min":{"1min":0.78500000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7509999999999999,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.2230000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.016,"15min":1.01},"min":{"1min":0.754,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.1180000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.1279999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":417824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89200000000000002,"15min":0.85999999999999999},"min":{"1min":0.61499999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.294,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.61699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2210000000000001,"5min":1.409,"15min":1.409},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.242,"5min":1.411,"15min":1.411},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.67300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.175,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.367},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98599999999999999,"15min":0.96499999999999997},"min":{"1min":0.70299999999999996,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.244,"5min":1.54,"15min":1.54},"last":0.80800000000000005}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.97099999999999997,"15min":0.95099999999999996},"min":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2769999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.028},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.77300000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.349,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.21}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":1.0089999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.204,"5min":1.419,"15min":1.419},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.091,"5min":1.143,"15min":1.179},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.05,"15min":1.1040000000000001},"min":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.327,"5min":1.508,"15min":1.508},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.3140000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.081}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.115,"15min":1.141},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.339,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.302,"5min":1.732,"15min":1.732},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":946176,"data_stored":412789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.85199999999999998,"15min":0.79800000000000004},"min":{"1min":0.66600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.64500000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3180000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0820000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85999999999999999,"15min":0.81599999999999995},"min":{"1min":0.70799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2649999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.034}]},{"osd":2,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.75700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.202,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.282},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.746,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1950000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.69999999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2230000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.997,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.80100000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.26,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.2450000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.995,"15min":1.0509999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1639999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.0249999999999999,"15min":1.04},"min":{"1min":0.69899999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.163,"5min":1.458,"15min":1.458},"last":1.3640000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.99399999999999999,"15min":0.998},"min":{"1min":0.66500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.429,"15min":1.429},"last":1.119},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.151,"15min":1.1719999999999999},"min":{"1min":0.83999999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.387,"5min":1.548,"15min":1.548},"last":1.157}]},{"osd":7,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1339999999999999,"15min":1.1359999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.415},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.351,"5min":1.75,"15min":1.75},"last":1.3240000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":418344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.47199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.85099999999999998,"5min":1.379,"15min":1.379},"last":0.873}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.54700000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0640000000000001,"5min":1.389,"15min":1.389},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79300000000000004,"15min":0.76500000000000001},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.107,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.93000000000000005}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2390000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.57899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.222,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.111}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.093,"15min":1.1180000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":1.4099999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.095,"15min":1.117},"min":{"1min":0.80800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5009999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1100000000000001,"15min":1.0960000000000001},"min":{"1min":0.85399999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.51}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.069,"15min":1.079},"min":{"1min":0.748,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3009999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1910000000000001,"15min":1.196},"min":{"1min":0.81799999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":1.968,"15min":1.968},"last":1.3260000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.173,"15min":1.1639999999999999},"min":{"1min":0.80000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.663,"5min":1.762,"15min":1.762},"last":1.587},{"interface":"front","average":{"1min":1.107,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.88800000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4039999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.288}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":950272,"data_stored":418504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.49299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.629,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2649999999999999,"5min":1.29,"15min":1.29},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.60299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.278,"5min":1.383,"15min":1.383},"last":0.627},{"interface":"front","average":{"1min":0.87,"5min":0.84499999999999997,"15min":0.874},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.85099999999999998},"min":{"1min":0.63800000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0389999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0089999999999999,"15min":1.1040000000000001},"min":{"1min":0.69999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2410000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.113,"5min":1.1890000000000001,"15min":1.2350000000000001},"min":{"1min":0.89200000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4430000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1319999999999999,"15min":1.1859999999999999},"min":{"1min":0.80800000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4019999999999999,"5min":1.829,"15min":1.829},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.095,"5min":1.1319999999999999,"15min":1.1819999999999999},"min":{"1min":0.80500000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.4339999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.246,"15min":1.276},"min":{"1min":0.91600000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.173,"5min":1.1830000000000001,"15min":1.2250000000000001},"min":{"1min":0.94299999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4690000000000001,"5min":1.708,"15min":1.708},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.208,"15min":1.268},"min":{"1min":0.86399999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4039999999999999,"5min":1.972,"15min":1.972},"last":0.751},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.333,"15min":1.377},"min":{"1min":1.0249999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.9059999999999999,"5min":2.04,"15min":2.04},"last":0.73999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":946176,"data_stored":417902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0609999999999999,"5min":1.468,"15min":1.468},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.752,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.63400000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.28,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.81599999999999995,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.236,"5min":1.419,"15min":1.419},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.59899999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.117,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.78900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1619999999999999},"min":{"1min":0.78500000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4630000000000001,"5min":1.899,"15min":1.899},"last":0.96199999999999997}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1379999999999999,"15min":1.1930000000000001},"min":{"1min":0.875,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.367,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1799999999999999,"15min":1.228},"min":{"1min":0.94399999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.458,"5min":2.02,"15min":2.02},"last":1.254}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.83899999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4990000000000001,"5min":1.804,"15min":1.804},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2230000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5720000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2509999999999999,"15min":1.2929999999999999},"min":{"1min":1.034,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.6819999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.208,"15min":1.206},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.81899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302880,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068960,"statfs":{"total":96636764160,"available":96326615040,"internally_reserved":0,"allocated":1531904,"data_stored":1008158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.54400000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.57099999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98599999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.2330000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.59999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96599999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0880000000000001,"5min":1.208,"15min":1.208},"last":0.81100000000000005}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.59399999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.89000000000000001},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1339999999999999,"5min":1.204,"15min":1.204},"last":0.63800000000000001}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0249999999999999,"15min":1.0189999999999999},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.359,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.81899999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.357,"5min":1.49,"15min":1.49},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.155,"15min":1.157},"min":{"1min":0.72199999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.113}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.212,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.665,"5min":1.696,"15min":1.696},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.1950000000000001,"15min":1.2110000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.5229999999999999,"5min":1.738,"15min":1.738},"last":1.3919999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.4430000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.143},{"interface":"front","average":{"1min":1.151,"5min":1.2110000000000001,"15min":1.2370000000000001},"min":{"1min":0.97799999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.468,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.94299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:30:02.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:30:02.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358f1fe700 1 Processor -- start 2023-10-06T05:30:02.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358f1fe700 1 -- start start 2023-10-06T05:30:02.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358f1fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35881605e0 0x7f35880c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:02.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358f1fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35880ca3c0 0x7f35880c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:02.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358f1fe700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35880c2980 con 0x7f358806b320 2023-10-06T05:30:02.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358f1fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35880c6bb0 con 0x7f35881605e0 2023-10-06T05:30:02.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358f1fe700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35880c6e90 con 0x7f35880ca3c0 2023-10-06T05:30:02.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358e1fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35881605e0 0x7f35880c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:02.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358e1fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35881605e0 0x7f35880c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44792/0 (socket says 172.21.15.29:44792) 2023-10-06T05:30:02.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358e1fc700 1 -- 172.21.15.29:0/409872945 learned_addr learned my addr 172.21.15.29:0/409872945 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:02.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.952+0000 7f358e9fd700 1 --2- 172.21.15.29:0/409872945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35880ca3c0 0x7f35880c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:02.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358e1fc700 1 -- 172.21.15.29:0/409872945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35880ca3c0 msgr2=0x7f35880c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:02.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358e1fc700 1 --2- 172.21.15.29:0/409872945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35880ca3c0 0x7f35880c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:02.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358e1fc700 1 -- 172.21.15.29:0/409872945 >> v1:172.21.15.173:6789/0 conn(0x7f358806b320 legacy=0x7f35880c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:02.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358e1fc700 1 -- 172.21.15.29:0/409872945 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35880c7170 con 0x7f35881605e0 2023-10-06T05:30:02.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358e1fc700 1 --2- 172.21.15.29:0/409872945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35881605e0 0x7f35880c6540 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f35840099b0 tx=0x7f3584009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a34eda54916f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:02.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358d1fa700 1 -- 172.21.15.29:0/409872945 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584009ea0 con 0x7f35881605e0 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358d1fa700 1 -- 172.21.15.29:0/409872945 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358400b860 con 0x7f35881605e0 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358d1fa700 1 -- 172.21.15.29:0/409872945 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400bc00 con 0x7f35881605e0 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 -- 172.21.15.29:0/409872945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35881605e0 msgr2=0x7f35880c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 --2- 172.21.15.29:0/409872945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35881605e0 0x7f35880c6540 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f35840099b0 tx=0x7f3584009250 comp rx=0 tx=0).stop 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 -- 172.21.15.29:0/409872945 shutdown_connections 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 --2- 172.21.15.29:0/409872945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35880ca3c0 0x7f35880c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 --2- 172.21.15.29:0/409872945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35881605e0 0x7f35880c6540 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 -- 172.21.15.29:0/409872945 >> 172.21.15.29:0/409872945 conn(0x7f35880670a0 msgr2=0x7f35880674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 -- 172.21.15.29:0/409872945 shutdown_connections 2023-10-06T05:30:02.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 -- 172.21.15.29:0/409872945 wait complete. 2023-10-06T05:30:02.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 Processor -- start 2023-10-06T05:30:02.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.956+0000 7f358f1fe700 1 -- start start 2023-10-06T05:30:02.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358f1fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f358806b320 0x7f35881520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:02.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358f1fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35880ca3c0 0x7f35880c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:02.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358f1fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35881605e0 0x7f35881538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:02.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358f1fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35880af040 con 0x7f358806b320 2023-10-06T05:30:02.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358f1fe700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358813e3b0 con 0x7f35880ca3c0 2023-10-06T05:30:02.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358f1fe700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35880c3d70 con 0x7f35881605e0 2023-10-06T05:30:02.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e1fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f358806b320 0x7f35881520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:02.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e1fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f358806b320 0x7f35881520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44802/0 (socket says 172.21.15.29:44802) 2023-10-06T05:30:02.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358d9fb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35880ca3c0 0x7f35880c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:02.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e9fd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35881605e0 0x7f35881538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:02.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e1fc700 1 -- 172.21.15.29:0/1723859952 learned_addr learned my addr 172.21.15.29:0/1723859952 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:02.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e1fc700 1 -- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35881605e0 msgr2=0x7f35881538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:02.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e1fc700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35881605e0 0x7f35881538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:02.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e1fc700 1 -- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35880ca3c0 msgr2=0x7f35880c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:02.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e1fc700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35880ca3c0 0x7f35880c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:02.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e1fc700 1 -- 172.21.15.29:0/1723859952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840094f0 con 0x7f358806b320 2023-10-06T05:30:02.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358e1fc700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f358806b320 0x7f35881520d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f358806df30 tx=0x7f3584017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f357e7fc700 1 -- 172.21.15.29:0/1723859952 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400b9d0 con 0x7f358806b320 2023-10-06T05:30:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f357e7fc700 1 -- 172.21.15.29:0/1723859952 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358400bb30 con 0x7f358806b320 2023-10-06T05:30:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35880c4050 con 0x7f358806b320 2023-10-06T05:30:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f357e7fc700 1 -- 172.21.15.29:0/1723859952 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584011650 con 0x7f358806b320 2023-10-06T05:30:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.960+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35880aecd0 con 0x7f358806b320 2023-10-06T05:30:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.964+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358804be00 con 0x7f358806b320 2023-10-06T05:30:02.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.964+0000 7f357e7fc700 1 -- 172.21.15.29:0/1723859952 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3584011a80 con 0x7f358806b320 2023-10-06T05:30:02.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.964+0000 7f357e7fc700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f356c060580 0x7f356c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:02.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.964+0000 7f357e7fc700 1 -- 172.21.15.29:0/1723859952 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f358407e010 con 0x7f358806b320 2023-10-06T05:30:02.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.964+0000 7f358d9fb700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f356c060580 0x7f356c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:02.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.964+0000 7f358d9fb700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f356c060580 0x7f356c062a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f35880c4630 tx=0x7f3578000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:02.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:02.972+0000 7f357e7fc700 1 -- 172.21.15.29:0/1723859952 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f358404e4a0 con 0x7f358806b320 2023-10-06T05:30:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.136+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35880af180 con 0x7f356c060580 2023-10-06T05:30:03.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.156+0000 7f357e7fc700 1 -- 172.21.15.29:0/1723859952 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309670 (secure 0 0 0) 0x7f3578002660 con 0x7f356c060580 2023-10-06T05:30:03.167 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:03.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f356c060580 msgr2=0x7f356c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f356c060580 0x7f356c062a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f35880c4630 tx=0x7f3578000bc0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f358806b320 msgr2=0x7f35881520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f358806b320 0x7f35881520d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f358806df30 tx=0x7f3584017000 comp rx=0 tx=0).stop 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 shutdown_connections 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35881605e0 0x7f35881538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f356c060580 0x7f356c062a30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35880ca3c0 0x7f35880c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 --2- 172.21.15.29:0/1723859952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f358806b320 0x7f35881520d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 >> 172.21.15.29:0/1723859952 conn(0x7f35880670a0 msgr2=0x7f35880cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 shutdown_connections 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.160+0000 7f358f1fe700 1 -- 172.21.15.29:0/1723859952 wait complete. 2023-10-06T05:30:03.170 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:30:03.183 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2023-10-06T05:30:02.742924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415528,"kb_used_data":8552,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752559192,"statfs":{"total":773094113280,"available":770620612608,"internally_reserved":0,"allocated":8757248,"data_stored":4527668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.245855"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.518715+0000","last_change":"2023-10-06T05:29:54.513162+0000","last_active":"2023-10-06T05:29:54.518715+0000","last_peered":"2023-10-06T05:29:54.518715+0000","last_clean":"2023-10-06T05:29:54.518715+0000","last_became_active":"2023-10-06T05:29:54.512831+0000","last_became_peered":"2023-10-06T05:29:54.512831+0000","last_unstale":"2023-10-06T05:29:54.518715+0000","last_undegraded":"2023-10-06T05:29:54.518715+0000","last_fullsized":"2023-10-06T05:29:54.518715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:27.646401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539119+0000","last_change":"2023-10-06T05:29:54.532966+0000","last_active":"2023-10-06T05:29:54.539119+0000","last_peered":"2023-10-06T05:29:54.539119+0000","last_clean":"2023-10-06T05:29:54.539119+0000","last_became_active":"2023-10-06T05:29:54.532240+0000","last_became_peered":"2023-10-06T05:29:54.532240+0000","last_unstale":"2023-10-06T05:29:54.539119+0000","last_undegraded":"2023-10-06T05:29:54.539119+0000","last_fullsized":"2023-10-06T05:29:54.539119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:42.346883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.535986+0000","last_change":"2023-10-06T05:29:54.534176+0000","last_active":"2023-10-06T05:29:54.535986+0000","last_peered":"2023-10-06T05:29:54.535986+0000","last_clean":"2023-10-06T05:29:54.535986+0000","last_became_active":"2023-10-06T05:29:54.533894+0000","last_became_peered":"2023-10-06T05:29:54.533894+0000","last_unstale":"2023-10-06T05:29:54.535986+0000","last_undegraded":"2023-10-06T05:29:54.535986+0000","last_fullsized":"2023-10-06T05:29:54.535986+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:20.058127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.513589+0000","last_change":"2023-10-06T05:29:54.509334+0000","last_active":"2023-10-06T05:29:54.513589+0000","last_peered":"2023-10-06T05:29:54.513589+0000","last_clean":"2023-10-06T05:29:54.513589+0000","last_became_active":"2023-10-06T05:29:54.506377+0000","last_became_peered":"2023-10-06T05:29:54.506377+0000","last_unstale":"2023-10-06T05:29:54.513589+0000","last_undegraded":"2023-10-06T05:29:54.513589+0000","last_fullsized":"2023-10-06T05:29:54.513589+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:31.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.521485+0000","last_change":"2023-10-06T05:29:54.515555+0000","last_active":"2023-10-06T05:29:54.521485+0000","last_peered":"2023-10-06T05:29:54.521485+0000","last_clean":"2023-10-06T05:29:54.521485+0000","last_became_active":"2023-10-06T05:29:54.515262+0000","last_became_peered":"2023-10-06T05:29:54.515262+0000","last_unstale":"2023-10-06T05:29:54.521485+0000","last_undegraded":"2023-10-06T05:29:54.521485+0000","last_fullsized":"2023-10-06T05:29:54.521485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:15.948263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.534548+0000","last_change":"2023-10-06T05:29:54.526011+0000","last_active":"2023-10-06T05:29:54.534548+0000","last_peered":"2023-10-06T05:29:54.534548+0000","last_clean":"2023-10-06T05:29:54.534548+0000","last_became_active":"2023-10-06T05:29:54.525708+0000","last_became_peered":"2023-10-06T05:29:54.525708+0000","last_unstale":"2023-10-06T05:29:54.534548+0000","last_undegraded":"2023-10-06T05:29:54.534548+0000","last_fullsized":"2023-10-06T05:29:54.534548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:42.346883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526111+0000","last_change":"2023-10-06T05:29:54.522737+0000","last_active":"2023-10-06T05:29:54.526111+0000","last_peered":"2023-10-06T05:29:54.526111+0000","last_clean":"2023-10-06T05:29:54.526111+0000","last_became_active":"2023-10-06T05:29:54.522458+0000","last_became_peered":"2023-10-06T05:29:54.522458+0000","last_unstale":"2023-10-06T05:29:54.526111+0000","last_undegraded":"2023-10-06T05:29:54.526111+0000","last_fullsized":"2023-10-06T05:29:54.526111+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:53.407139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.520790+0000","last_change":"2023-10-06T05:29:54.515566+0000","last_active":"2023-10-06T05:29:54.520790+0000","last_peered":"2023-10-06T05:29:54.520790+0000","last_clean":"2023-10-06T05:29:54.520790+0000","last_became_active":"2023-10-06T05:29:54.515310+0000","last_became_peered":"2023-10-06T05:29:54.515310+0000","last_unstale":"2023-10-06T05:29:54.520790+0000","last_undegraded":"2023-10-06T05:29:54.520790+0000","last_fullsized":"2023-10-06T05:29:54.520790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:55.374288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528702+0000","last_change":"2023-10-06T05:29:54.523814+0000","last_active":"2023-10-06T05:29:54.528702+0000","last_peered":"2023-10-06T05:29:54.528702+0000","last_clean":"2023-10-06T05:29:54.528702+0000","last_became_active":"2023-10-06T05:29:54.523504+0000","last_became_peered":"2023-10-06T05:29:54.523504+0000","last_unstale":"2023-10-06T05:29:54.528702+0000","last_undegraded":"2023-10-06T05:29:54.528702+0000","last_fullsized":"2023-10-06T05:29:54.528702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:05.783502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.530455+0000","last_change":"2023-10-06T05:29:54.524526+0000","last_active":"2023-10-06T05:29:54.530455+0000","last_peered":"2023-10-06T05:29:54.530455+0000","last_clean":"2023-10-06T05:29:54.530455+0000","last_became_active":"2023-10-06T05:29:54.524195+0000","last_became_peered":"2023-10-06T05:29:54.524195+0000","last_unstale":"2023-10-06T05:29:54.530455+0000","last_undegraded":"2023-10-06T05:29:54.530455+0000","last_fullsized":"2023-10-06T05:29:54.530455+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:27.646401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539204+0000","last_change":"2023-10-06T05:29:54.532990+0000","last_active":"2023-10-06T05:29:54.539204+0000","last_peered":"2023-10-06T05:29:54.539204+0000","last_clean":"2023-10-06T05:29:54.539204+0000","last_became_active":"2023-10-06T05:29:54.532231+0000","last_became_peered":"2023-10-06T05:29:54.532231+0000","last_unstale":"2023-10-06T05:29:54.539204+0000","last_undegraded":"2023-10-06T05:29:54.539204+0000","last_fullsized":"2023-10-06T05:29:54.539204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:00.511156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537764+0000","last_change":"2023-10-06T05:29:54.533931+0000","last_active":"2023-10-06T05:29:54.537764+0000","last_peered":"2023-10-06T05:29:54.537764+0000","last_clean":"2023-10-06T05:29:54.537764+0000","last_became_active":"2023-10-06T05:29:54.533649+0000","last_became_peered":"2023-10-06T05:29:54.533649+0000","last_unstale":"2023-10-06T05:29:54.537764+0000","last_undegraded":"2023-10-06T05:29:54.537764+0000","last_fullsized":"2023-10-06T05:29:54.537764+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:23.458976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529100+0000","last_change":"2023-10-06T05:29:54.523662+0000","last_active":"2023-10-06T05:29:54.529100+0000","last_peered":"2023-10-06T05:29:54.529100+0000","last_clean":"2023-10-06T05:29:54.529100+0000","last_became_active":"2023-10-06T05:29:54.523239+0000","last_became_peered":"2023-10-06T05:29:54.523239+0000","last_unstale":"2023-10-06T05:29:54.529100+0000","last_undegraded":"2023-10-06T05:29:54.529100+0000","last_fullsized":"2023-10-06T05:29:54.529100+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:35.356479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.534525+0000","last_change":"2023-10-06T05:29:54.525974+0000","last_active":"2023-10-06T05:29:54.534525+0000","last_peered":"2023-10-06T05:29:54.534525+0000","last_clean":"2023-10-06T05:29:54.534525+0000","last_became_active":"2023-10-06T05:29:54.525690+0000","last_became_peered":"2023-10-06T05:29:54.525690+0000","last_unstale":"2023-10-06T05:29:54.534525+0000","last_undegraded":"2023-10-06T05:29:54.534525+0000","last_fullsized":"2023-10-06T05:29:54.534525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:54.542473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.536795+0000","last_change":"2023-10-06T05:29:54.530404+0000","last_active":"2023-10-06T05:29:54.536795+0000","last_peered":"2023-10-06T05:29:54.536795+0000","last_clean":"2023-10-06T05:29:54.536795+0000","last_became_active":"2023-10-06T05:29:54.530041+0000","last_became_peered":"2023-10-06T05:29:54.530041+0000","last_unstale":"2023-10-06T05:29:54.536795+0000","last_undegraded":"2023-10-06T05:29:54.536795+0000","last_fullsized":"2023-10-06T05:29:54.536795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:36:08.526974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527057+0000","last_change":"2023-10-06T05:29:54.515107+0000","last_active":"2023-10-06T05:29:54.527057+0000","last_peered":"2023-10-06T05:29:54.527057+0000","last_clean":"2023-10-06T05:29:54.527057+0000","last_became_active":"2023-10-06T05:29:54.514832+0000","last_became_peered":"2023-10-06T05:29:54.514832+0000","last_unstale":"2023-10-06T05:29:54.527057+0000","last_undegraded":"2023-10-06T05:29:54.527057+0000","last_fullsized":"2023-10-06T05:29:54.527057+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:31.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529241+0000","last_change":"2023-10-06T05:29:54.525206+0000","last_active":"2023-10-06T05:29:54.529241+0000","last_peered":"2023-10-06T05:29:54.529241+0000","last_clean":"2023-10-06T05:29:54.529241+0000","last_became_active":"2023-10-06T05:29:54.524424+0000","last_became_peered":"2023-10-06T05:29:54.524424+0000","last_unstale":"2023-10-06T05:29:54.529241+0000","last_undegraded":"2023-10-06T05:29:54.529241+0000","last_fullsized":"2023-10-06T05:29:54.529241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:55:03.475085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525329+0000","last_change":"2023-10-06T05:29:54.520151+0000","last_active":"2023-10-06T05:29:54.525329+0000","last_peered":"2023-10-06T05:29:54.525329+0000","last_clean":"2023-10-06T05:29:54.525329+0000","last_became_active":"2023-10-06T05:29:54.518845+0000","last_became_peered":"2023-10-06T05:29:54.518845+0000","last_unstale":"2023-10-06T05:29:54.525329+0000","last_undegraded":"2023-10-06T05:29:54.525329+0000","last_fullsized":"2023-10-06T05:29:54.525329+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:05.700624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525497+0000","last_change":"2023-10-06T05:29:54.521962+0000","last_active":"2023-10-06T05:29:54.525497+0000","last_peered":"2023-10-06T05:29:54.525497+0000","last_clean":"2023-10-06T05:29:54.525497+0000","last_became_active":"2023-10-06T05:29:54.521564+0000","last_became_peered":"2023-10-06T05:29:54.521564+0000","last_unstale":"2023-10-06T05:29:54.525497+0000","last_undegraded":"2023-10-06T05:29:54.525497+0000","last_fullsized":"2023-10-06T05:29:54.525497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:44.474526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.523023+0000","last_change":"2023-10-06T05:29:54.516571+0000","last_active":"2023-10-06T05:29:54.523023+0000","last_peered":"2023-10-06T05:29:54.523023+0000","last_clean":"2023-10-06T05:29:54.523023+0000","last_became_active":"2023-10-06T05:29:54.516286+0000","last_became_peered":"2023-10-06T05:29:54.516286+0000","last_unstale":"2023-10-06T05:29:54.523023+0000","last_undegraded":"2023-10-06T05:29:54.523023+0000","last_fullsized":"2023-10-06T05:29:54.523023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:07.610035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526306+0000","last_change":"2023-10-06T05:29:54.520475+0000","last_active":"2023-10-06T05:29:54.526306+0000","last_peered":"2023-10-06T05:29:54.526306+0000","last_clean":"2023-10-06T05:29:54.526306+0000","last_became_active":"2023-10-06T05:29:54.520146+0000","last_became_peered":"2023-10-06T05:29:54.520146+0000","last_unstale":"2023-10-06T05:29:54.526306+0000","last_undegraded":"2023-10-06T05:29:54.526306+0000","last_fullsized":"2023-10-06T05:29:54.526306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:06.755837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529220+0000","last_change":"2023-10-06T05:29:54.524953+0000","last_active":"2023-10-06T05:29:54.529220+0000","last_peered":"2023-10-06T05:29:54.529220+0000","last_clean":"2023-10-06T05:29:54.529220+0000","last_became_active":"2023-10-06T05:29:54.524656+0000","last_became_peered":"2023-10-06T05:29:54.524656+0000","last_unstale":"2023-10-06T05:29:54.529220+0000","last_undegraded":"2023-10-06T05:29:54.529220+0000","last_fullsized":"2023-10-06T05:29:54.529220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:40.379472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.508461+0000","last_change":"2023-10-06T05:29:54.506643+0000","last_active":"2023-10-06T05:29:54.508461+0000","last_peered":"2023-10-06T05:29:54.508461+0000","last_clean":"2023-10-06T05:29:54.508461+0000","last_became_active":"2023-10-06T05:29:54.506290+0000","last_became_peered":"2023-10-06T05:29:54.506290+0000","last_unstale":"2023-10-06T05:29:54.508461+0000","last_undegraded":"2023-10-06T05:29:54.508461+0000","last_fullsized":"2023-10-06T05:29:54.508461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:29.207931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539239+0000","last_change":"2023-10-06T05:29:54.534292+0000","last_active":"2023-10-06T05:29:54.539239+0000","last_peered":"2023-10-06T05:29:54.539239+0000","last_clean":"2023-10-06T05:29:54.539239+0000","last_became_active":"2023-10-06T05:29:54.531552+0000","last_became_peered":"2023-10-06T05:29:54.531552+0000","last_unstale":"2023-10-06T05:29:54.539239+0000","last_undegraded":"2023-10-06T05:29:54.539239+0000","last_fullsized":"2023-10-06T05:29:54.539239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:15.330784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539013+0000","last_change":"2023-10-06T05:29:54.532510+0000","last_active":"2023-10-06T05:29:54.539013+0000","last_peered":"2023-10-06T05:29:54.539013+0000","last_clean":"2023-10-06T05:29:54.539013+0000","last_became_active":"2023-10-06T05:29:54.531267+0000","last_became_peered":"2023-10-06T05:29:54.531267+0000","last_unstale":"2023-10-06T05:29:54.539013+0000","last_undegraded":"2023-10-06T05:29:54.539013+0000","last_fullsized":"2023-10-06T05:29:54.539013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:46.198628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537834+0000","last_change":"2023-10-06T05:29:54.534551+0000","last_active":"2023-10-06T05:29:54.537834+0000","last_peered":"2023-10-06T05:29:54.537834+0000","last_clean":"2023-10-06T05:29:54.537834+0000","last_became_active":"2023-10-06T05:29:54.534225+0000","last_became_peered":"2023-10-06T05:29:54.534225+0000","last_unstale":"2023-10-06T05:29:54.537834+0000","last_undegraded":"2023-10-06T05:29:54.537834+0000","last_fullsized":"2023-10-06T05:29:54.537834+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:15.861483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527030+0000","last_change":"2023-10-06T05:29:54.514846+0000","last_active":"2023-10-06T05:29:54.527030+0000","last_peered":"2023-10-06T05:29:54.527030+0000","last_clean":"2023-10-06T05:29:54.527030+0000","last_became_active":"2023-10-06T05:29:54.514317+0000","last_became_peered":"2023-10-06T05:29:54.514317+0000","last_unstale":"2023-10-06T05:29:54.527030+0000","last_undegraded":"2023-10-06T05:29:54.527030+0000","last_fullsized":"2023-10-06T05:29:54.527030+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:43.103575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.520724+0000","last_change":"2023-10-06T05:29:54.513332+0000","last_active":"2023-10-06T05:29:54.520724+0000","last_peered":"2023-10-06T05:29:54.520724+0000","last_clean":"2023-10-06T05:29:54.520724+0000","last_became_active":"2023-10-06T05:29:54.513021+0000","last_became_peered":"2023-10-06T05:29:54.513021+0000","last_unstale":"2023-10-06T05:29:54.520724+0000","last_undegraded":"2023-10-06T05:29:54.520724+0000","last_fullsized":"2023-10-06T05:29:54.520724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:52.851641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539274+0000","last_change":"2023-10-06T05:29:54.534626+0000","last_active":"2023-10-06T05:29:54.539274+0000","last_peered":"2023-10-06T05:29:54.539274+0000","last_clean":"2023-10-06T05:29:54.539274+0000","last_became_active":"2023-10-06T05:29:54.531971+0000","last_became_peered":"2023-10-06T05:29:54.531971+0000","last_unstale":"2023-10-06T05:29:54.539274+0000","last_undegraded":"2023-10-06T05:29:54.539274+0000","last_fullsized":"2023-10-06T05:29:54.539274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.039388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.538121+0000","last_change":"2023-10-06T05:29:54.536018+0000","last_active":"2023-10-06T05:29:54.538121+0000","last_peered":"2023-10-06T05:29:54.538121+0000","last_clean":"2023-10-06T05:29:54.538121+0000","last_became_active":"2023-10-06T05:29:54.535691+0000","last_became_peered":"2023-10-06T05:29:54.535691+0000","last_unstale":"2023-10-06T05:29:54.538121+0000","last_undegraded":"2023-10-06T05:29:54.538121+0000","last_fullsized":"2023-10-06T05:29:54.538121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:24.780925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527298+0000","last_change":"2023-10-06T05:29:54.523021+0000","last_active":"2023-10-06T05:29:54.527298+0000","last_peered":"2023-10-06T05:29:54.527298+0000","last_clean":"2023-10-06T05:29:54.527298+0000","last_became_active":"2023-10-06T05:29:54.522675+0000","last_became_peered":"2023-10-06T05:29:54.522675+0000","last_unstale":"2023-10-06T05:29:54.527298+0000","last_undegraded":"2023-10-06T05:29:54.527298+0000","last_fullsized":"2023-10-06T05:29:54.527298+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:42.131276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527163+0000","last_change":"2023-10-06T05:29:54.515655+0000","last_active":"2023-10-06T05:29:54.527163+0000","last_peered":"2023-10-06T05:29:54.527163+0000","last_clean":"2023-10-06T05:29:54.527163+0000","last_became_active":"2023-10-06T05:29:54.515371+0000","last_became_peered":"2023-10-06T05:29:54.515371+0000","last_unstale":"2023-10-06T05:29:54.527163+0000","last_undegraded":"2023-10-06T05:29:54.527163+0000","last_fullsized":"2023-10-06T05:29:54.527163+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.039388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.521768+0000","last_change":"2023-10-06T05:29:54.518844+0000","last_active":"2023-10-06T05:29:54.521768+0000","last_peered":"2023-10-06T05:29:54.521768+0000","last_clean":"2023-10-06T05:29:54.521768+0000","last_became_active":"2023-10-06T05:29:54.518363+0000","last_became_peered":"2023-10-06T05:29:54.518363+0000","last_unstale":"2023-10-06T05:29:54.521768+0000","last_undegraded":"2023-10-06T05:29:54.521768+0000","last_fullsized":"2023-10-06T05:29:54.521768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:57.584908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"76'4","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528974+0000","last_change":"2023-10-06T05:29:53.520623+0000","last_active":"2023-10-06T05:29:54.528974+0000","last_peered":"2023-10-06T05:29:54.528974+0000","last_clean":"2023-10-06T05:29:54.528974+0000","last_became_active":"2023-10-06T05:29:53.520266+0000","last_became_peered":"2023-10-06T05:29:53.520266+0000","last_unstale":"2023-10-06T05:29:54.528974+0000","last_undegraded":"2023-10-06T05:29:54.528974+0000","last_fullsized":"2023-10-06T05:29:54.528974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:12.061838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539108+0000","last_change":"2023-10-06T05:29:54.532957+0000","last_active":"2023-10-06T05:29:54.539108+0000","last_peered":"2023-10-06T05:29:54.539108+0000","last_clean":"2023-10-06T05:29:54.539108+0000","last_became_active":"2023-10-06T05:29:54.531123+0000","last_became_peered":"2023-10-06T05:29:54.531123+0000","last_unstale":"2023-10-06T05:29:54.539108+0000","last_undegraded":"2023-10-06T05:29:54.539108+0000","last_fullsized":"2023-10-06T05:29:54.539108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:15.763800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527299+0000","last_change":"2023-10-06T05:29:53.511934+0000","last_active":"2023-10-06T05:29:54.527299+0000","last_peered":"2023-10-06T05:29:54.527299+0000","last_clean":"2023-10-06T05:29:54.527299+0000","last_became_active":"2023-10-06T05:29:53.511617+0000","last_became_peered":"2023-10-06T05:29:53.511617+0000","last_unstale":"2023-10-06T05:29:54.527299+0000","last_undegraded":"2023-10-06T05:29:54.527299+0000","last_fullsized":"2023-10-06T05:29:54.527299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:52.402311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528682+0000","last_change":"2023-10-06T05:29:54.524984+0000","last_active":"2023-10-06T05:29:54.528682+0000","last_peered":"2023-10-06T05:29:54.528682+0000","last_clean":"2023-10-06T05:29:54.528682+0000","last_became_active":"2023-10-06T05:29:54.524688+0000","last_became_peered":"2023-10-06T05:29:54.524688+0000","last_unstale":"2023-10-06T05:29:54.528682+0000","last_undegraded":"2023-10-06T05:29:54.528682+0000","last_fullsized":"2023-10-06T05:29:54.528682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:57.342705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537431+0000","last_change":"2023-10-06T05:29:53.517791+0000","last_active":"2023-10-06T05:29:54.537431+0000","last_peered":"2023-10-06T05:29:54.537431+0000","last_clean":"2023-10-06T05:29:54.537431+0000","last_became_active":"2023-10-06T05:29:53.517525+0000","last_became_peered":"2023-10-06T05:29:53.517525+0000","last_unstale":"2023-10-06T05:29:54.537431+0000","last_undegraded":"2023-10-06T05:29:54.537431+0000","last_fullsized":"2023-10-06T05:29:54.537431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:04.778675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526327+0000","last_change":"2023-10-06T05:29:54.520514+0000","last_active":"2023-10-06T05:29:54.526327+0000","last_peered":"2023-10-06T05:29:54.526327+0000","last_clean":"2023-10-06T05:29:54.526327+0000","last_became_active":"2023-10-06T05:29:54.520198+0000","last_became_peered":"2023-10-06T05:29:54.520198+0000","last_unstale":"2023-10-06T05:29:54.526327+0000","last_undegraded":"2023-10-06T05:29:54.526327+0000","last_fullsized":"2023-10-06T05:29:54.526327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:26.766248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529569+0000","last_change":"2023-10-06T05:29:53.515523+0000","last_active":"2023-10-06T05:29:54.529569+0000","last_peered":"2023-10-06T05:29:54.529569+0000","last_clean":"2023-10-06T05:29:54.529569+0000","last_became_active":"2023-10-06T05:29:53.515200+0000","last_became_peered":"2023-10-06T05:29:53.515200+0000","last_unstale":"2023-10-06T05:29:54.529569+0000","last_undegraded":"2023-10-06T05:29:54.529569+0000","last_fullsized":"2023-10-06T05:29:54.529569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:07.558499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.536851+0000","last_change":"2023-10-06T05:29:54.531889+0000","last_active":"2023-10-06T05:29:54.536851+0000","last_peered":"2023-10-06T05:29:54.536851+0000","last_clean":"2023-10-06T05:29:54.536851+0000","last_became_active":"2023-10-06T05:29:54.531108+0000","last_became_peered":"2023-10-06T05:29:54.531108+0000","last_unstale":"2023-10-06T05:29:54.536851+0000","last_undegraded":"2023-10-06T05:29:54.536851+0000","last_fullsized":"2023-10-06T05:29:54.536851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:44.474526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527545+0000","last_change":"2023-10-06T05:29:53.515187+0000","last_active":"2023-10-06T05:29:54.527545+0000","last_peered":"2023-10-06T05:29:54.527545+0000","last_clean":"2023-10-06T05:29:54.527545+0000","last_became_active":"2023-10-06T05:29:53.514889+0000","last_became_peered":"2023-10-06T05:29:53.514889+0000","last_unstale":"2023-10-06T05:29:54.527545+0000","last_undegraded":"2023-10-06T05:29:54.527545+0000","last_fullsized":"2023-10-06T05:29:54.527545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:36.374566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539231+0000","last_change":"2023-10-06T05:29:54.534255+0000","last_active":"2023-10-06T05:29:54.539231+0000","last_peered":"2023-10-06T05:29:54.539231+0000","last_clean":"2023-10-06T05:29:54.539231+0000","last_became_active":"2023-10-06T05:29:54.532585+0000","last_became_peered":"2023-10-06T05:29:54.532585+0000","last_unstale":"2023-10-06T05:29:54.539231+0000","last_undegraded":"2023-10-06T05:29:54.539231+0000","last_fullsized":"2023-10-06T05:29:54.539231+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:31.175342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525217+0000","last_change":"2023-10-06T05:29:53.512021+0000","last_active":"2023-10-06T05:29:54.525217+0000","last_peered":"2023-10-06T05:29:54.525217+0000","last_clean":"2023-10-06T05:29:54.525217+0000","last_became_active":"2023-10-06T05:29:53.511674+0000","last_became_peered":"2023-10-06T05:29:53.511674+0000","last_unstale":"2023-10-06T05:29:54.525217+0000","last_undegraded":"2023-10-06T05:29:54.525217+0000","last_fullsized":"2023-10-06T05:29:54.525217+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:04.778675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528674+0000","last_change":"2023-10-06T05:29:54.524150+0000","last_active":"2023-10-06T05:29:54.528674+0000","last_peered":"2023-10-06T05:29:54.528674+0000","last_clean":"2023-10-06T05:29:54.528674+0000","last_became_active":"2023-10-06T05:29:54.523854+0000","last_became_peered":"2023-10-06T05:29:54.523854+0000","last_unstale":"2023-10-06T05:29:54.528674+0000","last_undegraded":"2023-10-06T05:29:54.528674+0000","last_fullsized":"2023-10-06T05:29:54.528674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:32.044286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.501278+0000","last_change":"2023-10-06T05:29:53.512682+0000","last_active":"2023-10-06T05:29:54.501278+0000","last_peered":"2023-10-06T05:29:54.501278+0000","last_clean":"2023-10-06T05:29:54.501278+0000","last_became_active":"2023-10-06T05:29:53.512371+0000","last_became_peered":"2023-10-06T05:29:53.512371+0000","last_unstale":"2023-10-06T05:29:54.501278+0000","last_undegraded":"2023-10-06T05:29:54.501278+0000","last_fullsized":"2023-10-06T05:29:54.501278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:04.778675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528768+0000","last_change":"2023-10-06T05:29:54.525581+0000","last_active":"2023-10-06T05:29:54.528768+0000","last_peered":"2023-10-06T05:29:54.528768+0000","last_clean":"2023-10-06T05:29:54.528768+0000","last_became_active":"2023-10-06T05:29:54.525144+0000","last_became_peered":"2023-10-06T05:29:54.525144+0000","last_unstale":"2023-10-06T05:29:54.528768+0000","last_undegraded":"2023-10-06T05:29:54.528768+0000","last_fullsized":"2023-10-06T05:29:54.528768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:45.459246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.505135+0000","last_change":"2023-10-06T05:29:53.513090+0000","last_active":"2023-10-06T05:29:54.505135+0000","last_peered":"2023-10-06T05:29:54.505135+0000","last_clean":"2023-10-06T05:29:54.505135+0000","last_became_active":"2023-10-06T05:29:53.512791+0000","last_became_peered":"2023-10-06T05:29:53.512791+0000","last_unstale":"2023-10-06T05:29:54.505135+0000","last_undegraded":"2023-10-06T05:29:54.505135+0000","last_fullsized":"2023-10-06T05:29:54.505135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:54.403099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.536803+0000","last_change":"2023-10-06T05:29:54.529858+0000","last_active":"2023-10-06T05:29:54.536803+0000","last_peered":"2023-10-06T05:29:54.536803+0000","last_clean":"2023-10-06T05:29:54.536803+0000","last_became_active":"2023-10-06T05:29:54.526000+0000","last_became_peered":"2023-10-06T05:29:54.526000+0000","last_unstale":"2023-10-06T05:29:54.536803+0000","last_undegraded":"2023-10-06T05:29:54.536803+0000","last_fullsized":"2023-10-06T05:29:54.536803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:37:02.294278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507266+0000","last_change":"2023-10-06T05:29:53.512669+0000","last_active":"2023-10-06T05:29:54.507266+0000","last_peered":"2023-10-06T05:29:54.507266+0000","last_clean":"2023-10-06T05:29:54.507266+0000","last_became_active":"2023-10-06T05:29:53.511995+0000","last_became_peered":"2023-10-06T05:29:53.511995+0000","last_unstale":"2023-10-06T05:29:54.507266+0000","last_undegraded":"2023-10-06T05:29:54.507266+0000","last_fullsized":"2023-10-06T05:29:54.507266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:41.298695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.513866+0000","last_change":"2023-10-06T05:29:54.509641+0000","last_active":"2023-10-06T05:29:54.513866+0000","last_peered":"2023-10-06T05:29:54.513866+0000","last_clean":"2023-10-06T05:29:54.513866+0000","last_became_active":"2023-10-06T05:29:54.506915+0000","last_became_peered":"2023-10-06T05:29:54.506915+0000","last_unstale":"2023-10-06T05:29:54.513866+0000","last_undegraded":"2023-10-06T05:29:54.513866+0000","last_fullsized":"2023-10-06T05:29:54.513866+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.039388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.505008+0000","last_change":"2023-10-06T05:29:53.512341+0000","last_active":"2023-10-06T05:29:54.505008+0000","last_peered":"2023-10-06T05:29:54.505008+0000","last_clean":"2023-10-06T05:29:54.505008+0000","last_became_active":"2023-10-06T05:29:53.511506+0000","last_became_peered":"2023-10-06T05:29:53.511506+0000","last_unstale":"2023-10-06T05:29:54.505008+0000","last_undegraded":"2023-10-06T05:29:54.505008+0000","last_fullsized":"2023-10-06T05:29:54.505008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:58.589389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528352+0000","last_change":"2023-10-06T05:29:54.522338+0000","last_active":"2023-10-06T05:29:54.528352+0000","last_peered":"2023-10-06T05:29:54.528352+0000","last_clean":"2023-10-06T05:29:54.528352+0000","last_became_active":"2023-10-06T05:29:54.522008+0000","last_became_peered":"2023-10-06T05:29:54.522008+0000","last_unstale":"2023-10-06T05:29:54.528352+0000","last_undegraded":"2023-10-06T05:29:54.528352+0000","last_fullsized":"2023-10-06T05:29:54.528352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:00.511156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"76'3","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527712+0000","last_change":"2023-10-06T05:29:53.519538+0000","last_active":"2023-10-06T05:29:54.527712+0000","last_peered":"2023-10-06T05:29:54.527712+0000","last_clean":"2023-10-06T05:29:54.527712+0000","last_became_active":"2023-10-06T05:29:53.518865+0000","last_became_peered":"2023-10-06T05:29:53.518865+0000","last_unstale":"2023-10-06T05:29:54.527712+0000","last_undegraded":"2023-10-06T05:29:54.527712+0000","last_fullsized":"2023-10-06T05:29:54.527712+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:18.027432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.538749+0000","last_change":"2023-10-06T05:29:54.537788+0000","last_active":"2023-10-06T05:29:54.538749+0000","last_peered":"2023-10-06T05:29:54.538749+0000","last_clean":"2023-10-06T05:29:54.538749+0000","last_became_active":"2023-10-06T05:29:54.537395+0000","last_became_peered":"2023-10-06T05:29:54.537395+0000","last_unstale":"2023-10-06T05:29:54.538749+0000","last_undegraded":"2023-10-06T05:29:54.538749+0000","last_fullsized":"2023-10-06T05:29:54.538749+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:03.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"76'6","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.534643+0000","last_change":"2023-10-06T05:29:53.511583+0000","last_active":"2023-10-06T05:29:54.534643+0000","last_peered":"2023-10-06T05:29:54.534643+0000","last_clean":"2023-10-06T05:29:54.534643+0000","last_became_active":"2023-10-06T05:29:53.511304+0000","last_became_peered":"2023-10-06T05:29:53.511304+0000","last_unstale":"2023-10-06T05:29:54.534643+0000","last_undegraded":"2023-10-06T05:29:54.534643+0000","last_fullsized":"2023-10-06T05:29:54.534643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:10.792865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.524787+0000","last_change":"2023-10-06T05:29:54.523112+0000","last_active":"2023-10-06T05:29:54.524787+0000","last_peered":"2023-10-06T05:29:54.524787+0000","last_clean":"2023-10-06T05:29:54.524787+0000","last_became_active":"2023-10-06T05:29:54.522828+0000","last_became_peered":"2023-10-06T05:29:54.522828+0000","last_unstale":"2023-10-06T05:29:54.524787+0000","last_undegraded":"2023-10-06T05:29:54.524787+0000","last_fullsized":"2023-10-06T05:29:54.524787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:43.103575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528941+0000","last_change":"2023-10-06T05:29:53.511025+0000","last_active":"2023-10-06T05:29:54.528941+0000","last_peered":"2023-10-06T05:29:54.528941+0000","last_clean":"2023-10-06T05:29:54.528941+0000","last_became_active":"2023-10-06T05:29:53.510675+0000","last_became_peered":"2023-10-06T05:29:53.510675+0000","last_unstale":"2023-10-06T05:29:54.528941+0000","last_undegraded":"2023-10-06T05:29:54.528941+0000","last_fullsized":"2023-10-06T05:29:54.528941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:52.402311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526039+0000","last_change":"2023-10-06T05:29:54.522231+0000","last_active":"2023-10-06T05:29:54.526039+0000","last_peered":"2023-10-06T05:29:54.526039+0000","last_clean":"2023-10-06T05:29:54.526039+0000","last_became_active":"2023-10-06T05:29:54.521920+0000","last_became_peered":"2023-10-06T05:29:54.521920+0000","last_unstale":"2023-10-06T05:29:54.526039+0000","last_undegraded":"2023-10-06T05:29:54.526039+0000","last_fullsized":"2023-10-06T05:29:54.526039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:59.594216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507426+0000","last_change":"2023-10-06T05:29:53.511251+0000","last_active":"2023-10-06T05:29:54.507426+0000","last_peered":"2023-10-06T05:29:54.507426+0000","last_clean":"2023-10-06T05:29:54.507426+0000","last_became_active":"2023-10-06T05:29:53.510970+0000","last_became_peered":"2023-10-06T05:29:53.510970+0000","last_unstale":"2023-10-06T05:29:54.507426+0000","last_undegraded":"2023-10-06T05:29:54.507426+0000","last_fullsized":"2023-10-06T05:29:54.507426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:58.589389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528553+0000","last_change":"2023-10-06T05:29:54.524067+0000","last_active":"2023-10-06T05:29:54.528553+0000","last_peered":"2023-10-06T05:29:54.528553+0000","last_clean":"2023-10-06T05:29:54.528553+0000","last_became_active":"2023-10-06T05:29:54.523674+0000","last_became_peered":"2023-10-06T05:29:54.523674+0000","last_unstale":"2023-10-06T05:29:54.528553+0000","last_undegraded":"2023-10-06T05:29:54.528553+0000","last_fullsized":"2023-10-06T05:29:54.528553+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:20.058127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.505301+0000","last_change":"2023-10-06T05:29:53.511313+0000","last_active":"2023-10-06T05:29:54.505301+0000","last_peered":"2023-10-06T05:29:54.505301+0000","last_clean":"2023-10-06T05:29:54.505301+0000","last_became_active":"2023-10-06T05:29:53.510973+0000","last_became_peered":"2023-10-06T05:29:53.510973+0000","last_unstale":"2023-10-06T05:29:54.505301+0000","last_undegraded":"2023-10-06T05:29:54.505301+0000","last_fullsized":"2023-10-06T05:29:54.505301+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529354+0000","last_change":"2023-10-06T05:29:54.526574+0000","last_active":"2023-10-06T05:29:54.529354+0000","last_peered":"2023-10-06T05:29:54.529354+0000","last_clean":"2023-10-06T05:29:54.529354+0000","last_became_active":"2023-10-06T05:29:54.526064+0000","last_became_peered":"2023-10-06T05:29:54.526064+0000","last_unstale":"2023-10-06T05:29:54.529354+0000","last_undegraded":"2023-10-06T05:29:54.529354+0000","last_fullsized":"2023-10-06T05:29:54.529354+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:03.577810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"76'8","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537530+0000","last_change":"2023-10-06T05:29:53.510913+0000","last_active":"2023-10-06T05:29:54.537530+0000","last_peered":"2023-10-06T05:29:54.537530+0000","last_clean":"2023-10-06T05:29:54.537530+0000","last_became_active":"2023-10-06T05:29:53.510588+0000","last_became_peered":"2023-10-06T05:29:53.510588+0000","last_unstale":"2023-10-06T05:29:54.537530+0000","last_undegraded":"2023-10-06T05:29:54.537530+0000","last_fullsized":"2023-10-06T05:29:54.537530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:28.203103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528533+0000","last_change":"2023-10-06T05:29:54.522541+0000","last_active":"2023-10-06T05:29:54.528533+0000","last_peered":"2023-10-06T05:29:54.528533+0000","last_clean":"2023-10-06T05:29:54.528533+0000","last_became_active":"2023-10-06T05:29:54.522223+0000","last_became_peered":"2023-10-06T05:29:54.522223+0000","last_unstale":"2023-10-06T05:29:54.528533+0000","last_undegraded":"2023-10-06T05:29:54.528533+0000","last_fullsized":"2023-10-06T05:29:54.528533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:59.594216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526638+0000","last_change":"2023-10-06T05:29:53.513871+0000","last_active":"2023-10-06T05:29:54.526638+0000","last_peered":"2023-10-06T05:29:54.526638+0000","last_clean":"2023-10-06T05:29:54.526638+0000","last_became_active":"2023-10-06T05:29:53.513548+0000","last_became_peered":"2023-10-06T05:29:53.513548+0000","last_unstale":"2023-10-06T05:29:54.526638+0000","last_undegraded":"2023-10-06T05:29:54.526638+0000","last_fullsized":"2023-10-06T05:29:54.526638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:28.203103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528724+0000","last_change":"2023-10-06T05:29:54.525588+0000","last_active":"2023-10-06T05:29:54.528724+0000","last_peered":"2023-10-06T05:29:54.528724+0000","last_clean":"2023-10-06T05:29:54.528724+0000","last_became_active":"2023-10-06T05:29:54.524624+0000","last_became_peered":"2023-10-06T05:29:54.524624+0000","last_unstale":"2023-10-06T05:29:54.528724+0000","last_undegraded":"2023-10-06T05:29:54.528724+0000","last_fullsized":"2023-10-06T05:29:54.528724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:29.207931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"77'1","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T05:29:56.362437+0000","last_change":"2023-10-06T05:29:53.518153+0000","last_active":"2023-10-06T05:29:56.362437+0000","last_peered":"2023-10-06T05:29:56.362437+0000","last_clean":"2023-10-06T05:29:56.362437+0000","last_became_active":"2023-10-06T05:29:53.517866+0000","last_became_peered":"2023-10-06T05:29:53.517866+0000","last_unstale":"2023-10-06T05:29:56.362437+0000","last_undegraded":"2023-10-06T05:29:56.362437+0000","last_fullsized":"2023-10-06T05:29:56.362437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:58.589389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528663+0000","last_change":"2023-10-06T05:29:54.523839+0000","last_active":"2023-10-06T05:29:54.528663+0000","last_peered":"2023-10-06T05:29:54.528663+0000","last_clean":"2023-10-06T05:29:54.528663+0000","last_became_active":"2023-10-06T05:29:54.523522+0000","last_became_peered":"2023-10-06T05:29:54.523522+0000","last_unstale":"2023-10-06T05:29:54.528663+0000","last_undegraded":"2023-10-06T05:29:54.528663+0000","last_fullsized":"2023-10-06T05:29:54.528663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:16:26.036776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507642+0000","last_change":"2023-10-06T05:29:53.510393+0000","last_active":"2023-10-06T05:29:54.507642+0000","last_peered":"2023-10-06T05:29:54.507642+0000","last_clean":"2023-10-06T05:29:54.507642+0000","last_became_active":"2023-10-06T05:29:53.509188+0000","last_became_peered":"2023-10-06T05:29:53.509188+0000","last_unstale":"2023-10-06T05:29:54.507642+0000","last_undegraded":"2023-10-06T05:29:54.507642+0000","last_fullsized":"2023-10-06T05:29:54.507642+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:44.454418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539257+0000","last_change":"2023-10-06T05:29:54.534429+0000","last_active":"2023-10-06T05:29:54.539257+0000","last_peered":"2023-10-06T05:29:54.539257+0000","last_clean":"2023-10-06T05:29:54.539257+0000","last_became_active":"2023-10-06T05:29:54.531410+0000","last_became_peered":"2023-10-06T05:29:54.531410+0000","last_unstale":"2023-10-06T05:29:54.539257+0000","last_undegraded":"2023-10-06T05:29:54.539257+0000","last_fullsized":"2023-10-06T05:29:54.539257+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:43.103575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507119+0000","last_change":"2023-10-06T05:29:53.511934+0000","last_active":"2023-10-06T05:29:54.507119+0000","last_peered":"2023-10-06T05:29:54.507119+0000","last_clean":"2023-10-06T05:29:54.507119+0000","last_became_active":"2023-10-06T05:29:53.511552+0000","last_became_peered":"2023-10-06T05:29:53.511552+0000","last_unstale":"2023-10-06T05:29:54.507119+0000","last_undegraded":"2023-10-06T05:29:54.507119+0000","last_fullsized":"2023-10-06T05:29:54.507119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:28.203103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528784+0000","last_change":"2023-10-06T05:29:54.525544+0000","last_active":"2023-10-06T05:29:54.528784+0000","last_peered":"2023-10-06T05:29:54.528784+0000","last_clean":"2023-10-06T05:29:54.528784+0000","last_became_active":"2023-10-06T05:29:54.525216+0000","last_became_peered":"2023-10-06T05:29:54.525216+0000","last_unstale":"2023-10-06T05:29:54.528784+0000","last_undegraded":"2023-10-06T05:29:54.528784+0000","last_fullsized":"2023-10-06T05:29:54.528784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:42.303523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.512852+0000","last_change":"2023-10-06T05:29:53.515415+0000","last_active":"2023-10-06T05:29:54.512852+0000","last_peered":"2023-10-06T05:29:54.512852+0000","last_clean":"2023-10-06T05:29:54.512852+0000","last_became_active":"2023-10-06T05:29:53.515127+0000","last_became_peered":"2023-10-06T05:29:53.515127+0000","last_unstale":"2023-10-06T05:29:54.512852+0000","last_undegraded":"2023-10-06T05:29:54.512852+0000","last_fullsized":"2023-10-06T05:29:54.512852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.001283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526203+0000","last_change":"2023-10-06T05:29:54.523188+0000","last_active":"2023-10-06T05:29:54.526203+0000","last_peered":"2023-10-06T05:29:54.526203+0000","last_clean":"2023-10-06T05:29:54.526203+0000","last_became_active":"2023-10-06T05:29:54.522875+0000","last_became_peered":"2023-10-06T05:29:54.522875+0000","last_unstale":"2023-10-06T05:29:54.526203+0000","last_undegraded":"2023-10-06T05:29:54.526203+0000","last_fullsized":"2023-10-06T05:29:54.526203+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:43.407118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.506578+0000","last_change":"2023-10-06T05:29:53.511934+0000","last_active":"2023-10-06T05:29:54.506578+0000","last_peered":"2023-10-06T05:29:54.506578+0000","last_clean":"2023-10-06T05:29:54.506578+0000","last_became_active":"2023-10-06T05:29:53.511646+0000","last_became_peered":"2023-10-06T05:29:53.511646+0000","last_unstale":"2023-10-06T05:29:54.506578+0000","last_undegraded":"2023-10-06T05:29:54.506578+0000","last_fullsized":"2023-10-06T05:29:54.506578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:18.056226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.535984+0000","last_change":"2023-10-06T05:29:54.533581+0000","last_active":"2023-10-06T05:29:54.535984+0000","last_peered":"2023-10-06T05:29:54.535984+0000","last_clean":"2023-10-06T05:29:54.535984+0000","last_became_active":"2023-10-06T05:29:54.533306+0000","last_became_peered":"2023-10-06T05:29:54.533306+0000","last_unstale":"2023-10-06T05:29:54.535984+0000","last_undegraded":"2023-10-06T05:29:54.535984+0000","last_fullsized":"2023-10-06T05:29:54.535984+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:44.030500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.515044+0000","last_change":"2023-10-06T05:29:53.518726+0000","last_active":"2023-10-06T05:29:54.515044+0000","last_peered":"2023-10-06T05:29:54.515044+0000","last_clean":"2023-10-06T05:29:54.515044+0000","last_became_active":"2023-10-06T05:29:53.518316+0000","last_became_peered":"2023-10-06T05:29:53.518316+0000","last_unstale":"2023-10-06T05:29:54.515044+0000","last_undegraded":"2023-10-06T05:29:54.515044+0000","last_fullsized":"2023-10-06T05:29:54.515044+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:23.407812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525106+0000","last_change":"2023-10-06T05:29:54.519233+0000","last_active":"2023-10-06T05:29:54.525106+0000","last_peered":"2023-10-06T05:29:54.525106+0000","last_clean":"2023-10-06T05:29:54.525106+0000","last_became_active":"2023-10-06T05:29:54.518931+0000","last_became_peered":"2023-10-06T05:29:54.518931+0000","last_unstale":"2023-10-06T05:29:54.525106+0000","last_undegraded":"2023-10-06T05:29:54.525106+0000","last_fullsized":"2023-10-06T05:29:54.525106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:37.379394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.510839+0000","last_change":"2023-10-06T05:29:53.511526+0000","last_active":"2023-10-06T05:29:54.510839+0000","last_peered":"2023-10-06T05:29:54.510839+0000","last_clean":"2023-10-06T05:29:54.510839+0000","last_became_active":"2023-10-06T05:29:53.511218+0000","last_became_peered":"2023-10-06T05:29:53.511218+0000","last_unstale":"2023-10-06T05:29:54.510839+0000","last_undegraded":"2023-10-06T05:29:54.510839+0000","last_fullsized":"2023-10-06T05:29:54.510839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:03.816191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527402+0000","last_change":"2023-10-06T05:29:54.520400+0000","last_active":"2023-10-06T05:29:54.527402+0000","last_peered":"2023-10-06T05:29:54.527402+0000","last_clean":"2023-10-06T05:29:54.527402+0000","last_became_active":"2023-10-06T05:29:54.520083+0000","last_became_peered":"2023-10-06T05:29:54.520083+0000","last_unstale":"2023-10-06T05:29:54.527402+0000","last_undegraded":"2023-10-06T05:29:54.527402+0000","last_fullsized":"2023-10-06T05:29:54.527402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:15.861483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.516228+0000","last_change":"2023-10-06T05:29:53.510507+0000","last_active":"2023-10-06T05:29:54.516228+0000","last_peered":"2023-10-06T05:29:54.516228+0000","last_clean":"2023-10-06T05:29:54.516228+0000","last_became_active":"2023-10-06T05:29:53.510206+0000","last_became_peered":"2023-10-06T05:29:53.510206+0000","last_unstale":"2023-10-06T05:29:54.516228+0000","last_undegraded":"2023-10-06T05:29:54.516228+0000","last_fullsized":"2023-10-06T05:29:54.516228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:14.856655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.508485+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:29:54.508485+0000","last_peered":"2023-10-06T05:29:54.508485+0000","last_clean":"2023-10-06T05:29:54.508485+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:29:54.508485+0000","last_undegraded":"2023-10-06T05:29:54.508485+0000","last_fullsized":"2023-10-06T05:29:54.508485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.501316+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:29:54.501316+0000","last_peered":"2023-10-06T05:29:54.501316+0000","last_clean":"2023-10-06T05:29:54.501316+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:29:54.501316+0000","last_undegraded":"2023-10-06T05:29:54.501316+0000","last_fullsized":"2023-10-06T05:29:54.501316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.539155+0000","last_change":"2023-10-06T05:29:54.534329+0000","last_active":"2023-10-06T05:29:54.539155+0000","last_peered":"2023-10-06T05:29:54.539155+0000","last_clean":"2023-10-06T05:29:54.539155+0000","last_became_active":"2023-10-06T05:29:54.532561+0000","last_became_peered":"2023-10-06T05:29:54.532561+0000","last_unstale":"2023-10-06T05:29:54.539155+0000","last_undegraded":"2023-10-06T05:29:54.539155+0000","last_fullsized":"2023-10-06T05:29:54.539155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:03.987016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.513391+0000","last_change":"2023-10-06T05:29:53.511635+0000","last_active":"2023-10-06T05:29:54.513391+0000","last_peered":"2023-10-06T05:29:54.513391+0000","last_clean":"2023-10-06T05:29:54.513391+0000","last_became_active":"2023-10-06T05:29:53.511349+0000","last_became_peered":"2023-10-06T05:29:53.511349+0000","last_unstale":"2023-10-06T05:29:54.513391+0000","last_undegraded":"2023-10-06T05:29:54.513391+0000","last_fullsized":"2023-10-06T05:29:54.513391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:22.454148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.508397+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:29:54.508397+0000","last_peered":"2023-10-06T05:29:54.508397+0000","last_clean":"2023-10-06T05:29:54.508397+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:29:54.508397+0000","last_undegraded":"2023-10-06T05:29:54.508397+0000","last_fullsized":"2023-10-06T05:29:54.508397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528747+0000","last_change":"2023-10-06T05:29:54.523863+0000","last_active":"2023-10-06T05:29:54.528747+0000","last_peered":"2023-10-06T05:29:54.528747+0000","last_clean":"2023-10-06T05:29:54.528747+0000","last_became_active":"2023-10-06T05:29:54.523441+0000","last_became_peered":"2023-10-06T05:29:54.523441+0000","last_unstale":"2023-10-06T05:29:54.528747+0000","last_undegraded":"2023-10-06T05:29:54.528747+0000","last_fullsized":"2023-10-06T05:29:54.528747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:57.584908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.512407+0000","last_change":"2023-10-06T05:29:53.512239+0000","last_active":"2023-10-06T05:29:54.512407+0000","last_peered":"2023-10-06T05:29:54.512407+0000","last_clean":"2023-10-06T05:29:54.512407+0000","last_became_active":"2023-10-06T05:29:53.511935+0000","last_became_peered":"2023-10-06T05:29:53.511935+0000","last_unstale":"2023-10-06T05:29:54.512407+0000","last_undegraded":"2023-10-06T05:29:54.512407+0000","last_fullsized":"2023-10-06T05:29:54.512407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:26.641573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.505409+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:29:54.505409+0000","last_peered":"2023-10-06T05:29:54.505409+0000","last_clean":"2023-10-06T05:29:54.505409+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:29:54.505409+0000","last_undegraded":"2023-10-06T05:29:54.505409+0000","last_fullsized":"2023-10-06T05:29:54.505409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.538998+0000","last_change":"2023-10-06T05:29:54.532488+0000","last_active":"2023-10-06T05:29:54.538998+0000","last_peered":"2023-10-06T05:29:54.538998+0000","last_clean":"2023-10-06T05:29:54.538998+0000","last_became_active":"2023-10-06T05:29:54.532186+0000","last_became_peered":"2023-10-06T05:29:54.532186+0000","last_unstale":"2023-10-06T05:29:54.538998+0000","last_undegraded":"2023-10-06T05:29:54.538998+0000","last_fullsized":"2023-10-06T05:29:54.538998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:58.424208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.528609+0000","last_change":"2023-10-06T05:29:53.518334+0000","last_active":"2023-10-06T05:29:54.528609+0000","last_peered":"2023-10-06T05:29:54.528609+0000","last_clean":"2023-10-06T05:29:54.528609+0000","last_became_active":"2023-10-06T05:29:53.518040+0000","last_became_peered":"2023-10-06T05:29:53.518040+0000","last_unstale":"2023-10-06T05:29:54.528609+0000","last_undegraded":"2023-10-06T05:29:54.528609+0000","last_fullsized":"2023-10-06T05:29:54.528609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:48.034560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.501455+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:29:54.501455+0000","last_peered":"2023-10-06T05:29:54.501455+0000","last_clean":"2023-10-06T05:29:54.501455+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:29:54.501455+0000","last_undegraded":"2023-10-06T05:29:54.501455+0000","last_fullsized":"2023-10-06T05:29:54.501455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.537336+0000","last_change":"2023-10-06T05:29:54.536471+0000","last_active":"2023-10-06T05:29:54.537336+0000","last_peered":"2023-10-06T05:29:54.537336+0000","last_clean":"2023-10-06T05:29:54.537336+0000","last_became_active":"2023-10-06T05:29:54.536184+0000","last_became_peered":"2023-10-06T05:29:54.536184+0000","last_unstale":"2023-10-06T05:29:54.537336+0000","last_undegraded":"2023-10-06T05:29:54.537336+0000","last_fullsized":"2023-10-06T05:29:54.537336+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:05.851407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526248+0000","last_change":"2023-10-06T05:29:53.516093+0000","last_active":"2023-10-06T05:29:54.526248+0000","last_peered":"2023-10-06T05:29:54.526248+0000","last_clean":"2023-10-06T05:29:54.526248+0000","last_became_active":"2023-10-06T05:29:53.515779+0000","last_became_peered":"2023-10-06T05:29:53.515779+0000","last_unstale":"2023-10-06T05:29:54.526248+0000","last_undegraded":"2023-10-06T05:29:54.526248+0000","last_fullsized":"2023-10-06T05:29:54.526248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:41.271792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.510942+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:29:54.510942+0000","last_peered":"2023-10-06T05:29:54.510942+0000","last_clean":"2023-10-06T05:29:54.510942+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:29:54.510942+0000","last_undegraded":"2023-10-06T05:29:54.510942+0000","last_fullsized":"2023-10-06T05:29:54.510942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525768+0000","last_change":"2023-10-06T05:29:54.522828+0000","last_active":"2023-10-06T05:29:54.525768+0000","last_peered":"2023-10-06T05:29:54.525768+0000","last_clean":"2023-10-06T05:29:54.525768+0000","last_became_active":"2023-10-06T05:29:54.522480+0000","last_became_peered":"2023-10-06T05:29:54.522480+0000","last_unstale":"2023-10-06T05:29:54.525768+0000","last_undegraded":"2023-10-06T05:29:54.525768+0000","last_fullsized":"2023-10-06T05:29:54.525768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:31.175342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.510839+0000","last_change":"2023-10-06T05:29:53.516368+0000","last_active":"2023-10-06T05:29:54.510839+0000","last_peered":"2023-10-06T05:29:54.510839+0000","last_clean":"2023-10-06T05:29:54.510839+0000","last_became_active":"2023-10-06T05:29:53.516039+0000","last_became_peered":"2023-10-06T05:29:53.516039+0000","last_unstale":"2023-10-06T05:29:54.510839+0000","last_undegraded":"2023-10-06T05:29:54.510839+0000","last_fullsized":"2023-10-06T05:29:54.510839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:10.792865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.507747+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:29:54.507747+0000","last_peered":"2023-10-06T05:29:54.507747+0000","last_clean":"2023-10-06T05:29:54.507747+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:29:54.507747+0000","last_undegraded":"2023-10-06T05:29:54.507747+0000","last_fullsized":"2023-10-06T05:29:54.507747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.525617+0000","last_change":"2023-10-06T05:29:54.522186+0000","last_active":"2023-10-06T05:29:54.525617+0000","last_peered":"2023-10-06T05:29:54.525617+0000","last_clean":"2023-10-06T05:29:54.525617+0000","last_became_active":"2023-10-06T05:29:54.521586+0000","last_became_peered":"2023-10-06T05:29:54.521586+0000","last_unstale":"2023-10-06T05:29:54.525617+0000","last_undegraded":"2023-10-06T05:29:54.525617+0000","last_fullsized":"2023-10-06T05:29:54.525617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:36:08.526974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.527367+0000","last_change":"2023-10-06T05:29:53.516781+0000","last_active":"2023-10-06T05:29:54.527367+0000","last_peered":"2023-10-06T05:29:54.527367+0000","last_clean":"2023-10-06T05:29:54.527367+0000","last_became_active":"2023-10-06T05:29:53.516478+0000","last_became_peered":"2023-10-06T05:29:53.516478+0000","last_unstale":"2023-10-06T05:29:54.527367+0000","last_undegraded":"2023-10-06T05:29:54.527367+0000","last_fullsized":"2023-10-06T05:29:54.527367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:42.402290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.512505+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:29:54.512505+0000","last_peered":"2023-10-06T05:29:54.512505+0000","last_clean":"2023-10-06T05:29:54.512505+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:29:54.512505+0000","last_undegraded":"2023-10-06T05:29:54.512505+0000","last_fullsized":"2023-10-06T05:29:54.512505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.529276+0000","last_change":"2023-10-06T05:29:54.524594+0000","last_active":"2023-10-06T05:29:54.529276+0000","last_peered":"2023-10-06T05:29:54.529276+0000","last_clean":"2023-10-06T05:29:54.529276+0000","last_became_active":"2023-10-06T05:29:54.524218+0000","last_became_peered":"2023-10-06T05:29:54.524218+0000","last_unstale":"2023-10-06T05:29:54.529276+0000","last_undegraded":"2023-10-06T05:29:54.529276+0000","last_fullsized":"2023-10-06T05:29:54.529276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:53.475044+0000","last_clean_scrub_stamp":"2023-10-06T05:29:53.475044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:15.720460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.526202+0000","last_change":"2023-10-06T05:29:53.520527+0000","last_active":"2023-10-06T05:29:54.526202+0000","last_peered":"2023-10-06T05:29:54.526202+0000","last_clean":"2023-10-06T05:29:54.526202+0000","last_became_active":"2023-10-06T05:29:53.520201+0000","last_became_peered":"2023-10-06T05:29:53.520201+0000","last_unstale":"2023-10-06T05:29:54.526202+0000","last_undegraded":"2023-10-06T05:29:54.526202+0000","last_fullsized":"2023-10-06T05:29:54.526202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:29:52.470216+0000","last_clean_scrub_stamp":"2023-10-06T05:29:52.470216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:41.126449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T05:29:54.514019+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:29:54.514019+0000","last_peered":"2023-10-06T05:29:54.514019+0000","last_clean":"2023-10-06T05:29:54.514019+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:29:54.514019+0000","last_undegraded":"2023-10-06T05:29:54.514019+0000","last_fullsized":"2023-10-06T05:29:54.514019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1536000,"data_stored":1008180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86099999999999999,"15min":0.84499999999999997},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.89700000000000002,"15min":0.92800000000000005},"min":{"1min":0.68000000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.03,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88400000000000001,"15min":0.86899999999999999},"min":{"1min":0.61899999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2110000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.65700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1659999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.93000000000000005}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.64000000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1599999999999999,"5min":1.276,"15min":1.276},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.90600000000000003},"min":{"1min":0.72699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2509999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.96499999999999997}]},{"osd":3,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95999999999999996,"15min":0.96199999999999997},"min":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.163},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.70799999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3160000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.089}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90800000000000003,"15min":0.92300000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1719999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.028},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.111,"15min":1.113},"min":{"1min":0.89600000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.294,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.999}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.008,"15min":0.99299999999999999},"min":{"1min":0.75800000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.25,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.871},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1839999999999999,"15min":1.2030000000000001},"min":{"1min":0.96199999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.3979999999999999,"5min":1.859,"15min":1.859},"last":1.127}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.119,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3260000000000001,"5min":1.611,"15min":1.611},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.76100000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.0600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":950272,"data_stored":419326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83999999999999997,"15min":0.81499999999999995},"min":{"1min":0.51300000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.67700000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.88100000000000001}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98599999999999999,"15min":0.95899999999999996},"min":{"1min":0.61699999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4430000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.028,"5min":0.98099999999999998,"15min":0.96699999999999997},"min":{"1min":0.66600000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6659999999999999,"5min":1.679,"15min":1.679},"last":1.0669999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.872,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.339,"5min":1.643,"15min":1.643},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.95299999999999996,"15min":0.88700000000000001},"min":{"1min":0.69999999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5509999999999999,"5min":1.784,"15min":1.784},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.70899999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.1120000000000001,"15min":1.0800000000000001},"min":{"1min":0.89200000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5009999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.089}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96099999999999997},"min":{"1min":0.59999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.71,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.524,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.97299999999999998,"15min":0.97499999999999998},"min":{"1min":0.63300000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.097,"15min":1.069},"min":{"1min":0.78500000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7509999999999999,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.98399999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.016,"15min":1.01},"min":{"1min":0.754,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.1180000000000001},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.381}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":417824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89200000000000002,"15min":0.85999999999999999},"min":{"1min":0.61499999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.294,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.095}]},{"osd":1,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.61699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2210000000000001,"5min":1.409,"15min":1.409},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.242,"5min":1.411,"15min":1.411},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.67300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.175,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98599999999999999,"15min":0.96499999999999997},"min":{"1min":0.70299999999999996,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.244,"5min":1.54,"15min":1.54},"last":0.90600000000000003}]},{"osd":3,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.97099999999999997,"15min":0.95099999999999996},"min":{"1min":0.61199999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2769999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.05,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.77300000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.349,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.76200000000000001}]},{"osd":4,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.95499999999999996,"15min":1.0089999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.204,"5min":1.419,"15min":1.419},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.091,"5min":1.143,"15min":1.179},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.014}]},{"osd":6,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.05,"15min":1.1040000000000001},"min":{"1min":0.66800000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.327,"5min":1.508,"15min":1.508},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.3140000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.044}]},{"osd":7,"last update":"Fri Oct 6 05:29:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.115,"15min":1.141},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.339,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.302,"5min":1.732,"15min":1.732},"last":1.272}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":419430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.85199999999999998,"15min":0.79800000000000004},"min":{"1min":0.66600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.64500000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3180000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85999999999999999,"15min":0.81599999999999995},"min":{"1min":0.70799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2649999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.75900000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.75700000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.202,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.746,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1950000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.69999999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2230000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.80100000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.26,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.995,"15min":1.0509999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1639999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.998,"5min":1.0249999999999999,"15min":1.04},"min":{"1min":0.69899999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.163,"5min":1.458,"15min":1.458},"last":1.2549999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.99399999999999999,"15min":0.998},"min":{"1min":0.66500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.429,"15min":1.429},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.151,"15min":1.1719999999999999},"min":{"1min":0.83999999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.387,"5min":1.548,"15min":1.548},"last":1.0029999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:29:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1339999999999999,"15min":1.1359999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.88300000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.351,"5min":1.75,"15min":1.75},"last":0.97199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":942080,"data_stored":418344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.623},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.47199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.85099999999999998,"5min":1.379,"15min":1.379},"last":0.94699999999999995}]},{"osd":1,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.54700000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0640000000000001,"5min":1.389,"15min":1.389},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79300000000000004,"15min":0.76500000000000001},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.107,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2390000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.57899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.222,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96699999999999997,"15min":0.99099999999999999},"min":{"1min":0.71699999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.111,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.093,"15min":1.1180000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.3700000000000001,"5min":1.861,"15min":1.861},"last":1.167}]},{"osd":5,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.095,"15min":1.117},"min":{"1min":0.80800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5009999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1100000000000001,"15min":1.0960000000000001},"min":{"1min":0.85399999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.022}]},{"osd":6,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.069,"15min":1.079},"min":{"1min":0.748,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3009999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.325},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1910000000000001,"15min":1.196},"min":{"1min":0.81799999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.651,"5min":1.968,"15min":1.968},"last":1.2769999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.173,"15min":1.1639999999999999},"min":{"1min":0.80000000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.663,"5min":1.762,"15min":1.762},"last":1.139},{"interface":"front","average":{"1min":1.107,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.88800000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4039999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.399}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":950272,"data_stored":418504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.49299999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.629,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2649999999999999,"5min":1.29,"15min":1.29},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.60299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.278,"5min":1.383,"15min":1.383},"last":1.135},{"interface":"front","average":{"1min":0.87,"5min":0.84499999999999997,"15min":0.874},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.80800000000000005}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.85099999999999998},"min":{"1min":0.63800000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0389999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0089999999999999,"15min":1.1040000000000001},"min":{"1min":0.69999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2410000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1890000000000001,"15min":1.2350000000000001},"min":{"1min":0.89200000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4430000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.2470000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1319999999999999,"15min":1.1859999999999999},"min":{"1min":0.80800000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4019999999999999,"5min":1.829,"15min":1.829},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.095,"5min":1.1319999999999999,"15min":1.1819999999999999},"min":{"1min":0.80500000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.4339999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.96899999999999997}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.246,"15min":1.276},"min":{"1min":0.91600000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.202},{"interface":"front","average":{"1min":1.173,"5min":1.1830000000000001,"15min":1.2250000000000001},"min":{"1min":0.94299999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4690000000000001,"5min":1.708,"15min":1.708},"last":1.081}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.208,"15min":1.268},"min":{"1min":0.86399999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.4039999999999999,"5min":1.972,"15min":1.972},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.333,"15min":1.377},"min":{"1min":1.0249999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.9059999999999999,"5min":2.04,"15min":2.04},"last":1.29}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":946176,"data_stored":417902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0609999999999999,"5min":1.468,"15min":1.468},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.752,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.84899999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.008},{"interface":"front","average":{"1min":0.873,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.63400000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.28,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.70599999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.81599999999999995,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.236,"5min":1.419,"15min":1.419},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.90100000000000002},"min":{"1min":0.59899999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.117,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0449999999999999,"15min":1.0289999999999999},"min":{"1min":0.78900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1619999999999999},"min":{"1min":0.78500000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.4630000000000001,"5min":1.899,"15min":1.899},"last":1.056}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1379999999999999,"15min":1.1930000000000001},"min":{"1min":0.875,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.367,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1799999999999999,"15min":1.228},"min":{"1min":0.94399999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.458,"5min":2.02,"15min":2.02},"last":1.347}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.83899999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4990000000000001,"5min":1.804,"15min":1.804},"last":1.125},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2230000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5720000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.111}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2509999999999999,"15min":1.2929999999999999},"min":{"1min":1.034,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.6819999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.208,"15min":1.206},"min":{"1min":0.91600000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.083}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302880,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068960,"statfs":{"total":96636764160,"available":96326615040,"internally_reserved":0,"allocated":1531904,"data_stored":1008158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.68200000000000005},"min":{"1min":0.54400000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.57099999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98599999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.59999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96599999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.871},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0880000000000001,"5min":1.208,"15min":1.208},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.59399999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.88800000000000001,"15min":0.89000000000000001},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1339999999999999,"5min":1.204,"15min":1.204},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0249999999999999,"15min":1.0189999999999999},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.359,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.81899999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.99199999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.357,"5min":1.49,"15min":1.49},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.171,"5min":1.155,"15min":1.157},"min":{"1min":0.72199999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.95999999999999996}]},{"osd":6,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.212,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.665,"5min":1.696,"15min":1.696},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.1950000000000001,"15min":1.2110000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.5229999999999999,"5min":1.738,"15min":1.738},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Oct 6 05:29:34 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.4430000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.151,"5min":1.2110000000000001,"15min":1.2370000000000001},"min":{"1min":0.97799999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.468,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.81999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:30:03.191 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T05:30:03.191 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T05:30:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04ee45700 1 Processor -- start 2023-10-06T05:30:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04ee45700 1 -- start start 2023-10-06T05:30:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04ee45700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813ecb0 0x7fe048159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04ee45700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe04813f080 0x7fe04806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04ee45700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0480c7790 0x7fe04806dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04ee45700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0480c8930 con 0x7fe04813f080 2023-10-06T05:30:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04ee45700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0480688a0 con 0x7fe0480c7790 2023-10-06T05:30:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04ee45700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480c7d20 con 0x7fe04813ecb0 2023-10-06T05:30:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04de43700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813ecb0 0x7fe048159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04e644700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe0480c7790 0x7fe04806dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04de43700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813ecb0 0x7fe048159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:42862/0 (socket says 172.21.15.29:42862) 2023-10-06T05:30:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.344+0000 7fe04de43700 1 -- 172.21.15.29:0/356001480 learned_addr learned my addr 172.21.15.29:0/356001480 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04de43700 1 -- 172.21.15.29:0/356001480 >> v2:172.21.15.173:3300/0 conn(0x7fe0480c7790 msgr2=0x7fe04806dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04de43700 1 --2- 172.21.15.29:0/356001480 >> v2:172.21.15.173:3300/0 conn(0x7fe0480c7790 0x7fe04806dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04de43700 1 -- 172.21.15.29:0/356001480 >> v2:172.21.15.29:3300/0 conn(0x7fe04813f080 msgr2=0x7fe04806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:03.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04de43700 1 --2- 172.21.15.29:0/356001480 >> v2:172.21.15.29:3300/0 conn(0x7fe04813f080 0x7fe04806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04de43700 1 -- 172.21.15.29:0/356001480 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480c8000 con 0x7fe04813ecb0 2023-10-06T05:30:03.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04de43700 1 --2- 172.21.15.29:0/356001480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813ecb0 0x7fe048159a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe0480aee10 tx=0x7fe044009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41198e6365411afd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ce41700 1 -- 172.21.15.29:0/356001480 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400e070 con 0x7fe04813ecb0 2023-10-06T05:30:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ce41700 1 -- 172.21.15.29:0/356001480 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400ba20 con 0x7fe04813ecb0 2023-10-06T05:30:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ce41700 1 -- 172.21.15.29:0/356001480 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0440092e0 con 0x7fe04813ecb0 2023-10-06T05:30:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ee45700 1 -- 172.21.15.29:0/356001480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813ecb0 msgr2=0x7fe048159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ee45700 1 --2- 172.21.15.29:0/356001480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813ecb0 0x7fe048159a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe0480aee10 tx=0x7fe044009840 comp rx=0 tx=0).stop 2023-10-06T05:30:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ee45700 1 -- 172.21.15.29:0/356001480 shutdown_connections 2023-10-06T05:30:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ee45700 1 --2- 172.21.15.29:0/356001480 >> v2:172.21.15.173:3300/0 conn(0x7fe0480c7790 0x7fe04806dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ee45700 1 --2- 172.21.15.29:0/356001480 >> v2:172.21.15.29:3300/0 conn(0x7fe04813f080 0x7fe04806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ee45700 1 --2- 172.21.15.29:0/356001480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813ecb0 0x7fe048159a20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ee45700 1 -- 172.21.15.29:0/356001480 >> 172.21.15.29:0/356001480 conn(0x7fe0480c9830 msgr2=0x7fe04806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:03.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ee45700 1 -- 172.21.15.29:0/356001480 shutdown_connections 2023-10-06T05:30:03.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.348+0000 7fe04ee45700 1 -- 172.21.15.29:0/356001480 wait complete. 2023-10-06T05:30:03.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04ee45700 1 Processor -- start 2023-10-06T05:30:03.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04ee45700 1 -- start start 2023-10-06T05:30:03.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04ee45700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0480c7790 0x7fe048166610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04ee45700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe04813ecb0 0x7fe048155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04ee45700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813f080 0x7fe048155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04ee45700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048158c90 con 0x7fe0480c7790 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04ee45700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048166b50 con 0x7fe04813ecb0 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04ee45700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe048157bf0 con 0x7fe04813f080 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04de43700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0480c7790 0x7fe048166610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04de43700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0480c7790 0x7fe048166610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44826/0 (socket says 172.21.15.29:44826) 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04de43700 1 -- 172.21.15.29:0/3191371231 learned_addr learned my addr 172.21.15.29:0/3191371231 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04d642700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe04813ecb0 0x7fe048155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04e644700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813f080 0x7fe048155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04d642700 1 -- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813f080 msgr2=0x7fe048155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.352+0000 7fe04d642700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813f080 0x7fe048155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe04d642700 1 -- 172.21.15.29:0/3191371231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0480c7790 msgr2=0x7fe048166610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe04d642700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0480c7790 0x7fe048166610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe04d642700 1 -- 172.21.15.29:0/3191371231 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044009ae0 con 0x7fe04813ecb0 2023-10-06T05:30:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe04de43700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0480c7790 0x7fe048166610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe04d642700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe04813ecb0 0x7fe048155840 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe03800b610 tx=0x7fe0380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe03dffb700 1 -- 172.21.15.29:0/3191371231 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03800f510 con 0x7fe04813ecb0 2023-10-06T05:30:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe03dffb700 1 -- 172.21.15.29:0/3191371231 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03800f670 con 0x7fe04813ecb0 2023-10-06T05:30:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe048157ed0 con 0x7fe04813ecb0 2023-10-06T05:30:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe03dffb700 1 -- 172.21.15.29:0/3191371231 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03800fa30 con 0x7fe04813ecb0 2023-10-06T05:30:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe048158490 con 0x7fe04813ecb0 2023-10-06T05:30:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe03dffb700 1 -- 172.21.15.29:0/3191371231 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe03801a400 con 0x7fe04813ecb0 2023-10-06T05:30:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04804be00 con 0x7fe04813ecb0 2023-10-06T05:30:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.356+0000 7fe03dffb700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe02c060580 0x7fe02c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.360+0000 7fe03dffb700 1 -- 172.21.15.29:0/3191371231 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe03807c360 con 0x7fe04813ecb0 2023-10-06T05:30:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.360+0000 7fe04de43700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe02c060580 0x7fe02c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.360+0000 7fe04de43700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe02c060580 0x7fe02c062a30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe044009ab0 tx=0x7fe044018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:03.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.368+0000 7fe03dffb700 1 -- 172.21.15.29:0/3191371231 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe03804c7d0 con 0x7fe04813ecb0 2023-10-06T05:30:03.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.592+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe0480683c0 con 0x7fe04813ecb0 2023-10-06T05:30:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.600+0000 7fe03dffb700 1 -- 172.21.15.29:0/3191371231 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe03804fdf0 con 0x7fe04813ecb0 2023-10-06T05:30:03.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe02c060580 msgr2=0x7fe02c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe02c060580 0x7fe02c062a30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe044009ab0 tx=0x7fe044018000 comp rx=0 tx=0).stop 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe04813ecb0 msgr2=0x7fe048155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe04813ecb0 0x7fe048155840 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe03800b610 tx=0x7fe0380090f0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 shutdown_connections 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe04813f080 0x7fe048155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe02c060580 0x7fe02c062a30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe04813ecb0 0x7fe048155840 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 --2- 172.21.15.29:0/3191371231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0480c7790 0x7fe048166610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 >> 172.21.15.29:0/3191371231 conn(0x7fe0480c9830 msgr2=0x7fe04806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 shutdown_connections 2023-10-06T05:30:03.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.604+0000 7fe04ee45700 1 -- 172.21.15.29:0/3191371231 wait complete. 2023-10-06T05:30:03.613 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2023-10-06T05:30:03.627 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.728+0000 7fce18a03700 1 Processor -- start 2023-10-06T05:30:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.728+0000 7fce18a03700 1 -- start start 2023-10-06T05:30:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce18a03700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1406dde0 0x7fce14163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce18a03700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce14068de0 con 0x7fce14158cd0 2023-10-06T05:30:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce18a03700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce140681d0 con 0x7fce140cb0b0 2023-10-06T05:30:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce18a03700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce140684b0 con 0x7fce1406dde0 2023-10-06T05:30:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce12d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fce14158cd0 0x7fce14067710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56256/0 (socket says 172.21.15.29:56256) 2023-10-06T05:30:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce12d9d700 1 -- 172.21.15.29:0/287413800 learned_addr learned my addr 172.21.15.29:0/287413800 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:03.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce1359e700 1 --2- 172.21.15.29:0/287413800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1406dde0 0x7fce14163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce11d9b700 1 -- 172.21.15.29:0/287413800 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248591266 0 0) 0x7fce14068de0 con 0x7fce14158cd0 2023-10-06T05:30:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce11d9b700 1 -- 172.21.15.29:0/287413800 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdfc003570 con 0x7fce14158cd0 2023-10-06T05:30:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce11d9b700 1 -- 172.21.15.29:0/287413800 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462592919 0 0) 0x7fce140681d0 con 0x7fce140cb0b0 2023-10-06T05:30:03.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce11d9b700 1 -- 172.21.15.29:0/287413800 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce14068de0 con 0x7fce140cb0b0 2023-10-06T05:30:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce1359e700 1 -- 172.21.15.29:0/287413800 >> v1:172.21.15.173:6789/0 conn(0x7fce140cb0b0 legacy=0x7fce1406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce11d9b700 1 -- 172.21.15.29:0/287413800 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90248236 0 0) 0x7fcdfc003570 con 0x7fce14158cd0 2023-10-06T05:30:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce1359e700 1 -- 172.21.15.29:0/287413800 >> v1:172.21.15.29:6789/0 conn(0x7fce14158cd0 legacy=0x7fce14067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce1359e700 1 -- 172.21.15.29:0/287413800 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce14068790 con 0x7fce1406dde0 2023-10-06T05:30:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce1359e700 1 --2- 172.21.15.29:0/287413800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1406dde0 0x7fce14163d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009e90 tx=0x7fce0c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff2e31d466ddfcd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce11d9b700 1 -- 172.21.15.29:0/287413800 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00e070 con 0x7fce1406dde0 2023-10-06T05:30:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce11d9b700 1 -- 172.21.15.29:0/287413800 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c00bb80 con 0x7fce1406dde0 2023-10-06T05:30:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.732+0000 7fce11d9b700 1 -- 172.21.15.29:0/287413800 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c012430 con 0x7fce1406dde0 2023-10-06T05:30:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.736+0000 7fce18a03700 1 -- 172.21.15.29:0/287413800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1406dde0 msgr2=0x7fce14163d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.736+0000 7fce18a03700 1 --2- 172.21.15.29:0/287413800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1406dde0 0x7fce14163d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009e90 tx=0x7fce0c009780 comp rx=0 tx=0).stop 2023-10-06T05:30:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.736+0000 7fce18a03700 1 -- 172.21.15.29:0/287413800 shutdown_connections 2023-10-06T05:30:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.736+0000 7fce18a03700 1 --2- 172.21.15.29:0/287413800 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1406dde0 0x7fce14163d40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.736+0000 7fce18a03700 1 -- 172.21.15.29:0/287413800 >> 172.21.15.29:0/287413800 conn(0x7fce1406aaf0 msgr2=0x7fce1406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.736+0000 7fce18a03700 1 -- 172.21.15.29:0/287413800 shutdown_connections 2023-10-06T05:30:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.736+0000 7fce18a03700 1 -- 172.21.15.29:0/287413800 wait complete. 2023-10-06T05:30:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.736+0000 7fce18a03700 1 Processor -- start 2023-10-06T05:30:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.736+0000 7fce18a03700 1 -- start start 2023-10-06T05:30:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce18a03700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1406dde0 0x7fce14159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce18a03700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce14158cd0 0x7fce14168a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce18a03700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce1415cbb0 0x7fce14168fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce18a03700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1415b190 con 0x7fce1415cbb0 2023-10-06T05:30:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce18a03700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1415a610 con 0x7fce1406dde0 2023-10-06T05:30:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce18a03700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1415a8f0 con 0x7fce14158cd0 2023-10-06T05:30:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce1415cbb0 0x7fce14168fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce1415cbb0 0x7fce14168fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44834/0 (socket says 172.21.15.29:44834) 2023-10-06T05:30:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1359e700 1 -- 172.21.15.29:0/2425431723 learned_addr learned my addr 172.21.15.29:0/2425431723 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce12d9d700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1406dde0 0x7fce14159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1259c700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce14158cd0 0x7fce14168a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1359e700 1 -- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce14158cd0 msgr2=0x7fce14168a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1359e700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce14158cd0 0x7fce14168a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1359e700 1 -- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1406dde0 msgr2=0x7fce14159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1359e700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1406dde0 0x7fce14159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1359e700 1 -- 172.21.15.29:0/2425431723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c009a20 con 0x7fce1415cbb0 2023-10-06T05:30:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce1359e700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce1415cbb0 0x7fce14168fc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fce0c013000 tx=0x7fce0c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fcdfaffd700 1 -- 172.21.15.29:0/2425431723 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c01b420 con 0x7fce1415cbb0 2023-10-06T05:30:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fcdfaffd700 1 -- 172.21.15.29:0/2425431723 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c01b5a0 con 0x7fce1415cbb0 2023-10-06T05:30:03.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1415abd0 con 0x7fce1415cbb0 2023-10-06T05:30:03.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fcdfaffd700 1 -- 172.21.15.29:0/2425431723 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c01b960 con 0x7fce1415cbb0 2023-10-06T05:30:03.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce141597b0 con 0x7fce1415cbb0 2023-10-06T05:30:03.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.740+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1404be00 con 0x7fce1415cbb0 2023-10-06T05:30:03.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.744+0000 7fcdfaffd700 1 -- 172.21.15.29:0/2425431723 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fce0c01bd50 con 0x7fce1415cbb0 2023-10-06T05:30:03.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.744+0000 7fcdfaffd700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fce00060550 0x7fce00062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:03.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.744+0000 7fcdfaffd700 1 -- 172.21.15.29:0/2425431723 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce0c07e290 con 0x7fce1415cbb0 2023-10-06T05:30:03.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.744+0000 7fce12d9d700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fce00060550 0x7fce00062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:03.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.744+0000 7fce12d9d700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fce00060550 0x7fce00062a00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fce040011e0 tx=0x7fce04007d00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:03.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.752+0000 7fcdfaffd700 1 -- 172.21.15.29:0/2425431723 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fce0c04e730 con 0x7fce1415cbb0 2023-10-06T05:30:03.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.952+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce14068a70 con 0x7fce1415cbb0 2023-10-06T05:30:03.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.952+0000 7fcdfaffd700 1 -- 172.21.15.29:0/2425431723 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fce0c051d50 con 0x7fce1415cbb0 2023-10-06T05:30:03.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:03.958 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:29:56.535189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3515782118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3515782118},{"type":"v1","addr":"172.21.15.29:6835","nonce":3515782118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:03.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.952+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fce00060550 msgr2=0x7fce00062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.952+0000 7fce18a03700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fce00060550 0x7fce00062a00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fce040011e0 tx=0x7fce04007d00 comp rx=0 tx=0).stop 2023-10-06T05:30:03.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.952+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce1415cbb0 msgr2=0x7fce14168fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:03.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.952+0000 7fce18a03700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce1415cbb0 0x7fce14168fc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fce0c013000 tx=0x7fce0c019000 comp rx=0 tx=0).stop 2023-10-06T05:30:03.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.956+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 shutdown_connections 2023-10-06T05:30:03.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.956+0000 7fce18a03700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce1415cbb0 0x7fce14168fc0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.956+0000 7fce18a03700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce14158cd0 0x7fce14168a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.956+0000 7fce18a03700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fce00060550 0x7fce00062a00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.956+0000 7fce18a03700 1 --2- 172.21.15.29:0/2425431723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1406dde0 0x7fce14159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:03.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.956+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 >> 172.21.15.29:0/2425431723 conn(0x7fce1406aaf0 msgr2=0x7fce140c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:03.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.956+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 shutdown_connections 2023-10-06T05:30:03.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:03.956+0000 7fce18a03700 1 -- 172.21.15.29:0/2425431723 wait complete. 2023-10-06T05:30:03.962 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 41 2023-10-06T05:30:04.374 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:29:53.859418+0000', 'modified': '2023-10-06T05:29:56.535189+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6501}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6501': {'gid': 6501, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/3515782118', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 3515782118}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 3515782118}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:30:04.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T05:30:04.375 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T05:30:04.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7539127700 1 Processor -- start 2023-10-06T05:30:04.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7539127700 1 -- start start 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7539127700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f753415cd00 0x7f753415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7539127700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7534158a00 0x7f7534158e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7539127700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340cb000 con 0x7f75340c5d50 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7539127700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753406bb90 con 0x7f753415cd00 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7539127700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340caa80 con 0x7f7534158a00 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7533fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f753415cd00 0x7f753415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7538926700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7534158a00 0x7f7534158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f75337fe700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f75340c5d50 0x7f753406ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:41486/0 (socket says 172.21.15.29:41486) 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f7538926700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7534158a00 0x7f7534158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:55312/0 (socket says 172.21.15.29:55312) 2023-10-06T05:30:04.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.488+0000 7f75337fe700 1 -- 172.21.15.29:0/865212097 learned_addr learned my addr 172.21.15.29:0/865212097 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:04.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7538926700 1 -- 172.21.15.29:0/865212097 >> v2:172.21.15.29:3300/0 conn(0x7f753415cd00 msgr2=0x7f753415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7538926700 1 --2- 172.21.15.29:0/865212097 >> v2:172.21.15.29:3300/0 conn(0x7f753415cd00 0x7f753415d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7532ffd700 1 -- 172.21.15.29:0/865212097 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724752491 0 0) 0x7f75340cb000 con 0x7f75340c5d50 2023-10-06T05:30:04.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7538926700 1 -- 172.21.15.29:0/865212097 >> v1:172.21.15.173:6789/0 conn(0x7f75340c5d50 legacy=0x7f753406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7538926700 1 -- 172.21.15.29:0/865212097 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753406b340 con 0x7f7534158a00 2023-10-06T05:30:04.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7538926700 1 --2- 172.21.15.29:0/865212097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7534158a00 0x7f7534158e60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f752c009e60 tx=0x7f752c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f967166ad8490de4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7532ffd700 1 -- 172.21.15.29:0/865212097 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c00e070 con 0x7f7534158a00 2023-10-06T05:30:04.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7532ffd700 1 -- 172.21.15.29:0/865212097 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c00bb60 con 0x7f7534158a00 2023-10-06T05:30:04.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7532ffd700 1 -- 172.21.15.29:0/865212097 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c012430 con 0x7f7534158a00 2023-10-06T05:30:04.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7539127700 1 -- 172.21.15.29:0/865212097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7534158a00 msgr2=0x7f7534158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7539127700 1 --2- 172.21.15.29:0/865212097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7534158a00 0x7f7534158e60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f752c009e60 tx=0x7f752c009780 comp rx=0 tx=0).stop 2023-10-06T05:30:04.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7539127700 1 -- 172.21.15.29:0/865212097 shutdown_connections 2023-10-06T05:30:04.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7539127700 1 --2- 172.21.15.29:0/865212097 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7534158a00 0x7f7534158e60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7539127700 1 --2- 172.21.15.29:0/865212097 >> v2:172.21.15.29:3300/0 conn(0x7f753415cd00 0x7f753415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7539127700 1 -- 172.21.15.29:0/865212097 >> 172.21.15.29:0/865212097 conn(0x7f753406c6c0 msgr2=0x7f753406ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:04.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7539127700 1 -- 172.21.15.29:0/865212097 shutdown_connections 2023-10-06T05:30:04.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.492+0000 7f7539127700 1 -- 172.21.15.29:0/865212097 wait complete. 2023-10-06T05:30:04.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7539127700 1 Processor -- start 2023-10-06T05:30:04.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7539127700 1 -- start start 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7539127700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75340c5d50 0x7f75340c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7539127700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534158a00 0x7f753415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7539127700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f753415cd00 0x7f753415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7539127700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534159630 con 0x7f753415cd00 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7539127700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75341598d0 con 0x7f7534158a00 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7539127700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7534159bb0 con 0x7f75340c5d50 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7538926700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f753415cd00 0x7f753415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7538926700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f753415cd00 0x7f753415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38918/0 (socket says 172.21.15.29:38918) 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7538926700 1 -- 172.21.15.29:0/3361069650 learned_addr learned my addr 172.21.15.29:0/3361069650 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:04.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f75337fe700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534158a00 0x7f753415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.496+0000 7f7533fff700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75340c5d50 0x7f75340c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f7538926700 1 -- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75340c5d50 msgr2=0x7f75340c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f7538926700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75340c5d50 0x7f75340c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f7538926700 1 -- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534158a00 msgr2=0x7f753415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f7538926700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534158a00 0x7f753415a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f7538926700 1 -- 172.21.15.29:0/3361069650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c009a20 con 0x7f753415cd00 2023-10-06T05:30:04.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f75337fe700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534158a00 0x7f753415a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:04.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f7533fff700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75340c5d50 0x7f75340c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:04.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f7538926700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f753415cd00 0x7f753415abf0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f752c00b6c0 tx=0x7f752c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f752bfff700 1 -- 172.21.15.29:0/3361069650 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c012e90 con 0x7f753415cd00 2023-10-06T05:30:04.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f752bfff700 1 -- 172.21.15.29:0/3361069650 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c027470 con 0x7f753415cd00 2023-10-06T05:30:04.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f7539127700 1 -- 172.21.15.29:0/3361069650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534159e90 con 0x7f753415cd00 2023-10-06T05:30:04.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f752bfff700 1 -- 172.21.15.29:0/3361069650 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c027830 con 0x7f753415cd00 2023-10-06T05:30:04.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.500+0000 7f7539127700 1 -- 172.21.15.29:0/3361069650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753415b130 con 0x7f753415cd00 2023-10-06T05:30:04.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.504+0000 7f752bfff700 1 -- 172.21.15.29:0/3361069650 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f752c024070 con 0x7f753415cd00 2023-10-06T05:30:04.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.504+0000 7f752bfff700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7514060550 0x7f7514062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.504+0000 7f752bfff700 1 -- 172.21.15.29:0/3361069650 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f752c07f130 con 0x7f753415cd00 2023-10-06T05:30:04.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.504+0000 7f7533fff700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7514060550 0x7f7514062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.504+0000 7f7533fff700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7514060550 0x7f7514062a00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f751c0113e0 tx=0x7f751c0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 Processor -- start 2023-10-06T05:30:04.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 -- start start 2023-10-06T05:30:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x268d710 0x290ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26d8790 0x290b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2838f30 con 0x268dae0 2023-10-06T05:30:04.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2834ed0 con 0x268d710 2023-10-06T05:30:04.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x27fb0b0 con 0x26d8790 2023-10-06T05:30:04.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f7533fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f7533fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38932/0 (socket says 172.21.15.29:38932) 2023-10-06T05:30:04.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75337fe700 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x268d710 0x290ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f7538926700 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26d8790 0x290b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f7533fff700 1 -- 172.21.15.29:0/3391814052 learned_addr learned my addr 172.21.15.29:0/3391814052 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75337fe700 1 -- 172.21.15.29:0/3391814052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26d8790 msgr2=0x290b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75337fe700 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26d8790 0x290b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75337fe700 1 -- 172.21.15.29:0/3391814052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 msgr2=0x290a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75337fe700 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75337fe700 1 -- 172.21.15.29:0/3391814052 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26d99e0 con 0x268d710 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f7533fff700 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75337fe700 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x268d710 0x290ab70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7534154d80 tx=0x7f7524007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e450e67b655d32d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75297fa700 1 -- 172.21.15.29:0/3391814052 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524006a60 con 0x268d710 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75297fa700 1 -- 172.21.15.29:0/3391814052 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524007320 con 0x268d710 2023-10-06T05:30:04.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f75297fa700 1 -- 172.21.15.29:0/3391814052 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240076e0 con 0x268d710 2023-10-06T05:30:04.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 -- 172.21.15.29:0/3391814052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x268d710 msgr2=0x290ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x268d710 0x290ab70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7534154d80 tx=0x7f7524007d30 comp rx=0 tx=0).stop 2023-10-06T05:30:04.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 -- 172.21.15.29:0/3391814052 shutdown_connections 2023-10-06T05:30:04.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26d8790 0x290b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x268d710 0x290ab70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 --2- 172.21.15.29:0/3391814052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 -- 172.21.15.29:0/3391814052 >> 172.21.15.29:0/3391814052 conn(0x268deb0 msgr2=0x28c7060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:04.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 -- 172.21.15.29:0/3391814052 shutdown_connections 2023-10-06T05:30:04.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.508+0000 7f753c632740 1 -- 172.21.15.29:0/3391814052 wait complete. 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f753c632740 1 -- start start 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f753c632740 1 Processor -- start 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f753c632740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 0x290ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f753c632740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f753c632740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f753c632740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x27fad50 con 0x268dae0 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f753c632740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x27d3970 con 0x26d8790 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f753c632740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x27e6550 con 0x268d710 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f753c632740 10 client.0 _ll_register_callbacks cb 0x27d7b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75337fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f7533fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 0x290ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75337fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38948/0 (socket says 172.21.15.29:38948) 2023-10-06T05:30:04.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75337fe700 1 -- 172.21.15.29:0/1068192791 learned_addr learned my addr 172.21.15.29:0/1068192791 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:04.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f7538926700 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75337fe700 1 -- 172.21.15.29:0/1068192791 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 msgr2=0x290ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75337fe700 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 0x290ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75337fe700 1 -- 172.21.15.29:0/1068192791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 msgr2=0x28c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75337fe700 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75337fe700 1 -- 172.21.15.29:0/1068192791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c014440 con 0x268dae0 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75337fe700 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290f180 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7524007fd0 tx=0x7f7524018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e9a9029308e15d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75127fc700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75127fc700 1 -- 172.21.15.29:0/1068192791 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524000cb0 con 0x268dae0 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.512+0000 7f75127fc700 1 -- 172.21.15.29:0/1068192791 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f752401fc30 con 0x268dae0 2023-10-06T05:30:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 -- 172.21.15.29:0/1068192791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27d3cc0 con 0x268dae0 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f75127fc700 1 -- 172.21.15.29:0/1068192791 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75240062e0 con 0x268dae0 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 10 client.6666 fetch_fsmap learned FSMap version 41 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 -- 172.21.15.29:0/1068192791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x7f7524006c50 con 0x268dae0 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f75127fc700 1 -- 172.21.15.29:0/1068192791 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27d3cc0 con 0x268dae0 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f75127fc700 1 -- 172.21.15.29:0/1068192791 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 41) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7524012070 con 0x268dae0 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 10 client.6666 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 10 client.6666 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 20 client.6666 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x28c63b0 0x2919de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 4 client.6666 mds_command: new command op to 6501 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 -- 172.21.15.29:0/1068192791 --> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27d73e0 con 0x28c63b0 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f7533fff700 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x28c63b0 0x2919de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f75127fc700 10 client.6666 ms_handle_connect on v2:172.21.15.29:6834/3515782118 2023-10-06T05:30:04.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f7533fff700 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x28c63b0 0x2919de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79ff73a37c05dd25 server_cookie=2fcf009bbf2673c9 in_seq=0 out_seq=0 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f75127fc700 1 -- 172.21.15.29:0/1068192791 <== mds.0 v2:172.21.15.29:6834/3515782118 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x27d73e0 con 0x28c63b0 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f75127fc700 10 client.6666 handle_command_reply: tid=0 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 client.6666 shutdown 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 -- 172.21.15.29:0/1068192791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 msgr2=0x290f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290f180 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7524007fd0 tx=0x7f7524018000 comp rx=0 tx=0).stop 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 -- 172.21.15.29:0/1068192791 shutdown_connections 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x28c63b0 0x2919de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f75127fc700 0 client.6666 ms_handle_reset on v2:172.21.15.29:6834/3515782118 2023-10-06T05:30:04.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x290f180 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 --2- 172.21.15.29:0/1068192791 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 0x290ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 -- 172.21.15.29:0/1068192791 >> 172.21.15.29:0/1068192791 conn(0x268deb0 msgr2=0x28ee1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:04.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 -- 172.21.15.29:0/1068192791 shutdown_connections 2023-10-06T05:30:04.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 1 -- 172.21.15.29:0/1068192791 wait complete. 2023-10-06T05:30:04.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.516+0000 7f753c632740 20 client.6666 trim_cache size 0 max 16384 2023-10-06T05:30:04.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f753c632740 1 Processor -- start 2023-10-06T05:30:04.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f753c632740 1 -- start start 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f753c632740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 0x28c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f753c632740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x28c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f753c632740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f753c632740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x27067c0 con 0x268dae0 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f753c632740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2837590 con 0x26d8790 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f753c632740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x270a650 con 0x268d710 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f75337fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x28c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f75337fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x28c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38954/0 (socket says 172.21.15.29:38954) 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f75337fe700 1 -- 172.21.15.29:0/1071070678 learned_addr learned my addr 172.21.15.29:0/1071070678 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f7533fff700 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 0x28c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f7538926700 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f75337fe700 1 -- 172.21.15.29:0/1071070678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 msgr2=0x28c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f75337fe700 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 0x28c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f75337fe700 1 -- 172.21.15.29:0/1071070678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 msgr2=0x28e9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f75337fe700 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f75337fe700 1 -- 172.21.15.29:0/1071070678 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340cb880 con 0x268dae0 2023-10-06T05:30:04.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f7538926700 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:04.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f75337fe700 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x28c6cc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7524007b30 tx=0x7f7524021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f04697b595a020 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f7529ffb700 1 -- 172.21.15.29:0/1071070678 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524006680 con 0x268dae0 2023-10-06T05:30:04.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f7529ffb700 1 -- 172.21.15.29:0/1071070678 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75240062e0 con 0x268dae0 2023-10-06T05:30:04.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.540+0000 7f7529ffb700 1 -- 172.21.15.29:0/1071070678 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524004a60 con 0x268dae0 2023-10-06T05:30:04.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 -- 172.21.15.29:0/1071070678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 msgr2=0x28c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x28c6cc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7524007b30 tx=0x7f7524021040 comp rx=0 tx=0).stop 2023-10-06T05:30:04.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 -- 172.21.15.29:0/1071070678 shutdown_connections 2023-10-06T05:30:04.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268dae0 0x28c6cc0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 --2- 172.21.15.29:0/1071070678 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268d710 0x28c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 -- 172.21.15.29:0/1071070678 >> 172.21.15.29:0/1071070678 conn(0x268deb0 msgr2=0x28bf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:04.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 -- 172.21.15.29:0/1071070678 shutdown_connections 2023-10-06T05:30:04.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 -- 172.21.15.29:0/1071070678 wait complete. 2023-10-06T05:30:04.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 -- start start 2023-10-06T05:30:04.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.544+0000 7f753c632740 1 Processor -- start 2023-10-06T05:30:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268d710 0x28e9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268dae0 0x28e9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2809610 con 0x268d710 2023-10-06T05:30:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2839ef0 con 0x26d8790 2023-10-06T05:30:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x27fe400 con 0x268dae0 2023-10-06T05:30:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7533fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268d710 0x28e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 10 client.0 _ll_register_callbacks cb 0x2800110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7533fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268d710 0x28e9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38964/0 (socket says 172.21.15.29:38964) 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7533fff700 1 -- 172.21.15.29:0/1977775537 learned_addr learned my addr 172.21.15.29:0/1977775537 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7538926700 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f75337fe700 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268dae0 0x28e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7533fff700 1 -- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268dae0 msgr2=0x28e9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7533fff700 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268dae0 0x28e9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7533fff700 1 -- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 msgr2=0x28e9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7533fff700 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7533fff700 1 -- 172.21.15.29:0/1977775537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524006c50 con 0x268d710 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f75337fe700 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268dae0 0x28e9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7538926700 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f7533fff700 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268d710 0x28e9210 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f751c011b30 tx=0x7f751c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a81f7ad8b55d4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f75127fc700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:30:04.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f75127fc700 1 -- 172.21.15.29:0/1977775537 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c026040 con 0x268d710 2023-10-06T05:30:04.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f75127fc700 1 -- 172.21.15.29:0/1977775537 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f751c01a040 con 0x268d710 2023-10-06T05:30:04.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 -- 172.21.15.29:0/1977775537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7524007320 con 0x268d710 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f75127fc700 1 -- 172.21.15.29:0/1977775537 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f751c036e70 con 0x268d710 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 10 client.6672 fetch_fsmap learned FSMap version 41 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 -- 172.21.15.29:0/1977775537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x2803370 con 0x268d710 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f75127fc700 1 -- 172.21.15.29:0/1977775537 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524007320 con 0x268d710 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f75127fc700 1 -- 172.21.15.29:0/1977775537 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 41) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f751c02cbd0 con 0x268d710 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 10 client.6672 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 10 client.6672 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 20 client.6672 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x296aa90 0x296ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 4 client.6672 mds_command: new command op to 6501 tid=0[{"prefix": "status"}] 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f753c632740 1 -- 172.21.15.29:0/1977775537 --> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2809410 con 0x296aa90 2023-10-06T05:30:04.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.548+0000 7f75337fe700 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x296aa90 0x296ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f75127fc700 10 client.6672 ms_handle_connect on v2:172.21.15.29:6834/3515782118 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f75337fe700 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x296aa90 0x296ce70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36f93c02edc19d8e server_cookie=9fb391470d44951 in_seq=0 out_seq=0 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f75127fc700 1 -- 172.21.15.29:0/1977775537 <== mds.0 v2:172.21.15.29:6834/3515782118 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x2809410 con 0x296aa90 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f75127fc700 10 client.6672 handle_command_reply: tid=0 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 client.6672 shutdown 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 -- 172.21.15.29:0/1977775537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268d710 msgr2=0x28e9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268d710 0x28e9210 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f751c011b30 tx=0x7f751c016000 comp rx=0 tx=0).stop 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 -- 172.21.15.29:0/1977775537 shutdown_connections 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x296aa90 0x296ce70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26d8790 0x28e9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f75127fc700 0 client.6672 ms_handle_reset on v2:172.21.15.29:6834/3515782118 2023-10-06T05:30:04.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x268dae0 0x28e9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 --2- 172.21.15.29:0/1977775537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x268d710 0x28e9210 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 -- 172.21.15.29:0/1977775537 >> 172.21.15.29:0/1977775537 conn(0x268deb0 msgr2=0x28eea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 -- 172.21.15.29:0/1977775537 shutdown_connections 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 1 -- 172.21.15.29:0/1977775537 wait complete. 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f753c632740 20 client.6672 trim_cache size 0 max 16384 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "bd99696d-d9bf-47c8-93f5-f978334ae590", 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6501, 2023-10-06T05:30:04.561 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-06T05:30:04.562 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-06T05:30:04.562 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-06T05:30:04.562 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 10.061966268000001, 2023-10-06T05:30:04.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 41, 2023-10-06T05:30:04.562 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 77, 2023-10-06T05:30:04.562 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 77, 2023-10-06T05:30:04.562 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 16.041854379 2023-10-06T05:30:04.562 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:04.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 -- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7514060550 msgr2=0x7f7514062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7514060550 0x7f7514062a00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f751c0113e0 tx=0x7f751c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 -- 172.21.15.29:0/3361069650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f753415cd00 msgr2=0x7f753415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f753415cd00 0x7f753415abf0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f752c00b6c0 tx=0x7f752c019000 comp rx=0 tx=0).stop 2023-10-06T05:30:04.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 -- 172.21.15.29:0/3361069650 shutdown_connections 2023-10-06T05:30:04.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f753415cd00 0x7f753415abf0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7514060550 0x7f7514062a00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534158a00 0x7f753415a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 --2- 172.21.15.29:0/3361069650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75340c5d50 0x7f75340c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 -- 172.21.15.29:0/3361069650 >> 172.21.15.29:0/3361069650 conn(0x7f753406c6c0 msgr2=0x7f75340cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:04.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 -- 172.21.15.29:0/3361069650 shutdown_connections 2023-10-06T05:30:04.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.552+0000 7f7539127700 1 -- 172.21.15.29:0/3361069650 wait complete. 2023-10-06T05:30:04.576 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:30:04.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.684+0000 7fe70a3db700 1 Processor -- start 2023-10-06T05:30:04.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.684+0000 7fe70a3db700 1 -- start start 2023-10-06T05:30:04.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.684+0000 7fe70a3db700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe70406c8f0 0x7fe70406b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.684+0000 7fe70a3db700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe704159750 0x7fe7040c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.684+0000 7fe70a3db700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70406aef0 con 0x7fe70406ccc0 2023-10-06T05:30:04.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.684+0000 7fe70a3db700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7040c8080 con 0x7fe704159750 2023-10-06T05:30:04.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.684+0000 7fe70a3db700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70406a2e0 con 0x7fe70406c8f0 2023-10-06T05:30:04.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe709bda700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe704159750 0x7fe7040c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe708bd8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe70406ccc0 0x7fe7040c7970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58856/0 (socket says 172.21.15.29:58856) 2023-10-06T05:30:04.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe708bd8700 1 -- 172.21.15.29:0/1086320020 learned_addr learned my addr 172.21.15.29:0/1086320020 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:04.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe7093d9700 1 --2- 172.21.15.29:0/1086320020 >> v2:172.21.15.173:3300/0 conn(0x7fe70406c8f0 0x7fe70406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe709bda700 1 -- 172.21.15.29:0/1086320020 >> v2:172.21.15.173:3300/0 conn(0x7fe70406c8f0 msgr2=0x7fe70406b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe709bda700 1 --2- 172.21.15.29:0/1086320020 >> v2:172.21.15.173:3300/0 conn(0x7fe70406c8f0 0x7fe70406b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe709bda700 1 -- 172.21.15.29:0/1086320020 >> v1:172.21.15.29:6789/0 conn(0x7fe70406ccc0 legacy=0x7fe7040c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe709bda700 1 -- 172.21.15.29:0/1086320020 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70406a5c0 con 0x7fe704159750 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe7093d9700 1 --2- 172.21.15.29:0/1086320020 >> v2:172.21.15.173:3300/0 conn(0x7fe70406c8f0 0x7fe70406b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe709bda700 1 --2- 172.21.15.29:0/1086320020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe704159750 0x7fe7040c94a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe70406dec0 tx=0x7fe6fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a73bb6ade90dcb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe6fbfff700 1 -- 172.21.15.29:0/1086320020 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00bc30 con 0x7fe704159750 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe6fbfff700 1 -- 172.21.15.29:0/1086320020 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc00bd90 con 0x7fe704159750 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe6fbfff700 1 -- 172.21.15.29:0/1086320020 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc0116b0 con 0x7fe704159750 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe70a3db700 1 -- 172.21.15.29:0/1086320020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe704159750 msgr2=0x7fe7040c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe70a3db700 1 --2- 172.21.15.29:0/1086320020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe704159750 0x7fe7040c94a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe70406dec0 tx=0x7fe6fc009780 comp rx=0 tx=0).stop 2023-10-06T05:30:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe70a3db700 1 -- 172.21.15.29:0/1086320020 shutdown_connections 2023-10-06T05:30:04.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe70a3db700 1 --2- 172.21.15.29:0/1086320020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe704159750 0x7fe7040c94a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe70a3db700 1 --2- 172.21.15.29:0/1086320020 >> v2:172.21.15.173:3300/0 conn(0x7fe70406c8f0 0x7fe70406b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe70a3db700 1 -- 172.21.15.29:0/1086320020 >> 172.21.15.29:0/1086320020 conn(0x7fe7040670a0 msgr2=0x7fe7040674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:04.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe70a3db700 1 -- 172.21.15.29:0/1086320020 shutdown_connections 2023-10-06T05:30:04.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.688+0000 7fe70a3db700 1 -- 172.21.15.29:0/1086320020 wait complete. 2023-10-06T05:30:04.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 Processor -- start 2023-10-06T05:30:04.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 -- start start 2023-10-06T05:30:04.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe70406c8f0 0x7fe7040a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70406ccc0 0x7fe7040b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe704159750 0x7fe70416c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040aa320 con 0x7fe70406ccc0 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040a8d40 con 0x7fe70406c8f0 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040a9020 con 0x7fe704159750 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe708bd8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70406ccc0 0x7fe7040b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe708bd8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70406ccc0 0x7fe7040b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38978/0 (socket says 172.21.15.29:38978) 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe708bd8700 1 -- 172.21.15.29:0/2167721231 learned_addr learned my addr 172.21.15.29:0/2167721231 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe7093d9700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe70406c8f0 0x7fe7040a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe709bda700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe704159750 0x7fe70416c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe708bd8700 1 -- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe704159750 msgr2=0x7fe70416c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe708bd8700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe704159750 0x7fe70416c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe708bd8700 1 -- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe70406c8f0 msgr2=0x7fe7040a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe708bd8700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe70406c8f0 0x7fe7040a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe708bd8700 1 -- 172.21.15.29:0/2167721231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc009a20 con 0x7fe70406ccc0 2023-10-06T05:30:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe709bda700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe704159750 0x7fe70416c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:30:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe708bd8700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70406ccc0 0x7fe7040b11b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c7c0 tx=0x7fe700007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe6f97fa700 1 -- 172.21.15.29:0/2167721231 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700005b30 con 0x7fe70406ccc0 2023-10-06T05:30:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe6f97fa700 1 -- 172.21.15.29:0/2167721231 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700005cb0 con 0x7fe70406ccc0 2023-10-06T05:30:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7040a9300 con 0x7fe70406ccc0 2023-10-06T05:30:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe6f97fa700 1 -- 172.21.15.29:0/2167721231 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700004a80 con 0x7fe70406ccc0 2023-10-06T05:30:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7040a98c0 con 0x7fe70406ccc0 2023-10-06T05:30:04.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.692+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7040a9ae0 con 0x7fe70406ccc0 2023-10-06T05:30:04.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.696+0000 7fe6f97fa700 1 -- 172.21.15.29:0/2167721231 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe7000070f0 con 0x7fe70406ccc0 2023-10-06T05:30:04.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.696+0000 7fe6f97fa700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe6e8060550 0x7fe6e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:04.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.696+0000 7fe6f97fa700 1 -- 172.21.15.29:0/2167721231 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe70007bc90 con 0x7fe70406ccc0 2023-10-06T05:30:04.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.696+0000 7fe7093d9700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe6e8060550 0x7fe6e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:04.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.696+0000 7fe7093d9700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe6e8060550 0x7fe6e8062a00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4006f00 tx=0x7fe6f4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:04.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.708+0000 7fe6f97fa700 1 -- 172.21.15.29:0/2167721231 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe70004abe0 con 0x7fe70406ccc0 2023-10-06T05:30:04.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.904+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe70404be00 con 0x7fe70406ccc0 2023-10-06T05:30:04.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe6f97fa700 1 -- 172.21.15.29:0/2167721231 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe700018020 con 0x7fe70406ccc0 2023-10-06T05:30:04.912 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:30:04.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe6e8060550 msgr2=0x7fe6e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe6e8060550 0x7fe6e8062a00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4006f00 tx=0x7fe6f4008040 comp rx=0 tx=0).stop 2023-10-06T05:30:04.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70406ccc0 msgr2=0x7fe7040b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:04.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70406ccc0 0x7fe7040b11b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c7c0 tx=0x7fe700007f70 comp rx=0 tx=0).stop 2023-10-06T05:30:04.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 shutdown_connections 2023-10-06T05:30:04.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe704159750 0x7fe70416c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe70406ccc0 0x7fe7040b11b0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe6e8060550 0x7fe6e8062a00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 --2- 172.21.15.29:0/2167721231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe70406c8f0 0x7fe7040a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:04.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 >> 172.21.15.29:0/2167721231 conn(0x7fe7040670a0 msgr2=0x7fe7041528b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:04.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 shutdown_connections 2023-10-06T05:30:04.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:04.908+0000 7fe70a3db700 1 -- 172.21.15.29:0/2167721231 wait complete. 2023-10-06T05:30:04.927 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:30:04.927 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:30:04.927 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:30:04.927 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T05:30:04.927 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:04.927 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:30:04.927 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:30:04.927 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:30:04.927 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:04.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:04.928 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:30:04.936 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:30:04.936 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:30:04.936 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:30:04.936 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:04.936 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42323sec preferred_lft 42323sec 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:04.937 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::38dc:3fff:fed0:feb0/64 scope link 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:04.938 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:30:04.939 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:30:04.939 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c88:ceff:fe77:b613/64 scope link 2023-10-06T05:30:04.939 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:04.939 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:30:04.939 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether aa:ad:a4:57:7d:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:30:04.939 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a8ad:a4ff:fe57:7d6d/64 scope link 2023-10-06T05:30:04.939 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:04.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:04.939 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:30:04.954 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:30:04.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:04.956 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:30:05.009 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:30:05.009 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:30:05.009 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:30:05.009 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:30:05.009 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:30:05.009 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:30:05.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:05.010 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:30:05.010 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:30:05.010 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:30:05.010 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:30:05.010 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:30:05.010 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:30:05.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:05.053 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:30:05.060 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T05:30:05.061 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:30:05.061 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:05.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:05.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-06T05:30:05.075 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T05:30:05.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:30:05.075 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:05.123 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:05.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:30:05.123 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:05.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:05.147 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:05.147 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:05.205 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:05.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:05.206 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:05.213 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:30:05.213 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T05:30:05.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:05.234 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:05.234 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:05.248 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:05.249 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:05.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:05.250 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:05.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2023-10-06T05:30:05.292+0000 7fa83a713380 -1 init, newargv = 0x56281a934e30 newargc=15 2023-10-06T05:30:05.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[48267]: starting ceph client 2023-10-06T05:30:05.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[48267]: starting fuse 2023-10-06T05:30:06.356 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:06.375 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:06.376 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:06.432 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:06.432 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:06.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:06.433 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:06.441 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:30:06.441 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:30:06.441 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:06.441 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:30:06.441 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:30:06.441 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:06.441 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:30:06.441 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:06.441 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:30:06.442 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:30:06.443 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:30:06.443 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:30:06.443 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:30:06.443 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:30:06.443 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:06.443 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2023-10-06T05:30:06.443 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:06.528 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.48267.asok 2023-10-06T05:30:06.714 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48267.asok 2023-10-06T05:30:06.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:06.714 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48267.asok status 2023-10-06T05:30:06.855 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:06.855 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:30:06.855 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:30:06.855 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:30:06.855 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2023-10-06T05:30:06.855 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:30:06.855 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "48267", 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6687, 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 6687 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:06.856 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3329459593 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3329459593 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.6687 172.21.15.29:0/3329459593", 2023-10-06T05:30:06.857 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "172.21.15.29:0/3329459593", 2023-10-06T05:30:06.858 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:30:06.858 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 41, 2023-10-06T05:30:06.858 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 77, 2023-10-06T05:30:06.858 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:30:06.858 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:30:06.858 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:30:06.858 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:06.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:06.864 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:30:06.864 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:06.870 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:30:06.871 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:06.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:06.871 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:06.888 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:06.888 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:06.888 DEBUG:teuthology.orchestra.run.smithi029:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:30:06.888 DEBUG:teuthology.orchestra.run.smithi029:> parent = os.path.join(mount_point, "parent") 2023-10-06T05:30:06.888 DEBUG:teuthology.orchestra.run.smithi029:> os.mkdir(parent) 2023-10-06T05:30:06.889 DEBUG:teuthology.orchestra.run.smithi029:> flushed = os.path.join(parent, "flushed") 2023-10-06T05:30:06.889 DEBUG:teuthology.orchestra.run.smithi029:> os.mkdir(flushed) 2023-10-06T05:30:06.889 DEBUG:teuthology.orchestra.run.smithi029:> for f in ["alpha", "bravo", "charlie"]: 2023-10-06T05:30:06.889 DEBUG:teuthology.orchestra.run.smithi029:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2023-10-06T05:30:06.889 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:07.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:07.145 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T05:30:07.222 INFO:teuthology.orchestra.run.smithi029.stdout:./ 2023-10-06T05:30:07.222 INFO:teuthology.orchestra.run.smithi029.stdout:./parent 2023-10-06T05:30:07.223 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed 2023-10-06T05:30:07.223 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed/charlie 2023-10-06T05:30:07.223 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed/alpha 2023-10-06T05:30:07.223 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed/bravo 2023-10-06T05:30:07.225 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:07.225 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:07.225 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:07.225 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:07.225 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T05:30:07.226 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:07.297 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:30:07.487 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:07.487 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:07.487 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:07.487 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:07.487 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2023-10-06T05:30:07.487 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:07.557 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627776 2023-10-06T05:30:07.744 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:07.744 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:07.745 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:07.745 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:07.745 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2023-10-06T05:30:07.745 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:07.857 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627777 2023-10-06T05:30:08.045 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:08.045 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:08.045 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:08.046 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:08.046 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2023-10-06T05:30:08.046 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:08.116 INFO:teuthology.orchestra.run.smithi029.stdout:1099511628280 2023-10-06T05:30:08.306 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:08.306 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:08.306 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:08.306 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:08.306 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2023-10-06T05:30:08.306 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:08.374 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627778 2023-10-06T05:30:08.564 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:08.564 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:08.564 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:08.564 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:08.564 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2023-10-06T05:30:08.564 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:08.632 INFO:teuthology.orchestra.run.smithi029.stdout:1099511628279 2023-10-06T05:30:08.822 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:30:08.822 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:30:08.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:08.879 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[48267]: fuse finished with error 0 and tester_r 0 2023-10-06T05:30:08.880 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:30:10.417 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:30:10.420 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:30:14.982 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:30:14.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:14.982 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:30:14.991 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2023-10-06T05:30:15.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f235c94f700 1 Processor -- start 2023-10-06T05:30:15.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f235c94f700 1 -- start start 2023-10-06T05:30:15.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f235c94f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2358155460 0x7f235806af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f235c94f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f235806cdd0 0x7f235806b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f235c94f700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23581591e0 con 0x7f2358155830 2023-10-06T05:30:15.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f235c94f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23580c8ca0 con 0x7f235806cdd0 2023-10-06T05:30:15.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f235c94f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2358159a80 con 0x7f2358155460 2023-10-06T05:30:15.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f2356d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f235806cdd0 0x7f235806b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f2356d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f235806cdd0 0x7f235806b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58424/0 (socket says 172.21.15.29:58424) 2023-10-06T05:30:15.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f2356d9d700 1 -- 172.21.15.29:0/1328259495 learned_addr learned my addr 172.21.15.29:0/1328259495 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:15.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.148+0000 7f235659c700 1 --2- 172.21.15.29:0/1328259495 >> v2:172.21.15.173:3300/0 conn(0x7f2358155460 0x7f235806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f2356d9d700 1 -- 172.21.15.29:0/1328259495 >> v2:172.21.15.173:3300/0 conn(0x7f2358155460 msgr2=0x7f235806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f2356d9d700 1 --2- 172.21.15.29:0/1328259495 >> v2:172.21.15.173:3300/0 conn(0x7f2358155460 0x7f235806af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f2356d9d700 1 -- 172.21.15.29:0/1328259495 >> v1:172.21.15.173:6789/0 conn(0x7f2358155830 legacy=0x7f235806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f2356d9d700 1 -- 172.21.15.29:0/1328259495 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235806d380 con 0x7f235806cdd0 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f2356d9d700 1 --2- 172.21.15.29:0/1328259495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f235806cdd0 0x7f235806b4b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f235806ab10 tx=0x7f2350009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb25a42b9c18234 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235559a700 1 -- 172.21.15.29:0/1328259495 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350009e70 con 0x7f235806cdd0 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235559a700 1 -- 172.21.15.29:0/1328259495 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235000b860 con 0x7f235806cdd0 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235559a700 1 -- 172.21.15.29:0/1328259495 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000bc00 con 0x7f235806cdd0 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 -- 172.21.15.29:0/1328259495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f235806cdd0 msgr2=0x7f235806b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 --2- 172.21.15.29:0/1328259495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f235806cdd0 0x7f235806b4b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f235806ab10 tx=0x7f2350009250 comp rx=0 tx=0).stop 2023-10-06T05:30:15.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 -- 172.21.15.29:0/1328259495 shutdown_connections 2023-10-06T05:30:15.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 --2- 172.21.15.29:0/1328259495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f235806cdd0 0x7f235806b4b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 --2- 172.21.15.29:0/1328259495 >> v2:172.21.15.173:3300/0 conn(0x7f2358155460 0x7f235806af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 -- 172.21.15.29:0/1328259495 >> 172.21.15.29:0/1328259495 conn(0x7f23580cd0e0 msgr2=0x7f23580c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:15.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 -- 172.21.15.29:0/1328259495 shutdown_connections 2023-10-06T05:30:15.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 -- 172.21.15.29:0/1328259495 wait complete. 2023-10-06T05:30:15.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 Processor -- start 2023-10-06T05:30:15.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 -- start start 2023-10-06T05:30:15.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.152+0000 7f235c94f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235806cdd0 0x7f23580abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f235c94f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2358155460 0x7f2358151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f235c94f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2358155830 0x7f2358151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f235c94f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2358151fe0 con 0x7f2358155460 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f235c94f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580b0e50 con 0x7f235806cdd0 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f235c94f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580b0520 con 0x7f2358155830 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2355d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2358155460 0x7f2358151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2355d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2358155460 0x7f2358151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58434/0 (socket says 172.21.15.29:58434) 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2355d9b700 1 -- 172.21.15.29:0/835048739 learned_addr learned my addr 172.21.15.29:0/835048739 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f235659c700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235806cdd0 0x7f23580abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2356d9d700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2358155830 0x7f2358151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2355d9b700 1 -- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2358155830 msgr2=0x7f2358151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2355d9b700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2358155830 0x7f2358151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2355d9b700 1 -- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235806cdd0 msgr2=0x7f23580abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2355d9b700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235806cdd0 0x7f23580abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2355d9b700 1 -- 172.21.15.29:0/835048739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500094f0 con 0x7f2358155460 2023-10-06T05:30:15.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2356d9d700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2358155830 0x7f2358151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:15.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f2355d9b700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2358155460 0x7f2358151560 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f234c00c5c0 tx=0x7f234c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f23467fc700 1 -- 172.21.15.29:0/835048739 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c011590 con 0x7f2358155460 2023-10-06T05:30:15.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f23467fc700 1 -- 172.21.15.29:0/835048739 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234c011710 con 0x7f2358155460 2023-10-06T05:30:15.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f23467fc700 1 -- 172.21.15.29:0/835048739 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c011ad0 con 0x7f2358155460 2023-10-06T05:30:15.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f235c94f700 1 -- 172.21.15.29:0/835048739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23580b0800 con 0x7f2358155460 2023-10-06T05:30:15.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.156+0000 7f235c94f700 1 -- 172.21.15.29:0/835048739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2358145e10 con 0x7f2358155460 2023-10-06T05:30:15.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.160+0000 7f23467fc700 1 -- 172.21.15.29:0/835048739 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f234c01a360 con 0x7f2358155460 2023-10-06T05:30:15.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.160+0000 7f23467fc700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2338060550 0x7f2338062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.160+0000 7f23467fc700 1 -- 172.21.15.29:0/835048739 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f234c07b870 con 0x7f2358155460 2023-10-06T05:30:15.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.160+0000 7f235659c700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2338060550 0x7f2338062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.160+0000 7f235659c700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2338060550 0x7f2338062a00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2348009fd0 tx=0x7f234800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235ebf8740 1 Processor -- start 2023-10-06T05:30:15.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235ebf8740 1 -- start start 2023-10-06T05:30:15.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1af7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 0x1af7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1af8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235ebf8740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6f0f0 con 0x18c3c10 2023-10-06T05:30:15.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235ebf8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6aee0 con 0x18c3840 2023-10-06T05:30:15.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235ebf8740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a31020 con 0x190e8c0 2023-10-06T05:30:15.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1af7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1af7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58446/0 (socket says 172.21.15.29:58446) 2023-10-06T05:30:15.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235659c700 1 -- 172.21.15.29:0/2714944330 learned_addr learned my addr 172.21.15.29:0/2714944330 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:15.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f2355d9b700 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 0x1af7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f2356d9d700 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1af8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235659c700 1 -- 172.21.15.29:0/2714944330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 msgr2=0x1af8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:15.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235659c700 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1af8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235659c700 1 -- 172.21.15.29:0/2714944330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 msgr2=0x1af7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:15.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235659c700 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 0x1af7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235659c700 1 -- 172.21.15.29:0/2714944330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x190fb10 con 0x18c3c10 2023-10-06T05:30:15.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f2356d9d700 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1af8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:15.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f235659c700 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1af7730 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f2348017790 tx=0x7f2348019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a72fb0c3bb6405 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f23377fe700 1 -- 172.21.15.29:0/2714944330 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234801c040 con 0x18c3c10 2023-10-06T05:30:15.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f23377fe700 1 -- 172.21.15.29:0/2714944330 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234800f040 con 0x18c3c10 2023-10-06T05:30:15.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.164+0000 7f23377fe700 1 -- 172.21.15.29:0/2714944330 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234800e040 con 0x18c3c10 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- 172.21.15.29:0/2714944330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 msgr2=0x1af7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1af7730 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f2348017790 tx=0x7f2348019000 comp rx=0 tx=0).stop 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- 172.21.15.29:0/2714944330 shutdown_connections 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1af8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 0x1af7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2714944330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1af7730 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- 172.21.15.29:0/2714944330 >> 172.21.15.29:0/2714944330 conn(0x18c3fe0 msgr2=0x1b23fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- 172.21.15.29:0/2714944330 shutdown_connections 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- 172.21.15.29:0/2714944330 wait complete. 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- start start 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 Processor -- start 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3840 0x1afd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3c10 0x1afb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1afbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a30cc0 con 0x18c3840 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a09820 con 0x18c3c10 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a143c0 con 0x190e8c0 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 10 client.0 _ll_register_callbacks cb 0x1a0db90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3840 0x1afd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3840 0x1afd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58458/0 (socket says 172.21.15.29:58458) 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235659c700 1 -- 172.21.15.29:0/2068437740 learned_addr learned my addr 172.21.15.29:0/2068437740 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f2356d9d700 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1afbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f2355d9b700 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3c10 0x1afb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235659c700 1 -- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 msgr2=0x1afbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235659c700 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1afbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235659c700 1 -- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3c10 msgr2=0x1afb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235659c700 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3c10 0x1afb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235659c700 1 -- 172.21.15.29:0/2068437740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2348017440 con 0x18c3840 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f2356d9d700 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1afbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f2355d9b700 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3c10 0x1afb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235659c700 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3840 0x1afd870 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2348009870 tx=0x7f234801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550cf79eb8774ecd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f2334ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f2334ff9700 1 -- 172.21.15.29:0/2068437740 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234800e070 con 0x18c3840 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f2334ff9700 1 -- 172.21.15.29:0/2068437740 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23480156f0 con 0x18c3840 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.168+0000 7f235ebf8740 1 -- 172.21.15.29:0/2068437740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a23a10 con 0x18c3840 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f2334ff9700 1 -- 172.21.15.29:0/2068437740 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2348022890 con 0x18c3840 2023-10-06T05:30:15.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 10 client.6699 fetch_fsmap learned FSMap version 41 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 -- 172.21.15.29:0/2068437740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x1a39220 con 0x18c3840 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f2334ff9700 1 -- 172.21.15.29:0/2068437740 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a23a10 con 0x18c3840 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f2334ff9700 1 -- 172.21.15.29:0/2068437740 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 41) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f23480229f0 con 0x18c3840 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 10 client.6699 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 10 client.6699 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 20 client.6699 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x1b20e80 0x1b21280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 4 client.6699 mds_command: new command op to 6501 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 -- 172.21.15.29:0/2068437740 --> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a0d3f0 con 0x1b20e80 2023-10-06T05:30:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f2355d9b700 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x1b20e80 0x1b21280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f2334ff9700 10 client.6699 ms_handle_connect on v2:172.21.15.29:6834/3515782118 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f2355d9b700 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x1b20e80 0x1b21280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7ab098ddd57dac2 server_cookie=df8df7b3c4ce2bd5 in_seq=0 out_seq=0 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f2334ff9700 1 -- 172.21.15.29:0/2068437740 <== mds.0 v2:172.21.15.29:6834/3515782118 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x1a0d3f0 con 0x1b20e80 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f2334ff9700 10 client.6699 handle_command_reply: tid=0 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 client.6699 shutdown 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 -- 172.21.15.29:0/2068437740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3840 msgr2=0x1afd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3840 0x1afd870 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2348009870 tx=0x7f234801b000 comp rx=0 tx=0).stop 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 -- 172.21.15.29:0/2068437740 shutdown_connections 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x1b20e80 0x1b21280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1afbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3c10 0x1afb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 --2- 172.21.15.29:0/2068437740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3840 0x1afd870 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f2334ff9700 0 client.6699 ms_handle_reset on v2:172.21.15.29:6834/3515782118 2023-10-06T05:30:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 -- 172.21.15.29:0/2068437740 >> 172.21.15.29:0/2068437740 conn(0x18c3fe0 msgr2=0x1af6720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 -- 172.21.15.29:0/2068437740 shutdown_connections 2023-10-06T05:30:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 1 -- 172.21.15.29:0/2068437740 wait complete. 2023-10-06T05:30:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.172+0000 7f235ebf8740 20 client.6699 trim_cache size 0 max 16384 2023-10-06T05:30:15.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 Processor -- start 2023-10-06T05:30:15.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 -- start start 2023-10-06T05:30:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 0x1b23bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b24100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1b4e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a69d70 con 0x18c3c10 2023-10-06T05:30:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6e9e0 con 0x18c3840 2023-10-06T05:30:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a712f0 con 0x190e8c0 2023-10-06T05:30:15.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2355d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b24100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2355d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b24100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58466/0 (socket says 172.21.15.29:58466) 2023-10-06T05:30:15.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2355d9b700 1 -- 172.21.15.29:0/847379570 learned_addr learned my addr 172.21.15.29:0/847379570 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235659c700 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 0x1b23bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2356d9d700 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1b4e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2355d9b700 1 -- 172.21.15.29:0/847379570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 msgr2=0x1b4e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2355d9b700 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1b4e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2355d9b700 1 -- 172.21.15.29:0/847379570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 msgr2=0x1b23bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2355d9b700 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 0x1b23bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2355d9b700 1 -- 172.21.15.29:0/847379570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235806b1d0 con 0x18c3c10 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2356d9d700 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1b4e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2355d9b700 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b24100 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f234c050210 tx=0x7f234c003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0719f9005818164 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2337fff700 1 -- 172.21.15.29:0/847379570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c056900 con 0x18c3c10 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2337fff700 1 -- 172.21.15.29:0/847379570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234c04f920 con 0x18c3c10 2023-10-06T05:30:15.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f2337fff700 1 -- 172.21.15.29:0/847379570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c079ca0 con 0x18c3c10 2023-10-06T05:30:15.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 -- 172.21.15.29:0/847379570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 msgr2=0x1b24100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.192+0000 7f235ebf8740 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b24100 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f234c050210 tx=0x7f234c003040 comp rx=0 tx=0).stop 2023-10-06T05:30:15.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 -- 172.21.15.29:0/847379570 shutdown_connections 2023-10-06T05:30:15.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x190e8c0 0x1b4e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b24100 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 --2- 172.21.15.29:0/847379570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x18c3840 0x1b23bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 -- 172.21.15.29:0/847379570 >> 172.21.15.29:0/847379570 conn(0x18c3fe0 msgr2=0x1af6720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:15.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 -- 172.21.15.29:0/847379570 shutdown_connections 2023-10-06T05:30:15.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 -- 172.21.15.29:0/847379570 wait complete. 2023-10-06T05:30:15.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 -- start start 2023-10-06T05:30:15.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 Processor -- start 2023-10-06T05:30:15.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x18c3840 0x1b9a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b9a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x190e8c0 0x1b50d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a43b00 con 0x18c3c10 2023-10-06T05:30:15.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a688a0 con 0x190e8c0 2023-10-06T05:30:15.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a3b930 con 0x18c3840 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235ebf8740 10 client.0 _ll_register_callbacks cb 0x19e7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2355d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b9a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2355d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b9a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58468/0 (socket says 172.21.15.29:58468) 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2355d9b700 1 -- 172.21.15.29:0/977718159 learned_addr learned my addr 172.21.15.29:0/977718159 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f235659c700 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x18c3840 0x1b9a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2356d9d700 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x190e8c0 0x1b50d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2355d9b700 1 -- 172.21.15.29:0/977718159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x18c3840 msgr2=0x1b9a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2355d9b700 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x18c3840 0x1b9a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2355d9b700 1 -- 172.21.15.29:0/977718159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x190e8c0 msgr2=0x1b50d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2355d9b700 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x190e8c0 0x1b50d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2355d9b700 1 -- 172.21.15.29:0/977718159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2358145e10 con 0x18c3c10 2023-10-06T05:30:15.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2355d9b700 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b9a790 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f234c050210 tx=0x7f234c067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab422612da9d775a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2334ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:30:15.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2334ff9700 1 -- 172.21.15.29:0/977718159 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c0790f0 con 0x18c3c10 2023-10-06T05:30:15.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.196+0000 7f2334ff9700 1 -- 172.21.15.29:0/977718159 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f234c068030 con 0x18c3c10 2023-10-06T05:30:15.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235ebf8740 1 -- 172.21.15.29:0/977718159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f234800f040 con 0x18c3c10 2023-10-06T05:30:15.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f2334ff9700 1 -- 172.21.15.29:0/977718159 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f234c056980 con 0x18c3c10 2023-10-06T05:30:15.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235ebf8740 10 client.6705 fetch_fsmap learned FSMap version 41 2023-10-06T05:30:15.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235ebf8740 1 -- 172.21.15.29:0/977718159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x1a1fc30 con 0x18c3c10 2023-10-06T05:30:15.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f2334ff9700 1 -- 172.21.15.29:0/977718159 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234800f040 con 0x18c3c10 2023-10-06T05:30:15.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f2334ff9700 1 -- 172.21.15.29:0/977718159 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 41) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f234c056470 con 0x18c3c10 2023-10-06T05:30:15.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235ebf8740 10 client.6705 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T05:30:15.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235ebf8740 10 client.6705 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T05:30:15.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235ebf8740 20 client.6705 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:15.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235ebf8740 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x1b51740 0x1b51b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235ebf8740 4 client.6705 mds_command: new command op to 6501 tid=0[{"prefix": "flush journal"}] 2023-10-06T05:30:15.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235ebf8740 1 -- 172.21.15.29:0/977718159 --> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x1a3f2c0 con 0x1b51740 2023-10-06T05:30:15.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235659c700 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x1b51740 0x1b51b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f2334ff9700 10 client.6705 ms_handle_connect on v2:172.21.15.29:6834/3515782118 2023-10-06T05:30:15.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.200+0000 7f235659c700 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x1b51740 0x1b51b10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c174aa829efd6826 server_cookie=bff18c7116b37f63 in_seq=0 out_seq=0 2023-10-06T05:30:15.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f2334ff9700 1 -- 172.21.15.29:0/977718159 <== mds.0 v2:172.21.15.29:6834/3515782118 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x1a3f2c0 con 0x1b51740 2023-10-06T05:30:15.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f2334ff9700 10 client.6705 handle_command_reply: tid=0 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 client.6705 shutdown 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 -- 172.21.15.29:0/977718159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 msgr2=0x1b9a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b9a790 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f234c050210 tx=0x7f234c067000 comp rx=0 tx=0).stop 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 -- 172.21.15.29:0/977718159 shutdown_connections 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.29:6834/3515782118,v1:172.21.15.29:6835/3515782118] conn(0x1b51740 0x1b51b10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x190e8c0 0x1b50d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x18c3c10 0x1b9a790 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 --2- 172.21.15.29:0/977718159 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x18c3840 0x1b9a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f2334ff9700 0 client.6705 ms_handle_reset on v2:172.21.15.29:6834/3515782118 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 -- 172.21.15.29:0/977718159 >> 172.21.15.29:0/977718159 conn(0x18c3fe0 msgr2=0x1af5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:15.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 -- 172.21.15.29:0/977718159 shutdown_connections 2023-10-06T05:30:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 1 -- 172.21.15.29:0/977718159 wait complete. 2023-10-06T05:30:15.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235ebf8740 20 client.6705 trim_cache size 0 max 16384 2023-10-06T05:30:15.227 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:15.227 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "", 2023-10-06T05:30:15.227 INFO:teuthology.orchestra.run.smithi029.stdout: "return_code": 0 2023-10-06T05:30:15.227 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:15.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 -- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2338060550 msgr2=0x7f2338062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2338060550 0x7f2338062a00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2348009fd0 tx=0x7f234800b040 comp rx=0 tx=0).stop 2023-10-06T05:30:15.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 -- 172.21.15.29:0/835048739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2358155460 msgr2=0x7f2358151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2358155460 0x7f2358151560 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f234c00c5c0 tx=0x7f234c007f50 comp rx=0 tx=0).stop 2023-10-06T05:30:15.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 -- 172.21.15.29:0/835048739 shutdown_connections 2023-10-06T05:30:15.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2358155830 0x7f2358151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2358155460 0x7f2358151560 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2338060550 0x7f2338062a00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 --2- 172.21.15.29:0/835048739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f235806cdd0 0x7f23580abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 -- 172.21.15.29:0/835048739 >> 172.21.15.29:0/835048739 conn(0x7f23580cd0e0 msgr2=0x7f23580c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 -- 172.21.15.29:0/835048739 shutdown_connections 2023-10-06T05:30:15.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.220+0000 7f235c94f700 1 -- 172.21.15.29:0/835048739 wait complete. 2023-10-06T05:30:15.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:30:15.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.344+0000 7ff7caddb700 1 Processor -- start 2023-10-06T05:30:15.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.344+0000 7ff7caddb700 1 -- start start 2023-10-06T05:30:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7caddb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c406dde0 0x7ff7c4163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7caddb700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c4068de0 con 0x7ff7c4158cd0 2023-10-06T05:30:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7caddb700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c40681d0 con 0x7ff7c40cb0b0 2023-10-06T05:30:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7caddb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40684b0 con 0x7ff7c406dde0 2023-10-06T05:30:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7c9dd9700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff7c4158cd0 0x7ff7c4067710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41000/0 (socket says 172.21.15.29:41000) 2023-10-06T05:30:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7c9dd9700 1 -- 172.21.15.29:0/1300081862 learned_addr learned my addr 172.21.15.29:0/1300081862 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7ca5da700 1 --2- 172.21.15.29:0/1300081862 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c406dde0 0x7ff7c4163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7ca5da700 1 -- 172.21.15.29:0/1300081862 >> v1:172.21.15.173:6789/0 conn(0x7ff7c40cb0b0 legacy=0x7ff7c406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7c8dd7700 1 -- 172.21.15.29:0/1300081862 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290335028 0 0) 0x7ff7c4068de0 con 0x7ff7c4158cd0 2023-10-06T05:30:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7ca5da700 1 -- 172.21.15.29:0/1300081862 >> v1:172.21.15.29:6789/0 conn(0x7ff7c4158cd0 legacy=0x7ff7c4067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7ca5da700 1 -- 172.21.15.29:0/1300081862 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4068790 con 0x7ff7c406dde0 2023-10-06T05:30:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.348+0000 7ff7ca5da700 1 --2- 172.21.15.29:0/1300081862 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c406dde0 0x7ff7c4163d40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009e10 tx=0x7ff7bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efb0b090b370c344 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7c8dd7700 1 -- 172.21.15.29:0/1300081862 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00e070 con 0x7ff7c406dde0 2023-10-06T05:30:15.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7c8dd7700 1 -- 172.21.15.29:0/1300081862 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00bbb0 con 0x7ff7c406dde0 2023-10-06T05:30:15.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7c8dd7700 1 -- 172.21.15.29:0/1300081862 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc012430 con 0x7ff7c406dde0 2023-10-06T05:30:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7caddb700 1 -- 172.21.15.29:0/1300081862 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c406dde0 msgr2=0x7ff7c4163d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7caddb700 1 --2- 172.21.15.29:0/1300081862 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c406dde0 0x7ff7c4163d40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009e10 tx=0x7ff7bc009780 comp rx=0 tx=0).stop 2023-10-06T05:30:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7caddb700 1 -- 172.21.15.29:0/1300081862 shutdown_connections 2023-10-06T05:30:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7caddb700 1 --2- 172.21.15.29:0/1300081862 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c406dde0 0x7ff7c4163d40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7caddb700 1 -- 172.21.15.29:0/1300081862 >> 172.21.15.29:0/1300081862 conn(0x7ff7c406aaf0 msgr2=0x7ff7c406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7caddb700 1 -- 172.21.15.29:0/1300081862 shutdown_connections 2023-10-06T05:30:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.352+0000 7ff7caddb700 1 -- 172.21.15.29:0/1300081862 wait complete. 2023-10-06T05:30:15.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7caddb700 1 Processor -- start 2023-10-06T05:30:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7caddb700 1 -- start start 2023-10-06T05:30:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7caddb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406dde0 0x7ff7c41428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7caddb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7c4158cd0 0x7ff7c415c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7caddb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c415ce50 0x7ff7c416c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7caddb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c416c2d0 con 0x7ff7c406dde0 2023-10-06T05:30:15.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7caddb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4142e20 con 0x7ff7c4158cd0 2023-10-06T05:30:15.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7caddb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40c51e0 con 0x7ff7c415ce50 2023-10-06T05:30:15.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c9dd9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406dde0 0x7ff7c41428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c9dd9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406dde0 0x7ff7c41428e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58470/0 (socket says 172.21.15.29:58470) 2023-10-06T05:30:15.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c9dd9700 1 -- 172.21.15.29:0/3517479894 learned_addr learned my addr 172.21.15.29:0/3517479894 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:15.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c95d8700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7c4158cd0 0x7ff7c415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7ca5da700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c415ce50 0x7ff7c416c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c9dd9700 1 -- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c415ce50 msgr2=0x7ff7c416c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c9dd9700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c415ce50 0x7ff7c416c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c9dd9700 1 -- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7c4158cd0 msgr2=0x7ff7c415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c9dd9700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7c4158cd0 0x7ff7c415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c9dd9700 1 -- 172.21.15.29:0/3517479894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc009a20 con 0x7ff7c406dde0 2023-10-06T05:30:15.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.356+0000 7ff7c9dd9700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406dde0 0x7ff7c41428e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c7e0 tx=0x7ff7c0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7b9ffb700 1 -- 172.21.15.29:0/3517479894 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0005b30 con 0x7ff7c406dde0 2023-10-06T05:30:15.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7b9ffb700 1 -- 172.21.15.29:0/3517479894 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0005c90 con 0x7ff7c406dde0 2023-10-06T05:30:15.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c40c45d0 con 0x7ff7c406dde0 2023-10-06T05:30:15.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7b9ffb700 1 -- 172.21.15.29:0/3517479894 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0007300 con 0x7ff7c406dde0 2023-10-06T05:30:15.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c40c4b90 con 0x7ff7c406dde0 2023-10-06T05:30:15.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c404be00 con 0x7ff7c406dde0 2023-10-06T05:30:15.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7b9ffb700 1 -- 172.21.15.29:0/3517479894 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff7c001b3b0 con 0x7ff7c406dde0 2023-10-06T05:30:15.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7b9ffb700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff7a8060580 0x7ff7a8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:15.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7b9ffb700 1 -- 172.21.15.29:0/3517479894 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7c007be40 con 0x7ff7c406dde0 2023-10-06T05:30:15.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.360+0000 7ff7c95d8700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff7a8060580 0x7ff7a8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:15.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.364+0000 7ff7c95d8700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff7a8060580 0x7ff7a8062a30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4067f60 tx=0x7ff7b4007e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:15.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.372+0000 7ff7b9ffb700 1 -- 172.21.15.29:0/3517479894 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff7c004c230 con 0x7ff7c406dde0 2023-10-06T05:30:15.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.568+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff7c4068a70 con 0x7ff7c406dde0 2023-10-06T05:30:15.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7b9ffb700 1 -- 172.21.15.29:0/3517479894 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff7c0017070 con 0x7ff7c406dde0 2023-10-06T05:30:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:30:15.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff7a8060580 msgr2=0x7ff7a8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff7a8060580 0x7ff7a8062a30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4067f60 tx=0x7ff7b4007e20 comp rx=0 tx=0).stop 2023-10-06T05:30:15.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406dde0 msgr2=0x7ff7c41428e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:15.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406dde0 0x7ff7c41428e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c7e0 tx=0x7ff7c0007df0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 shutdown_connections 2023-10-06T05:30:15.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7c415ce50 0x7ff7c416c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff7a8060580 0x7ff7a8062a30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff7c4158cd0 0x7ff7c415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 --2- 172.21.15.29:0/3517479894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7c406dde0 0x7ff7c41428e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:15.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 >> 172.21.15.29:0/3517479894 conn(0x7ff7c406aaf0 msgr2=0x7ff7c40c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:15.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 shutdown_connections 2023-10-06T05:30:15.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:15.572+0000 7ff7caddb700 1 -- 172.21.15.29:0/3517479894 wait complete. 2023-10-06T05:30:15.590 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:30:15.590 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:30:15.590 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:30:15.590 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T05:30:15.590 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:15.590 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:30:15.590 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:30:15.591 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:30:15.591 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:15.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:15.591 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42312sec preferred_lft 42312sec 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::38dc:3fff:fed0:feb0/64 scope link 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c88:ceff:fe77:b613/64 scope link 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether aa:ad:a4:57:7d:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:30:15.599 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a8ad:a4ff:fe57:7d6d/64 scope link 2023-10-06T05:30:15.600 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:15.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:15.600 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:30:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:30:15.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:15.614 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:30:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:30:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:30:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:30:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:30:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:30:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:30:15.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:15.665 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:30:15.665 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:30:15.665 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:30:15.665 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:30:15.666 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:30:15.666 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:30:15.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:15.708 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:30:15.716 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T05:30:15.716 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:30:15.716 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:15.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:15.717 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-06T05:30:15.776 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T05:30:15.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:30:15.776 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:15.784 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:15.784 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:30:15.784 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:15.789 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:15.849 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:15.849 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:15.865 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:15.865 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:15.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:15.866 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:15.873 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:30:15.873 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T05:30:15.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:15.890 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:15.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:15.901 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:15.901 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:15.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:15.902 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:15.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2023-10-06T05:30:15.952+0000 7f0a9957b380 -1 init, newargv = 0x5594db740ee0 newargc=15 2023-10-06T05:30:15.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[48460]: starting ceph client 2023-10-06T05:30:15.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[48460]: starting fuse 2023-10-06T05:30:17.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:17.073 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:17.074 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:17.130 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:17.130 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:17.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:17.131 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:17.138 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:30:17.138 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:30:17.138 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:17.138 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:30:17.139 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2023-10-06T05:30:17.140 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:17.224 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.48460.asok 2023-10-06T05:30:17.409 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48460.asok 2023-10-06T05:30:17.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:17.410 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48460.asok status 2023-10-06T05:30:17.552 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:17.552 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:30:17.552 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:30:17.552 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:30:17.552 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2023-10-06T05:30:17.552 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:30:17.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "48460", 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6717, 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 6717 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:30:17.553 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 4050291189 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 4050291189 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.6717 192.168.0.1:0/4050291189", 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/4050291189", 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:30:17.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 41, 2023-10-06T05:30:17.555 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 77, 2023-10-06T05:30:17.555 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:30:17.555 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:30:17.555 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:30:17.555 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:17.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:17.561 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:30:17.561 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:17.567 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:30:17.568 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:17.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:17.568 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:17.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:17.584 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2023-10-06T05:30:17.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:17.647 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2023-10-06T05:30:17.732 INFO:teuthology.orchestra.run.smithi029.stderr:8+0 records in 2023-10-06T05:30:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:8+0 records out 2023-10-06T05:30:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0746849 s, 112 MB/s 2023-10-06T05:30:17.734 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:17.734 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:17.734 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:17.734 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:17.734 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2023-10-06T05:30:17.734 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:17.803 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627779 2023-10-06T05:30:17.991 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:17.991 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:17.991 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:17.992 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:17.992 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2023-10-06T05:30:17.992 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:18.061 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627780 2023-10-06T05:30:18.249 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:30:18.250 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:30:18.250 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:18.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[48460]: fuse finished with error 0 and tester_r 0 2023-10-06T05:30:18.267 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:30:18.349 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:30:18.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:18.349 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:30:18.355 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi029.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:18.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:30:18.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:18.355 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:30:18.359 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T05:30:18.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:30:18.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T05:30:18.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0effff700 1 Processor -- start 2023-10-06T05:30:18.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0effff700 1 -- start start 2023-10-06T05:30:18.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0effff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00cb960 0x7fa0f00cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0effff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa0f00ab5f0 0x7fa0f00aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0effff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f00c9110 con 0x7fa0f00aad20 2023-10-06T05:30:18.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0effff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f00cc2f0 con 0x7fa0f00ab5f0 2023-10-06T05:30:18.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0effff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f00c8500 con 0x7fa0f00cb960 2023-10-06T05:30:18.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0eeffd700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa0f00aad20 0x7fa0f00caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:59270/0 (socket says 172.21.15.29:59270) 2023-10-06T05:30:18.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0eeffd700 1 -- 172.21.15.29:0/1740068094 learned_addr learned my addr 172.21.15.29:0/1740068094 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:18.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0ee7fc700 1 --2- 172.21.15.29:0/1740068094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00cb960 0x7fa0f00cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0ef7fe700 1 --2- 172.21.15.29:0/1740068094 >> v2:172.21.15.173:3300/0 conn(0x7fa0f00ab5f0 0x7fa0f00aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0edffb700 1 -- 172.21.15.29:0/1740068094 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094782938 0 0) 0x7fa0f00c9110 con 0x7fa0f00aad20 2023-10-06T05:30:18.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0edffb700 1 -- 172.21.15.29:0/1740068094 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d8003570 con 0x7fa0f00aad20 2023-10-06T05:30:18.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0ee7fc700 1 -- 172.21.15.29:0/1740068094 >> v2:172.21.15.173:3300/0 conn(0x7fa0f00ab5f0 msgr2=0x7fa0f00aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:18.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0ee7fc700 1 --2- 172.21.15.29:0/1740068094 >> v2:172.21.15.173:3300/0 conn(0x7fa0f00ab5f0 0x7fa0f00aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0ee7fc700 1 -- 172.21.15.29:0/1740068094 >> v1:172.21.15.173:6789/0 conn(0x7fa0f00aad20 legacy=0x7fa0f00caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0ee7fc700 1 -- 172.21.15.29:0/1740068094 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f00c87e0 con 0x7fa0f00cb960 2023-10-06T05:30:18.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0ef7fe700 1 --2- 172.21.15.29:0/1740068094 >> v2:172.21.15.173:3300/0 conn(0x7fa0f00ab5f0 0x7fa0f00aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:18.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0ee7fc700 1 --2- 172.21.15.29:0/1740068094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00cb960 0x7fa0f00cbdb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00098e0 tx=0x7fa0e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e97199f41ca21e1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:18.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0edffb700 1 -- 172.21.15.29:0/1740068094 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0011630 con 0x7fa0f00cb960 2023-10-06T05:30:18.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0edffb700 1 -- 172.21.15.29:0/1740068094 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e0011790 con 0x7fa0f00cb960 2023-10-06T05:30:18.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.516+0000 7fa0edffb700 1 -- 172.21.15.29:0/1740068094 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0011b10 con 0x7fa0f00cb960 2023-10-06T05:30:18.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.520+0000 7fa0effff700 1 -- 172.21.15.29:0/1740068094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00cb960 msgr2=0x7fa0f00cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.520+0000 7fa0effff700 1 --2- 172.21.15.29:0/1740068094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00cb960 0x7fa0f00cbdb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00098e0 tx=0x7fa0e00091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.520+0000 7fa0effff700 1 -- 172.21.15.29:0/1740068094 shutdown_connections 2023-10-06T05:30:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.520+0000 7fa0effff700 1 --2- 172.21.15.29:0/1740068094 >> v2:172.21.15.173:3300/0 conn(0x7fa0f00ab5f0 0x7fa0f00aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.520+0000 7fa0effff700 1 --2- 172.21.15.29:0/1740068094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00cb960 0x7fa0f00cbdb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.520+0000 7fa0effff700 1 -- 172.21.15.29:0/1740068094 >> 172.21.15.29:0/1740068094 conn(0x7fa0f00670a0 msgr2=0x7fa0f0067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.520+0000 7fa0effff700 1 -- 172.21.15.29:0/1740068094 shutdown_connections 2023-10-06T05:30:18.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.520+0000 7fa0effff700 1 -- 172.21.15.29:0/1740068094 wait complete. 2023-10-06T05:30:18.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 Processor -- start 2023-10-06T05:30:18.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 -- start start 2023-10-06T05:30:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0f00aad20 0x7fa0f00af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00ab5f0 0x7fa0f014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0f00cb960 0x7fa0f00b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f00af980 con 0x7fa0f00aad20 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f0158860 con 0x7fa0f00cb960 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f014ed10 con 0x7fa0f00ab5f0 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0eeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0f00aad20 0x7fa0f00af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0eeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0f00aad20 0x7fa0f00af2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58482/0 (socket says 172.21.15.29:58482) 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0eeffd700 1 -- 172.21.15.29:0/1018095227 learned_addr learned my addr 172.21.15.29:0/1018095227 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0ee7fc700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00ab5f0 0x7fa0f014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0ef7fe700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0f00cb960 0x7fa0f00b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0eeffd700 1 -- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00ab5f0 msgr2=0x7fa0f014e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0eeffd700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00ab5f0 0x7fa0f014e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0eeffd700 1 -- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0f00cb960 msgr2=0x7fa0f00b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0eeffd700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0f00cb960 0x7fa0f00b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0eeffd700 1 -- 172.21.15.29:0/1018095227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4009420 con 0x7fa0f00aad20 2023-10-06T05:30:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0ef7fe700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0f00cb960 0x7fa0f00b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0eeffd700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0f00aad20 0x7fa0f00af2a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800cc40 tx=0x7fa0e8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0d6ffd700 1 -- 172.21.15.29:0/1018095227 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e800a910 con 0x7fa0f00aad20 2023-10-06T05:30:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0d6ffd700 1 -- 172.21.15.29:0/1018095227 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e800aa90 con 0x7fa0f00aad20 2023-10-06T05:30:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e0009420 con 0x7fa0f00aad20 2023-10-06T05:30:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0d6ffd700 1 -- 172.21.15.29:0/1018095227 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e800ae50 con 0x7fa0f00aad20 2023-10-06T05:30:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.524+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f0150260 con 0x7fa0f00aad20 2023-10-06T05:30:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.528+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f004be00 con 0x7fa0f00aad20 2023-10-06T05:30:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.528+0000 7fa0d6ffd700 1 -- 172.21.15.29:0/1018095227 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa0e8007300 con 0x7fa0f00aad20 2023-10-06T05:30:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.528+0000 7fa0d6ffd700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa0dc0605d0 0x7fa0dc062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.528+0000 7fa0d6ffd700 1 -- 172.21.15.29:0/1018095227 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa0e807cd80 con 0x7fa0f00aad20 2023-10-06T05:30:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.528+0000 7fa0ee7fc700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa0dc0605d0 0x7fa0dc062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.528+0000 7fa0ee7fc700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa0dc0605d0 0x7fa0dc062a80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00091e0 tx=0x7fa0e0017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:18.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.536+0000 7fa0d6ffd700 1 -- 172.21.15.29:0/1018095227 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa0e804d1f0 con 0x7fa0f00aad20 2023-10-06T05:30:18.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.728+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa0f00aa8d0 con 0x7fa0f00aad20 2023-10-06T05:30:18.735 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-06T05:30:18.728+0000 7fe44aab2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T05:30:18.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.736+0000 7fa0d6ffd700 1 -- 172.21.15.29:0/1018095227 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa0e8050810 con 0x7fa0f00aad20 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa0dc0605d0 msgr2=0x7fa0dc062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa0dc0605d0 0x7fa0dc062a80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00091e0 tx=0x7fa0e0017000 comp rx=0 tx=0).stop 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0f00aad20 msgr2=0x7fa0f00af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0f00aad20 0x7fa0f00af2a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800cc40 tx=0x7fa0e8001a70 comp rx=0 tx=0).stop 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 shutdown_connections 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa0dc0605d0 0x7fa0dc062a80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0f00cb960 0x7fa0f00b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0f00ab5f0 0x7fa0f014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 --2- 172.21.15.29:0/1018095227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0f00aad20 0x7fa0f00af2a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 >> 172.21.15.29:0/1018095227 conn(0x7fa0f00670a0 msgr2=0x7fa0f014f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:18.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 shutdown_connections 2023-10-06T05:30:18.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.740+0000 7fa0effff700 1 -- 172.21.15.29:0/1018095227 wait complete. 2023-10-06T05:30:18.746 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T05:30:18.750 INFO:tasks.ceph.mds.c.smithi029.stderr: -7215> 2023-10-06T05:29:58.988+0000 7f935f112700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:30:18.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:30:18.760 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:30:18.780 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:30:18.783 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-10-06T05:30:18.784 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2023-10-06T05:30:18.784 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:30:18.784 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2023-10-06T05:30:18.784 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.784 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2023-10-06T05:30:18.784 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.784 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2023-10-06T05:30:18.784 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.784 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.785 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2023-10-06T05:30:18.786 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:30:18.787 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2023-10-06T05:30:18.788 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2023-10-06T05:30:18.789 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2023-10-06T05:30:18.790 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:30:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:18.792 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.793 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:30:18.794 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = "" 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-06T05:30:18.795 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2023-10-06T05:30:18.796 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2023-10-06T05:30:18.796 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.796 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2023-10-06T05:30:18.796 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2023-10-06T05:30:18.796 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2023-10-06T05:30:18.796 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = False 2023-10-06T05:30:18.796 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:30:18.796 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:30:18.796 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.798 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2023-10-06T05:30:18.799 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.800 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2023-10-06T05:30:18.801 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2023-10-06T05:30:18.802 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.803 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: bdev async discard = True 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: bdev enable discard = True 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore allocator = bitmap 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 1/20 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 1/20 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 4/10 2023-10-06T05:30:18.804 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:18.805 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2023-10-06T05:30:18.806 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.807 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: mon op complaint time = 120 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: client mount timeout = 600 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: debug client = 20 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.808 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = "" 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout:[mds] 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds = 20 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.809 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug frag = True 2023-10-06T05:30:18.810 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug scatterstat = True 2023-10-06T05:30:18.810 INFO:teuthology.orchestra.run.smithi173.stdout: mds op complaint time = 180 2023-10-06T05:30:18.810 INFO:teuthology.orchestra.run.smithi173.stdout: mds verify scatter = False 2023-10-06T05:30:18.810 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:30:18.810 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:30:18.810 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:30:18.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:30:18.813 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:30:18.845 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-10-06T05:30:18.845 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2023-10-06T05:30:18.845 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:30:18.845 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2023-10-06T05:30:18.845 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.845 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2023-10-06T05:30:18.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2023-10-06T05:30:18.847 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2023-10-06T05:30:18.848 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2023-10-06T05:30:18.849 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2023-10-06T05:30:18.850 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2023-10-06T05:30:18.851 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.852 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2023-10-06T05:30:18.853 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:30:18.854 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:30:18.855 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = "" 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-06T05:30:18.856 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2023-10-06T05:30:18.857 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2023-10-06T05:30:18.857 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:18.857 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2023-10-06T05:30:18.857 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = False 2023-10-06T05:30:18.857 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2023-10-06T05:30:18.857 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = False 2023-10-06T05:30:18.857 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:30:18.857 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:30:18.857 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:30:18.876 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2023-10-06T05:30:18.876 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2023-10-06T05:30:18.876 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:30:18.876 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.877 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:30:18.878 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.879 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.880 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.881 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: bdev async discard = True 2023-10-06T05:30:18.882 INFO:teuthology.orchestra.run.smithi173.stdout: bdev enable discard = True 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore allocator = bitmap 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 1/20 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 1/20 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 4/10 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:30:18.883 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.884 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:18.885 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:30:18.886 INFO:teuthology.orchestra.run.smithi173.stdout: mon op complaint time = 120 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: client mount timeout = 600 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: debug client = 20 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = "" 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:30:18.887 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout:[mds] 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds = 20 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug frag = True 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug scatterstat = False 2023-10-06T05:30:18.888 INFO:teuthology.orchestra.run.smithi173.stdout: mds op complaint time = 180 2023-10-06T05:30:18.889 INFO:teuthology.orchestra.run.smithi173.stdout: mds verify scatter = False 2023-10-06T05:30:18.889 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:30:18.889 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:30:18.889 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:30:18.890 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2023-10-06T05:30:18.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0c8b8e80 1 Processor -- start 2023-10-06T05:30:18.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0c8b8e80 1 -- start start 2023-10-06T05:30:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0c8b8e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 0x55e4e3d44270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0c8b8e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3de7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0c8b8e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4e3de8430 0x55e4e3d5df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0c8b8e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e3c5b840 con 0x55e4e3d41320 2023-10-06T05:30:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0c8b8e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e3c5b4e0 con 0x55e4e3de8430 2023-10-06T05:30:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0c8b8e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4e3c52270 con 0x55e4e3d3e610 2023-10-06T05:30:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb09bee700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3de7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0abf0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4e3de8430 0x55e4e3d5df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0a3ef700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 0x55e4e3d44270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb09bee700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3de7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58512/0 (socket says 172.21.15.29:58512) 2023-10-06T05:30:18.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb09bee700 1 -- 172.21.15.29:0/918808942 learned_addr learned my addr 172.21.15.29:0/918808942 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:18.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0a3ef700 1 -- 172.21.15.29:0/918808942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4e3de8430 msgr2=0x55e4e3d5df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:18.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0a3ef700 1 --2- 172.21.15.29:0/918808942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4e3de8430 0x55e4e3d5df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0a3ef700 1 -- 172.21.15.29:0/918808942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 msgr2=0x55e4e3de7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:18.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0a3ef700 1 --2- 172.21.15.29:0/918808942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3de7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb0a3ef700 1 -- 172.21.15.29:0/918808942 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4005cf0 con 0x55e4e3d3e610 2023-10-06T05:30:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.932+0000 7ffb09bee700 1 --2- 172.21.15.29:0/918808942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3de7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0a3ef700 1 --2- 172.21.15.29:0/918808942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 0x55e4e3d44270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb04006e50 tx=0x7ffb04006930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83d2b7d26efbeb76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb08bec700 1 -- 172.21.15.29:0/918808942 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04006110 con 0x55e4e3d3e610 2023-10-06T05:30:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb08bec700 1 -- 172.21.15.29:0/918808942 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb04006270 con 0x55e4e3d3e610 2023-10-06T05:30:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb08bec700 1 -- 172.21.15.29:0/918808942 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04004770 con 0x55e4e3d3e610 2023-10-06T05:30:18.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/918808942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 msgr2=0x55e4e3d44270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 --2- 172.21.15.29:0/918808942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 0x55e4e3d44270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb04006e50 tx=0x7ffb04006930 comp rx=0 tx=0).stop 2023-10-06T05:30:18.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/918808942 shutdown_connections 2023-10-06T05:30:18.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 --2- 172.21.15.29:0/918808942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4e3de8430 0x55e4e3d5df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 --2- 172.21.15.29:0/918808942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3de7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 --2- 172.21.15.29:0/918808942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 0x55e4e3d44270 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/918808942 >> 172.21.15.29:0/918808942 conn(0x55e4e3d0d980 msgr2=0x55e4e3d556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:18.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/918808942 shutdown_connections 2023-10-06T05:30:18.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/918808942 wait complete. 2023-10-06T05:30:18.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 Processor -- start 2023-10-06T05:30:18.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 -- start start 2023-10-06T05:30:18.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 0x55e4e3de5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3d5df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4e3de8430 0x55e4e3d5e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e3de6140 con 0x55e4e3d41320 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e3d55b50 con 0x55e4e3de8430 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.936+0000 7ffb0c8b8e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4e3d54f40 con 0x55e4e3d3e610 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb09bee700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3d5df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb0a3ef700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 0x55e4e3de5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb0a3ef700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 0x55e4e3de5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:37950/0 (socket says 172.21.15.29:37950) 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb0abf0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4e3de8430 0x55e4e3d5e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb0a3ef700 1 -- 172.21.15.29:0/690432667 learned_addr learned my addr 172.21.15.29:0/690432667 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb09bee700 1 -- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 msgr2=0x55e4e3de5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb09bee700 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e4e3d3e610 0x55e4e3de5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb09bee700 1 -- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4e3de8430 msgr2=0x55e4e3d5e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb09bee700 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e4e3de8430 0x55e4e3d5e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb09bee700 1 -- 172.21.15.29:0/690432667 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4e3c84040 con 0x55e4e3d41320 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb09bee700 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3d5df70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400a520 tx=0x7ffaf4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb02ffd700 1 -- 172.21.15.29:0/690432667 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4007e60 con 0x55e4e3d41320 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb02ffd700 1 -- 172.21.15.29:0/690432667 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf40078e0 con 0x55e4e3d41320 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf8001e10 con 0x55e4e3d41320 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb02ffd700 1 -- 172.21.15.29:0/690432667 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf401d6b0 con 0x55e4e3d41320 2023-10-06T05:30:18.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.940+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4e3c6a250 con 0x55e4e3d41320 2023-10-06T05:30:18.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.944+0000 7ffb02ffd700 1 -- 172.21.15.29:0/690432667 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffaf4019070 con 0x55e4e3d41320 2023-10-06T05:30:18.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.944+0000 7ffb02ffd700 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffaec05eee0 0x7ffaec061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.944+0000 7ffb02ffd700 1 -- 172.21.15.29:0/690432667 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7ffaf407c810 con 0x55e4e3d41320 2023-10-06T05:30:18.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.944+0000 7ffb0c8b8e80 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55e4e3d56ea0 0x55e4e3d57270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:18.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.944+0000 7ffb0a3ef700 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffaec05eee0 0x7ffaec061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.944+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) v8 -- 0x55e4e3d593c0 con 0x55e4e3d56ea0 2023-10-06T05:30:18.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.944+0000 7ffb0abf0700 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55e4e3d56ea0 0x55e4e3d57270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:18.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.944+0000 7ffb0a3ef700 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffaec05eee0 0x7ffaec061390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffb04006240 tx=0x7ffb04010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:18.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.944+0000 7ffb0abf0700 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55e4e3d56ea0 0x55e4e3d57270 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:18.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0abf0700 1 -- 172.21.15.29:0/690432667 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v78'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ffafc012040 con 0x55e4e3d56ea0 2023-10-06T05:30:18.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55e4e3d56ea0 msgr2=0x55e4e3d57270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0c8b8e80 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55e4e3d56ea0 0x55e4e3d57270 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:18.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffaec05eee0 msgr2=0x7ffaec061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0c8b8e80 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ffaec05eee0 0x7ffaec061390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffb04006240 tx=0x7ffb04010000 comp rx=0 tx=0).stop 2023-10-06T05:30:18.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 msgr2=0x55e4e3d5df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:18.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0c8b8e80 1 --2- 172.21.15.29:0/690432667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e4e3d41320 0x55e4e3d5df70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400a520 tx=0x7ffaf4015000 comp rx=0 tx=0).stop 2023-10-06T05:30:18.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0abf0700 1 -- 172.21.15.29:0/690432667 reap_dead start 2023-10-06T05:30:18.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 shutdown_connections 2023-10-06T05:30:18.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 >> 172.21.15.29:0/690432667 conn(0x55e4e3d0d980 msgr2=0x55e4e3deb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:18.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.948+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 shutdown_connections 2023-10-06T05:30:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:18.952+0000 7ffb0c8b8e80 1 -- 172.21.15.29:0/690432667 wait complete. 2023-10-06T05:30:18.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T05:30:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.076+0000 7f99d275e700 1 Processor -- start 2023-10-06T05:30:19.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.076+0000 7f99d275e700 1 -- start start 2023-10-06T05:30:19.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f99cc0cb8c0 0x7f99cc0c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99cc0c9ab0 0x7f99cc0c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0c9ed0 con 0x7f99cc155ac0 2023-10-06T05:30:19.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99cc0c8ce0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99cc0c8060 con 0x7f99cc0cb8c0 2023-10-06T05:30:19.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d1f5d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99cc0c9ab0 0x7f99cc0c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d1f5d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99cc0c9ab0 0x7f99cc0c19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58530/0 (socket says 172.21.15.29:58530) 2023-10-06T05:30:19.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d1f5d700 1 -- 172.21.15.29:0/3823508349 learned_addr learned my addr 172.21.15.29:0/3823508349 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:19.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d0f5b700 1 --2- 172.21.15.29:0/3823508349 >> v2:172.21.15.173:3300/0 conn(0x7f99cc0cb8c0 0x7f99cc0c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d1f5d700 1 -- 172.21.15.29:0/3823508349 >> v2:172.21.15.173:3300/0 conn(0x7f99cc0cb8c0 msgr2=0x7f99cc0c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d1f5d700 1 --2- 172.21.15.29:0/3823508349 >> v2:172.21.15.173:3300/0 conn(0x7f99cc0cb8c0 0x7f99cc0c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d1f5d700 1 -- 172.21.15.29:0/3823508349 >> v1:172.21.15.173:6789/0 conn(0x7f99cc155ac0 legacy=0x7f99cc0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d1f5d700 1 -- 172.21.15.29:0/3823508349 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0c8340 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d1f5d700 1 --2- 172.21.15.29:0/3823508349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 0x7f99cc0c19d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f99cc06ac20 tx=0x7f99c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ca1b37a65a8d99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99c3fff700 1 -- 172.21.15.29:0/3823508349 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c400e070 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99c3fff700 1 -- 172.21.15.29:0/3823508349 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c400ba20 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99c3fff700 1 -- 172.21.15.29:0/3823508349 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40092e0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 -- 172.21.15.29:0/3823508349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 msgr2=0x7f99cc0c19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 --2- 172.21.15.29:0/3823508349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 0x7f99cc0c19d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f99cc06ac20 tx=0x7f99c4009840 comp rx=0 tx=0).stop 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 -- 172.21.15.29:0/3823508349 shutdown_connections 2023-10-06T05:30:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 --2- 172.21.15.29:0/3823508349 >> v2:172.21.15.173:3300/0 conn(0x7f99cc0cb8c0 0x7f99cc0c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 --2- 172.21.15.29:0/3823508349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 0x7f99cc0c19d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 -- 172.21.15.29:0/3823508349 >> 172.21.15.29:0/3823508349 conn(0x7f99cc06ba30 msgr2=0x7f99cc095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:19.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 -- 172.21.15.29:0/3823508349 shutdown_connections 2023-10-06T05:30:19.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.080+0000 7f99d275e700 1 -- 172.21.15.29:0/3823508349 wait complete. 2023-10-06T05:30:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 Processor -- start 2023-10-06T05:30:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 -- start start 2023-10-06T05:30:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 0x7f99cc0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99cc0cb8c0 0x7f99cc0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99cc155ac0 0x7f99cc0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc169950 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc169020 con 0x7f99cc0cb8c0 2023-10-06T05:30:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc169300 con 0x7f99cc155ac0 2023-10-06T05:30:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d175c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 0x7f99cc0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d175c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 0x7f99cc0b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58536/0 (socket says 172.21.15.29:58536) 2023-10-06T05:30:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d175c700 1 -- 172.21.15.29:0/4164235506 learned_addr learned my addr 172.21.15.29:0/4164235506 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d0f5b700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99cc0cb8c0 0x7f99cc0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d1f5d700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99cc155ac0 0x7f99cc0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d175c700 1 -- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99cc155ac0 msgr2=0x7f99cc0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d175c700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99cc155ac0 0x7f99cc0c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d175c700 1 -- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99cc0cb8c0 msgr2=0x7f99cc0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d175c700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99cc0cb8c0 0x7f99cc0b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d175c700 1 -- 172.21.15.29:0/4164235506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009ae0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d175c700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 0x7f99cc0b1ee0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c7c0 tx=0x7f99c8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:19.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99c17fa700 1 -- 172.21.15.29:0/4164235506 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8011590 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99c17fa700 1 -- 172.21.15.29:0/4164235506 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c80116f0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc1695e0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99c17fa700 1 -- 172.21.15.29:0/4164235506 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8011ab0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.084+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc14e250 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.088+0000 7f99c17fa700 1 -- 172.21.15.29:0/4164235506 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f99c801b3b0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.088+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc04be00 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.088+0000 7f99c17fa700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99b0060550 0x7f99b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.088+0000 7f99c17fa700 1 -- 172.21.15.29:0/4164235506 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f99c807bce0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.088+0000 7f99d0f5b700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99b0060550 0x7f99b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.088+0000 7f99d0f5b700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99b0060550 0x7f99b0062a00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f99cc09a8f0 tx=0x7f99bc0091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:19.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.096+0000 7f99c17fa700 1 -- 172.21.15.29:0/4164235506 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f99c804c1d0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.292+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f99cc0ca420 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.748+0000 7f99c17fa700 1 -- 172.21.15.29:0/4164235506 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v43) v1 ==== 162+0+0 (secure 0 0 0) 0x7f99c804f7f0 con 0x7f99cc0c9ab0 2023-10-06T05:30:19.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99b0060550 msgr2=0x7f99b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:19.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99b0060550 0x7f99b0062a00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f99cc09a8f0 tx=0x7f99bc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 msgr2=0x7f99cc0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:19.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 0x7f99cc0b1ee0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c7c0 tx=0x7f99c8007f70 comp rx=0 tx=0).stop 2023-10-06T05:30:19.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 shutdown_connections 2023-10-06T05:30:19.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99cc155ac0 0x7f99cc0c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f99b0060550 0x7f99b0062a00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99cc0cb8c0 0x7f99cc0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 --2- 172.21.15.29:0/4164235506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc0c9ab0 0x7f99cc0b1ee0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 >> 172.21.15.29:0/4164235506 conn(0x7f99cc06ba30 msgr2=0x7f99cc14fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:19.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 shutdown_connections 2023-10-06T05:30:19.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.752+0000 7f99d275e700 1 -- 172.21.15.29:0/4164235506 wait complete. 2023-10-06T05:30:19.762 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T05:30:19.778 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:19.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.880+0000 7fd52b59e700 1 Processor -- start 2023-10-06T05:30:19.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.880+0000 7fd52b59e700 1 -- start start 2023-10-06T05:30:19.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd52c1569f0 0x7fd52c0ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd52c156dc0 0x7fd52c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c0c68b0 0x7fd52c0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52c06a5b0 con 0x7fd52c1569f0 2023-10-06T05:30:19.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52c0c7240 con 0x7fd52c156dc0 2023-10-06T05:30:19.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c15b0a0 con 0x7fd52c0c68b0 2023-10-06T05:30:19.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52a59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd52c1569f0 0x7fd52c0ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd523fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd52c156dc0 0x7fd52c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52a59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd52c1569f0 0x7fd52c0ab220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58546/0 (socket says 172.21.15.29:58546) 2023-10-06T05:30:19.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd523fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd52c156dc0 0x7fd52c15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:45644/0 (socket says 172.21.15.29:45644) 2023-10-06T05:30:19.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52a59c700 1 -- 172.21.15.29:0/1839792679 learned_addr learned my addr 172.21.15.29:0/1839792679 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:19.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52ad9d700 1 --2- 172.21.15.29:0/1839792679 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c0c68b0 0x7fd52c0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd523fff700 1 -- 172.21.15.29:0/1839792679 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c0c68b0 msgr2=0x7fd52c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:19.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd523fff700 1 --2- 172.21.15.29:0/1839792679 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c0c68b0 0x7fd52c0c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd523fff700 1 -- 172.21.15.29:0/1839792679 >> v2:172.21.15.29:3300/0 conn(0x7fd52c1569f0 msgr2=0x7fd52c0ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd523fff700 1 --2- 172.21.15.29:0/1839792679 >> v2:172.21.15.29:3300/0 conn(0x7fd52c1569f0 0x7fd52c0ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd523fff700 1 -- 172.21.15.29:0/1839792679 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c15b380 con 0x7fd52c156dc0 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd523fff700 1 --2- 172.21.15.29:0/1839792679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c156dc0 0x7fd52c15a870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd52c15b960 tx=0x7fd51c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e45a708a49bee242 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd529d9b700 1 -- 172.21.15.29:0/1839792679 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011630 con 0x7fd52c156dc0 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd529d9b700 1 -- 172.21.15.29:0/1839792679 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0117b0 con 0x7fd52c156dc0 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd529d9b700 1 -- 172.21.15.29:0/1839792679 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011b70 con 0x7fd52c156dc0 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 -- 172.21.15.29:0/1839792679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c156dc0 msgr2=0x7fd52c15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 --2- 172.21.15.29:0/1839792679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c156dc0 0x7fd52c15a870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd52c15b960 tx=0x7fd51c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 -- 172.21.15.29:0/1839792679 shutdown_connections 2023-10-06T05:30:19.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 --2- 172.21.15.29:0/1839792679 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c0c68b0 0x7fd52c0c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 --2- 172.21.15.29:0/1839792679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c156dc0 0x7fd52c15a870 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 --2- 172.21.15.29:0/1839792679 >> v2:172.21.15.29:3300/0 conn(0x7fd52c1569f0 0x7fd52c0ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 -- 172.21.15.29:0/1839792679 >> 172.21.15.29:0/1839792679 conn(0x7fd52c0670a0 msgr2=0x7fd52c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:19.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 -- 172.21.15.29:0/1839792679 shutdown_connections 2023-10-06T05:30:19.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.884+0000 7fd52b59e700 1 -- 172.21.15.29:0/1839792679 wait complete. 2023-10-06T05:30:19.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 Processor -- start 2023-10-06T05:30:19.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 -- start start 2023-10-06T05:30:19.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c0c68b0 0x7fd52c0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd52c1569f0 0x7fd52c13e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c156dc0 0x7fd52c14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c3900 con 0x7fd52c1569f0 2023-10-06T05:30:19.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c3be0 con 0x7fd52c0c68b0 2023-10-06T05:30:19.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c3ec0 con 0x7fd52c156dc0 2023-10-06T05:30:19.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd523fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd52c1569f0 0x7fd52c13e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd523fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd52c1569f0 0x7fd52c13e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58562/0 (socket says 172.21.15.29:58562) 2023-10-06T05:30:19.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd523fff700 1 -- 172.21.15.29:0/3949548077 learned_addr learned my addr 172.21.15.29:0/3949548077 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:19.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52a59c700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c0c68b0 0x7fd52c0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52ad9d700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c156dc0 0x7fd52c14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd523fff700 1 -- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c156dc0 msgr2=0x7fd52c14ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:19.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd523fff700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c156dc0 0x7fd52c14ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd523fff700 1 -- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c0c68b0 msgr2=0x7fd52c0b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:19.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd523fff700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c0c68b0 0x7fd52c0b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:19.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd523fff700 1 -- 172.21.15.29:0/3949548077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c009420 con 0x7fd52c1569f0 2023-10-06T05:30:19.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd523fff700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd52c1569f0 0x7fd52c13e310 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009ea0 tx=0x7fd51c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:19.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd5227fc700 1 -- 172.21.15.29:0/3949548077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c01f070 con 0x7fd52c1569f0 2023-10-06T05:30:19.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd5227fc700 1 -- 172.21.15.29:0/3949548077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c000bc0 con 0x7fd52c1569f0 2023-10-06T05:30:19.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c0c41a0 con 0x7fd52c1569f0 2023-10-06T05:30:19.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd5227fc700 1 -- 172.21.15.29:0/3949548077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011b50 con 0x7fd52c1569f0 2023-10-06T05:30:19.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.888+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c13e850 con 0x7fd52c1569f0 2023-10-06T05:30:19.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.892+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c0c9530 con 0x7fd52c1569f0 2023-10-06T05:30:19.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.892+0000 7fd5227fc700 1 -- 172.21.15.29:0/3949548077 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd51c023070 con 0x7fd52c1569f0 2023-10-06T05:30:19.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.892+0000 7fd5227fc700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd50c060550 0x7fd50c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:19.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.892+0000 7fd5227fc700 1 -- 172.21.15.29:0/3949548077 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fd51c07dbc0 con 0x7fd52c1569f0 2023-10-06T05:30:19.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.892+0000 7fd52a59c700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd50c060550 0x7fd50c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:19.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.896+0000 7fd52a59c700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd50c060550 0x7fd50c062a00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd514006d40 tx=0x7fd514009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:19.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:19.900+0000 7fd5227fc700 1 -- 172.21.15.29:0/3949548077 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd52c0c9530 con 0x7fd52c1569f0 2023-10-06T05:30:20.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.104+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd52c0c9530 con 0x7fd52c1569f0 2023-10-06T05:30:20.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.104+0000 7fd5227fc700 1 -- 172.21.15.29:0/3949548077 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fd52c0c9530 con 0x7fd52c1569f0 2023-10-06T05:30:20.112 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:20.112 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:19.751200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":44,"state":"up:replay","state_seq":1,"addr":"172.21.15.29:6835/763503157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":763503157},{"type":"v1","addr":"172.21.15.29:6835","nonce":763503157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:20.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd50c060550 msgr2=0x7fd50c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:20.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd50c060550 0x7fd50c062a00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd514006d40 tx=0x7fd514009250 comp rx=0 tx=0).stop 2023-10-06T05:30:20.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd52c1569f0 msgr2=0x7fd52c13e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:20.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd52c1569f0 0x7fd52c13e310 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009ea0 tx=0x7fd51c017000 comp rx=0 tx=0).stop 2023-10-06T05:30:20.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 shutdown_connections 2023-10-06T05:30:20.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd52c156dc0 0x7fd52c14ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:20.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd52c1569f0 0x7fd52c13e310 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:20.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fd50c060550 0x7fd50c062a00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:20.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 --2- 172.21.15.29:0/3949548077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52c0c68b0 0x7fd52c0b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:20.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 >> 172.21.15.29:0/3949548077 conn(0x7fd52c0670a0 msgr2=0x7fd52c0abe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:20.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 shutdown_connections 2023-10-06T05:30:20.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:20.108+0000 7fd52b59e700 1 -- 172.21.15.29:0/3949548077 wait complete. 2023-10-06T05:30:20.116 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 44 2023-10-06T05:30:20.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:29:53.859418+0000', 'modified': '2023-10-06T05:30:19.751200+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 78, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6726}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6726': {'gid': 6726, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.29:6835/763503157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 763503157}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 763503157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:30:20.529 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6726:up:replay 2023-10-06T05:30:21.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe065584700 1 Processor -- start 2023-10-06T05:30:21.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe065584700 1 -- start start 2023-10-06T05:30:21.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe065584700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe06006e960 0x7fe06006ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:21.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe065584700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0600c8100 0x7fe060156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:21.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe065584700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe060159bf0 con 0x7fe06015a080 2023-10-06T05:30:21.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe065584700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0601598c0 con 0x7fe06006e960 2023-10-06T05:30:21.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe065584700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe060156b90 con 0x7fe0600c8100 2023-10-06T05:30:21.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe05effd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe06006e960 0x7fe06006ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:21.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe05effd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe06006e960 0x7fe06006ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58566/0 (socket says 172.21.15.29:58566) 2023-10-06T05:30:21.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe05effd700 1 -- 172.21.15.29:0/1839715148 learned_addr learned my addr 172.21.15.29:0/1839715148 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:21.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe05e7fc700 1 --2- 172.21.15.29:0/1839715148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0600c8100 0x7fe060156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:21.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe05effd700 1 -- 172.21.15.29:0/1839715148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0600c8100 msgr2=0x7fe060156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:21.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe05dffb700 1 -- 172.21.15.29:0/1839715148 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409685799 0 0) 0x7fe060159bf0 con 0x7fe06015a080 2023-10-06T05:30:21.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe05effd700 1 --2- 172.21.15.29:0/1839715148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0600c8100 0x7fe060156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe05effd700 1 -- 172.21.15.29:0/1839715148 >> v1:172.21.15.173:6789/0 conn(0x7fe06015a080 legacy=0x7fe06014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:21.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.636+0000 7fe05effd700 1 -- 172.21.15.29:0/1839715148 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060156e70 con 0x7fe06006e960 2023-10-06T05:30:21.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe05effd700 1 --2- 172.21.15.29:0/1839715148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe06006e960 0x7fe06006ed30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe0480099b0 tx=0x7fe048009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0c6b4e2a82ae44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:21.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe05dffb700 1 -- 172.21.15.29:0/1839715148 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048009ea0 con 0x7fe06006e960 2023-10-06T05:30:21.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe05dffb700 1 -- 172.21.15.29:0/1839715148 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04800b860 con 0x7fe06006e960 2023-10-06T05:30:21.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe05dffb700 1 -- 172.21.15.29:0/1839715148 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800bc00 con 0x7fe06006e960 2023-10-06T05:30:21.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 -- 172.21.15.29:0/1839715148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe06006e960 msgr2=0x7fe06006ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:21.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 --2- 172.21.15.29:0/1839715148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe06006e960 0x7fe06006ed30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe0480099b0 tx=0x7fe048009250 comp rx=0 tx=0).stop 2023-10-06T05:30:21.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 -- 172.21.15.29:0/1839715148 shutdown_connections 2023-10-06T05:30:21.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 --2- 172.21.15.29:0/1839715148 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0600c8100 0x7fe060156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 --2- 172.21.15.29:0/1839715148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe06006e960 0x7fe06006ed30 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 -- 172.21.15.29:0/1839715148 >> 172.21.15.29:0/1839715148 conn(0x7fe060067b70 msgr2=0x7fe06006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:21.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 -- 172.21.15.29:0/1839715148 shutdown_connections 2023-10-06T05:30:21.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 -- 172.21.15.29:0/1839715148 wait complete. 2023-10-06T05:30:21.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 Processor -- start 2023-10-06T05:30:21.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.640+0000 7fe065584700 1 -- start start 2023-10-06T05:30:21.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe065584700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe06006e960 0x7fe06014c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:21.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe065584700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0600c8100 0x7fe0600c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe065584700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe06015a080 0x7fe0600ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe065584700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe060168b80 con 0x7fe0600c8100 2023-10-06T05:30:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe065584700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600ca5d0 con 0x7fe06006e960 2023-10-06T05:30:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe065584700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600ca8b0 con 0x7fe06015a080 2023-10-06T05:30:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0600c8100 0x7fe0600c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0600c8100 0x7fe0600c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58576/0 (socket says 172.21.15.29:58576) 2023-10-06T05:30:21.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05e7fc700 1 -- 172.21.15.29:0/1803810459 learned_addr learned my addr 172.21.15.29:0/1803810459 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05effd700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe06006e960 0x7fe06014c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05f7fe700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe06015a080 0x7fe0600ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05e7fc700 1 -- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe06015a080 msgr2=0x7fe0600ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05e7fc700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe06015a080 0x7fe0600ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05e7fc700 1 -- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe06006e960 msgr2=0x7fe06014c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05e7fc700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe06006e960 0x7fe06014c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05e7fc700 1 -- 172.21.15.29:0/1803810459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480094f0 con 0x7fe0600c8100 2023-10-06T05:30:21.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe05e7fc700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0600c8100 0x7fe0600c9b80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe05000ec80 tx=0x7fe0500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:21.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe056ffd700 1 -- 172.21.15.29:0/1803810459 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000c850 con 0x7fe0600c8100 2023-10-06T05:30:21.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe056ffd700 1 -- 172.21.15.29:0/1803810459 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05000c9b0 con 0x7fe0600c8100 2023-10-06T05:30:21.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0600cab90 con 0x7fe0600c8100 2023-10-06T05:30:21.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe056ffd700 1 -- 172.21.15.29:0/1803810459 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000cd50 con 0x7fe0600c8100 2023-10-06T05:30:21.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe06014cb10 con 0x7fe0600c8100 2023-10-06T05:30:21.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.644+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe06004be00 con 0x7fe0600c8100 2023-10-06T05:30:21.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.648+0000 7fe056ffd700 1 -- 172.21.15.29:0/1803810459 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe050013680 con 0x7fe0600c8100 2023-10-06T05:30:21.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.648+0000 7fe056ffd700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe040060550 0x7fe040062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:21.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.648+0000 7fe056ffd700 1 -- 172.21.15.29:0/1803810459 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe05007d300 con 0x7fe0600c8100 2023-10-06T05:30:21.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.648+0000 7fe05effd700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe040060550 0x7fe040062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:21.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.648+0000 7fe05effd700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe040060550 0x7fe040062a00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe0480099b0 tx=0x7fe048017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:21.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.656+0000 7fe056ffd700 1 -- 172.21.15.29:0/1803810459 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe05004d7c0 con 0x7fe0600c8100 2023-10-06T05:30:21.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.860+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe06006f4f0 con 0x7fe0600c8100 2023-10-06T05:30:21.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.860+0000 7fe056ffd700 1 -- 172.21.15.29:0/1803810459 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fe050050de0 con 0x7fe0600c8100 2023-10-06T05:30:21.866 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:21.866 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:21.758019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":44,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.29:6835/763503157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":763503157},{"type":"v1","addr":"172.21.15.29:6835","nonce":763503157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:21.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.860+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe040060550 msgr2=0x7fe040062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.860+0000 7fe065584700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe040060550 0x7fe040062a00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe0480099b0 tx=0x7fe048017000 comp rx=0 tx=0).stop 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.860+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0600c8100 msgr2=0x7fe0600c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.860+0000 7fe065584700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0600c8100 0x7fe0600c9b80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe05000ec80 tx=0x7fe0500091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.864+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 shutdown_connections 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.864+0000 7fe065584700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe06015a080 0x7fe0600ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.864+0000 7fe065584700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0600c8100 0x7fe0600c9b80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.864+0000 7fe065584700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fe040060550 0x7fe040062a00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.864+0000 7fe065584700 1 --2- 172.21.15.29:0/1803810459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe06006e960 0x7fe06014c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.864+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 >> 172.21.15.29:0/1803810459 conn(0x7fe060067b70 msgr2=0x7fe060153e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.864+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 shutdown_connections 2023-10-06T05:30:21.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:21.864+0000 7fe065584700 1 -- 172.21.15.29:0/1803810459 wait complete. 2023-10-06T05:30:21.870 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 46 2023-10-06T05:30:22.288 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:29:53.859418+0000', 'modified': '2023-10-06T05:30:21.758019+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 78, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6726}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6726': {'gid': 6726, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.29:6835/763503157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 763503157}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 763503157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:30:22.288 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6726:up:rejoin 2023-10-06T05:30:23.289 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:23.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.400+0000 7ff4f7916700 1 Processor -- start 2023-10-06T05:30:23.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.400+0000 7ff4f7916700 1 -- start start 2023-10-06T05:30:23.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4f015d4a0 0x7ff4f006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:23.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff4f006dc10 0x7ff4f00aa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:23.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f015d010 con 0x7ff4f00ace80 2023-10-06T05:30:23.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f006e050 con 0x7ff4f015d4a0 2023-10-06T05:30:23.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00ad250 con 0x7ff4f006dc10 2023-10-06T05:30:23.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f56b2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff4f00ace80 0x7ff4f0159500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41022/0 (socket says 172.21.15.29:41022) 2023-10-06T05:30:23.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f4eb1700 1 --2- 172.21.15.29:0/1829513499 >> v2:172.21.15.29:3300/0 conn(0x7ff4f015d4a0 0x7ff4f006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:23.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f56b2700 1 -- 172.21.15.29:0/1829513499 learned_addr learned my addr 172.21.15.29:0/1829513499 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:23.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f5eb3700 1 --2- 172.21.15.29:0/1829513499 >> v2:172.21.15.173:3300/0 conn(0x7ff4f006dc10 0x7ff4f00aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:23.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f4eb1700 1 -- 172.21.15.29:0/1829513499 >> v2:172.21.15.173:3300/0 conn(0x7ff4f006dc10 msgr2=0x7ff4f00aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:23.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f4eb1700 1 --2- 172.21.15.29:0/1829513499 >> v2:172.21.15.173:3300/0 conn(0x7ff4f006dc10 0x7ff4f00aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f4eb1700 1 -- 172.21.15.29:0/1829513499 >> v1:172.21.15.29:6789/0 conn(0x7ff4f00ace80 legacy=0x7ff4f0159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:23.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f4eb1700 1 -- 172.21.15.29:0/1829513499 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0159f50 con 0x7ff4f015d4a0 2023-10-06T05:30:23.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4e3fff700 1 -- 172.21.15.29:0/1829513499 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491240341 0 0) 0x7ff4f015d010 con 0x7ff4f00ace80 2023-10-06T05:30:23.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f4eb1700 1 --2- 172.21.15.29:0/1829513499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f015d4a0 0x7ff4f006d6d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff4f006c180 tx=0x7ff4e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fb177a9599ca5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:23.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4e3fff700 1 -- 172.21.15.29:0/1829513499 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011630 con 0x7ff4f015d4a0 2023-10-06T05:30:23.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4e3fff700 1 -- 172.21.15.29:0/1829513499 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4011790 con 0x7ff4f015d4a0 2023-10-06T05:30:23.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4e3fff700 1 -- 172.21.15.29:0/1829513499 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011b30 con 0x7ff4f015d4a0 2023-10-06T05:30:23.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 -- 172.21.15.29:0/1829513499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f015d4a0 msgr2=0x7ff4f006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 --2- 172.21.15.29:0/1829513499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f015d4a0 0x7ff4f006d6d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff4f006c180 tx=0x7ff4e40091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 -- 172.21.15.29:0/1829513499 shutdown_connections 2023-10-06T05:30:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 --2- 172.21.15.29:0/1829513499 >> v2:172.21.15.173:3300/0 conn(0x7ff4f006dc10 0x7ff4f00aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 --2- 172.21.15.29:0/1829513499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f015d4a0 0x7ff4f006d6d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 -- 172.21.15.29:0/1829513499 >> 172.21.15.29:0/1829513499 conn(0x7ff4f006b7b0 msgr2=0x7ff4f00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 -- 172.21.15.29:0/1829513499 shutdown_connections 2023-10-06T05:30:23.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.404+0000 7ff4f7916700 1 -- 172.21.15.29:0/1829513499 wait complete. 2023-10-06T05:30:23.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f7916700 1 Processor -- start 2023-10-06T05:30:23.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f7916700 1 -- start start 2023-10-06T05:30:23.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f7916700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4f006dc10 0x7ff4f00af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:23.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f7916700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f00ace80 0x7ff4f00afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:23.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f7916700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4f015d4a0 0x7ff4f016c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:23.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f7916700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00b0da0 con 0x7ff4f00ace80 2023-10-06T05:30:23.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f7916700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c13b0 con 0x7ff4f015d4a0 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f7916700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00b0190 con 0x7ff4f006dc10 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f4eb1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f00ace80 0x7ff4f00afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f4eb1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f00ace80 0x7ff4f00afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58600/0 (socket says 172.21.15.29:58600) 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f4eb1700 1 -- 172.21.15.29:0/1155298467 learned_addr learned my addr 172.21.15.29:0/1155298467 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f56b2700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4f006dc10 0x7ff4f00af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.408+0000 7ff4f5eb3700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4f015d4a0 0x7ff4f016c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4f4eb1700 1 -- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4f006dc10 msgr2=0x7ff4f00af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4f4eb1700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4f006dc10 0x7ff4f00af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4f4eb1700 1 -- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4f015d4a0 msgr2=0x7ff4f016c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4f4eb1700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4f015d4a0 0x7ff4f016c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4f4eb1700 1 -- 172.21.15.29:0/1155298467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009420 con 0x7ff4f00ace80 2023-10-06T05:30:23.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4f4eb1700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f00ace80 0x7ff4f00afb60 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff4f006a620 tx=0x7ff4e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:23.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4e17fa700 1 -- 172.21.15.29:0/1155298467 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4000d10 con 0x7ff4f00ace80 2023-10-06T05:30:23.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4e17fa700 1 -- 172.21.15.29:0/1155298467 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4011b10 con 0x7ff4f00ace80 2023-10-06T05:30:23.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f00b0470 con 0x7ff4f00ace80 2023-10-06T05:30:23.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4e17fa700 1 -- 172.21.15.29:0/1155298467 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4025640 con 0x7ff4f00ace80 2023-10-06T05:30:23.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f00b0a30 con 0x7ff4f00ace80 2023-10-06T05:30:23.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f00b0f50 con 0x7ff4f00ace80 2023-10-06T05:30:23.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4e17fa700 1 -- 172.21.15.29:0/1155298467 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff4e4025a30 con 0x7ff4f00ace80 2023-10-06T05:30:23.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4e17fa700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff4d4060550 0x7ff4d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:23.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.412+0000 7ff4e17fa700 1 -- 172.21.15.29:0/1155298467 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7ff4e407e070 con 0x7ff4f00ace80 2023-10-06T05:30:23.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.416+0000 7ff4f56b2700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff4d4060550 0x7ff4d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:23.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.416+0000 7ff4f56b2700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff4d4060550 0x7ff4d4062a00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec007fd0 tx=0x7ff4ec007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:23.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.420+0000 7ff4e17fa700 1 -- 172.21.15.29:0/1155298467 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff4f00b0f50 con 0x7ff4f00ace80 2023-10-06T05:30:23.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.620+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4f004be00 con 0x7ff4f00ace80 2023-10-06T05:30:23.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.620+0000 7ff4e17fa700 1 -- 172.21.15.29:0/1155298467 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4603 (secure 0 0 0) 0x7ff4e4015090 con 0x7ff4f00ace80 2023-10-06T05:30:23.628 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:23.628 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:22.771194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/763503157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":763503157},{"type":"v1","addr":"172.21.15.29:6835","nonce":763503157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff4d4060550 msgr2=0x7ff4d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff4d4060550 0x7ff4d4062a00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec007fd0 tx=0x7ff4ec007d30 comp rx=0 tx=0).stop 2023-10-06T05:30:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f00ace80 msgr2=0x7ff4f00afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:23.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f00ace80 0x7ff4f00afb60 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff4f006a620 tx=0x7ff4e4017000 comp rx=0 tx=0).stop 2023-10-06T05:30:23.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 shutdown_connections 2023-10-06T05:30:23.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff4d4060550 0x7ff4d4062a00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4f015d4a0 0x7ff4f016c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f00ace80 0x7ff4f00afb60 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 --2- 172.21.15.29:0/1155298467 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4f006dc10 0x7ff4f00af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:23.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 >> 172.21.15.29:0/1155298467 conn(0x7ff4f006b7b0 msgr2=0x7ff4f00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:23.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 shutdown_connections 2023-10-06T05:30:23.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:23.624+0000 7ff4f7916700 1 -- 172.21.15.29:0/1155298467 wait complete. 2023-10-06T05:30:23.633 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 47 2023-10-06T05:30:24.045 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:29:53.859418+0000', 'modified': '2023-10-06T05:30:22.771194+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 78, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6726}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6726': {'gid': 6726, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.29:6835/763503157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 763503157}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 763503157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:30:24.046 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T05:30:24.046 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T05:30:24.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.156+0000 7fa308987700 1 Processor -- start 2023-10-06T05:30:24.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.156+0000 7fa308987700 1 -- start start 2023-10-06T05:30:24.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa308987700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3040ca5b0 0x7fa30406b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa308987700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3040cc8b0 con 0x7fa30415e490 2023-10-06T05:30:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa308987700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30406b280 con 0x7fa30415ace0 2023-10-06T05:30:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa308987700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30406bc50 con 0x7fa3040ca5b0 2023-10-06T05:30:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30259c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa30415e490 0x7fa3040c9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41024/0 (socket says 172.21.15.29:41024) 2023-10-06T05:30:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30259c700 1 -- 172.21.15.29:0/1486141866 learned_addr learned my addr 172.21.15.29:0/1486141866 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:24.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30359e700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3040ca5b0 0x7fa30406b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898833399 0 0) 0x7fa3040cc8b0 con 0x7fa30415e490 2023-10-06T05:30:24.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f0003570 con 0x7fa30415e490 2023-10-06T05:30:24.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483677231 0 0) 0x7fa30406b280 con 0x7fa30415ace0 2023-10-06T05:30:24.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3040cc8b0 con 0x7fa30415ace0 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3046941620 0 0) 0x7fa2f0003570 con 0x7fa30415e490 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3040ca5b0 msgr2=0x7fa30406b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3040ca5b0 0x7fa30406b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 >> v1:172.21.15.173:6789/0 conn(0x7fa30415ace0 legacy=0x7fa3040cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30406a670 con 0x7fa30415e490 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fa2f4001490 con 0x7fa30415e490 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 >> v1:172.21.15.29:6789/0 conn(0x7fa30415e490 legacy=0x7fa3040c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f0003c20 0x7fa2f0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2f0004810 0x7fa2f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3040ca5b0 0x7fa2f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30406bc50 con 0x7fa2f0004810 2023-10-06T05:30:24.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f000bb40 con 0x7fa2f0003c20 2023-10-06T05:30:24.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f000bd00 con 0x7fa3040ca5b0 2023-10-06T05:30:24.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30259c700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2f0004810 0x7fa2f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa302d9d700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f0003c20 0x7fa2f0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30359e700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3040ca5b0 0x7fa2f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30259c700 1 -- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3040ca5b0 msgr2=0x7fa2f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30259c700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa3040ca5b0 0x7fa2f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30259c700 1 -- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f0003c20 msgr2=0x7fa2f0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30259c700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f0003c20 0x7fa2f0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30259c700 1 -- 172.21.15.29:0/1486141866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0003570 con 0x7fa2f0004810 2023-10-06T05:30:24.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa302d9d700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f0003c20 0x7fa2f0004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:24.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa30259c700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2f0004810 0x7fa2f0004c80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa30406ed30 tx=0x7fa30406b1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f64c27f62a83bae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400cba0 con 0x7fa2f0004810 2023-10-06T05:30:24.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f400cd00 con 0x7fa2f0004810 2023-10-06T05:30:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.160+0000 7fa301d9b700 1 -- 172.21.15.29:0/1486141866 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4004b40 con 0x7fa2f0004810 2023-10-06T05:30:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 -- 172.21.15.29:0/1486141866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2f0004810 msgr2=0x7fa2f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 --2- 172.21.15.29:0/1486141866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2f0004810 0x7fa2f0004c80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa30406ed30 tx=0x7fa30406b1f0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa30359e700 1 -- 172.21.15.29:0/1486141866 reap_dead start 2023-10-06T05:30:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 -- 172.21.15.29:0/1486141866 shutdown_connections 2023-10-06T05:30:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 -- 172.21.15.29:0/1486141866 >> 172.21.15.29:0/1486141866 conn(0x7fa3040670a0 msgr2=0x7fa304067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 -- 172.21.15.29:0/1486141866 shutdown_connections 2023-10-06T05:30:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 -- 172.21.15.29:0/1486141866 wait complete. 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 Processor -- start 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 -- start start 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa304153230 0x7fa3040c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3040c2f20 0x7fa3040ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3040aee20 0x7fa30415bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30415b810 con 0x7fa3040c2f20 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa304153600 con 0x7fa3040aee20 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa308987700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040c34a0 con 0x7fa304153230 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa30259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3040c2f20 0x7fa3040ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa302d9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa304153230 0x7fa3040c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa30259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3040c2f20 0x7fa3040ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58614/0 (socket says 172.21.15.29:58614) 2023-10-06T05:30:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa30259c700 1 -- 172.21.15.29:0/375378760 learned_addr learned my addr 172.21.15.29:0/375378760 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.164+0000 7fa30359e700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3040aee20 0x7fa30415bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa30259c700 1 -- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa304153230 msgr2=0x7fa3040c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa30259c700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa304153230 0x7fa3040c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa30259c700 1 -- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3040aee20 msgr2=0x7fa30415bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa30259c700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3040aee20 0x7fa30415bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa30259c700 1 -- 172.21.15.29:0/375378760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30415b1c0 con 0x7fa3040c2f20 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa30259c700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3040c2f20 0x7fa3040ae8e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000bb10 tx=0x7fa2f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa2faffd700 1 -- 172.21.15.29:0/375378760 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4004b00 con 0x7fa3040c2f20 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa2faffd700 1 -- 172.21.15.29:0/375378760 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4007150 con 0x7fa3040c2f20 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa308987700 1 -- 172.21.15.29:0/375378760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30415b4a0 con 0x7fa3040c2f20 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa2faffd700 1 -- 172.21.15.29:0/375378760 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4007530 con 0x7fa3040c2f20 2023-10-06T05:30:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa308987700 1 -- 172.21.15.29:0/375378760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30415ceb0 con 0x7fa3040c2f20 2023-10-06T05:30:24.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.168+0000 7fa2faffd700 1 -- 172.21.15.29:0/375378760 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa2f4014420 con 0x7fa3040c2f20 2023-10-06T05:30:24.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa2faffd700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa2e4060550 0x7fa2e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa2faffd700 1 -- 172.21.15.29:0/375378760 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa2f407e160 con 0x7fa3040c2f20 2023-10-06T05:30:24.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa302d9d700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa2e4060550 0x7fa2e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa302d9d700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa2e4060550 0x7fa2e4062a00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0014d0 tx=0x7fa2ec007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa30b431740 1 Processor -- start 2023-10-06T05:30:24.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa30b431740 1 -- start start 2023-10-06T05:30:24.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa30b431740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2930630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa30b431740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 0x2930b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa30b431740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 0x29310b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa30b431740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x285ef30 con 0x26b3ae0 2023-10-06T05:30:24.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa30b431740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x285aed0 con 0x26b3710 2023-10-06T05:30:24.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa30b431740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x28210b0 con 0x26fe790 2023-10-06T05:30:24.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa302d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2930630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa302d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2930630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58628/0 (socket says 172.21.15.29:58628) 2023-10-06T05:30:24.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.172+0000 7fa302d9d700 1 -- 172.21.15.29:0/3787405348 learned_addr learned my addr 172.21.15.29:0/3787405348 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:24.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30359e700 1 --2- 172.21.15.29:0/3787405348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 0x29310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30259c700 1 --2- 172.21.15.29:0/3787405348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 0x2930b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa302d9d700 1 -- 172.21.15.29:0/3787405348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 msgr2=0x29310b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa302d9d700 1 --2- 172.21.15.29:0/3787405348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 0x29310b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa302d9d700 1 -- 172.21.15.29:0/3787405348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 msgr2=0x2930b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa302d9d700 1 --2- 172.21.15.29:0/3787405348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 0x2930b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa302d9d700 1 -- 172.21.15.29:0/3787405348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26ff9e0 con 0x26b3ae0 2023-10-06T05:30:24.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa302d9d700 1 --2- 172.21.15.29:0/3787405348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2930630 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0027d0 tx=0x7fa2ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa616b923a3e03d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa2e3fff700 1 -- 172.21.15.29:0/3787405348 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec01a040 con 0x26b3ae0 2023-10-06T05:30:24.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa2e3fff700 1 -- 172.21.15.29:0/3787405348 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0016b0 con 0x26b3ae0 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa2e3fff700 1 -- 172.21.15.29:0/3787405348 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec001a70 con 0x26b3ae0 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 -- 172.21.15.29:0/3787405348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 msgr2=0x2930630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 --2- 172.21.15.29:0/3787405348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2930630 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0027d0 tx=0x7fa2ec017000 comp rx=0 tx=0).stop 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 -- 172.21.15.29:0/3787405348 shutdown_connections 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 --2- 172.21.15.29:0/3787405348 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 0x29310b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 --2- 172.21.15.29:0/3787405348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 0x2930b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 --2- 172.21.15.29:0/3787405348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2930630 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 -- 172.21.15.29:0/3787405348 >> 172.21.15.29:0/3787405348 conn(0x26b3eb0 msgr2=0x28ed060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 -- 172.21.15.29:0/3787405348 shutdown_connections 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 -- 172.21.15.29:0/3787405348 wait complete. 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 -- start start 2023-10-06T05:30:24.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.176+0000 7fa30b431740 1 Processor -- start 2023-10-06T05:30:24.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 0x2934c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3ae0 0x2935180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26fe790 0x28eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2820d50 con 0x26fe790 2023-10-06T05:30:24.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x27f9970 con 0x26b3ae0 2023-10-06T05:30:24.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x280c550 con 0x26b3710 2023-10-06T05:30:24.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 10 client.0 _ll_register_callbacks cb 0x27fdb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:24.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26fe790 0x28eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26fe790 0x28eac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58636/0 (socket says 172.21.15.29:58636) 2023-10-06T05:30:24.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30359e700 1 -- 172.21.15.29:0/459323930 learned_addr learned my addr 172.21.15.29:0/459323930 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:24.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa302d9d700 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 0x2934c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30259c700 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3ae0 0x2935180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30359e700 1 -- 172.21.15.29:0/459323930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 msgr2=0x2934c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30359e700 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 0x2934c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30359e700 1 -- 172.21.15.29:0/459323930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3ae0 msgr2=0x2935180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30359e700 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3ae0 0x2935180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30359e700 1 -- 172.21.15.29:0/459323930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3040cc8b0 con 0x26fe790 2023-10-06T05:30:24.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30359e700 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26fe790 0x28eac60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa304069b10 tx=0x7fa2fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33757749fc3b0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa2e17fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:30:24.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa2e17fa700 1 -- 172.21.15.29:0/459323930 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc00e040 con 0x26fe790 2023-10-06T05:30:24.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 -- 172.21.15.29:0/459323930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27f9cc0 con 0x26fe790 2023-10-06T05:30:24.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa2e17fa700 1 -- 172.21.15.29:0/459323930 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa2fc015c00 con 0x26fe790 2023-10-06T05:30:24.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa2e17fa700 1 -- 172.21.15.29:0/459323930 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2fc017310 con 0x26fe790 2023-10-06T05:30:24.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 10 client.6777 fetch_fsmap learned FSMap version 47 2023-10-06T05:30:24.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 -- 172.21.15.29:0/459323930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x2829370 con 0x26fe790 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa2e17fa700 1 -- 172.21.15.29:0/459323930 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27f9cc0 con 0x26fe790 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa2e17fa700 1 -- 172.21.15.29:0/459323930 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa2fc01f400 con 0x26fe790 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 10 client.6777 fetch_fsmap finished waiting for FSMap version 47 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 10 client.6777 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 20 client.6777 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x28ec2f0 0x293fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 4 client.6777 mds_command: new command op to 6726 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa30b431740 1 -- 172.21.15.29:0/459323930 --> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27fd3e0 con 0x28ec2f0 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.180+0000 7fa302d9d700 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x28ec2f0 0x293fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa2e17fa700 10 client.6777 ms_handle_connect on v2:172.21.15.29:6834/763503157 2023-10-06T05:30:24.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa302d9d700 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x28ec2f0 0x293fde0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90662c2586225300 server_cookie=10ef62a0e4ab3890 in_seq=0 out_seq=0 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa2e17fa700 1 -- 172.21.15.29:0/459323930 <== mds.0 v2:172.21.15.29:6834/763503157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x27fd3e0 con 0x28ec2f0 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa2e17fa700 10 client.6777 handle_command_reply: tid=0 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 client.6777 shutdown 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 -- 172.21.15.29:0/459323930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26fe790 msgr2=0x28eac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26fe790 0x28eac60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa304069b10 tx=0x7fa2fc00b040 comp rx=0 tx=0).stop 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 -- 172.21.15.29:0/459323930 shutdown_connections 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x28ec2f0 0x293fde0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26fe790 0x28eac60 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3ae0 0x2935180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 --2- 172.21.15.29:0/459323930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 0x2934c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 -- 172.21.15.29:0/459323930 >> 172.21.15.29:0/459323930 conn(0x26b3eb0 msgr2=0x29141e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:24.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa2e17fa700 0 client.6777 ms_handle_reset on v2:172.21.15.29:6834/763503157 2023-10-06T05:30:24.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 -- 172.21.15.29:0/459323930 shutdown_connections 2023-10-06T05:30:24.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 1 -- 172.21.15.29:0/459323930 wait complete. 2023-10-06T05:30:24.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.184+0000 7fa30b431740 20 client.6777 trim_cache size 0 max 16384 2023-10-06T05:30:24.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30b431740 1 Processor -- start 2023-10-06T05:30:24.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30b431740 1 -- start start 2023-10-06T05:30:24.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30b431740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 0x293fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30b431740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2940320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30b431740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26fe790 0x2940860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30b431740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x285e5d0 con 0x26b3ae0 2023-10-06T05:30:24.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30b431740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2858890 con 0x26fe790 2023-10-06T05:30:24.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30b431740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x282f610 con 0x26b3710 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2940320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2940320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58652/0 (socket says 172.21.15.29:58652) 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30259c700 1 -- 172.21.15.29:0/1727992634 learned_addr learned my addr 172.21.15.29:0/1727992634 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa302d9d700 1 --2- 172.21.15.29:0/1727992634 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 0x293fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30359e700 1 --2- 172.21.15.29:0/1727992634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26fe790 0x2940860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30259c700 1 -- 172.21.15.29:0/1727992634 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 msgr2=0x293fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30259c700 1 --2- 172.21.15.29:0/1727992634 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 0x293fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30259c700 1 -- 172.21.15.29:0/1727992634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26fe790 msgr2=0x2940860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30259c700 1 --2- 172.21.15.29:0/1727992634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26fe790 0x2940860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30259c700 1 -- 172.21.15.29:0/1727992634 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x280fd80 con 0x26b3ae0 2023-10-06T05:30:24.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa30259c700 1 --2- 172.21.15.29:0/1727992634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2940320 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40522b0 tx=0x7fa2f4006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4533a14d6c78d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa2f8ff9700 1 -- 172.21.15.29:0/1727992634 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40555b0 con 0x26b3ae0 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa2f8ff9700 1 -- 172.21.15.29:0/1727992634 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4059300 con 0x26b3ae0 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.200+0000 7fa2f8ff9700 1 -- 172.21.15.29:0/1727992634 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4050460 con 0x26b3ae0 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 -- 172.21.15.29:0/1727992634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 msgr2=0x2940320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 --2- 172.21.15.29:0/1727992634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2940320 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40522b0 tx=0x7fa2f4006040 comp rx=0 tx=0).stop 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 -- 172.21.15.29:0/1727992634 shutdown_connections 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 --2- 172.21.15.29:0/1727992634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26fe790 0x2940860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 --2- 172.21.15.29:0/1727992634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x2940320 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 --2- 172.21.15.29:0/1727992634 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26b3710 0x293fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 -- 172.21.15.29:0/1727992634 >> 172.21.15.29:0/1727992634 conn(0x26b3eb0 msgr2=0x2933650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 -- 172.21.15.29:0/1727992634 shutdown_connections 2023-10-06T05:30:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 -- 172.21.15.29:0/1727992634 wait complete. 2023-10-06T05:30:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 -- start start 2023-10-06T05:30:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.204+0000 7fa30b431740 1 Processor -- start 2023-10-06T05:30:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 0x298a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x298a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 0x290e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x2859d60 con 0x26b3ae0 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x282e040 con 0x26b3710 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2830550 con 0x26fe790 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 10 client.0 _ll_register_callbacks cb 0x2826110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x298a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x298a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58666/0 (socket says 172.21.15.29:58666) 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30259c700 1 -- 172.21.15.29:0/2621908847 learned_addr learned my addr 172.21.15.29:0/2621908847 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa302d9d700 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 0x298a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30359e700 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 0x290e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30259c700 1 -- 172.21.15.29:0/2621908847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 msgr2=0x290e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30259c700 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 0x290e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30259c700 1 -- 172.21.15.29:0/2621908847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 msgr2=0x298a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30259c700 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 0x298a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30259c700 1 -- 172.21.15.29:0/2621908847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30415ceb0 con 0x26b3ae0 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30359e700 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 0x290e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30259c700 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x298a7e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4007c90 tx=0x7fa2f4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ebb262ba6cb375 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa2e17fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa2e17fa700 1 -- 172.21.15.29:0/2621908847 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f407c2a0 con 0x26b3ae0 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa2e17fa700 1 -- 172.21.15.29:0/2621908847 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa2f40555b0 con 0x26b3ae0 2023-10-06T05:30:24.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 -- 172.21.15.29:0/2621908847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2ec0016b0 con 0x26b3ae0 2023-10-06T05:30:24.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa2e17fa700 1 -- 172.21.15.29:0/2621908847 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2f406c250 con 0x26b3ae0 2023-10-06T05:30:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 10 client.6783 fetch_fsmap learned FSMap version 47 2023-10-06T05:30:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 -- 172.21.15.29:0/2621908847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x2804130 con 0x26b3ae0 2023-10-06T05:30:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa2e17fa700 1 -- 172.21.15.29:0/2621908847 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0016b0 con 0x26b3ae0 2023-10-06T05:30:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa2e17fa700 1 -- 172.21.15.29:0/2621908847 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa2f40525c0 con 0x26b3ae0 2023-10-06T05:30:24.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 10 client.6783 fetch_fsmap finished waiting for FSMap version 47 2023-10-06T05:30:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 10 client.6783 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:30:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 20 client.6783 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x290ec60 0x290f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 4 client.6783 mds_command: new command op to 6726 tid=0[{"prefix": "status"}] 2023-10-06T05:30:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 -- 172.21.15.29:0/2621908847 --> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] -- command(tid 0: {"prefix": "status"}) v1 -- 0x282f410 con 0x290ec60 2023-10-06T05:30:24.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa302d9d700 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x290ec60 0x290f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa2e17fa700 10 client.6783 ms_handle_connect on v2:172.21.15.29:6834/763503157 2023-10-06T05:30:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa302d9d700 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x290ec60 0x290f030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aab1d0ec55522625 server_cookie=8900c8cf80fe928e in_seq=0 out_seq=0 2023-10-06T05:30:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa2e17fa700 1 -- 172.21.15.29:0/2621908847 <== mds.0 v2:172.21.15.29:6834/763503157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x282f410 con 0x290ec60 2023-10-06T05:30:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa2e17fa700 10 client.6783 handle_command_reply: tid=0 2023-10-06T05:30:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.208+0000 7fa30b431740 1 client.6783 shutdown 2023-10-06T05:30:24.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 -- 172.21.15.29:0/2621908847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 msgr2=0x298a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x298a7e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4007c90 tx=0x7fa2f4020000 comp rx=0 tx=0).stop 2023-10-06T05:30:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 -- 172.21.15.29:0/2621908847 shutdown_connections 2023-10-06T05:30:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x290ec60 0x290f030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26fe790 0x290e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26b3ae0 0x298a7e0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 --2- 172.21.15.29:0/2621908847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x26b3710 0x298a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 -- 172.21.15.29:0/2621908847 >> 172.21.15.29:0/2621908847 conn(0x26b3eb0 msgr2=0x2941210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa2e17fa700 0 client.6783 ms_handle_reset on v2:172.21.15.29:6834/763503157 2023-10-06T05:30:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 -- 172.21.15.29:0/2621908847 shutdown_connections 2023-10-06T05:30:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 1 -- 172.21.15.29:0/2621908847 wait complete. 2023-10-06T05:30:24.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa30b431740 20 client.6783 trim_cache size 0 max 16384 2023-10-06T05:30:24.226 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:24.226 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "bd99696d-d9bf-47c8-93f5-f978334ae590", 2023-10-06T05:30:24.226 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-06T05:30:24.226 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6726, 2023-10-06T05:30:24.227 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-06T05:30:24.227 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-06T05:30:24.227 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-06T05:30:24.227 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 4.4540529129999999, 2023-10-06T05:30:24.227 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 47, 2023-10-06T05:30:24.227 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 78, 2023-10-06T05:30:24.228 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 78, 2023-10-06T05:30:24.228 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 5.4333078769999998 2023-10-06T05:30:24.228 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:24.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 -- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa2e4060550 msgr2=0x7fa2e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa2e4060550 0x7fa2e4062a00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0014d0 tx=0x7fa2ec007d30 comp rx=0 tx=0).stop 2023-10-06T05:30:24.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 -- 172.21.15.29:0/375378760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3040c2f20 msgr2=0x7fa3040ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3040c2f20 0x7fa3040ae8e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000bb10 tx=0x7fa2f4015000 comp rx=0 tx=0).stop 2023-10-06T05:30:24.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 -- 172.21.15.29:0/375378760 shutdown_connections 2023-10-06T05:30:24.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa2e4060550 0x7fa2e4062a00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3040aee20 0x7fa30415bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3040c2f20 0x7fa3040ae8e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 --2- 172.21.15.29:0/375378760 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa304153230 0x7fa3040c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 -- 172.21.15.29:0/375378760 >> 172.21.15.29:0/375378760 conn(0x7fa3040670a0 msgr2=0x7fa30415dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:24.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 -- 172.21.15.29:0/375378760 shutdown_connections 2023-10-06T05:30:24.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.212+0000 7fa308987700 1 -- 172.21.15.29:0/375378760 wait complete. 2023-10-06T05:30:24.233 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:30:24.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f884d45b700 1 Processor -- start 2023-10-06T05:30:24.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f884d45b700 1 -- start start 2023-10-06T05:30:24.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f884d45b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8848155880 0x7f88480c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f884d45b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 0x7f884806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f884d45b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88480c8370 con 0x7f88480c7bc0 2023-10-06T05:30:24.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f884d45b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480c7730 con 0x7f8848155880 2023-10-06T05:30:24.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f884d45b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88480c6d60 con 0x7f88480670a0 2023-10-06T05:30:24.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f8847fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8848155880 0x7f88480c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f8847fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8848155880 0x7f88480c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58674/0 (socket says 172.21.15.29:58674) 2023-10-06T05:30:24.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f8847fff700 1 -- 172.21.15.29:0/2644256575 learned_addr learned my addr 172.21.15.29:0/2644256575 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:24.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f883ffff700 1 --2- 172.21.15.29:0/2644256575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 0x7f884806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f88477fe700 1 -- 172.21.15.29:0/2644256575 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278680674 0 0) 0x7f88480c8370 con 0x7f88480c7bc0 2023-10-06T05:30:24.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f88477fe700 1 -- 172.21.15.29:0/2644256575 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8834003570 con 0x7f88480c7bc0 2023-10-06T05:30:24.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f8847fff700 1 -- 172.21.15.29:0/2644256575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 msgr2=0x7f884806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:24.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f8847fff700 1 --2- 172.21.15.29:0/2644256575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 0x7f884806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f8847fff700 1 -- 172.21.15.29:0/2644256575 >> v1:172.21.15.173:6789/0 conn(0x7f88480c7bc0 legacy=0x7f88480caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f8847fff700 1 -- 172.21.15.29:0/2644256575 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848063170 con 0x7f8848155880 2023-10-06T05:30:24.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.340+0000 7f883ffff700 1 --2- 172.21.15.29:0/2644256575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 0x7f884806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:24.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f8847fff700 1 --2- 172.21.15.29:0/2644256575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 0x7f88480c71f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f88380099b0 tx=0x7f8838009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5246b27b75c62531 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f88477fe700 1 -- 172.21.15.29:0/2644256575 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800f6b0 con 0x7f8848155880 2023-10-06T05:30:24.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f88477fe700 1 -- 172.21.15.29:0/2644256575 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883800f810 con 0x7f8848155880 2023-10-06T05:30:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f88477fe700 1 -- 172.21.15.29:0/2644256575 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800fbb0 con 0x7f8848155880 2023-10-06T05:30:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 -- 172.21.15.29:0/2644256575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 msgr2=0x7f88480c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 --2- 172.21.15.29:0/2644256575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 0x7f88480c71f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f88380099b0 tx=0x7f8838009250 comp rx=0 tx=0).stop 2023-10-06T05:30:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 -- 172.21.15.29:0/2644256575 shutdown_connections 2023-10-06T05:30:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 --2- 172.21.15.29:0/2644256575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 0x7f884806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 --2- 172.21.15.29:0/2644256575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 0x7f88480c71f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 -- 172.21.15.29:0/2644256575 >> 172.21.15.29:0/2644256575 conn(0x7f884806aaf0 msgr2=0x7f884806aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 -- 172.21.15.29:0/2644256575 shutdown_connections 2023-10-06T05:30:24.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 -- 172.21.15.29:0/2644256575 wait complete. 2023-10-06T05:30:24.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 Processor -- start 2023-10-06T05:30:24.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.344+0000 7f884d45b700 1 -- start start 2023-10-06T05:30:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884d45b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 0x7f88480c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884d45b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88480c7bc0 0x7f8848164190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884d45b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 0x7f88480a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884d45b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88480c53b0 con 0x7f8848155880 2023-10-06T05:30:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884d45b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88480c5c50 con 0x7f88480c7bc0 2023-10-06T05:30:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884d45b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88480c6620 con 0x7f88480670a0 2023-10-06T05:30:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884cc5a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 0x7f88480a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884cc5a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 0x7f88480a5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58684/0 (socket says 172.21.15.29:58684) 2023-10-06T05:30:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884cc5a700 1 -- 172.21.15.29:0/2115551027 learned_addr learned my addr 172.21.15.29:0/2115551027 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f8847fff700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 0x7f88480c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f883ffff700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88480c7bc0 0x7f8848164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884cc5a700 1 -- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 msgr2=0x7f88480c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884cc5a700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 0x7f88480c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884cc5a700 1 -- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88480c7bc0 msgr2=0x7f8848164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884cc5a700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88480c7bc0 0x7f8848164190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884cc5a700 1 -- 172.21.15.29:0/2115551027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009420 con 0x7f8848155880 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884cc5a700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 0x7f88480a5960 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f884000c940 tx=0x7f8840007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f8844ff9700 1 -- 172.21.15.29:0/2115551027 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840012630 con 0x7f8848155880 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f8844ff9700 1 -- 172.21.15.29:0/2115551027 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88400127b0 con 0x7f8848155880 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88380094f0 con 0x7f8848155880 2023-10-06T05:30:24.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f8844ff9700 1 -- 172.21.15.29:0/2115551027 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840012b70 con 0x7f8848155880 2023-10-06T05:30:24.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88480c5600 con 0x7f8848155880 2023-10-06T05:30:24.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884804be00 con 0x7f8848155880 2023-10-06T05:30:24.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.348+0000 7f8844ff9700 1 -- 172.21.15.29:0/2115551027 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f884001b400 con 0x7f8848155880 2023-10-06T05:30:24.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.352+0000 7f8844ff9700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8828060550 0x7f8828062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:24.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.352+0000 7f8844ff9700 1 -- 172.21.15.29:0/2115551027 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f884007ccf0 con 0x7f8848155880 2023-10-06T05:30:24.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.352+0000 7f8847fff700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8828060550 0x7f8828062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:24.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.352+0000 7f8847fff700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8828060550 0x7f8828062a00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f88380099b0 tx=0x7f8838019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:24.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.356+0000 7f8844ff9700 1 -- 172.21.15.29:0/2115551027 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8840081070 con 0x7f8848155880 2023-10-06T05:30:24.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.552+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88480c5d90 con 0x7f8848155880 2023-10-06T05:30:24.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.552+0000 7f8844ff9700 1 -- 172.21.15.29:0/2115551027 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8840016070 con 0x7f8848155880 2023-10-06T05:30:24.559 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:30:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8828060550 msgr2=0x7f8828062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8828060550 0x7f8828062a00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f88380099b0 tx=0x7f8838019000 comp rx=0 tx=0).stop 2023-10-06T05:30:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 msgr2=0x7f88480a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:24.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 0x7f88480a5960 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f884000c940 tx=0x7f8840007f90 comp rx=0 tx=0).stop 2023-10-06T05:30:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 shutdown_connections 2023-10-06T05:30:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8848155880 0x7f88480a5960 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8828060550 0x7f8828062a00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88480c7bc0 0x7f8848164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 --2- 172.21.15.29:0/2115551027 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88480670a0 0x7f88480c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 >> 172.21.15.29:0/2115551027 conn(0x7f884806aaf0 msgr2=0x7f88480c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 shutdown_connections 2023-10-06T05:30:24.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:24.556+0000 7f884d45b700 1 -- 172.21.15.29:0/2115551027 wait complete. 2023-10-06T05:30:24.573 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:30:24.573 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:30:24.574 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:30:24.574 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T05:30:24.574 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:24.574 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:30:24.574 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:30:24.574 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:30:24.574 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:24.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:24.574 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:30:24.582 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:30:24.583 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42303sec preferred_lft 42303sec 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:24.584 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::38dc:3fff:fed0:feb0/64 scope link 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c88:ceff:fe77:b613/64 scope link 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether aa:ad:a4:57:7d:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a8ad:a4ff:fe57:7d6d/64 scope link 2023-10-06T05:30:24.585 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:24.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:24.586 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:30:24.600 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:30:24.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:24.602 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:30:24.609 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:30:24.610 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:30:24.610 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:30:24.610 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:30:24.610 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:30:24.610 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:30:24.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:24.610 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:30:24.610 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:30:24.610 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:30:24.611 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:30:24.611 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:30:24.611 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:30:24.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:24.694 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:30:24.700 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T05:30:24.701 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:30:24.701 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:24.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:24.701 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-06T05:30:24.716 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T05:30:24.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:30:24.716 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:24.723 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:24.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:30:24.724 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:24.765 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-06T05:30:24.760+0000 7fc790201700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:30:24.770 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:24.787 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:24.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:24.798 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:24.799 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:24.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:24.800 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:24.806 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:30:24.806 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T05:30:24.850 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:24.867 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:24.867 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:24.880 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:24.881 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:24.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:24.882 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:24.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2023-10-06T05:30:24.936+0000 7fcd3649e380 -1 init, newargv = 0x55bb871762d0 newargc=15 2023-10-06T05:30:24.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[48844]: starting ceph client 2023-10-06T05:30:24.953 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[48844]: starting fuse 2023-10-06T05:30:25.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:26.007 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:26.008 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:26.064 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:26.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:26.065 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:26.070 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:30:26.070 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:30:26.070 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:26.070 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:30:26.070 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:30:26.070 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:30:26.071 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:30:26.072 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:30:26.072 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:30:26.072 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:30:26.072 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:30:26.072 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:30:26.072 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:30:26.072 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:26.072 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2023-10-06T05:30:26.072 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:26.154 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.48844.asok 2023-10-06T05:30:26.339 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48844.asok 2023-10-06T05:30:26.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:26.340 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48844.asok status 2023-10-06T05:30:26.439 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "48844", 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:30:26.440 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6795, 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 6795 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:30:26.441 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2547081133 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2547081133 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.6795 192.168.0.1:0/2547081133", 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/2547081133", 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 47, 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 78, 2023-10-06T05:30:26.442 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:30:26.443 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:30:26.443 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:30:26.443 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:26.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:26.449 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:30:26.449 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:26.455 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:30:26.455 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:26.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:26.456 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:26.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:26.472 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T05:30:26.500 INFO:teuthology.orchestra.run.smithi029.stdout:./ 2023-10-06T05:30:26.500 INFO:teuthology.orchestra.run.smithi029.stdout:./parent 2023-10-06T05:30:26.500 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed 2023-10-06T05:30:26.500 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed/charlie 2023-10-06T05:30:26.501 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed/alpha 2023-10-06T05:30:26.501 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/unflushed 2023-10-06T05:30:26.501 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/unflushed/jfile 2023-10-06T05:30:26.502 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:26.502 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:26.502 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:26.502 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:26.502 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T05:30:26.502 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:26.613 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:30:26.801 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:26.801 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:26.801 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:26.801 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:26.801 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2023-10-06T05:30:26.801 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:26.867 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627776 2023-10-06T05:30:27.056 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:27.056 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:27.056 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:27.056 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:27.056 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2023-10-06T05:30:27.057 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:27.125 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627777 2023-10-06T05:30:27.313 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:27.314 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:27.314 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:27.314 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:27.314 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2023-10-06T05:30:27.314 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:27.385 INFO:teuthology.orchestra.run.smithi029.stdout:1099511628280 2023-10-06T05:30:27.572 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:27.572 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:27.572 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:27.572 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:27.572 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2023-10-06T05:30:27.572 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:27.644 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627778 2023-10-06T05:30:27.832 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:27.832 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:27.833 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:27.833 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:27.833 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2023-10-06T05:30:27.833 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:27.944 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627779 2023-10-06T05:30:28.136 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:28.136 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:28.136 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:28.136 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:28.136 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2023-10-06T05:30:28.136 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:28.201 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627780 2023-10-06T05:30:28.389 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:30:28.389 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:30:28.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:28.406 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[48844]: fuse finished with error 0 and tester_r 0 2023-10-06T05:30:28.407 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T05:30:34.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:30:34.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:34.510 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:30:34.518 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f36557f6700 1 Processor -- start 2023-10-06T05:30:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f36557f6700 1 -- start start 2023-10-06T05:30:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f36557f6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f365006c8f0 0x7f365006ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f36557f6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36500c8b50 0x7f365006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f36557f6700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365006b9e0 con 0x7f36500c9e80 2023-10-06T05:30:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f36557f6700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36500cb7e0 con 0x7f36500c8b50 2023-10-06T05:30:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f36557f6700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500caf80 con 0x7f365006c8f0 2023-10-06T05:30:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f364f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f36500c9e80 0x7f36501555a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57050/0 (socket says 172.21.15.29:57050) 2023-10-06T05:30:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f3654ff5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36500c8b50 0x7f365006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f364f7fe700 1 -- 172.21.15.29:0/237398782 learned_addr learned my addr 172.21.15.29:0/237398782 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f364ffff700 1 --2- 172.21.15.29:0/237398782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f365006c8f0 0x7f365006ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f3654ff5700 1 -- 172.21.15.29:0/237398782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f365006c8f0 msgr2=0x7f365006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f3654ff5700 1 --2- 172.21.15.29:0/237398782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f365006c8f0 0x7f365006ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f3654ff5700 1 -- 172.21.15.29:0/237398782 >> v1:172.21.15.29:6789/0 conn(0x7f36500c9e80 legacy=0x7f36501555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.623+0000 7f3654ff5700 1 -- 172.21.15.29:0/237398782 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500c7660 con 0x7f36500c8b50 2023-10-06T05:30:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f3654ff5700 1 --2- 172.21.15.29:0/237398782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36500c8b50 0x7f365006b4a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3648009e60 tx=0x7f3648009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7747cbc0b8066b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f364effd700 1 -- 172.21.15.29:0/237398782 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364800e070 con 0x7f36500c8b50 2023-10-06T05:30:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f364effd700 1 -- 172.21.15.29:0/237398782 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364800bc30 con 0x7f36500c8b50 2023-10-06T05:30:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f364effd700 1 -- 172.21.15.29:0/237398782 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648012430 con 0x7f36500c8b50 2023-10-06T05:30:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 -- 172.21.15.29:0/237398782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36500c8b50 msgr2=0x7f365006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 --2- 172.21.15.29:0/237398782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36500c8b50 0x7f365006b4a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3648009e60 tx=0x7f3648009780 comp rx=0 tx=0).stop 2023-10-06T05:30:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 -- 172.21.15.29:0/237398782 shutdown_connections 2023-10-06T05:30:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 --2- 172.21.15.29:0/237398782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36500c8b50 0x7f365006b4a0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 --2- 172.21.15.29:0/237398782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f365006c8f0 0x7f365006ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 -- 172.21.15.29:0/237398782 >> 172.21.15.29:0/237398782 conn(0x7f36500670a0 msgr2=0x7f36500674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 -- 172.21.15.29:0/237398782 shutdown_connections 2023-10-06T05:30:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 -- 172.21.15.29:0/237398782 wait complete. 2023-10-06T05:30:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 Processor -- start 2023-10-06T05:30:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.627+0000 7f36557f6700 1 -- start start 2023-10-06T05:30:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f36557f6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f365006c8f0 0x7f36500a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f36557f6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36500c9e80 0x7f3650151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f36557f6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3650152300 0x7f3650150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f36557f6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500b0ba0 con 0x7f365006c8f0 2023-10-06T05:30:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f36557f6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500a99c0 con 0x7f3650152300 2023-10-06T05:30:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f36557f6700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500a9ca0 con 0x7f36500c9e80 2023-10-06T05:30:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f365006c8f0 0x7f36500a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f365006c8f0 0x7f36500a92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57740/0 (socket says 172.21.15.29:57740) 2023-10-06T05:30:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364ffff700 1 -- 172.21.15.29:0/2971670362 learned_addr learned my addr 172.21.15.29:0/2971670362 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364f7fe700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36500c9e80 0x7f3650151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f3654ff5700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3650152300 0x7f3650150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:34.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364ffff700 1 -- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36500c9e80 msgr2=0x7f3650151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:34.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364ffff700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36500c9e80 0x7f3650151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:34.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364ffff700 1 -- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3650152300 msgr2=0x7f3650150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:34.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364ffff700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3650152300 0x7f3650150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:34.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364ffff700 1 -- 172.21.15.29:0/2971670362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3648009a20 con 0x7f365006c8f0 2023-10-06T05:30:34.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f364ffff700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f365006c8f0 0x7f36500a92e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f364000d890 tx=0x7f3640008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:34.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f3647fff700 1 -- 172.21.15.29:0/2971670362 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400125f0 con 0x7f365006c8f0 2023-10-06T05:30:34.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f3647fff700 1 -- 172.21.15.29:0/2971670362 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640012750 con 0x7f365006c8f0 2023-10-06T05:30:34.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36500a9f80 con 0x7f365006c8f0 2023-10-06T05:30:34.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f3647fff700 1 -- 172.21.15.29:0/2971670362 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640012af0 con 0x7f365006c8f0 2023-10-06T05:30:34.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36500ab8c0 con 0x7f365006c8f0 2023-10-06T05:30:34.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.631+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36500c5a10 con 0x7f365006c8f0 2023-10-06T05:30:34.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.635+0000 7f3647fff700 1 -- 172.21.15.29:0/2971670362 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f364001e460 con 0x7f365006c8f0 2023-10-06T05:30:34.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.635+0000 7f3647fff700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3630060550 0x7f3630062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:34.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.635+0000 7f3647fff700 1 -- 172.21.15.29:0/2971670362 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f364007cf00 con 0x7f365006c8f0 2023-10-06T05:30:34.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.635+0000 7f364f7fe700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3630060550 0x7f3630062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:34.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.635+0000 7f364f7fe700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3630060550 0x7f3630062a00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3650151a40 tx=0x7f3638009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.639+0000 7f3647fff700 1 -- 172.21.15.29:0/2971670362 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f36500c5a10 con 0x7f365006c8f0 2023-10-06T05:30:34.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.835+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36500c5a10 con 0x7f365006c8f0 2023-10-06T05:30:34.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.835+0000 7f3647fff700 1 -- 172.21.15.29:0/2971670362 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f36500c5a10 con 0x7f365006c8f0 2023-10-06T05:30:34.844 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:34.844 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:22.771194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/763503157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":763503157},{"type":"v1","addr":"172.21.15.29:6835","nonce":763503157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:34.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.839+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3630060550 msgr2=0x7f3630062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.839+0000 7f36557f6700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3630060550 0x7f3630062a00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3650151a40 tx=0x7f3638009040 comp rx=0 tx=0).stop 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.839+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f365006c8f0 msgr2=0x7f36500a92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.839+0000 7f36557f6700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f365006c8f0 0x7f36500a92e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f364000d890 tx=0x7f3640008040 comp rx=0 tx=0).stop 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.839+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 shutdown_connections 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.839+0000 7f36557f6700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3630060550 0x7f3630062a00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.839+0000 7f36557f6700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3650152300 0x7f3650150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.839+0000 7f36557f6700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36500c9e80 0x7f3650151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.839+0000 7f36557f6700 1 --2- 172.21.15.29:0/2971670362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f365006c8f0 0x7f36500a92e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.843+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 >> 172.21.15.29:0/2971670362 conn(0x7f36500670a0 msgr2=0x7f3650150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.843+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 shutdown_connections 2023-10-06T05:30:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:34.843+0000 7f36557f6700 1 -- 172.21.15.29:0/2971670362 wait complete. 2023-10-06T05:30:34.850 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 47 2023-10-06T05:30:34.863 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parent mytag123 2023-10-06T05:30:34.981 INFO:teuthology.orchestra.run.smithi029.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2023-10-06T05:30:34.981 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2023-10-06T05:30:34.982 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-10-06T05:30:35.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.007+0000 7f4c387c3e80 1 Processor -- start 2023-10-06T05:30:35.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.007+0000 7f4c387c3e80 1 -- start start 2023-10-06T05:30:35.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c387c3e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b20838f50 0x563b2083d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c387c3e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b208c1900 0x563b20836740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c387c3e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 0x563b20836c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c387c3e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2073a840 con 0x563b20838f50 2023-10-06T05:30:35.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c387c3e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2073a4e0 con 0x563b208c7830 2023-10-06T05:30:35.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c387c3e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b20731270 con 0x563b208c1900 2023-10-06T05:30:35.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c362fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b20838f50 0x563b2083d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c362fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b20838f50 0x563b2083d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57760/0 (socket says 172.21.15.29:57760) 2023-10-06T05:30:35.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c362fa700 1 -- 172.21.15.29:0/2923298958 learned_addr learned my addr 172.21.15.29:0/2923298958 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c36afb700 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 0x563b20836c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c362fa700 1 -- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b208c1900 msgr2=0x563b20836740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c35af9700 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b208c1900 0x563b20836740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c362fa700 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b208c1900 0x563b20836740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c362fa700 1 -- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 msgr2=0x563b20836c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c362fa700 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 0x563b20836c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c362fa700 1 -- 172.21.15.29:0/2923298958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28005db0 con 0x563b20838f50 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c36afb700 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 0x563b20836c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c35af9700 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b208c1900 0x563b20836740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:30:35.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c362fa700 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b20838f50 0x563b2083d4e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4c30002a00 tx=0x7f4c30005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d02b77d46c574f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c34af7700 1 -- 172.21.15.29:0/2923298958 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000d870 con 0x563b20838f50 2023-10-06T05:30:35.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c34af7700 1 -- 172.21.15.29:0/2923298958 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3000d9d0 con 0x563b20838f50 2023-10-06T05:30:35.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.011+0000 7f4c34af7700 1 -- 172.21.15.29:0/2923298958 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000dd90 con 0x563b20838f50 2023-10-06T05:30:35.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 -- 172.21.15.29:0/2923298958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b20838f50 msgr2=0x563b2083d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b20838f50 0x563b2083d4e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4c30002a00 tx=0x7f4c30005d40 comp rx=0 tx=0).stop 2023-10-06T05:30:35.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 -- 172.21.15.29:0/2923298958 shutdown_connections 2023-10-06T05:30:35.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 0x563b20836c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b208c1900 0x563b20836740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 --2- 172.21.15.29:0/2923298958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b20838f50 0x563b2083d4e0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 -- 172.21.15.29:0/2923298958 >> 172.21.15.29:0/2923298958 conn(0x563b2083ecd0 msgr2=0x563b208233a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 -- 172.21.15.29:0/2923298958 shutdown_connections 2023-10-06T05:30:35.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 -- 172.21.15.29:0/2923298958 wait complete. 2023-10-06T05:30:35.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 Processor -- start 2023-10-06T05:30:35.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 -- start start 2023-10-06T05:30:35.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b20838f50 0x563b208ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b208c1900 0x563b208d76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 0x563b208bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b208bc660 con 0x563b208c1900 2023-10-06T05:30:35.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b208bba50 con 0x563b208c7830 2023-10-06T05:30:35.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.015+0000 7f4c387c3e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b208bbd30 con 0x563b20838f50 2023-10-06T05:30:35.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c35af9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b208c1900 0x563b208d76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c36afb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 0x563b208bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c362fa700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b20838f50 0x563b208ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c36afb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 0x563b208bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:38752/0 (socket says 172.21.15.29:38752) 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c36afb700 1 -- 172.21.15.29:0/3790692918 learned_addr learned my addr 172.21.15.29:0/3790692918 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c35af9700 1 -- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b20838f50 msgr2=0x563b208ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c35af9700 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563b20838f50 0x563b208ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c35af9700 1 -- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 msgr2=0x563b208bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c35af9700 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563b208c7830 0x563b208bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c35af9700 1 -- 172.21.15.29:0/3790692918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30002600 con 0x563b208c1900 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c35af9700 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b208c1900 0x563b208d76b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00cf20 tx=0x7f4c2c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c26ffd700 1 -- 172.21.15.29:0/3790692918 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00ac00 con 0x563b208c1900 2023-10-06T05:30:35.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c26ffd700 1 -- 172.21.15.29:0/3790692918 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c008040 con 0x563b208c1900 2023-10-06T05:30:35.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b20749250 con 0x563b208c1900 2023-10-06T05:30:35.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c26ffd700 1 -- 172.21.15.29:0/3790692918 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c010470 con 0x563b208c1900 2023-10-06T05:30:35.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b2073c770 con 0x563b208c1900 2023-10-06T05:30:35.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.019+0000 7f4c26ffd700 1 -- 172.21.15.29:0/3790692918 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4c2c010860 con 0x563b208c1900 2023-10-06T05:30:35.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c26ffd700 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c1805eeb0 0x7f4c18061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c26ffd700 1 -- 172.21.15.29:0/3790692918 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f4c2c07b2f0 con 0x563b208c1900 2023-10-06T05:30:35.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c362fa700 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c1805eeb0 0x7f4c18061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x563b208bb5c0 0x563b208bd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:1 12.36 12:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x563b208d7bf0 con 0x563b208bb5c0 2023-10-06T05:30:35.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c36afb700 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x563b208bb5c0 0x563b208bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c362fa700 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c1805eeb0 0x7f4c18061360 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4c30002870 tx=0x7f4c30018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c36afb700 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x563b208bb5c0 0x563b208bd000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c36afb700 1 -- 172.21.15.29:0/3790692918 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4c2801d420 con 0x563b208bb5c0 2023-10-06T05:30:35.032 INFO:teuthology.orchestra.run.smithi029.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2023-10-06T05:30:35.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x563b208bb5c0 msgr2=0x563b208bd000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x563b208bb5c0 0x563b208bd000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c1805eeb0 msgr2=0x7f4c18061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c1805eeb0 0x7f4c18061360 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4c30002870 tx=0x7f4c30018000 comp rx=0 tx=0).stop 2023-10-06T05:30:35.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b208c1900 msgr2=0x563b208d76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 --2- 172.21.15.29:0/3790692918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b208c1900 0x563b208d76b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00cf20 tx=0x7f4c2c000bc0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c36afb700 1 -- 172.21.15.29:0/3790692918 reap_dead start 2023-10-06T05:30:35.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 shutdown_connections 2023-10-06T05:30:35.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 >> 172.21.15.29:0/3790692918 conn(0x563b2083ecd0 msgr2=0x563b2083cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 shutdown_connections 2023-10-06T05:30:35.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.023+0000 7f4c387c3e80 1 -- 172.21.15.29:0/3790692918 wait complete. 2023-10-06T05:30:35.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:30:35.035 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-10-06T05:30:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f46669f4e80 1 Processor -- start 2023-10-06T05:30:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f46669f4e80 1 -- start start 2023-10-06T05:30:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f46669f4e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b8f80 0x5630ab3b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f46669f4e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b9350 0x5630ab2de450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f46669f4e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5630ab3b57a0 0x5630ab325310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f46669f4e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ab22c840 con 0x5630ab3b8f80 2023-10-06T05:30:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f46669f4e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ab22c4e0 con 0x5630ab3b9350 2023-10-06T05:30:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f46669f4e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630ab223270 con 0x5630ab3b57a0 2023-10-06T05:30:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f466452b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b8f80 0x5630ab3b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f4663d2a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b9350 0x5630ab2de450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f4664d2c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5630ab3b57a0 0x5630ab325310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f466452b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b8f80 0x5630ab3b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57782/0 (socket says 172.21.15.29:57782) 2023-10-06T05:30:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f466452b700 1 -- 172.21.15.29:0/21469507 learned_addr learned my addr 172.21.15.29:0/21469507 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f466452b700 1 -- 172.21.15.29:0/21469507 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5630ab3b57a0 msgr2=0x5630ab325310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f466452b700 1 --2- 172.21.15.29:0/21469507 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5630ab3b57a0 0x5630ab325310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f466452b700 1 -- 172.21.15.29:0/21469507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b9350 msgr2=0x5630ab2de450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f466452b700 1 --2- 172.21.15.29:0/21469507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b9350 0x5630ab2de450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f466452b700 1 -- 172.21.15.29:0/21469507 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465400a0e0 con 0x5630ab3b8f80 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.103+0000 7f4663d2a700 1 --2- 172.21.15.29:0/21469507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b9350 0x5630ab2de450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f466452b700 1 --2- 172.21.15.29:0/21469507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b8f80 0x5630ab3b6620 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f465400a9a0 tx=0x7f4654007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d9b457e437e1ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f4662d28700 1 -- 172.21.15.29:0/21469507 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400d780 con 0x5630ab3b8f80 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f4662d28700 1 -- 172.21.15.29:0/21469507 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465400d8e0 con 0x5630ab3b8f80 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f4662d28700 1 -- 172.21.15.29:0/21469507 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400dc60 con 0x5630ab3b8f80 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 -- 172.21.15.29:0/21469507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b8f80 msgr2=0x5630ab3b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 --2- 172.21.15.29:0/21469507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b8f80 0x5630ab3b6620 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f465400a9a0 tx=0x7f4654007040 comp rx=0 tx=0).stop 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 -- 172.21.15.29:0/21469507 shutdown_connections 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 --2- 172.21.15.29:0/21469507 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5630ab3b57a0 0x5630ab325310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 --2- 172.21.15.29:0/21469507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b9350 0x5630ab2de450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 --2- 172.21.15.29:0/21469507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b8f80 0x5630ab3b6620 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 -- 172.21.15.29:0/21469507 >> 172.21.15.29:0/21469507 conn(0x5630ab2e76a0 msgr2=0x5630ab3bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 -- 172.21.15.29:0/21469507 shutdown_connections 2023-10-06T05:30:35.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 -- 172.21.15.29:0/21469507 wait complete. 2023-10-06T05:30:35.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 Processor -- start 2023-10-06T05:30:35.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 -- start start 2023-10-06T05:30:35.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b57a0 0x5630ab3b8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5630ab3b8f80 0x5630ab313070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b9350 0x5630ab2de600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ab328940 con 0x5630ab3b9350 2023-10-06T05:30:35.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ab328ec0 con 0x5630ab3b57a0 2023-10-06T05:30:35.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f46669f4e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630ab325e30 con 0x5630ab3b8f80 2023-10-06T05:30:35.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f4664d2c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b9350 0x5630ab2de600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f4664d2c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b9350 0x5630ab2de600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57796/0 (socket says 172.21.15.29:57796) 2023-10-06T05:30:35.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f4664d2c700 1 -- 172.21.15.29:0/2331446518 learned_addr learned my addr 172.21.15.29:0/2331446518 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f466452b700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b57a0 0x5630ab3b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.107+0000 7f4663d2a700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5630ab3b8f80 0x5630ab313070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4664d2c700 1 -- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5630ab3b8f80 msgr2=0x5630ab313070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4664d2c700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5630ab3b8f80 0x5630ab313070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4664d2c700 1 -- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b57a0 msgr2=0x5630ab3b8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4664d2c700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5630ab3b57a0 0x5630ab3b8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4664d2c700 1 -- 172.21.15.29:0/2331446518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630ab255040 con 0x5630ab3b9350 2023-10-06T05:30:35.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4664d2c700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b9350 0x5630ab2de600 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c680 tx=0x7f465c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4661525700 1 -- 172.21.15.29:0/2331446518 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c001b60 con 0x5630ab3b9350 2023-10-06T05:30:35.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4661525700 1 -- 172.21.15.29:0/2331446518 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c005070 con 0x5630ab3b9350 2023-10-06T05:30:35.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465400a5d0 con 0x5630ab3b9350 2023-10-06T05:30:35.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4661525700 1 -- 172.21.15.29:0/2331446518 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c010400 con 0x5630ab3b9350 2023-10-06T05:30:35.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c005db0 con 0x5630ab3b9350 2023-10-06T05:30:35.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.111+0000 7f4661525700 1 -- 172.21.15.29:0/2331446518 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f465c0107b0 con 0x5630ab3b9350 2023-10-06T05:30:35.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f4661525700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f464405eeb0 0x7f4644061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f4661525700 1 -- 172.21.15.29:0/2331446518 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f465c008070 con 0x5630ab3b9350 2023-10-06T05:30:35.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f466452b700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f464405eeb0 0x7f4644061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5630ab3135b0 0x5630ab3b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:1 12.12 12:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x5630ab2deb40 con 0x5630ab3135b0 2023-10-06T05:30:35.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f4663d2a700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5630ab3135b0 0x5630ab3b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f466452b700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f464405eeb0 0x7f4644061360 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f465400e010 tx=0x7f4654018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f4663d2a700 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5630ab3135b0 0x5630ab3b4210 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f4663d2a700 1 -- 172.21.15.29:0/2331446518 <== osd.3 v2:172.21.15.29:6800/33419 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f464c000bc0 con 0x5630ab3135b0 2023-10-06T05:30:35.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5630ab3135b0 msgr2=0x5630ab3b4210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5630ab3135b0 0x5630ab3b4210 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f464405eeb0 msgr2=0x7f4644061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f464405eeb0 0x7f4644061360 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f465400e010 tx=0x7f4654018000 comp rx=0 tx=0).stop 2023-10-06T05:30:35.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b9350 msgr2=0x5630ab2de600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 --2- 172.21.15.29:0/2331446518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630ab3b9350 0x5630ab2de600 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c680 tx=0x7f465c001770 comp rx=0 tx=0).stop 2023-10-06T05:30:35.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f4664d2c700 1 -- 172.21.15.29:0/2331446518 reap_dead start 2023-10-06T05:30:35.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 shutdown_connections 2023-10-06T05:30:35.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 >> 172.21.15.29:0/2331446518 conn(0x5630ab2e76a0 msgr2=0x5630ab3bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 shutdown_connections 2023-10-06T05:30:35.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.115+0000 7f46669f4e80 1 -- 172.21.15.29:0/2331446518 wait complete. 2023-10-06T05:30:35.127 INFO:teuthology.orchestra.run.smithi029.stdout:mytag123 2023-10-06T05:30:35.127 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-10-06T05:30:35.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878cdfae80 1 Processor -- start 2023-10-06T05:30:35.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878cdfae80 1 -- start start 2023-10-06T05:30:35.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878cdfae80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9a2dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878cdfae80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 0x5610f9a32c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878cdfae80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a18640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878cdfae80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610f99304e0 con 0x5610f9abd830 2023-10-06T05:30:35.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878cdfae80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610f9927270 con 0x5610f9a2ed80 2023-10-06T05:30:35.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878cdfae80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610f9a177d0 con 0x5610f9ab7900 2023-10-06T05:30:35.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878b132700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a18640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878a931700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9a2dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878a130700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 0x5610f9a32c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878a931700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9a2dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:38800/0 (socket says 172.21.15.29:38800) 2023-10-06T05:30:35.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878a931700 1 -- 172.21.15.29:0/1401913569 learned_addr learned my addr 172.21.15.29:0/1401913569 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878b132700 1 -- 172.21.15.29:0/1401913569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 msgr2=0x5610f9a32c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878b132700 1 --2- 172.21.15.29:0/1401913569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 0x5610f9a32c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878b132700 1 -- 172.21.15.29:0/1401913569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 msgr2=0x5610f9a2dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878b132700 1 --2- 172.21.15.29:0/1401913569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9a2dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878b132700 1 -- 172.21.15.29:0/1401913569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774005cf0 con 0x5610f9abd830 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878a931700 1 --2- 172.21.15.29:0/1401913569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9a2dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.159+0000 7f878b132700 1 --2- 172.21.15.29:0/1401913569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a18640 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x5610f9a352e0 tx=0x7f8784016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe31dbfffe016ee0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878912e700 1 -- 172.21.15.29:0/1401913569 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784005510 con 0x5610f9abd830 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878912e700 1 -- 172.21.15.29:0/1401913569 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784008970 con 0x5610f9abd830 2023-10-06T05:30:35.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878912e700 1 -- 172.21.15.29:0/1401913569 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878401d420 con 0x5610f9abd830 2023-10-06T05:30:35.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 -- 172.21.15.29:0/1401913569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 msgr2=0x5610f9a18640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 --2- 172.21.15.29:0/1401913569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a18640 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x5610f9a352e0 tx=0x7f8784016000 comp rx=0 tx=0).stop 2023-10-06T05:30:35.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 -- 172.21.15.29:0/1401913569 shutdown_connections 2023-10-06T05:30:35.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 --2- 172.21.15.29:0/1401913569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a18640 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 --2- 172.21.15.29:0/1401913569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 0x5610f9a32c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 --2- 172.21.15.29:0/1401913569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9a2dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 -- 172.21.15.29:0/1401913569 >> 172.21.15.29:0/1401913569 conn(0x5610f9a34cd0 msgr2=0x5610f9a17020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 -- 172.21.15.29:0/1401913569 shutdown_connections 2023-10-06T05:30:35.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 -- 172.21.15.29:0/1401913569 wait complete. 2023-10-06T05:30:35.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 Processor -- start 2023-10-06T05:30:35.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.163+0000 7f878cdfae80 1 -- start start 2023-10-06T05:30:35.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878cdfae80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9ab4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878cdfae80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 0x5610f9abb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878cdfae80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a32c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878cdfae80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610f9aa0e10 con 0x5610f9abd830 2023-10-06T05:30:35.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878cdfae80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610f9aa04e0 con 0x5610f9a2ed80 2023-10-06T05:30:35.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878cdfae80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610f9aa07c0 con 0x5610f9ab7900 2023-10-06T05:30:35.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878b132700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a32c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878b132700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a32c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57832/0 (socket says 172.21.15.29:57832) 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878b132700 1 -- 172.21.15.29:0/1561259224 learned_addr learned my addr 172.21.15.29:0/1561259224 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878a931700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9ab4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878a130700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 0x5610f9abb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878b132700 1 -- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 msgr2=0x5610f9abb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878b132700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 0x5610f9abb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878b132700 1 -- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 msgr2=0x5610f9ab4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878b132700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9ab4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878b132700 1 -- 172.21.15.29:0/1561259224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c00a440 con 0x5610f9abd830 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878a931700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610f9a2ed80 0x5610f9ab4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:35.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878a130700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610f9ab7900 0x5610f9abb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:35.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878b132700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a32c70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8784012000 tx=0x7f878401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f87837fe700 1 -- 172.21.15.29:0/1561259224 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878402c070 con 0x5610f9abd830 2023-10-06T05:30:35.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f87837fe700 1 -- 172.21.15.29:0/1561259224 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784026450 con 0x5610f9abd830 2023-10-06T05:30:35.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610f99323e0 con 0x5610f9abd830 2023-10-06T05:30:35.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f87837fe700 1 -- 172.21.15.29:0/1561259224 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784026810 con 0x5610f9abd830 2023-10-06T05:30:35.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.167+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8784005db0 con 0x5610f9abd830 2023-10-06T05:30:35.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f87837fe700 1 -- 172.21.15.29:0/1561259224 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8784026c40 con 0x5610f9abd830 2023-10-06T05:30:35.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f87837fe700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f877005eee0 0x7f8770061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f87837fe700 1 -- 172.21.15.29:0/1561259224 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f878407ef40 con 0x5610f9abd830 2023-10-06T05:30:35.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878a931700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f877005eee0 0x7f8770061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x5610f9abb830 0x5610f9aa17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:1 12.19 12:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x5610f9ab5be0 con 0x5610f9abb830 2023-10-06T05:30:35.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878a130700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x5610f9abb830 0x5610f9aa17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878a931700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f877005eee0 0x7f8770061390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f877c00ad50 tx=0x7f877c007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878a130700 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x5610f9abb830 0x5610f9aa17b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878a130700 1 -- 172.21.15.29:0/1561259224 <== osd.0 v2:172.21.15.29:6808/33420 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f8774009c00 con 0x5610f9abb830 2023-10-06T05:30:35.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x5610f9abb830 msgr2=0x5610f9aa17b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x5610f9abb830 0x5610f9aa17b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f877005eee0 msgr2=0x7f8770061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f877005eee0 0x7f8770061390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f877c00ad50 tx=0x7f877c007040 comp rx=0 tx=0).stop 2023-10-06T05:30:35.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 msgr2=0x5610f9a32c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 --2- 172.21.15.29:0/1561259224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610f9abd830 0x5610f9a32c70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8784012000 tx=0x7f878401e000 comp rx=0 tx=0).stop 2023-10-06T05:30:35.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878b132700 1 -- 172.21.15.29:0/1561259224 reap_dead start 2023-10-06T05:30:35.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 shutdown_connections 2023-10-06T05:30:35.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.171+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 >> 172.21.15.29:0/1561259224 conn(0x5610f9a34cd0 msgr2=0x5610f9a17020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.175+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 shutdown_connections 2023-10-06T05:30:35.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.175+0000 7f878cdfae80 1 -- 172.21.15.29:0/1561259224 wait complete. 2023-10-06T05:30:35.183 INFO:teuthology.orchestra.run.smithi029.stdout:mytag123 2023-10-06T05:30:35.184 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2023-10-06T05:30:35.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.211+0000 7efe31242e80 1 Processor -- start 2023-10-06T05:30:35.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.211+0000 7efe31242e80 1 -- start start 2023-10-06T05:30:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.211+0000 7efe31242e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56528a03cd80 0x56528a026c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.211+0000 7efe31242e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528a0c5900 0x56528a0407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.211+0000 7efe31242e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0cb830 0x56528a0392b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.211+0000 7efe31242e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x565289f9a220 con 0x56528a0cb830 2023-10-06T05:30:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.211+0000 7efe31242e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x565289f3e840 con 0x56528a0c5900 2023-10-06T05:30:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.211+0000 7efe31242e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x565289f3e4e0 con 0x56528a03cd80 2023-10-06T05:30:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.211+0000 7efe2f57a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0cb830 0x56528a0392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2f57a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0cb830 0x56528a0392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57846/0 (socket says 172.21.15.29:57846) 2023-10-06T05:30:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2f57a700 1 -- 172.21.15.29:0/1602516436 learned_addr learned my addr 172.21.15.29:0/1602516436 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2e578700 1 --2- 172.21.15.29:0/1602516436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528a0c5900 0x56528a0407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2ed79700 1 --2- 172.21.15.29:0/1602516436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56528a03cd80 0x56528a026c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2f57a700 1 -- 172.21.15.29:0/1602516436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56528a03cd80 msgr2=0x56528a026c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2f57a700 1 --2- 172.21.15.29:0/1602516436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56528a03cd80 0x56528a026c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2f57a700 1 -- 172.21.15.29:0/1602516436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528a0c5900 msgr2=0x56528a0407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2f57a700 1 --2- 172.21.15.29:0/1602516436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528a0c5900 0x56528a0407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2f57a700 1 -- 172.21.15.29:0/1602516436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1800a0e0 con 0x56528a0cb830 2023-10-06T05:30:35.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2f57a700 1 --2- 172.21.15.29:0/1602516436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0cb830 0x56528a0392b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7efe20001c70 tx=0x7efe20001750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549c4c9cf063d9c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2d576700 1 -- 172.21.15.29:0/1602516436 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000bbf0 con 0x56528a0cb830 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2d576700 1 -- 172.21.15.29:0/1602516436 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2000bd70 con 0x56528a0cb830 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe2d576700 1 -- 172.21.15.29:0/1602516436 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000e6c0 con 0x56528a0cb830 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe31242e80 1 -- 172.21.15.29:0/1602516436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0cb830 msgr2=0x56528a0392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe31242e80 1 --2- 172.21.15.29:0/1602516436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0cb830 0x56528a0392b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7efe20001c70 tx=0x7efe20001750 comp rx=0 tx=0).stop 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe31242e80 1 -- 172.21.15.29:0/1602516436 shutdown_connections 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe31242e80 1 --2- 172.21.15.29:0/1602516436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0cb830 0x56528a0392b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe31242e80 1 --2- 172.21.15.29:0/1602516436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528a0c5900 0x56528a0407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe31242e80 1 --2- 172.21.15.29:0/1602516436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56528a03cd80 0x56528a026c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe31242e80 1 -- 172.21.15.29:0/1602516436 >> 172.21.15.29:0/1602516436 conn(0x56528a042cd0 msgr2=0x56528a0276f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe31242e80 1 -- 172.21.15.29:0/1602516436 shutdown_connections 2023-10-06T05:30:35.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.215+0000 7efe31242e80 1 -- 172.21.15.29:0/1602516436 wait complete. 2023-10-06T05:30:35.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe31242e80 1 Processor -- start 2023-10-06T05:30:35.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe31242e80 1 -- start start 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe31242e80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528a03cd80 0x56528a0b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe31242e80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0c5900 0x56528a0392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe31242e80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56528a0cb830 0x56528a039830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe31242e80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x565289f35270 con 0x56528a0c5900 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe31242e80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56528a0c7b70 con 0x56528a03cd80 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe31242e80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x56528a0c8fa0 con 0x56528a0cb830 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2e578700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0c5900 0x56528a0392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2e578700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0c5900 0x56528a0392f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57852/0 (socket says 172.21.15.29:57852) 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2e578700 1 -- 172.21.15.29:0/1363561493 learned_addr learned my addr 172.21.15.29:0/1363561493 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2f57a700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56528a0cb830 0x56528a039830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2ed79700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528a03cd80 0x56528a0b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2e578700 1 -- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56528a0cb830 msgr2=0x56528a039830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2e578700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x56528a0cb830 0x56528a039830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2e578700 1 -- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528a03cd80 msgr2=0x56528a0b9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2e578700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56528a03cd80 0x56528a0b9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2e578700 1 -- 172.21.15.29:0/1363561493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe10001e10 con 0x56528a0c5900 2023-10-06T05:30:35.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.219+0000 7efe2e578700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0c5900 0x56528a0392f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efe18011000 tx=0x7efe18015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe277fe700 1 -- 172.21.15.29:0/1363561493 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18005730 con 0x56528a0c5900 2023-10-06T05:30:35.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe277fe700 1 -- 172.21.15.29:0/1363561493 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1800f860 con 0x56528a0c5900 2023-10-06T05:30:35.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565289f40770 con 0x56528a0c5900 2023-10-06T05:30:35.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe277fe700 1 -- 172.21.15.29:0/1363561493 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180058b0 con 0x56528a0c5900 2023-10-06T05:30:35.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565289f401d0 con 0x56528a0c5900 2023-10-06T05:30:35.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe277fe700 1 -- 172.21.15.29:0/1363561493 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efe18010630 con 0x56528a0c5900 2023-10-06T05:30:35.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe277fe700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe1405eee0 0x7efe14061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe277fe700 1 -- 172.21.15.29:0/1363561493 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7efe18005e40 con 0x56528a0c5900 2023-10-06T05:30:35.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe2ed79700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe1405eee0 0x7efe14061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe31242e80 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x56528a0c2740 0x56528a0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.223+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:1 12.5 12:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78) v8 -- 0x56528a0c5cd0 con 0x56528a0c2740 2023-10-06T05:30:35.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe2f57a700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x56528a0c2740 0x56528a0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe2ed79700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe1405eee0 0x7efe14061390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efe28000c00 tx=0x7efe28003830 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe2f57a700 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x56528a0c2740 0x56528a0c9e80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe2f57a700 1 -- 172.21.15.29:0/1363561493 <== osd.6 v2:172.21.15.173:6816/33717 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7efe20014070 con 0x56528a0c2740 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x56528a0c2740 msgr2=0x56528a0c9e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x56528a0c2740 0x56528a0c9e80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe1405eee0 msgr2=0x7efe14061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7efe1405eee0 0x7efe14061390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efe28000c00 tx=0x7efe28003830 comp rx=0 tx=0).stop 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0c5900 msgr2=0x56528a0392f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 --2- 172.21.15.29:0/1363561493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56528a0c5900 0x56528a0392f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efe18011000 tx=0x7efe18015000 comp rx=0 tx=0).stop 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe2f57a700 1 -- 172.21.15.29:0/1363561493 reap_dead start 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 shutdown_connections 2023-10-06T05:30:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 >> 172.21.15.29:0/1363561493 conn(0x56528a042cd0 msgr2=0x56528a0275d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 shutdown_connections 2023-10-06T05:30:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.227+0000 7efe31242e80 1 -- 172.21.15.29:0/1363561493 wait complete. 2023-10-06T05:30:35.237 INFO:teuthology.orchestra.run.smithi029.stdout:mytag123 2023-10-06T05:30:35.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2023-10-06T05:30:35.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc32759e700 1 Processor -- start 2023-10-06T05:30:35.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc32759e700 1 -- start start 2023-10-06T05:30:35.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc32759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc32806cdd0 0x7fc328163ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc32759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280cacd0 con 0x7fc32815d730 2023-10-06T05:30:35.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc32759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280cafb0 con 0x7fc328158f10 2023-10-06T05:30:35.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc32759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32806a600 con 0x7fc32806cdd0 2023-10-06T05:30:35.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc325d9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc32815d730 0x7fc32806c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57070/0 (socket says 172.21.15.29:57070) 2023-10-06T05:30:35.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc325d9b700 1 -- 172.21.15.29:0/2294535853 learned_addr learned my addr 172.21.15.29:0/2294535853 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:35.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc326d9d700 1 --2- 172.21.15.29:0/2294535853 >> v2:172.21.15.173:3300/0 conn(0x7fc32806cdd0 0x7fc328163ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414543891 0 0) 0x7fc3280cacd0 con 0x7fc32815d730 2023-10-06T05:30:35.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.395+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc314003570 con 0x7fc32815d730 2023-10-06T05:30:35.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3593037634 0 0) 0x7fc314003570 con 0x7fc32815d730 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 >> v2:172.21.15.173:3300/0 conn(0x7fc32806cdd0 msgr2=0x7fc328163ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 --2- 172.21.15.29:0/2294535853 >> v2:172.21.15.173:3300/0 conn(0x7fc32806cdd0 0x7fc328163ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 >> v1:172.21.15.173:6789/0 conn(0x7fc328158f10 legacy=0x7fc3280ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280cb290 con 0x7fc32815d730 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7fc318001490 con 0x7fc32815d730 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 >> v1:172.21.15.29:6789/0 conn(0x7fc32815d730 legacy=0x7fc32806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc314003a60 0x7fc314003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314004810 0x7fc314004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3140051c0 0x7fc31400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31400c050 con 0x7fc314004810 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31400c190 con 0x7fc3140051c0 2023-10-06T05:30:35.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31400c350 con 0x7fc314003a60 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc325d9b700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314004810 0x7fc314004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc326d9d700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3140051c0 0x7fc31400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32659c700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc314003a60 0x7fc314003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc326d9d700 1 -- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc314003a60 msgr2=0x7fc314003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc326d9d700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc314003a60 0x7fc314003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc326d9d700 1 -- 172.21.15.29:0/2294535853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314004810 msgr2=0x7fc314004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc326d9d700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314004810 0x7fc314004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc326d9d700 1 -- 172.21.15.29:0/2294535853 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314003570 con 0x7fc3140051c0 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc325d9b700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314004810 0x7fc314004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc326d9d700 1 -- 172.21.15.29:0/2294535853 reap_dead start 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc326d9d700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3140051c0 0x7fc31400ba60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc328069c00 tx=0x7fc32000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef8b609990bcc41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320009ac0 con 0x7fc3140051c0 2023-10-06T05:30:35.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32000f040 con 0x7fc3140051c0 2023-10-06T05:30:35.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32559a700 1 -- 172.21.15.29:0/2294535853 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000ecc0 con 0x7fc3140051c0 2023-10-06T05:30:35.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32759e700 1 -- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3140051c0 msgr2=0x7fc31400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32759e700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3140051c0 0x7fc31400ba60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc328069c00 tx=0x7fc32000b040 comp rx=0 tx=0).stop 2023-10-06T05:30:35.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32759e700 1 -- 172.21.15.29:0/2294535853 shutdown_connections 2023-10-06T05:30:35.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32759e700 1 --2- 172.21.15.29:0/2294535853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3140051c0 0x7fc31400ba60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32759e700 1 -- 172.21.15.29:0/2294535853 >> 172.21.15.29:0/2294535853 conn(0x7fc328062b60 msgr2=0x7fc328062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32759e700 1 -- 172.21.15.29:0/2294535853 shutdown_connections 2023-10-06T05:30:35.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.399+0000 7fc32759e700 1 -- 172.21.15.29:0/2294535853 wait complete. 2023-10-06T05:30:35.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 Processor -- start 2023-10-06T05:30:35.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 -- start start 2023-10-06T05:30:35.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc3140051c0 0x7fc328156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3280c46e0 0x7fc32815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32815ba60 0x7fc32815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328157430 con 0x7fc32815ba60 2023-10-06T05:30:35.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280c4e30 con 0x7fc3280c46e0 2023-10-06T05:30:35.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280c5110 con 0x7fc3140051c0 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc326d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32815ba60 0x7fc32815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc326d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32815ba60 0x7fc32815bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57870/0 (socket says 172.21.15.29:57870) 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc326d9d700 1 -- 172.21.15.29:0/4258266282 learned_addr learned my addr 172.21.15.29:0/4258266282 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc325d9b700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3280c46e0 0x7fc32815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32659c700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc3140051c0 0x7fc328156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc326d9d700 1 -- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc3140051c0 msgr2=0x7fc328156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc326d9d700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc3140051c0 0x7fc328156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc326d9d700 1 -- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3280c46e0 msgr2=0x7fc32815b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc326d9d700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3280c46e0 0x7fc32815b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc326d9d700 1 -- 172.21.15.29:0/4258266282 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280c53f0 con 0x7fc32815ba60 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc325d9b700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3280c46e0 0x7fc32815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc326d9d700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32815ba60 0x7fc32815bf00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fc3280ccce0 tx=0x7fc32001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc31e7fc700 1 -- 172.21.15.29:0/4258266282 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32001d700 con 0x7fc32815ba60 2023-10-06T05:30:35.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc31e7fc700 1 -- 172.21.15.29:0/4258266282 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32001d860 con 0x7fc32815ba60 2023-10-06T05:30:35.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 -- 172.21.15.29:0/4258266282 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3280c56d0 con 0x7fc32815ba60 2023-10-06T05:30:35.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc31e7fc700 1 -- 172.21.15.29:0/4258266282 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32001dc20 con 0x7fc32815ba60 2023-10-06T05:30:35.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.403+0000 7fc32759e700 1 -- 172.21.15.29:0/4258266282 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3280c4b50 con 0x7fc32815ba60 2023-10-06T05:30:35.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.407+0000 7fc31e7fc700 1 -- 172.21.15.29:0/4258266282 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc320003020 con 0x7fc32815ba60 2023-10-06T05:30:35.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.407+0000 7fc31e7fc700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc308060550 0x7fc308062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.407+0000 7fc31e7fc700 1 -- 172.21.15.29:0/4258266282 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc32007d780 con 0x7fc32815ba60 2023-10-06T05:30:35.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.407+0000 7fc32659c700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc308060550 0x7fc308062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32659c700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc308060550 0x7fc308062a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc310007e20 tx=0x7fc310009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32f18c740 1 Processor -- start 2023-10-06T05:30:35.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32f18c740 1 -- start start 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267cc10 0x28b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267c840 0x28b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x28b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32f18c740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x28280f0 con 0x26c78c0 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32f18c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x2823ee0 con 0x267c840 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32f18c740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x27ea020 con 0x267cc10 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267cc10 0x28b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc326d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x28b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc325d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267c840 0x28b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267cc10 0x28b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:50056/0 (socket says 172.21.15.29:50056) 2023-10-06T05:30:35.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.411+0000 7fc32659c700 1 -- 172.21.15.29:0/3995308515 learned_addr learned my addr 172.21.15.29:0/3995308515 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc326d9d700 1 -- 172.21.15.29:0/3995308515 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267cc10 msgr2=0x28b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc326d9d700 1 --2- 172.21.15.29:0/3995308515 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267cc10 0x28b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc326d9d700 1 -- 172.21.15.29:0/3995308515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267c840 msgr2=0x28b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc326d9d700 1 --2- 172.21.15.29:0/3995308515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267c840 0x28b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc326d9d700 1 -- 172.21.15.29:0/3995308515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26c8b10 con 0x26c78c0 2023-10-06T05:30:35.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc325d9b700 1 --2- 172.21.15.29:0/3995308515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267c840 0x28b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32659c700 1 --2- 172.21.15.29:0/3995308515 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267cc10 0x28b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc326d9d700 1 --2- 172.21.15.29:0/3995308515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x28b1900 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc32007bbd0 tx=0x7fc32007ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee31b1664831bcf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc3077fe700 1 -- 172.21.15.29:0/3995308515 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32006a070 con 0x26c78c0 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc3077fe700 1 -- 172.21.15.29:0/3995308515 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320023310 con 0x26c78c0 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc3077fe700 1 -- 172.21.15.29:0/3995308515 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320051fc0 con 0x26c78c0 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 -- 172.21.15.29:0/3995308515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 msgr2=0x28b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3995308515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x28b1900 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc32007bbd0 tx=0x7fc32007ba50 comp rx=0 tx=0).stop 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 -- 172.21.15.29:0/3995308515 shutdown_connections 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3995308515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x28b1900 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3995308515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267c840 0x28b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3995308515 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267cc10 0x28b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 -- 172.21.15.29:0/3995308515 >> 172.21.15.29:0/3995308515 conn(0x267cfe0 msgr2=0x28dcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 -- 172.21.15.29:0/3995308515 shutdown_connections 2023-10-06T05:30:35.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 -- 172.21.15.29:0/3995308515 wait complete. 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 -- start start 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 Processor -- start 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x28b6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x28b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 0x28b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x27e9cc0 con 0x267c840 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x27c2820 con 0x267cc10 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x26c7fd0 con 0x26c78c0 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32f18c740 10 client.0 _ll_register_callbacks cb 0x27c6b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x28b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x28b6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57882/0 (socket says 172.21.15.29:57882) 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc32659c700 1 -- 172.21.15.29:0/3699498988 learned_addr learned my addr 172.21.15.29:0/3699498988 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc325d9b700 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x28b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.415+0000 7fc326d9d700 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 0x28b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32659c700 1 -- 172.21.15.29:0/3699498988 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 msgr2=0x28b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32659c700 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 0x28b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32659c700 1 -- 172.21.15.29:0/3699498988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 msgr2=0x28b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32659c700 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x28b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32659c700 1 -- 172.21.15.29:0/3699498988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3280cb290 con 0x267c840 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32659c700 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x28b6870 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc310002db0 tx=0x7fc310017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dcfd64d58dfc46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc304ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc304ff9700 1 -- 172.21.15.29:0/3699498988 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310014d50 con 0x267c840 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc304ff9700 1 -- 172.21.15.29:0/3699498988 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc31001a070 con 0x267c840 2023-10-06T05:30:35.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32f18c740 1 -- 172.21.15.29:0/3699498988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27dca10 con 0x267c840 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc304ff9700 1 -- 172.21.15.29:0/3699498988 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc310026bf0 con 0x267c840 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32f18c740 10 client.6849 fetch_fsmap learned FSMap version 47 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32f18c740 1 -- 172.21.15.29:0/3699498988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x7fc310002ad0 con 0x267c840 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc304ff9700 1 -- 172.21.15.29:0/3699498988 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27dca10 con 0x267c840 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc304ff9700 1 -- 172.21.15.29:0/3699498988 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc310006820 con 0x267c840 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32f18c740 10 client.6849 fetch_fsmap finished waiting for FSMap version 47 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32f18c740 10 client.6849 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32f18c740 20 client.6849 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x28d9e80 0x28da280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32f18c740 4 client.6849 mds_command: new command op to 6726 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc32f18c740 1 -- 172.21.15.29:0/3699498988 --> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27c63f0 con 0x28d9e80 2023-10-06T05:30:35.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc325d9b700 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x28d9e80 0x28da280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc304ff9700 10 client.6849 ms_handle_connect on v2:172.21.15.29:6834/763503157 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.419+0000 7fc325d9b700 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x28d9e80 0x28da280 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ff296fedf658bba server_cookie=da9214f46ef69cdd in_seq=0 out_seq=0 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc304ff9700 1 -- 172.21.15.29:0/3699498988 <== mds.0 v2:172.21.15.29:6834/763503157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x27c63f0 con 0x28d9e80 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc304ff9700 10 client.6849 handle_command_reply: tid=0 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 client.6849 shutdown 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 -- 172.21.15.29:0/3699498988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 msgr2=0x28b6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x28b6870 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc310002db0 tx=0x7fc310017000 comp rx=0 tx=0).stop 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 -- 172.21.15.29:0/3699498988 shutdown_connections 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x28d9e80 0x28da280 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 0x28b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x28b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc304ff9700 0 client.6849 ms_handle_reset on v2:172.21.15.29:6834/763503157 2023-10-06T05:30:35.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3699498988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x28b6870 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 -- 172.21.15.29:0/3699498988 >> 172.21.15.29:0/3699498988 conn(0x267cfe0 msgr2=0x28af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 -- 172.21.15.29:0/3699498988 shutdown_connections 2023-10-06T05:30:35.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 1 -- 172.21.15.29:0/3699498988 wait complete. 2023-10-06T05:30:35.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.423+0000 7fc32f18c740 20 client.6849 trim_cache size 0 max 16384 2023-10-06T05:30:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 Processor -- start 2023-10-06T05:30:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 -- start start 2023-10-06T05:30:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267c840 0x294ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x294f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x294f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x27fbaa0 con 0x26c78c0 2023-10-06T05:30:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x28290b0 con 0x267cc10 2023-10-06T05:30:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x2828650 con 0x267c840 2023-10-06T05:30:35.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc326d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x294f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc325d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x294f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc326d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x294f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57894/0 (socket says 172.21.15.29:57894) 2023-10-06T05:30:35.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267c840 0x294ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc326d9d700 1 -- 172.21.15.29:0/3646973154 learned_addr learned my addr 172.21.15.29:0/3646973154 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc325d9b700 1 -- 172.21.15.29:0/3646973154 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267c840 msgr2=0x294ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc325d9b700 1 --2- 172.21.15.29:0/3646973154 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267c840 0x294ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc325d9b700 1 -- 172.21.15.29:0/3646973154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 msgr2=0x294f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc325d9b700 1 --2- 172.21.15.29:0/3646973154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x294f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc325d9b700 1 -- 172.21.15.29:0/3646973154 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280b14f0 con 0x267cc10 2023-10-06T05:30:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc326d9d700 1 --2- 172.21.15.29:0/3646973154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x294f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc325d9b700 1 --2- 172.21.15.29:0/3646973154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x294f1f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x27d2ac0 tx=0x7fc318009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=525072def60e43a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc307fff700 1 -- 172.21.15.29:0/3646973154 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31801a0a0 con 0x267cc10 2023-10-06T05:30:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc307fff700 1 -- 172.21.15.29:0/3646973154 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31801a200 con 0x267cc10 2023-10-06T05:30:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc307fff700 1 -- 172.21.15.29:0/3646973154 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31801a5c0 con 0x267cc10 2023-10-06T05:30:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 -- 172.21.15.29:0/3646973154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 msgr2=0x294f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3646973154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x294f1f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x27d2ac0 tx=0x7fc318009040 comp rx=0 tx=0).stop 2023-10-06T05:30:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 -- 172.21.15.29:0/3646973154 shutdown_connections 2023-10-06T05:30:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3646973154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x26c78c0 0x294f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.443+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3646973154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x294f1f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 --2- 172.21.15.29:0/3646973154 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x267c840 0x294ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 -- 172.21.15.29:0/3646973154 >> 172.21.15.29:0/3646973154 conn(0x267cfe0 msgr2=0x28af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 -- 172.21.15.29:0/3646973154 shutdown_connections 2023-10-06T05:30:35.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 -- 172.21.15.29:0/3646973154 wait complete. 2023-10-06T05:30:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 -- start start 2023-10-06T05:30:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 Processor -- start 2023-10-06T05:30:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x29093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x2909920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 0x2909e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x282a2f0 con 0x267c840 2023-10-06T05:30:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x27fcb00 con 0x267cc10 2023-10-06T05:30:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x28218a0 con 0x26c78c0 2023-10-06T05:30:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32f18c740 10 client.0 _ll_register_callbacks cb 0x27a0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x29093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x29093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57904/0 (socket says 172.21.15.29:57904) 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32659c700 1 -- 172.21.15.29:0/1569223643 learned_addr learned my addr 172.21.15.29:0/1569223643 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc325d9b700 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x2909920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc326d9d700 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 0x2909e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32659c700 1 -- 172.21.15.29:0/1569223643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 msgr2=0x2909e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32659c700 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 0x2909e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32659c700 1 -- 172.21.15.29:0/1569223643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 msgr2=0x2909920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32659c700 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x2909920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32659c700 1 -- 172.21.15.29:0/1569223643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x26c8b10 con 0x267c840 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc32659c700 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x29093e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc310009010 tx=0x7fc31001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9db7954489f857 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc304ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.447+0000 7fc304ff9700 1 -- 172.21.15.29:0/1569223643 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310014d50 con 0x267c840 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc32f18c740 1 -- 172.21.15.29:0/1569223643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc320023310 con 0x267c840 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc304ff9700 1 -- 172.21.15.29:0/1569223643 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc310006820 con 0x267c840 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc304ff9700 1 -- 172.21.15.29:0/1569223643 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3100263f0 con 0x267c840 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc32f18c740 10 client.6855 fetch_fsmap learned FSMap version 47 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc32f18c740 1 -- 172.21.15.29:0/1569223643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x7fc318004a70 con 0x267c840 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc304ff9700 1 -- 172.21.15.29:0/1569223643 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320023310 con 0x267c840 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc304ff9700 1 -- 172.21.15.29:0/1569223643 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc310026550 con 0x267c840 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc32f18c740 10 client.6855 fetch_fsmap finished waiting for FSMap version 47 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc32f18c740 10 client.6855 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc32f18c740 20 client.6855 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc32f18c740 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x290a3a0 0x290a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc32f18c740 4 client.6855 mds_command: new command op to 6726 tid=0[{"prefix": "flush journal"}] 2023-10-06T05:30:35.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc32f18c740 1 -- 172.21.15.29:0/1569223643 --> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x27f82c0 con 0x290a3a0 2023-10-06T05:30:35.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc325d9b700 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x290a3a0 0x290a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc325d9b700 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x290a3a0 0x290a7a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f42956afbb649d4 server_cookie=5f6d1d37eb7f82ab in_seq=0 out_seq=0 2023-10-06T05:30:35.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.451+0000 7fc304ff9700 10 client.6855 ms_handle_connect on v2:172.21.15.29:6834/763503157 2023-10-06T05:30:35.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc304ff9700 1 -- 172.21.15.29:0/1569223643 <== mds.0 v2:172.21.15.29:6834/763503157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x27f82c0 con 0x290a3a0 2023-10-06T05:30:35.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc304ff9700 10 client.6855 handle_command_reply: tid=0 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 client.6855 shutdown 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 -- 172.21.15.29:0/1569223643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 msgr2=0x29093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x29093e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc310009010 tx=0x7fc31001a000 comp rx=0 tx=0).stop 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 -- 172.21.15.29:0/1569223643 shutdown_connections 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.29:6834/763503157,v1:172.21.15.29:6835/763503157] conn(0x290a3a0 0x290a7a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x26c78c0 0x2909e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x267cc10 0x2909920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 --2- 172.21.15.29:0/1569223643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x267c840 0x29093e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc304ff9700 0 client.6855 ms_handle_reset on v2:172.21.15.29:6834/763503157 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 -- 172.21.15.29:0/1569223643 >> 172.21.15.29:0/1569223643 conn(0x267cfe0 msgr2=0x28aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 -- 172.21.15.29:0/1569223643 shutdown_connections 2023-10-06T05:30:35.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 1 -- 172.21.15.29:0/1569223643 wait complete. 2023-10-06T05:30:35.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32f18c740 20 client.6855 trim_cache size 0 max 16384 2023-10-06T05:30:35.479 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:35.479 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "", 2023-10-06T05:30:35.479 INFO:teuthology.orchestra.run.smithi029.stdout: "return_code": 0 2023-10-06T05:30:35.479 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:35.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 -- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc308060550 msgr2=0x7fc308062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc308060550 0x7fc308062a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc310007e20 tx=0x7fc310009040 comp rx=0 tx=0).stop 2023-10-06T05:30:35.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 -- 172.21.15.29:0/4258266282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32815ba60 msgr2=0x7fc32815bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32815ba60 0x7fc32815bf00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fc3280ccce0 tx=0x7fc32001a000 comp rx=0 tx=0).stop 2023-10-06T05:30:35.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 -- 172.21.15.29:0/4258266282 shutdown_connections 2023-10-06T05:30:35.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32815ba60 0x7fc32815bf00 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fc308060550 0x7fc308062a00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc3280c46e0 0x7fc32815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 --2- 172.21.15.29:0/4258266282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc3140051c0 0x7fc328156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 -- 172.21.15.29:0/4258266282 >> 172.21.15.29:0/4258266282 conn(0x7fc328062b60 msgr2=0x7fc3280cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 -- 172.21.15.29:0/4258266282 shutdown_connections 2023-10-06T05:30:35.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.471+0000 7fc32759e700 1 -- 172.21.15.29:0/4258266282 wait complete. 2023-10-06T05:30:35.495 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T05:30:35.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4348d700 1 Processor -- start 2023-10-06T05:30:35.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4348d700 1 -- start start 2023-10-06T05:30:35.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4348d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7eff3c06d110 0x7eff3c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4348d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 0x7eff3c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4348d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7eff3c0b1350 0x7eff3c0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4348d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0b1cf0 con 0x7eff3c06d110 2023-10-06T05:30:35.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4348d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c15b730 con 0x7eff3c0b1350 2023-10-06T05:30:35.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4348d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1581b0 con 0x7eff3c06d4e0 2023-10-06T05:30:35.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4248b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7eff3c06d110 0x7eff3c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4248b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7eff3c06d110 0x7eff3c06c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57916/0 (socket says 172.21.15.29:57916) 2023-10-06T05:30:35.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4248b700 1 -- 172.21.15.29:0/3688888566 learned_addr learned my addr 172.21.15.29:0/3688888566 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff42c8c700 1 --2- 172.21.15.29:0/3688888566 >> v2:172.21.15.173:3300/0 conn(0x7eff3c0b1350 0x7eff3c0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff41c8a700 1 --2- 172.21.15.29:0/3688888566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 0x7eff3c157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4248b700 1 -- 172.21.15.29:0/3688888566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 msgr2=0x7eff3c157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4248b700 1 --2- 172.21.15.29:0/3688888566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 0x7eff3c157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4248b700 1 -- 172.21.15.29:0/3688888566 >> v2:172.21.15.173:3300/0 conn(0x7eff3c0b1350 msgr2=0x7eff3c0b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4248b700 1 --2- 172.21.15.29:0/3688888566 >> v2:172.21.15.173:3300/0 conn(0x7eff3c0b1350 0x7eff3c0b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff4248b700 1 -- 172.21.15.29:0/3688888566 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c15a840 con 0x7eff3c06d110 2023-10-06T05:30:35.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.607+0000 7eff42c8c700 1 --2- 172.21.15.29:0/3688888566 >> v2:172.21.15.173:3300/0 conn(0x7eff3c0b1350 0x7eff3c0b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:35.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4248b700 1 --2- 172.21.15.29:0/3688888566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c06d110 0x7eff3c06c6c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7eff3c069b20 tx=0x7eff38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddeca0353c652418 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff41489700 1 -- 172.21.15.29:0/3688888566 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800b640 con 0x7eff3c06d110 2023-10-06T05:30:35.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff41489700 1 -- 172.21.15.29:0/3688888566 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3800b7a0 con 0x7eff3c06d110 2023-10-06T05:30:35.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff41489700 1 -- 172.21.15.29:0/3688888566 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800bb60 con 0x7eff3c06d110 2023-10-06T05:30:35.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4348d700 1 -- 172.21.15.29:0/3688888566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c06d110 msgr2=0x7eff3c06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4348d700 1 --2- 172.21.15.29:0/3688888566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c06d110 0x7eff3c06c6c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7eff3c069b20 tx=0x7eff38009250 comp rx=0 tx=0).stop 2023-10-06T05:30:35.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4348d700 1 -- 172.21.15.29:0/3688888566 shutdown_connections 2023-10-06T05:30:35.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4348d700 1 --2- 172.21.15.29:0/3688888566 >> v2:172.21.15.173:3300/0 conn(0x7eff3c0b1350 0x7eff3c0b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4348d700 1 --2- 172.21.15.29:0/3688888566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 0x7eff3c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4348d700 1 --2- 172.21.15.29:0/3688888566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c06d110 0x7eff3c06c6c0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4348d700 1 -- 172.21.15.29:0/3688888566 >> 172.21.15.29:0/3688888566 conn(0x7eff3c06abc0 msgr2=0x7eff3c0adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4348d700 1 -- 172.21.15.29:0/3688888566 shutdown_connections 2023-10-06T05:30:35.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.611+0000 7eff4348d700 1 -- 172.21.15.29:0/3688888566 wait complete. 2023-10-06T05:30:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff4348d700 1 Processor -- start 2023-10-06T05:30:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff4348d700 1 -- start start 2023-10-06T05:30:35.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff4348d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff3c06d110 0x7eff3c153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff4348d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 0x7eff3c156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff4348d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c0b1350 0x7eff3c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff4348d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c150740 con 0x7eff3c0b1350 2023-10-06T05:30:35.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff4348d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1590e0 con 0x7eff3c06d110 2023-10-06T05:30:35.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff4348d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c158510 con 0x7eff3c06d4e0 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff42c8c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c0b1350 0x7eff3c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff42c8c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c0b1350 0x7eff3c1565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57922/0 (socket says 172.21.15.29:57922) 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff42c8c700 1 -- 172.21.15.29:0/3650266523 learned_addr learned my addr 172.21.15.29:0/3650266523 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff41c8a700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 0x7eff3c156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff4248b700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff3c06d110 0x7eff3c153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff42c8c700 1 -- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 msgr2=0x7eff3c156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff42c8c700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 0x7eff3c156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff42c8c700 1 -- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff3c06d110 msgr2=0x7eff3c153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.615+0000 7eff42c8c700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff3c06d110 0x7eff3c153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.619+0000 7eff42c8c700 1 -- 172.21.15.29:0/3650266523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff34009a20 con 0x7eff3c0b1350 2023-10-06T05:30:35.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.619+0000 7eff42c8c700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c0b1350 0x7eff3c1565c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7eff34009f50 tx=0x7eff3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.619+0000 7eff327fc700 1 -- 172.21.15.29:0/3650266523 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3400cb50 con 0x7eff3c0b1350 2023-10-06T05:30:35.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.619+0000 7eff327fc700 1 -- 172.21.15.29:0/3650266523 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3400f040 con 0x7eff3c0b1350 2023-10-06T05:30:35.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.619+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff380094f0 con 0x7eff3c0b1350 2023-10-06T05:30:35.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.619+0000 7eff327fc700 1 -- 172.21.15.29:0/3650266523 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34014480 con 0x7eff3c0b1350 2023-10-06T05:30:35.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.619+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c158a90 con 0x7eff3c0b1350 2023-10-06T05:30:35.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.619+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c04be00 con 0x7eff3c0b1350 2023-10-06T05:30:35.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.619+0000 7eff327fc700 1 -- 172.21.15.29:0/3650266523 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7eff34003020 con 0x7eff3c0b1350 2023-10-06T05:30:35.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.623+0000 7eff327fc700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff20060550 0x7eff20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.623+0000 7eff327fc700 1 -- 172.21.15.29:0/3650266523 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7eff3407d220 con 0x7eff3c0b1350 2023-10-06T05:30:35.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.623+0000 7eff4248b700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff20060550 0x7eff20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.623+0000 7eff4248b700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff20060550 0x7eff20062a00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7eff3c069b20 tx=0x7eff38017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.627+0000 7eff327fc700 1 -- 172.21.15.29:0/3650266523 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7eff3404d660 con 0x7eff3c0b1350 2023-10-06T05:30:35.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.827+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7eff3c159220 con 0x7eff3c0b1350 2023-10-06T05:30:35.836 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-06T05:30:35.827+0000 7fe44aab2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T05:30:35.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.835+0000 7eff327fc700 1 -- 172.21.15.29:0/3650266523 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7eff34050c80 con 0x7eff3c0b1350 2023-10-06T05:30:35.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff20060550 msgr2=0x7eff20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff20060550 0x7eff20062a00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7eff3c069b20 tx=0x7eff38017000 comp rx=0 tx=0).stop 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c0b1350 msgr2=0x7eff3c1565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c0b1350 0x7eff3c1565c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7eff34009f50 tx=0x7eff3400b040 comp rx=0 tx=0).stop 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 shutdown_connections 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff3c0b1350 0x7eff3c1565c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7eff3c06d4e0 0x7eff3c156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7eff20060550 0x7eff20062a00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 --2- 172.21.15.29:0/3650266523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff3c06d110 0x7eff3c153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 >> 172.21.15.29:0/3650266523 conn(0x7eff3c06abc0 msgr2=0x7eff3c157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 shutdown_connections 2023-10-06T05:30:35.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.839+0000 7eff4348d700 1 -- 172.21.15.29:0/3650266523 wait complete. 2023-10-06T05:30:35.849 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T05:30:35.849 INFO:tasks.ceph.mds.c.smithi029.stderr: -2073> 2023-10-06T05:30:24.760+0000 7fc790201700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T05:30:35.859 DEBUG:teuthology.orchestra.run.smithi029:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2023-10-06T05:30:35.872 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:30:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.883+0000 7eff148e80c0 1 -- start start 2023-10-06T05:30:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.883+0000 7eff148e80c0 1 Processor -- start 2023-10-06T05:30:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc1c400 0x5610cefac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1c800 0x5610cefacb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1cc00 0x5610cefad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cee84dc0 con 0x5610cfc1c800 2023-10-06T05:30:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cee85cc0 con 0x5610cfc1c400 2023-10-06T05:30:35.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610cee85b80 con 0x5610cfc1cc00 2023-10-06T05:30:35.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff128a1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1c800 0x5610cefacb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff128a1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1c800 0x5610cefacb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57948/0 (socket says 172.21.15.29:57948) 2023-10-06T05:30:35.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff128a1700 1 -- 172.21.15.29:0/2105844825 learned_addr learned my addr 172.21.15.29:0/2105844825 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff130a2700 1 --2- 172.21.15.29:0/2105844825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc1c400 0x5610cefac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff138a3700 1 --2- 172.21.15.29:0/2105844825 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1cc00 0x5610cefad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff128a1700 1 -- 172.21.15.29:0/2105844825 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1cc00 msgr2=0x5610cefad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff128a1700 1 --2- 172.21.15.29:0/2105844825 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1cc00 0x5610cefad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff128a1700 1 -- 172.21.15.29:0/2105844825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc1c400 msgr2=0x5610cefac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff128a1700 1 --2- 172.21.15.29:0/2105844825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc1c400 0x5610cefac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff128a1700 1 -- 172.21.15.29:0/2105844825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610cee68340 con 0x5610cfc1c800 2023-10-06T05:30:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff128a1700 1 --2- 172.21.15.29:0/2105844825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1c800 0x5610cefacb00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x5610cfc300f0 tx=0x5610cfbd70e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2d4030e0ef085d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff1089d700 1 -- 172.21.15.29:0/2105844825 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610cee93600 con 0x5610cfc1c800 2023-10-06T05:30:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff1089d700 1 -- 172.21.15.29:0/2105844825 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610cee9a600 con 0x5610cfc1c800 2023-10-06T05:30:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff1089d700 1 -- 172.21.15.29:0/2105844825 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610cee931e0 con 0x5610cfc1c800 2023-10-06T05:30:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 1 -- 172.21.15.29:0/2105844825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610cee68000 con 0x5610cfc1c800 2023-10-06T05:30:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 1 -- 172.21.15.29:0/2105844825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5610cee68ea0 con 0x5610cfc1c800 2023-10-06T05:30:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 4 waiting for MDS map... 2023-10-06T05:30:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff1089d700 1 -- 172.21.15.29:0/2105844825 <== mon.0 v2:172.21.15.29:3300/0 4 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x5610cfc26a80 con 0x5610cfc1c800 2023-10-06T05:30:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff1089d700 1 -- 172.21.15.29:0/2105844825 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 48) v1 ==== 2559+0+0 (secure 0 0 0) 0x5610cfc44600 con 0x5610cfc1c800 2023-10-06T05:30:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 4 Got MDS map 48 2023-10-06T05:30:35.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 10 main: JournalTool::main 2023-10-06T05:30:35.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.887+0000 7eff148e80c0 4 main: JournalTool: connecting to RADOS... 2023-10-06T05:30:35.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 Processor -- start 2023-10-06T05:30:35.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 -- start start 2023-10-06T05:30:35.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1d800 0x5610cefad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1dc00 0x5610cefadb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc9a000 0x5610cefae100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cee843c0 con 0x5610cfc1dc00 2023-10-06T05:30:35.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cee85cc0 con 0x5610cfc9a000 2023-10-06T05:30:35.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610cee84000 con 0x5610cfc1d800 2023-10-06T05:30:35.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff130a2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1dc00 0x5610cefadb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff130a2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1dc00 0x5610cefadb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57954/0 (socket says 172.21.15.29:57954) 2023-10-06T05:30:35.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff130a2700 1 -- 172.21.15.29:0/4146393947 learned_addr learned my addr 172.21.15.29:0/4146393947 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff128a1700 1 --2- 172.21.15.29:0/4146393947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc9a000 0x5610cefae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff138a3700 1 --2- 172.21.15.29:0/4146393947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1d800 0x5610cefad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff130a2700 1 -- 172.21.15.29:0/4146393947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1d800 msgr2=0x5610cefad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff130a2700 1 --2- 172.21.15.29:0/4146393947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1d800 0x5610cefad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff130a2700 1 -- 172.21.15.29:0/4146393947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc9a000 msgr2=0x5610cefae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff130a2700 1 --2- 172.21.15.29:0/4146393947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc9a000 0x5610cefae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff130a2700 1 -- 172.21.15.29:0/4146393947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610cee69860 con 0x5610cfc1dc00 2023-10-06T05:30:35.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff130a2700 1 --2- 172.21.15.29:0/4146393947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1dc00 0x5610cefadb80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x5610cfc31590 tx=0x5610cefbde60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd167e2bab34e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff0e899700 1 -- 172.21.15.29:0/4146393947 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610cee93600 con 0x5610cfc1dc00 2023-10-06T05:30:35.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff0e899700 1 -- 172.21.15.29:0/4146393947 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610cee9ac00 con 0x5610cfc1dc00 2023-10-06T05:30:35.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff0e899700 1 -- 172.21.15.29:0/4146393947 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610cee931e0 con 0x5610cfc1dc00 2023-10-06T05:30:35.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 -- 172.21.15.29:0/4146393947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1dc00 msgr2=0x5610cefadb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 --2- 172.21.15.29:0/4146393947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1dc00 0x5610cefadb80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x5610cfc31590 tx=0x5610cefbde60 comp rx=0 tx=0).stop 2023-10-06T05:30:35.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 -- 172.21.15.29:0/4146393947 shutdown_connections 2023-10-06T05:30:35.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 --2- 172.21.15.29:0/4146393947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc9a000 0x5610cefae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 --2- 172.21.15.29:0/4146393947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1dc00 0x5610cefadb80 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 --2- 172.21.15.29:0/4146393947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1d800 0x5610cefad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 -- 172.21.15.29:0/4146393947 >> 172.21.15.29:0/4146393947 conn(0x5610cfc1d000 msgr2=0x5610cef35800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 -- 172.21.15.29:0/4146393947 shutdown_connections 2023-10-06T05:30:35.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.891+0000 7eff148e80c0 1 -- 172.21.15.29:0/4146393947 wait complete. 2023-10-06T05:30:35.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 Processor -- start 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 -- start start 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1d000 0x5610cefae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfcc2000 0x5610cefae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfcc2400 0x5610cefaec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cee85180 con 0x5610cfc1d000 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cee85040 con 0x5610cfcc2400 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610cee84f00 con 0x5610cfcc2000 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff138a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1d000 0x5610cefae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff138a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1d000 0x5610cefae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57968/0 (socket says 172.21.15.29:57968) 2023-10-06T05:30:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff138a3700 1 -- 172.21.15.29:0/484532346 learned_addr learned my addr 172.21.15.29:0/484532346 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff128a1700 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfcc2400 0x5610cefaec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff130a2700 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfcc2000 0x5610cefae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff138a3700 1 -- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfcc2000 msgr2=0x5610cefae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff138a3700 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfcc2000 0x5610cefae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff138a3700 1 -- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfcc2400 msgr2=0x5610cefaec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff138a3700 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfcc2400 0x5610cefaec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff138a3700 1 -- 172.21.15.29:0/484532346 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610cee68340 con 0x5610cfc1d000 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff138a3700 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1d000 0x5610cefae100 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x5610cfcc4090 tx=0x5610cefbc300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff0d096700 1 -- 172.21.15.29:0/484532346 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610cee93080 con 0x5610cfc1d000 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff0d096700 1 -- 172.21.15.29:0/484532346 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610cee9ad80 con 0x5610cfc1d000 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 -- 172.21.15.29:0/484532346 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610cee69a00 con 0x5610cfc1d000 2023-10-06T05:30:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff0d096700 1 -- 172.21.15.29:0/484532346 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610cee93600 con 0x5610cfc1d000 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 1 -- 172.21.15.29:0/484532346 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610cee689c0 con 0x5610cfc1d000 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.895+0000 7eff148e80c0 4 main: JournalTool: resolving pool 11 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.899+0000 7eff0d096700 1 -- 172.21.15.29:0/484532346 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x5610cfbb5080 con 0x5610cfc1d000 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.899+0000 7eff0d096700 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5610cfcc6400 0x5610cefaf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.899+0000 7eff0d096700 1 -- 172.21.15.29:0/484532346 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x5610cfc27880 con 0x5610cfc1d000 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.899+0000 7eff148e80c0 4 main: JournalTool: creating IoCtx.. 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.899+0000 7eff148e80c0 4 main: Executing for rank 0 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.899+0000 7eff130a2700 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5610cfcc6400 0x5610cefaf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.899+0000 7eff148e80c0 1 -- start start 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.899+0000 7eff148e80c0 1 Processor -- start 2023-10-06T05:30:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.899+0000 7eff130a2700 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5610cfcc6400 0x5610cefaf700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x5610cfbc3920 tx=0x5610cefbdf20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfcc2c00 0x5610cfdee000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfcc3000 0x5610cfdee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfcc3400 0x5610cfdeeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cef0d040 con 0x5610cfcc2c00 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cef0d180 con 0x5610cfcc3000 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610cee85040 con 0x5610cfcc3400 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff138a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfcc2c00 0x5610cfdee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff138a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfcc2c00 0x5610cfdee000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57970/0 (socket says 172.21.15.29:57970) 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff138a3700 1 -- 172.21.15.29:0/170006593 learned_addr learned my addr 172.21.15.29:0/170006593 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff130a2700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfcc3000 0x5610cfdee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff128a1700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfcc3400 0x5610cfdeeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff138a3700 1 -- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfcc3400 msgr2=0x5610cfdeeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff138a3700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfcc3400 0x5610cfdeeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff138a3700 1 -- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfcc3000 msgr2=0x5610cfdee580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff138a3700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfcc3000 0x5610cfdee580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff138a3700 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610cee69a00 con 0x5610cfcc2c00 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff138a3700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfcc2c00 0x5610cfdee000 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x5610cfdfe030 tx=0x5610cfc5d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b3091ddb6c677c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff0a090700 1 -- 172.21.15.29:0/170006593 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610cee931e0 con 0x5610cfcc2c00 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff0a090700 1 -- 172.21.15.29:0/170006593 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610cee9af00 con 0x5610cfcc2c00 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff0a090700 1 -- 172.21.15.29:0/170006593 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5610cee92420 con 0x5610cfcc2c00 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610cee68000 con 0x5610cfcc2c00 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5610cfcf1a00 con 0x5610cfcc2c00 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 4 waiting for MDS map... 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff0a090700 1 -- 172.21.15.29:0/170006593 <== mon.0 v2:172.21.15.29:3300/0 4 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x5610cfe08000 con 0x5610cfcc2c00 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff0a090700 1 -- 172.21.15.29:0/170006593 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 48) v1 ==== 2559+0+0 (secure 0 0 0) 0x5610cfe00600 con 0x5610cfcc2c00 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 4 Got MDS map 48 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x5610cfcc3800 0x5610cfdef080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:1 11.f 11:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x5610cfcc3c00 con 0x5610cfcc3800 2023-10-06T05:30:35.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff130a2700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x5610cfcc3800 0x5610cfdef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.903+0000 7eff130a2700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x5610cfcc3800 0x5610cfdef080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=9ae559a1a32c3942 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.915+0000 7eff130a2700 1 -- 172.21.15.29:0/170006593 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v79'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5610cfc25200 con 0x5610cfcc3800 2023-10-06T05:30:35.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.915+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x5610cfcc7000 0x5610cfdef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.915+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:2 11.14 11:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x5610cfcc7400 con 0x5610cfcc7000 2023-10-06T05:30:35.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.915+0000 7eff128a1700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x5610cfcc7000 0x5610cfdef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.915+0000 7eff128a1700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x5610cfcc7000 0x5610cfdef600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=b13bcf5356646ba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff128a1700 1 -- 172.21.15.29:0/170006593 <== osd.6 v2:172.21.15.173:6816/33717 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v79'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5610cfc25440 con 0x5610cfcc7000 2023-10-06T05:30:35.928 INFO:teuthology.orchestra.run.smithi029.stdout:writing EResetJournal entry 2023-10-06T05:30:35.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:3 11.14 11:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x5610cfcc7800 con 0x5610cfcc7000 2023-10-06T05:30:35.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x5610cfcc7c00 0x5610cfdefb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:4 11.1b 11:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x5610cfcc3c00 con 0x5610cfcc7c00 2023-10-06T05:30:35.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5610cfc1dc00 0x5610cfdf0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:5 11.b 11:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x5610cfe1e000 con 0x5610cfc1dc00 2023-10-06T05:30:35.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x5610cfe1e400 0x5610cfdf0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:6 11.1f 11:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x5610cfe1e800 con 0x5610cfe1e400 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5610cfe1ec00 0x5610cfdf0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:7 11.1a 11:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x5610cfe1f000 con 0x5610cfe1ec00 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:8 11.1e 11:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x5610cfe1f400 con 0x5610cfcc3800 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff130a2700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5610cfc1dc00 0x5610cfdf0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff138a3700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x5610cfcc7c00 0x5610cfdefb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff128a1700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x5610cfe1e400 0x5610cfdf0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff138a3700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5610cfe1ec00 0x5610cfdf0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff130a2700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5610cfc1dc00 0x5610cfdf0100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=befcf791a7d2174d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff128a1700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x5610cfe1e400 0x5610cfdf0680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=38793983db79e962 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff138a3700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x5610cfcc7c00 0x5610cfdefb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=b9d91b37d1b45f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff138a3700 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5610cfe1ec00 0x5610cfdf0c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=e6e849c99ceb2fbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff128a1700 1 -- 172.21.15.29:0/170006593 <== osd.6 v2:172.21.15.173:6816/33717 2 ==== osd_op_reply(3 200.00000001 [delete] v79'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5610cfc25440 con 0x5610cfcc7000 2023-10-06T05:30:35.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.923+0000 7eff130a2700 1 -- 172.21.15.29:0/170006593 <== osd.7 v2:172.21.15.173:6824/33718 2 ==== osd_op_reply(8 200.00000006 [delete] v79'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5610cfc25200 con 0x5610cfcc3800 2023-10-06T05:30:35.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.927+0000 7eff138a3700 1 -- 172.21.15.29:0/170006593 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(7 200.00000005 [delete] v79'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5610cfc25b00 con 0x5610cfe1ec00 2023-10-06T05:30:35.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.927+0000 7eff138a3700 1 -- 172.21.15.29:0/170006593 <== osd.4 v2:172.21.15.173:6800/33715 1 ==== osd_op_reply(4 200.00000002 [delete] v79'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5610cfc25b00 con 0x5610cfcc7c00 2023-10-06T05:30:35.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.927+0000 7eff0888d700 1 -- 172.21.15.29:0/170006593 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:9 11.14 11:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x5610cfcc7400 con 0x5610cfcc7000 2023-10-06T05:30:35.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff128a1700 1 -- 172.21.15.29:0/170006593 <== osd.6 v2:172.21.15.173:6816/33717 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v79'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5610cfc25440 con 0x5610cfcc7000 2023-10-06T05:30:35.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff128a1700 1 -- 172.21.15.29:0/170006593 <== osd.2 v2:172.21.15.29:6824/33445 1 ==== osd_op_reply(6 200.00000004 [delete] v79'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5610cfc25440 con 0x5610cfe1e400 2023-10-06T05:30:35.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff130a2700 1 -- 172.21.15.29:0/170006593 <== osd.3 v2:172.21.15.29:6800/33419 1 ==== osd_op_reply(5 200.00000003 [delete] v79'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5610cfc25200 con 0x5610cfc1dc00 2023-10-06T05:30:35.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 4 Successfully wrote new journal pointer and header for rank 5:0 2023-10-06T05:30:35.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x5610cfe1e400 msgr2=0x5610cfdf0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x5610cfe1e400 0x5610cfdf0680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5610cfc1dc00 msgr2=0x5610cfdf0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x5610cfc1dc00 0x5610cfdf0100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x5610cfcc7c00 msgr2=0x5610cfdefb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x5610cfcc7c00 0x5610cfdefb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5610cfe1ec00 msgr2=0x5610cfdf0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x5610cfe1ec00 0x5610cfdf0c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x5610cfcc7000 msgr2=0x5610cfdef600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff128a1700 1 -- 172.21.15.29:0/170006593 reap_dead start 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.931+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x5610cfcc7000 0x5610cfdef600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x5610cfcc3800 msgr2=0x5610cfdef080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x5610cfcc3800 0x5610cfdef080 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfcc2c00 msgr2=0x5610cfdee000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfcc2c00 0x5610cfdee000 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x5610cfdfe030 tx=0x5610cfc5d380 comp rx=0 tx=0).stop 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 shutdown_connections 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x5610cfcc7000 0x5610cfdef600 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x5610cfcc3800 0x5610cfdef080 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/170006593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfcc2c00 0x5610cfdee000 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 >> 172.21.15.29:0/170006593 conn(0x5610cfcc2800 msgr2=0x5610cef36000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 shutdown_connections 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/170006593 wait complete. 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5610cfcc6400 msgr2=0x5610cefaf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5610cfcc6400 0x5610cefaf700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x5610cfbc3920 tx=0x5610cefbdf20 comp rx=0 tx=0).stop 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/484532346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1d000 msgr2=0x5610cefae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1d000 0x5610cefae100 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x5610cfcc4090 tx=0x5610cefbc300 comp rx=0 tx=0).stop 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/484532346 shutdown_connections 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x5610cfcc6400 0x5610cefaf700 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfcc2400 0x5610cefaec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfcc2000 0x5610cefae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/484532346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1d000 0x5610cefae100 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/484532346 >> 172.21.15.29:0/484532346 conn(0x5610cfc1d800 msgr2=0x5610cef35800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/484532346 shutdown_connections 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/484532346 wait complete. 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/2105844825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1c800 msgr2=0x5610cefacb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/2105844825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1c800 0x5610cefacb00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x5610cfc300f0 tx=0x5610cfbd70e0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/2105844825 shutdown_connections 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/2105844825 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5610cfc1cc00 0x5610cefad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/2105844825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610cfc1c800 0x5610cefacb00 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 --2- 172.21.15.29:0/2105844825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5610cfc1c400 0x5610cefac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/2105844825 >> 172.21.15.29:0/2105844825 conn(0x5610cfc1c000 msgr2=0x5610cef35000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/2105844825 shutdown_connections 2023-10-06T05:30:35.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.935+0000 7eff148e80c0 1 -- 172.21.15.29:0/2105844825 wait complete. 2023-10-06T05:30:35.946 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.087000, result: writing EResetJournal entry 2023-10-06T05:30:35.947 DEBUG:teuthology.orchestra.run.smithi029:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2023-10-06T05:30:35.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f650479b5c0 1 -- start start 2023-10-06T05:30:35.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f650479b5c0 1 Processor -- start 2023-10-06T05:30:35.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f650479b5c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6da400 0x55911d75e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f650479b5c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911d6da800 0x55911d75eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f650479b5c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dac00 0x55911d75f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f650479b5c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d62adc0 con 0x55911d6da400 2023-10-06T05:30:35.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f650479b5c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d62bcc0 con 0x55911d6da800 2023-10-06T05:30:35.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f650479b5c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55911d62bb80 con 0x55911d6dac00 2023-10-06T05:30:35.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f6502f55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6da400 0x55911d75e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f6502f55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6da400 0x55911d75e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57990/0 (socket says 172.21.15.29:57990) 2023-10-06T05:30:35.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f6502f55700 1 -- 172.21.15.29:0/2644194990 learned_addr learned my addr 172.21.15.29:0/2644194990 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f6502754700 1 --2- 172.21.15.29:0/2644194990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911d6da800 0x55911d75eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.971+0000 7f6503756700 1 --2- 172.21.15.29:0/2644194990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dac00 0x55911d75f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6502f55700 1 -- 172.21.15.29:0/2644194990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dac00 msgr2=0x55911d75f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6502f55700 1 --2- 172.21.15.29:0/2644194990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dac00 0x55911d75f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6502f55700 1 -- 172.21.15.29:0/2644194990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911d6da800 msgr2=0x55911d75eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6502f55700 1 --2- 172.21.15.29:0/2644194990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911d6da800 0x55911d75eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6502f55700 1 -- 172.21.15.29:0/2644194990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55911d60e340 con 0x55911d6da400 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6502f55700 1 --2- 172.21.15.29:0/2644194990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6da400 0x55911d75e580 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x55911e3d06f0 tx=0x55911e36c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65cb36d26a0b4ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6500750700 1 -- 172.21.15.29:0/2644194990 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55911d639600 con 0x55911d6da400 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6500750700 1 -- 172.21.15.29:0/2644194990 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55911d640600 con 0x55911d6da400 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f650479b5c0 1 -- 172.21.15.29:0/2644194990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55911d60e000 con 0x55911d6da400 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f650479b5c0 1 -- 172.21.15.29:0/2644194990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55911d60eea0 con 0x55911d6da400 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f650479b5c0 4 waiting for MDS map... 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6500750700 1 -- 172.21.15.29:0/2644194990 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55911d6391e0 con 0x55911d6da400 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6500750700 1 -- 172.21.15.29:0/2644194990 <== mon.0 v2:172.21.15.29:3300/0 4 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x55911e344a80 con 0x55911d6da400 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f6500750700 1 -- 172.21.15.29:0/2644194990 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 48) v1 ==== 2559+0+0 (secure 0 0 0) 0x55911e3ee600 con 0x55911d6da400 2023-10-06T05:30:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f650479b5c0 4 Got MDS map 48 2023-10-06T05:30:35.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f650479b5c0 4 datascan.main: Using metadata pool output 2023-10-06T05:30:35.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f650479b5c0 4 datascan.main: connecting to RADOS... 2023-10-06T05:30:35.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f650479b5c0 1 Processor -- start 2023-10-06T05:30:35.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.975+0000 7f650479b5c0 1 -- start start 2023-10-06T05:30:35.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d75f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dbc00 0x55911d75fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911e444000 0x55911d760100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d62a3c0 con 0x55911d6db800 2023-10-06T05:30:35.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d62bcc0 con 0x55911e444000 2023-10-06T05:30:35.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55911d62a000 con 0x55911d6dbc00 2023-10-06T05:30:35.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6503756700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d75f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6502f55700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dbc00 0x55911d75fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6503756700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d75f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57998/0 (socket says 172.21.15.29:57998) 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6503756700 1 -- 172.21.15.29:0/1869018312 learned_addr learned my addr 172.21.15.29:0/1869018312 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6502754700 1 --2- 172.21.15.29:0/1869018312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911e444000 0x55911d760100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6503756700 1 -- 172.21.15.29:0/1869018312 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dbc00 msgr2=0x55911d75fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6503756700 1 --2- 172.21.15.29:0/1869018312 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dbc00 0x55911d75fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6503756700 1 -- 172.21.15.29:0/1869018312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911e444000 msgr2=0x55911d760100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6503756700 1 --2- 172.21.15.29:0/1869018312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911e444000 0x55911d760100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6503756700 1 -- 172.21.15.29:0/1869018312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55911d60f860 con 0x55911d6db800 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f6503756700 1 --2- 172.21.15.29:0/1869018312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d75f600 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x55911e3d1560 tx=0x55911d6dc300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc34f5b60128e3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f64fe74c700 1 -- 172.21.15.29:0/1869018312 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55911d639080 con 0x55911d6db800 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f64fe74c700 1 -- 172.21.15.29:0/1869018312 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55911d640c00 con 0x55911d6db800 2023-10-06T05:30:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f64fe74c700 1 -- 172.21.15.29:0/1869018312 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55911d639600 con 0x55911d6db800 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 -- 172.21.15.29:0/1869018312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 msgr2=0x55911d75f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 --2- 172.21.15.29:0/1869018312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d75f600 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x55911e3d1560 tx=0x55911d6dc300 comp rx=0 tx=0).stop 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 -- 172.21.15.29:0/1869018312 shutdown_connections 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 --2- 172.21.15.29:0/1869018312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911e444000 0x55911d760100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 --2- 172.21.15.29:0/1869018312 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dbc00 0x55911d75fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 --2- 172.21.15.29:0/1869018312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d75f600 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 -- 172.21.15.29:0/1869018312 >> 172.21.15.29:0/1869018312 conn(0x55911d6db000 msgr2=0x55911d6bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.979+0000 7f650479b5c0 1 -- 172.21.15.29:0/1869018312 shutdown_connections 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f650479b5c0 1 -- 172.21.15.29:0/1869018312 wait complete. 2023-10-06T05:30:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f650479b5c0 1 Processor -- start 2023-10-06T05:30:35.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f650479b5c0 1 -- start start 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f650479b5c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911d6dbc00 0x55911d760c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f650479b5c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d760680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f650479b5c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911e460000 0x55911d760100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f650479b5c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d62b180 con 0x55911d6db800 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f650479b5c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d62b040 con 0x55911d6dbc00 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f650479b5c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55911d62af00 con 0x55911e460000 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6502f55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d760680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6502f55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d760680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58014/0 (socket says 172.21.15.29:58014) 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 learned_addr learned my addr 172.21.15.29:0/3254551403 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:35.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6503756700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911d6dbc00 0x55911d760c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6502754700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911e460000 0x55911d760100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911e460000 msgr2=0x55911d760100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6502f55700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911e460000 0x55911d760100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911d6dbc00 msgr2=0x55911d760c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6502f55700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911d6dbc00 0x55911d760c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.983+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55911d60e9c0 con 0x55911d6db800 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f6502f55700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d760680 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x55911e408690 tx=0x55911e37d140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f64fcf49700 1 -- 172.21.15.29:0/3254551403 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55911d638f20 con 0x55911d6db800 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f64fcf49700 1 -- 172.21.15.29:0/3254551403 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55911e3e0300 con 0x55911d6db800 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55911d60fa00 con 0x55911d6db800 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f64fcf49700 1 -- 172.21.15.29:0/3254551403 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55911d639080 con 0x55911d6db800 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55911d60e340 con 0x55911d6db800 2023-10-06T05:30:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f650479b5c0 4 datascan.init: resolving metadata pool 11 2023-10-06T05:30:35.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f64fcf49700 1 -- 172.21.15.29:0/3254551403 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x55911e35b080 con 0x55911d6db800 2023-10-06T05:30:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f64fcf49700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55911e462800 0x55911d761700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f64fcf49700 1 -- 172.21.15.29:0/3254551403 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x55911e345880 con 0x55911d6db800 2023-10-06T05:30:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f650479b5c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-10-06T05:30:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f650479b5c0 4 datascan.main: data pool 'cephfs_data' has ID 12 2023-10-06T05:30:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f650479b5c0 4 datascan.main: opening data pool 'cephfs_data' 2023-10-06T05:30:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55911e460400 0x55911d75fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f6503756700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55911e462800 0x55911d761700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e460800 con 0x55911e460400 2023-10-06T05:30:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.987+0000 7f6502754700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55911e460400 0x55911d75fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f6503756700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55911e462800 0x55911d761700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55911e3d1560 tx=0x55911d6dc2a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f6502754700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55911e460400 0x55911d75fb80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.4 v2:172.21.15.173:6800/33715 1 ==== osd_op_reply(1 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e460400 2023-10-06T05:30:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f64fdf4b700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55911e462c00 0x55911e54a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:2 12.20 12:04000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463000 con 0x55911e462c00 2023-10-06T05:30:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f6503756700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55911e462c00 0x55911e54a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:35.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f6503756700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55911e462c00 0x55911e54a000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== osd_op_reply(2 [pgnls start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e462c00 2023-10-06T05:30:36.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f64fe74c700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55911e463800 0x55911e54a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:3 12.10 12:08000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463c00 con 0x55911e463800 2023-10-06T05:30:36.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.991+0000 7f6502f55700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55911e463800 0x55911e54a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.995+0000 7f6502f55700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55911e463800 0x55911e54a580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.999+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 1 ==== osd_op_reply(3 [pgnls start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.999+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:4 12.30 12:0c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463400 con 0x55911e462c00 2023-10-06T05:30:36.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.999+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.7 v2:172.21.15.173:6824/33718 2 ==== osd_op_reply(4 [pgnls start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e462c00 2023-10-06T05:30:36.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.999+0000 7f64fe74c700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55911e463000 0x55911e54ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.999+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:5 12.8 12:10000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463400 con 0x55911e463000 2023-10-06T05:30:36.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.999+0000 7f6502754700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55911e463000 0x55911e54ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.999+0000 7f6502754700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55911e463000 0x55911e54ab00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.999+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.3 v2:172.21.15.29:6800/33419 1 ==== osd_op_reply(5 [pgnls start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e463000 2023-10-06T05:30:36.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:35.999+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:6 12.28 12:14000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463400 con 0x55911e463800 2023-10-06T05:30:36.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 2 ==== osd_op_reply(6 [pgnls start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f64fe74c700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55911e558000 0x55911e54b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:7 12.18 12:18000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e558400 con 0x55911e558000 2023-10-06T05:30:36.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f6503756700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55911e558000 0x55911e54b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f6503756700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55911e558000 0x55911e54b080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== osd_op_reply(7 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e558000 2023-10-06T05:30:36.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f64fdf4b700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55911e460800 0x55911e54b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:8 12.38 12:1c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559000 con 0x55911e460800 2023-10-06T05:30:36.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f6502f55700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55911e460800 0x55911e54b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f6502f55700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55911e460800 0x55911e54b600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.2 v2:172.21.15.29:6824/33445 1 ==== osd_op_reply(8 [pgnls start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e460800 2023-10-06T05:30:36.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f64fe74c700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55911e558800 0x55911e54c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.003+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:9 12.4 12:20000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e558c00 con 0x55911e558800 2023-10-06T05:30:36.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.007+0000 7f6502754700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55911e558800 0x55911e54c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.007+0000 7f6502754700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55911e558800 0x55911e54c100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.007+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 1 ==== osd_op_reply(9 [pgnls start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.007+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:10 12.24 12:24000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559400 con 0x55911e460800 2023-10-06T05:30:36.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.007+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.2 v2:172.21.15.29:6824/33445 2 ==== osd_op_reply(10 [pgnls start_epoch 79 out=49b] v77'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e460800 2023-10-06T05:30:36.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.007+0000 7f64fe74c700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55911e559000 0x55911e54c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.007+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:11 12.14 12:28000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e462400 con 0x55911e559000 2023-10-06T05:30:36.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.007+0000 7f6503756700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55911e559000 0x55911e54c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.007+0000 7f6503756700 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55911e559000 0x55911e54c680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(11 [pgnls start_epoch 79 out=49b] v77'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e559000 2023-10-06T05:30:36.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:12 12.34 12:2c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559800 con 0x55911e559000 2023-10-06T05:30:36.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.5 v2:172.21.15.173:6808/33716 2 ==== osd_op_reply(12 [pgnls start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e559000 2023-10-06T05:30:36.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:13 12.c 12:30000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463c00 con 0x55911e463800 2023-10-06T05:30:36.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 3 ==== osd_op_reply(13 [pgnls start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:14 12.2c 12:34000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559c00 con 0x55911e460800 2023-10-06T05:30:36.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.2 v2:172.21.15.29:6824/33445 3 ==== osd_op_reply(14 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e460800 2023-10-06T05:30:36.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:15 12.1c 12:38000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463400 con 0x55911e463800 2023-10-06T05:30:36.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 4 ==== osd_op_reply(15 [pgnls start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.011+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:16 12.3c 12:3c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e558400 con 0x55911e559000 2023-10-06T05:30:36.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.015+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.5 v2:172.21.15.173:6808/33716 3 ==== osd_op_reply(16 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e559000 2023-10-06T05:30:36.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.015+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:17 12.2 12:40000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e574000 con 0x55911e460400 2023-10-06T05:30:36.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.015+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.4 v2:172.21.15.173:6800/33715 2 ==== osd_op_reply(17 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e460400 2023-10-06T05:30:36.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.015+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:18 12.22 12:44000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559800 con 0x55911e462c00 2023-10-06T05:30:36.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.015+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.7 v2:172.21.15.173:6824/33718 3 ==== osd_op_reply(18 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e462c00 2023-10-06T05:30:36.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.015+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:19 12.12 12:48000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e574400 con 0x55911e463000 2023-10-06T05:30:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.015+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.3 v2:172.21.15.29:6800/33419 2 ==== osd_op_reply(19 [pgnls start_epoch 79 out=81b] v78'22 uv22 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55911e342fc0 con 0x55911e463000 2023-10-06T05:30:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.015+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:20 12.12 12:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e460c00 con 0x55911e463000 2023-10-06T05:30:36.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.019+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.3 v2:172.21.15.29:6800/33419 3 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55911e342fc0 con 0x55911e463000 2023-10-06T05:30:36.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.019+0000 7f650479b5c0 10 datascan.operator(): handling object 1099511627778.0 2023-10-06T05:30:36.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.019+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:21 12.12 12:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461000 con 0x55911e463000 2023-10-06T05:30:36.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.019+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.3 v2:172.21.15.29:6800/33419 4 ==== osd_op_reply(21 10000000002.00000000 [call] v79'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55911e342fc0 con 0x55911e463000 2023-10-06T05:30:36.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.019+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:22 12.32 12:4c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461400 con 0x55911e463000 2023-10-06T05:30:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.023+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.3 v2:172.21.15.29:6800/33419 5 ==== osd_op_reply(22 [pgnls start_epoch 79 out=49b] v77'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e463000 2023-10-06T05:30:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.023+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:23 12.a 12:50000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e574800 con 0x55911e460800 2023-10-06T05:30:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.023+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.2 v2:172.21.15.29:6824/33445 4 ==== osd_op_reply(23 [pgnls start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e460800 2023-10-06T05:30:36.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.023+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:24 12.2a 12:54000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e462400 con 0x55911e460800 2023-10-06T05:30:36.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.023+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.2 v2:172.21.15.29:6824/33445 5 ==== osd_op_reply(24 [pgnls start_epoch 79 out=49b] v77'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e460800 2023-10-06T05:30:36.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.023+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:25 12.1a 12:58000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e574c00 con 0x55911e460400 2023-10-06T05:30:36.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.023+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.4 v2:172.21.15.173:6800/33715 3 ==== osd_op_reply(25 [pgnls start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e460400 2023-10-06T05:30:36.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.023+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:26 12.3a 12:5c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559400 con 0x55911e463000 2023-10-06T05:30:36.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.027+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.3 v2:172.21.15.29:6800/33419 6 ==== osd_op_reply(26 [pgnls start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e463000 2023-10-06T05:30:36.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.027+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:27 12.6 12:60000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e575000 con 0x55911e558000 2023-10-06T05:30:36.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.027+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.1 v2:172.21.15.29:6816/33422 2 ==== osd_op_reply(27 [pgnls start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e558000 2023-10-06T05:30:36.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.027+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:28 12.26 12:64000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463c00 con 0x55911e559000 2023-10-06T05:30:36.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.027+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.5 v2:172.21.15.173:6808/33716 4 ==== osd_op_reply(28 [pgnls start_epoch 79 out=49b] v77'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e559000 2023-10-06T05:30:36.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.027+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:29 12.16 12:68000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e575400 con 0x55911e558800 2023-10-06T05:30:36.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.027+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 2 ==== osd_op_reply(29 [pgnls start_epoch 79 out=49b] v77'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.027+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:30 12.36 12:6c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463400 con 0x55911e559000 2023-10-06T05:30:36.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.031+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.5 v2:172.21.15.173:6808/33716 5 ==== osd_op_reply(30 [pgnls start_epoch 79 out=81b] v77'33 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55911e343200 con 0x55911e559000 2023-10-06T05:30:36.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.031+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:31 12.36 12:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461800 con 0x55911e559000 2023-10-06T05:30:36.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.031+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.5 v2:172.21.15.173:6808/33716 6 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55911e343200 con 0x55911e559000 2023-10-06T05:30:36.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.031+0000 7f650479b5c0 10 datascan.operator(): handling object 1099511628279.0 2023-10-06T05:30:36.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.031+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:32 12.36 12:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461c00 con 0x55911e559000 2023-10-06T05:30:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.035+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.5 v2:172.21.15.173:6808/33716 7 ==== osd_op_reply(32 100000001f7.00000000 [call] v79'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55911e343200 con 0x55911e559000 2023-10-06T05:30:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.035+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:33 12.e 12:70000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e575000 con 0x55911e463800 2023-10-06T05:30:36.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.035+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 5 ==== osd_op_reply(33 [pgnls start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.035+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:34 12.2e 12:74000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e460c00 con 0x55911e558000 2023-10-06T05:30:36.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.035+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.1 v2:172.21.15.29:6816/33422 3 ==== osd_op_reply(34 [pgnls start_epoch 79 out=49b] v77'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e558000 2023-10-06T05:30:36.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.035+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:35 12.1e 12:78000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e575c00 con 0x55911e460400 2023-10-06T05:30:36.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.039+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.4 v2:172.21.15.173:6800/33715 4 ==== osd_op_reply(35 [pgnls start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e460400 2023-10-06T05:30:36.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.039+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:36 12.3e 12:7c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461000 con 0x55911e463800 2023-10-06T05:30:36.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.039+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 6 ==== osd_op_reply(36 [pgnls start_epoch 79 out=49b] v77'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.039+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:37 12.1 12:80000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57a000 con 0x55911e558800 2023-10-06T05:30:36.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.039+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 3 ==== osd_op_reply(37 [pgnls start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.039+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:38 12.21 12:84000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461400 con 0x55911e558000 2023-10-06T05:30:36.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.039+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.1 v2:172.21.15.29:6816/33422 4 ==== osd_op_reply(38 [pgnls start_epoch 79 out=49b] v77'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e558000 2023-10-06T05:30:36.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.039+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:39 12.11 12:88000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57a400 con 0x55911e559000 2023-10-06T05:30:36.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.043+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.5 v2:172.21.15.173:6808/33716 8 ==== osd_op_reply(39 [pgnls start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e559000 2023-10-06T05:30:36.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.043+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:40 12.31 12:8c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461800 con 0x55911e463800 2023-10-06T05:30:36.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.043+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 7 ==== osd_op_reply(40 [pgnls start_epoch 79 out=81b] v77'15 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.043+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:41 12.31 12:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e574c00 con 0x55911e463800 2023-10-06T05:30:36.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.043+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 8 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.043+0000 7f650479b5c0 10 datascan.operator(): handling object 1099511627780.1 2023-10-06T05:30:36.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.043+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:42 12.5 12:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e574800 con 0x55911e558800 2023-10-06T05:30:36.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.047+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 4 ==== osd_op_reply(42 10000000004.00000000 [call] v79'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.047+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:43 12.9 12:90000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e574000 con 0x55911e460800 2023-10-06T05:30:36.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.047+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.2 v2:172.21.15.29:6824/33445 6 ==== osd_op_reply(43 [pgnls start_epoch 79 out=49b] v77'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e460800 2023-10-06T05:30:36.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.047+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:44 12.29 12:94000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461c00 con 0x55911e460400 2023-10-06T05:30:36.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.051+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.4 v2:172.21.15.173:6800/33715 5 ==== osd_op_reply(44 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e460400 2023-10-06T05:30:36.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.051+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:45 12.19 12:98000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57a800 con 0x55911e463800 2023-10-06T05:30:36.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.051+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 9 ==== osd_op_reply(45 [pgnls start_epoch 79 out=81b] v78'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.051+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:46 12.19 12:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e574400 con 0x55911e463800 2023-10-06T05:30:36.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.051+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 10 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.051+0000 7f650479b5c0 10 datascan.operator(): handling object 1099511628280.0 2023-10-06T05:30:36.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.051+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:47 12.19 12:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e575800 con 0x55911e463800 2023-10-06T05:30:36.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.055+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 11 ==== osd_op_reply(47 100000001f8.00000000 [call] v79'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.055+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:48 12.39 12:9c000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e558400 con 0x55911e558800 2023-10-06T05:30:36.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.055+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 5 ==== osd_op_reply(48 [pgnls start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.055+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:49 12.5 12:a0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57ac00 con 0x55911e558800 2023-10-06T05:30:36.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.059+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 6 ==== osd_op_reply(49 [pgnls start_epoch 79 out=81b] v79'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.059+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:50 12.5 12:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559800 con 0x55911e558800 2023-10-06T05:30:36.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.059+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 7 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.059+0000 7f650479b5c0 10 datascan.operator(): handling object 1099511627780.0 2023-10-06T05:30:36.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.059+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:51 12.5 12:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559c00 con 0x55911e558800 2023-10-06T05:30:36.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.063+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 8 ==== osd_op_reply(51 10000000004.00000000 [call] v79'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.063+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:52 12.25 12:a4000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e558c00 con 0x55911e462c00 2023-10-06T05:30:36.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.063+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.7 v2:172.21.15.173:6824/33718 4 ==== osd_op_reply(52 [pgnls start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e462c00 2023-10-06T05:30:36.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.063+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:53 12.15 12:a8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57b000 con 0x55911e558800 2023-10-06T05:30:36.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.063+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 9 ==== osd_op_reply(53 [pgnls start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.063+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:54 12.35 12:ac000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e460c00 con 0x55911e463800 2023-10-06T05:30:36.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.063+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 12 ==== osd_op_reply(54 [pgnls start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.067+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:55 12.d 12:b0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57b400 con 0x55911e462c00 2023-10-06T05:30:36.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.067+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.7 v2:172.21.15.173:6824/33718 5 ==== osd_op_reply(55 [pgnls start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e462c00 2023-10-06T05:30:36.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.067+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:56 12.2d 12:b4000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461400 con 0x55911e463000 2023-10-06T05:30:36.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.067+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.3 v2:172.21.15.29:6800/33419 7 ==== osd_op_reply(56 [pgnls start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e463000 2023-10-06T05:30:36.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.067+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:57 12.1d 12:b8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57b800 con 0x55911e463800 2023-10-06T05:30:36.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.067+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 13 ==== osd_op_reply(57 [pgnls start_epoch 79 out=49b] v77'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.067+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:58 12.3d 12:bc000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e463400 con 0x55911e558000 2023-10-06T05:30:36.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.067+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.1 v2:172.21.15.29:6816/33422 5 ==== osd_op_reply(58 [pgnls start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e558000 2023-10-06T05:30:36.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.067+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:59 12.3 12:c0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57bc00 con 0x55911e463800 2023-10-06T05:30:36.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.071+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 14 ==== osd_op_reply(59 [pgnls start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.071+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:60 12.23 12:c4000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e558400 con 0x55911e463800 2023-10-06T05:30:36.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.071+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 15 ==== osd_op_reply(60 [pgnls start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.071+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:61 12.13 12:c8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57a800 con 0x55911e558000 2023-10-06T05:30:36.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.071+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.1 v2:172.21.15.29:6816/33422 6 ==== osd_op_reply(61 [pgnls start_epoch 79 out=49b] v77'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e558000 2023-10-06T05:30:36.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.071+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:62 12.33 12:cc000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559800 con 0x55911e460800 2023-10-06T05:30:36.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.071+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.2 v2:172.21.15.29:6824/33445 7 ==== osd_op_reply(62 [pgnls start_epoch 79 out=49b] v77'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e460800 2023-10-06T05:30:36.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.071+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:63 12.b 12:d0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57b800 con 0x55911e463000 2023-10-06T05:30:36.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.3 v2:172.21.15.29:6800/33419 8 ==== osd_op_reply(63 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e463000 2023-10-06T05:30:36.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:64 12.2b 12:d4000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559c00 con 0x55911e460400 2023-10-06T05:30:36.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.4 v2:172.21.15.173:6800/33715 6 ==== osd_op_reply(64 [pgnls start_epoch 79 out=49b] v77'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e460400 2023-10-06T05:30:36.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:65 12.1b 12:d8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57bc00 con 0x55911e460400 2023-10-06T05:30:36.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.4 v2:172.21.15.173:6800/33715 7 ==== osd_op_reply(65 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e460400 2023-10-06T05:30:36.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:66 12.3b 12:dc000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e559400 con 0x55911e460800 2023-10-06T05:30:36.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.2 v2:172.21.15.29:6824/33445 8 ==== osd_op_reply(66 [pgnls start_epoch 79 out=49b] v77'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e460800 2023-10-06T05:30:36.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:67 12.7 12:e0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57ac00 con 0x55911e558000 2023-10-06T05:30:36.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.1 v2:172.21.15.29:6816/33422 7 ==== osd_op_reply(67 [pgnls start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e558000 2023-10-06T05:30:36.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.075+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:68 12.27 12:e4000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461c00 con 0x55911e463800 2023-10-06T05:30:36.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.079+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.0 v2:172.21.15.29:6808/33420 16 ==== osd_op_reply(68 [pgnls start_epoch 79 out=49b] v77'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e463800 2023-10-06T05:30:36.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.079+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:69 12.17 12:e8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57b000 con 0x55911e558800 2023-10-06T05:30:36.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.079+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 10 ==== osd_op_reply(69 [pgnls start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.079+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:70 12.37 12:ec000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461000 con 0x55911e460400 2023-10-06T05:30:36.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.079+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.4 v2:172.21.15.173:6800/33715 8 ==== osd_op_reply(70 [pgnls start_epoch 79 out=49b] v77'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e460400 2023-10-06T05:30:36.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.079+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:71 12.f 12:f0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e57a000 con 0x55911e558800 2023-10-06T05:30:36.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.079+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 11 ==== osd_op_reply(71 [pgnls start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.079+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:72 12.2f 12:f4000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e461800 con 0x55911e460800 2023-10-06T05:30:36.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f6502f55700 1 -- 172.21.15.29:0/3254551403 <== osd.2 v2:172.21.15.29:6824/33445 9 ==== osd_op_reply(72 [pgnls start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343440 con 0x55911e460800 2023-10-06T05:30:36.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f64fe74c700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:73 12.1f 12:f8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e558400 con 0x55911e558800 2023-10-06T05:30:36.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 <== osd.6 v2:172.21.15.173:6816/33717 12 ==== osd_op_reply(73 [pgnls start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e342fc0 con 0x55911e558800 2023-10-06T05:30:36.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f64fdf4b700 1 -- 172.21.15.29:0/3254551403 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:74 12.3f 12:fc000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55911e462400 con 0x55911e462c00 2023-10-06T05:30:36.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f6503756700 1 -- 172.21.15.29:0/3254551403 <== osd.7 v2:172.21.15.173:6824/33718 6 ==== osd_op_reply(74 [pgnls start_epoch 79 out=49b] v77'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55911e343200 con 0x55911e462c00 2023-10-06T05:30:36.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55911e463800 msgr2=0x55911e54a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55911e463800 0x55911e54a580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.092 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55911e558000 msgr2=0x55911e54b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55911e558000 0x55911e54b080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55911e460800 msgr2=0x55911e54b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55911e460800 0x55911e54b600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55911e463000 msgr2=0x55911e54ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55911e463000 0x55911e54ab00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 reap_dead start 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55911e460400 msgr2=0x55911d75fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55911e460400 0x55911d75fb80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55911e559000 msgr2=0x55911e54c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 reap_dead start 2023-10-06T05:30:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55911e559000 0x55911e54c680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55911e558800 msgr2=0x55911e54c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55911e558800 0x55911e54c100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55911e462c00 msgr2=0x55911e54a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55911e462c00 0x55911e54a000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55911e462800 msgr2=0x55911d761700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55911e462800 0x55911d761700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55911e3d1560 tx=0x55911d6dc2a0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 msgr2=0x55911d760680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 --2- 172.21.15.29:0/3254551403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6db800 0x55911d760680 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x55911e408690 tx=0x55911e37d140 comp rx=0 tx=0).stop 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f6502754700 1 -- 172.21.15.29:0/3254551403 reap_dead start 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 shutdown_connections 2023-10-06T05:30:36.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 >> 172.21.15.29:0/3254551403 conn(0x55911d6db000 msgr2=0x55911d6bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:36.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 shutdown_connections 2023-10-06T05:30:36.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.083+0000 7f650479b5c0 1 -- 172.21.15.29:0/3254551403 wait complete. 2023-10-06T05:30:36.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.087+0000 7f650479b5c0 1 -- 172.21.15.29:0/2644194990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6da400 msgr2=0x55911d75e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.087+0000 7f650479b5c0 1 --2- 172.21.15.29:0/2644194990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6da400 0x55911d75e580 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x55911e3d06f0 tx=0x55911e36c8a0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.087+0000 7f650479b5c0 1 -- 172.21.15.29:0/2644194990 shutdown_connections 2023-10-06T05:30:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.087+0000 7f650479b5c0 1 --2- 172.21.15.29:0/2644194990 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55911d6dac00 0x55911d75f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.087+0000 7f650479b5c0 1 --2- 172.21.15.29:0/2644194990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55911d6da800 0x55911d75eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.087+0000 7f650479b5c0 1 --2- 172.21.15.29:0/2644194990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55911d6da400 0x55911d75e580 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.087+0000 7f650479b5c0 1 -- 172.21.15.29:0/2644194990 >> 172.21.15.29:0/2644194990 conn(0x55911d6da000 msgr2=0x55911d6bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.087+0000 7f650479b5c0 1 -- 172.21.15.29:0/2644194990 shutdown_connections 2023-10-06T05:30:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.087+0000 7f650479b5c0 1 -- 172.21.15.29:0/2644194990 wait complete. 2023-10-06T05:30:36.097 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.150744, result: 2023-10-06T05:30:36.098 DEBUG:teuthology.orchestra.run.smithi029:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2023-10-06T05:30:36.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.171+0000 7fe77cff85c0 1 -- start start 2023-10-06T05:30:36.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.171+0000 7fe77cff85c0 1 Processor -- start 2023-10-06T05:30:36.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aec400 0x55c498b46580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aec800 0x55c498b46b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aecc00 0x55c498b47080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c497dcadc0 con 0x55c498aec800 2023-10-06T05:30:36.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c497dcbcc0 con 0x55c498aec400 2023-10-06T05:30:36.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c497dcbb80 con 0x55c498aecc00 2023-10-06T05:30:36.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77afb1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aec800 0x55c498b46b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77afb1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aec800 0x55c498b46b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58034/0 (socket says 172.21.15.29:58034) 2023-10-06T05:30:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77afb1700 1 -- 172.21.15.29:0/950206150 learned_addr learned my addr 172.21.15.29:0/950206150 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77b7b2700 1 --2- 172.21.15.29:0/950206150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aec400 0x55c498b46580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/950206150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aecc00 0x55c498b47080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77afb1700 1 -- 172.21.15.29:0/950206150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aecc00 msgr2=0x55c498b47080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:36.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77afb1700 1 --2- 172.21.15.29:0/950206150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aecc00 0x55c498b47080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77afb1700 1 -- 172.21.15.29:0/950206150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aec400 msgr2=0x55c498b46580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:36.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77afb1700 1 --2- 172.21.15.29:0/950206150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aec400 0x55c498b46580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77afb1700 1 -- 172.21.15.29:0/950206150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c497daeb60 con 0x55c498aec800 2023-10-06T05:30:36.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77afb1700 1 --2- 172.21.15.29:0/950206150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aec800 0x55c498b46b00 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x55c498b66690 tx=0x55c498b52300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eaf8d707444a1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe778fad700 1 -- 172.21.15.29:0/950206150 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c497dd9080 con 0x55c498aec800 2023-10-06T05:30:36.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe778fad700 1 -- 172.21.15.29:0/950206150 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c497de0900 con 0x55c498aec800 2023-10-06T05:30:36.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe778fad700 1 -- 172.21.15.29:0/950206150 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c497dd9600 con 0x55c498aec800 2023-10-06T05:30:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 1 -- 172.21.15.29:0/950206150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c497dae000 con 0x55c498aec800 2023-10-06T05:30:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 1 -- 172.21.15.29:0/950206150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c497daeea0 con 0x55c498aec800 2023-10-06T05:30:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 4 waiting for MDS map... 2023-10-06T05:30:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe778fad700 1 -- 172.21.15.29:0/950206150 <== mon.0 v2:172.21.15.29:3300/0 4 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x55c498b64a80 con 0x55c498aec800 2023-10-06T05:30:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe778fad700 1 -- 172.21.15.29:0/950206150 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 48) v1 ==== 2559+0+0 (secure 0 0 0) 0x55c498b9b200 con 0x55c498aec800 2023-10-06T05:30:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 4 Got MDS map 48 2023-10-06T05:30:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2023-10-06T05:30:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 4 datascan.main: Using metadata pool output 2023-10-06T05:30:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.175+0000 7fe77cff85c0 4 datascan.main: connecting to RADOS... 2023-10-06T05:30:36.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77cff85c0 1 Processor -- start 2023-10-06T05:30:36.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77cff85c0 1 -- start start 2023-10-06T05:30:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77cff85c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aed800 0x55c498b47600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77cff85c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aedc00 0x55c498b47b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77cff85c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498be0000 0x55c498b48100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77cff85c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c497dca3c0 con 0x55c498be0000 2023-10-06T05:30:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77cff85c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c497dcbcc0 con 0x55c498aed800 2023-10-06T05:30:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77cff85c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c497dcadc0 con 0x55c498aedc00 2023-10-06T05:30:36.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77afb1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498be0000 0x55c498b48100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77afb1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498be0000 0x55c498b48100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58042/0 (socket says 172.21.15.29:58042) 2023-10-06T05:30:36.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77afb1700 1 -- 172.21.15.29:0/1837464550 learned_addr learned my addr 172.21.15.29:0/1837464550 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:36.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/1837464550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aed800 0x55c498b47600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77b7b2700 1 --2- 172.21.15.29:0/1837464550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aedc00 0x55c498b47b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77afb1700 1 -- 172.21.15.29:0/1837464550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aedc00 msgr2=0x55c498b47b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:36.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77afb1700 1 --2- 172.21.15.29:0/1837464550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aedc00 0x55c498b47b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77afb1700 1 -- 172.21.15.29:0/1837464550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aed800 msgr2=0x55c498b47600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:36.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77afb1700 1 --2- 172.21.15.29:0/1837464550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aed800 0x55c498b47600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77afb1700 1 -- 172.21.15.29:0/1837464550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c497daf860 con 0x55c498be0000 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe77afb1700 1 --2- 172.21.15.29:0/1837464550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498be0000 0x55c498b48100 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x55c498b67500 tx=0x55c498b52060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05e29710a7085f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe776fa9700 1 -- 172.21.15.29:0/1837464550 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c497dd91e0 con 0x55c498be0000 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe776fa9700 1 -- 172.21.15.29:0/1837464550 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c497de0300 con 0x55c498be0000 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.179+0000 7fe776fa9700 1 -- 172.21.15.29:0/1837464550 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c497dd8f20 con 0x55c498be0000 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 -- 172.21.15.29:0/1837464550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498be0000 msgr2=0x55c498b48100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/1837464550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498be0000 0x55c498b48100 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x55c498b67500 tx=0x55c498b52060 comp rx=0 tx=0).stop 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 -- 172.21.15.29:0/1837464550 shutdown_connections 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/1837464550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498be0000 0x55c498b48100 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/1837464550 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aedc00 0x55c498b47b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/1837464550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aed800 0x55c498b47600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 -- 172.21.15.29:0/1837464550 >> 172.21.15.29:0/1837464550 conn(0x55c498aed000 msgr2=0x55c498b03800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:36.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 -- 172.21.15.29:0/1837464550 shutdown_connections 2023-10-06T05:30:36.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 -- 172.21.15.29:0/1837464550 wait complete. 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 Processor -- start 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 -- start start 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aedc00 0x55c498b48c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aed800 0x55c498b48680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498c00000 0x55c498b48100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c497dca000 con 0x55c498aedc00 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c497dcb180 con 0x55c498c00000 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77cff85c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c497dcb040 con 0x55c498aed800 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77bfb3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aedc00 0x55c498b48c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77bfb3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aedc00 0x55c498b48c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58046/0 (socket says 172.21.15.29:58046) 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 learned_addr learned my addr 172.21.15.29:0/3846293135 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:36.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77afb1700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498c00000 0x55c498b48100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77b7b2700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aed800 0x55c498b48680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aed800 msgr2=0x55c498b48680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aed800 0x55c498b48680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498c00000 msgr2=0x55c498b48100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498c00000 0x55c498b48100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c497daeea0 con 0x55c498aedc00 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77afb1700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498c00000 0x55c498b48100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aedc00 0x55c498b48c00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x55c498be06c0 tx=0x55c498bfcc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe7757a6700 1 -- 172.21.15.29:0/3846293135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c497dd91e0 con 0x55c498aedc00 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.183+0000 7fe7757a6700 1 -- 172.21.15.29:0/3846293135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c498ba6300 con 0x55c498aedc00 2023-10-06T05:30:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.187+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c497dafa00 con 0x55c498aedc00 2023-10-06T05:30:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.187+0000 7fe7757a6700 1 -- 172.21.15.29:0/3846293135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c497dd8f20 con 0x55c498aedc00 2023-10-06T05:30:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.187+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c497daeea0 con 0x55c498aedc00 2023-10-06T05:30:36.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.187+0000 7fe77cff85c0 4 datascan.init: resolving metadata pool 11 2023-10-06T05:30:36.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.187+0000 7fe7757a6700 1 -- 172.21.15.29:0/3846293135 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x55c498afb080 con 0x55c498aedc00 2023-10-06T05:30:36.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.187+0000 7fe7757a6700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55c498c04400 0x55c498b49700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.187+0000 7fe7757a6700 1 -- 172.21.15.29:0/3846293135 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x55c498b65880 con 0x55c498aedc00 2023-10-06T05:30:36.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77cff85c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-10-06T05:30:36.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77cff85c0 4 datascan.main: data pool 'cephfs_data' has ID 12 2023-10-06T05:30:36.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77cff85c0 4 datascan.main: opening data pool 'cephfs_data' 2023-10-06T05:30:36.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55c498c00400 0x55c498b47b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77b7b2700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55c498c04400 0x55c498b49700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:1 11.14 11:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c00800 con 0x55c498c00400 2023-10-06T05:30:36.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77afb1700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55c498c00400 0x55c498b47b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77b7b2700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55c498c04400 0x55c498b49700 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55c498afdd70 tx=0x55c498bfd380 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77afb1700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55c498c00400 0x55c498b47b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv35 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55c498c00c00 0x55c498b47600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:2 11.1f 11:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01000 con 0x55c498c00c00 2023-10-06T05:30:36.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55c498c00c00 0x55c498b47600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55c498c00c00 0x55c498b47600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55c498c01400 0x55c498cee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:3 12.0 12:00000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01800 con 0x55c498c01400 2023-10-06T05:30:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.191+0000 7fe77b7b2700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55c498c01400 0x55c498cee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.195+0000 7fe77b7b2700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55c498c01400 0x55c498cee000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.195+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.195+0000 7fe776fa9700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55c498c04800 0x55c498cf0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.195+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:4 12.20 12:04000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c04c00 con 0x55c498c04800 2023-10-06T05:30:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.195+0000 7fe77afb1700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55c498c04800 0x55c498cf0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.195+0000 7fe77afb1700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55c498c04800 0x55c498cf0680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.195+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c04800 2023-10-06T05:30:36.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe7767a8700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55c498c05400 0x55c498cf0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:5 12.10 12:08000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c05800 con 0x55c498c05400 2023-10-06T05:30:36.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55c498c05400 0x55c498cf0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55c498c05400 0x55c498cf0c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.205 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:6 12.30 12:0c000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c05000 con 0x55c498c04800 2023-10-06T05:30:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.7 v2:172.21.15.173:6824/33718 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c04800 2023-10-06T05:30:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe7767a8700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55c498c05c00 0x55c498cf1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:7 12.8 12:10000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c04c00 con 0x55c498c05c00 2023-10-06T05:30:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe77b7b2700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55c498c05c00 0x55c498cf1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.199+0000 7fe77b7b2700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55c498c05c00 0x55c498cf1180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.3 v2:172.21.15.29:6800/33419 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c05c00 2023-10-06T05:30:36.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:8 12.28 12:14000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c04c00 con 0x55c498c05400 2023-10-06T05:30:36.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe7767a8700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55c498c05000 0x55c498cf1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:9 12.18 12:18000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c00800 con 0x55c498c05000 2023-10-06T05:30:36.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe77afb1700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55c498c05000 0x55c498cf1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe77afb1700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55c498c05000 0x55c498cf1700 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c05000 2023-10-06T05:30:36.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:10 12.38 12:1c000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01800 con 0x55c498c00c00 2023-10-06T05:30:36.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.203+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:11 12.4 12:20000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c05800 con 0x55c498c00400 2023-10-06T05:30:36.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:12 12.24 12:24000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a000 con 0x55c498c00c00 2023-10-06T05:30:36.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 79 out=49b] v77'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe7767a8700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55c498c04c00 0x55c498d10000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:13 12.14 12:28000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01000 con 0x55c498c04c00 2023-10-06T05:30:36.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55c498c04c00 0x55c498d10000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe77bfb3700 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55c498c04c00 0x55c498d10000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 79 out=49b] v77'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:14 12.34 12:2c000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a400 con 0x55c498c04c00 2023-10-06T05:30:36.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 2 ==== osd_op_reply(14 [pgnls-filter start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.207+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:15 12.c 12:30000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a000 con 0x55c498c05400 2023-10-06T05:30:36.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.211+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.211+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:16 12.2c 12:34000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a800 con 0x55c498c00c00 2023-10-06T05:30:36.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.211+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 4 ==== osd_op_reply(16 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.211+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:17 12.1c 12:38000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a400 con 0x55c498c05400 2023-10-06T05:30:36.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.211+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 4 ==== osd_op_reply(17 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.211+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:18 12.3c 12:3c000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0ac00 con 0x55c498c04c00 2023-10-06T05:30:36.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.211+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 3 ==== osd_op_reply(18 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.211+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:19 12.2 12:40000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b000 con 0x55c498c01400 2023-10-06T05:30:36.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.215+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.215+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:20 12.22 12:44000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b400 con 0x55c498c04800 2023-10-06T05:30:36.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.215+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.7 v2:172.21.15.173:6824/33718 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c04800 2023-10-06T05:30:36.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.215+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:21 12.12 12:48000000::::head [pgnls-filter start_epoch 79 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01800 con 0x55c498c05c00 2023-10-06T05:30:36.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.215+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.3 v2:172.21.15.29:6800/33419 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 79 out=81b] v79'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c498b63440 con 0x55c498c05c00 2023-10-06T05:30:36.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.215+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:22 12.0 12:00000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01c00 con 0x55c498c01400 2023-10-06T05:30:36.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.215+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 3 ==== osd_op_reply(22 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.215+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:23 12.20 12:04000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01000 con 0x55c498c04800 2023-10-06T05:30:36.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.219+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.7 v2:172.21.15.173:6824/33718 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c04800 2023-10-06T05:30:36.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.219+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:24 12.10 12:08000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b800 con 0x55c498c05400 2023-10-06T05:30:36.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.219+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 5 ==== osd_op_reply(24 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.219+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:25 12.30 12:0c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a000 con 0x55c498c04800 2023-10-06T05:30:36.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.219+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.7 v2:172.21.15.173:6824/33718 5 ==== osd_op_reply(25 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c04800 2023-10-06T05:30:36.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.219+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:26 12.8 12:10000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0bc00 con 0x55c498c05c00 2023-10-06T05:30:36.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.219+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.3 v2:172.21.15.29:6800/33419 3 ==== osd_op_reply(26 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c05c00 2023-10-06T05:30:36.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.219+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:27 12.28 12:14000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a800 con 0x55c498c05400 2023-10-06T05:30:36.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.223+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 6 ==== osd_op_reply(27 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.223+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:28 12.18 12:18000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c00800 con 0x55c498c05000 2023-10-06T05:30:36.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.223+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.1 v2:172.21.15.29:6816/33422 2 ==== osd_op_reply(28 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c05000 2023-10-06T05:30:36.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.223+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:29 12.38 12:1c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a400 con 0x55c498c00c00 2023-10-06T05:30:36.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.223+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 5 ==== osd_op_reply(29 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.223+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:30 12.4 12:20000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01000 con 0x55c498c00400 2023-10-06T05:30:36.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.223+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 3 ==== osd_op_reply(30 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.223+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:31 12.24 12:24000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0ac00 con 0x55c498c00c00 2023-10-06T05:30:36.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.227+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 6 ==== osd_op_reply(31 [pgnls-filter start_epoch 79 out=49b] v77'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.227+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:32 12.14 12:28000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01800 con 0x55c498c04c00 2023-10-06T05:30:36.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.227+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 4 ==== osd_op_reply(32 [pgnls-filter start_epoch 79 out=49b] v77'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.227+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:33 12.34 12:2c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b800 con 0x55c498c04c00 2023-10-06T05:30:36.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.227+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 5 ==== osd_op_reply(33 [pgnls-filter start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.227+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:34 12.c 12:30000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01c00 con 0x55c498c05400 2023-10-06T05:30:36.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.227+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 7 ==== osd_op_reply(34 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.227+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:35 12.2c 12:34000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c05800 con 0x55c498c00c00 2023-10-06T05:30:36.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.231+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 7 ==== osd_op_reply(35 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.231+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:36 12.1c 12:38000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b400 con 0x55c498c05400 2023-10-06T05:30:36.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.231+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 8 ==== osd_op_reply(36 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.231+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:37 12.3c 12:3c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01800 con 0x55c498c04c00 2023-10-06T05:30:36.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.231+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 6 ==== osd_op_reply(37 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.231+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:38 12.2 12:40000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b000 con 0x55c498c01400 2023-10-06T05:30:36.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.231+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.231+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:39 12.22 12:44000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01c00 con 0x55c498c04800 2023-10-06T05:30:36.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.235+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.7 v2:172.21.15.173:6824/33718 6 ==== osd_op_reply(39 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c04800 2023-10-06T05:30:36.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.235+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:40 12.12 12:48000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e000 con 0x55c498c05c00 2023-10-06T05:30:36.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.235+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.3 v2:172.21.15.29:6800/33419 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 79 out=49b] v79'23 uv23 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c05c00 2023-10-06T05:30:36.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.235+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:41 12.32 12:4c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a800 con 0x55c498c05c00 2023-10-06T05:30:36.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.235+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.3 v2:172.21.15.29:6800/33419 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 79 out=49b] v77'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c05c00 2023-10-06T05:30:36.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.235+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:42 12.a 12:50000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e400 con 0x55c498c00c00 2023-10-06T05:30:36.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.235+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 8 ==== osd_op_reply(42 [pgnls-filter start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.235+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:43 12.2a 12:54000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a400 con 0x55c498c00c00 2023-10-06T05:30:36.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.239+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 9 ==== osd_op_reply(43 [pgnls-filter start_epoch 79 out=49b] v77'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.239+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:44 12.1a 12:58000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e800 con 0x55c498c01400 2023-10-06T05:30:36.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.239+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 5 ==== osd_op_reply(44 [pgnls-filter start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.239+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:45 12.3a 12:5c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0ac00 con 0x55c498c05c00 2023-10-06T05:30:36.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.239+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.3 v2:172.21.15.29:6800/33419 6 ==== osd_op_reply(45 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c05c00 2023-10-06T05:30:36.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.239+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:46 12.6 12:60000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1ec00 con 0x55c498c05000 2023-10-06T05:30:36.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.239+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.1 v2:172.21.15.29:6816/33422 3 ==== osd_op_reply(46 [pgnls-filter start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c05000 2023-10-06T05:30:36.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.239+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:47 12.26 12:64000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b800 con 0x55c498c04c00 2023-10-06T05:30:36.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.243+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 7 ==== osd_op_reply(47 [pgnls-filter start_epoch 79 out=49b] v77'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.243+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:48 12.16 12:68000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1f000 con 0x55c498c00400 2023-10-06T05:30:36.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.243+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 4 ==== osd_op_reply(48 [pgnls-filter start_epoch 79 out=49b] v77'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.243+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:49 12.36 12:6c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1ec00 con 0x55c498c04c00 2023-10-06T05:30:36.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.243+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 8 ==== osd_op_reply(49 [pgnls-filter start_epoch 79 out=81b] v79'34 uv34 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.243+0000 7fe77cff85c0 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2023-10-06T05:30:36.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.243+0000 7fe77cff85c0 10 datascan.operator(): handling object 100000001f7.0 2023-10-06T05:30:36.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.243+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:50 12.36 12:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e400 con 0x55c498c04c00 2023-10-06T05:30:36.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 9 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) v8 ==== 416+0+194 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2023-10-06T05:30:36.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2023-10-06T05:30:36.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2023-10-06T05:30:36.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:51 11.7 11:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1ec00 con 0x55c498c04c00 2023-10-06T05:30:36.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 10 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2023-10-06T05:30:36.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:52 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e000 con 0x55c498c05400 2023-10-06T05:30:36.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 9 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=512b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+512 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2023-10-06T05:30:36.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2023-10-06T05:30:36.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 20 datascan.get_frag_of: frag is * 2023-10-06T05:30:36.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:53 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1fc00 con 0x55c498c04c00 2023-10-06T05:30:36.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 11 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 10 datascan.find_or_create_dirfrag: read_version = 7 2023-10-06T05:30:36.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2023-10-06T05:30:36.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.247+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:54 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b400 con 0x55c498c04c00 2023-10-06T05:30:36.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.251+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 12 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.251+0000 7fe77cff85c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2023-10-06T05:30:36.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.251+0000 7fe77cff85c0 20 datascan.read_dentry: bravo_head not found in result 2023-10-06T05:30:36.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.251+0000 7fe77cff85c0 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2023-10-06T05:30:36.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.251+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:55 11.7 11:e2e07930:::10000000001.00000000:head [omap-set-vals in=494b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a400 con 0x55c498c04c00 2023-10-06T05:30:36.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.251+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 13 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v79'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.251+0000 7fe77cff85c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2023-10-06T05:30:36.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.251+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:56 12.e 12:70000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b800 con 0x55c498c05400 2023-10-06T05:30:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.255+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 10 ==== osd_op_reply(56 [pgnls-filter start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.255+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:57 12.2e 12:74000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a000 con 0x55c498c05000 2023-10-06T05:30:36.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.255+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.1 v2:172.21.15.29:6816/33422 4 ==== osd_op_reply(57 [pgnls-filter start_epoch 79 out=49b] v77'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c05000 2023-10-06T05:30:36.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.255+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:58 12.1e 12:78000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1f400 con 0x55c498c01400 2023-10-06T05:30:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.255+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 6 ==== osd_op_reply(58 [pgnls-filter start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.255+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:59 12.3e 12:7c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0bc00 con 0x55c498c05400 2023-10-06T05:30:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.255+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 11 ==== osd_op_reply(59 [pgnls-filter start_epoch 79 out=49b] v77'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.255+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:60 12.1 12:80000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1f800 con 0x55c498c00400 2023-10-06T05:30:36.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.259+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 5 ==== osd_op_reply(60 [pgnls-filter start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.259+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:61 12.21 12:84000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b000 con 0x55c498c05000 2023-10-06T05:30:36.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.259+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.1 v2:172.21.15.29:6816/33422 5 ==== osd_op_reply(61 [pgnls-filter start_epoch 79 out=49b] v77'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c05000 2023-10-06T05:30:36.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.259+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:62 12.11 12:88000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b400 con 0x55c498c04c00 2023-10-06T05:30:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.259+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.5 v2:172.21.15.173:6808/33716 14 ==== osd_op_reply(62 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c04c00 2023-10-06T05:30:36.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.259+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:63 12.31 12:8c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a800 con 0x55c498c05400 2023-10-06T05:30:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.263+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 12 ==== osd_op_reply(63 [pgnls-filter start_epoch 79 out=49b] v77'15 uv8 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.263+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:64 12.9 12:90000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a400 con 0x55c498c00c00 2023-10-06T05:30:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.263+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 10 ==== osd_op_reply(64 [pgnls-filter start_epoch 79 out=49b] v77'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.263+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:65 12.29 12:94000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c00800 con 0x55c498c01400 2023-10-06T05:30:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.263+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 7 ==== osd_op_reply(65 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.263+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:66 12.19 12:98000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b800 con 0x55c498c05400 2023-10-06T05:30:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.263+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 13 ==== osd_op_reply(66 [pgnls-filter start_epoch 79 out=49b] v79'24 uv24 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.263+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:67 12.39 12:9c000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01000 con 0x55c498c00400 2023-10-06T05:30:36.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.267+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 6 ==== osd_op_reply(67 [pgnls-filter start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.267+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:68 12.5 12:a0000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0bc00 con 0x55c498c00400 2023-10-06T05:30:36.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.267+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 79 out=49b] v79'15 uv15 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.267+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:69 12.25 12:a4000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01c00 con 0x55c498c04800 2023-10-06T05:30:36.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.267+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.7 v2:172.21.15.173:6824/33718 7 ==== osd_op_reply(69 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c04800 2023-10-06T05:30:36.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.267+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:70 12.15 12:a8000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e400 con 0x55c498c00400 2023-10-06T05:30:36.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.267+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 8 ==== osd_op_reply(70 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.267+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:71 12.35 12:ac000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0a000 con 0x55c498c05400 2023-10-06T05:30:36.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.271+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 14 ==== osd_op_reply(71 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.271+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:72 12.d 12:b0000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1ec00 con 0x55c498c04800 2023-10-06T05:30:36.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.271+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.7 v2:172.21.15.173:6824/33718 8 ==== osd_op_reply(72 [pgnls-filter start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c04800 2023-10-06T05:30:36.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.271+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:73 12.2d 12:b4000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b000 con 0x55c498c05c00 2023-10-06T05:30:36.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.271+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.3 v2:172.21.15.29:6800/33419 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c05c00 2023-10-06T05:30:36.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.271+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:74 12.1d 12:b8000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e000 con 0x55c498c05400 2023-10-06T05:30:36.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.271+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 15 ==== osd_op_reply(74 [pgnls-filter start_epoch 79 out=49b] v77'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.271+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:75 12.3d 12:bc000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0bc00 con 0x55c498c05000 2023-10-06T05:30:36.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.275+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.1 v2:172.21.15.29:6816/33422 6 ==== osd_op_reply(75 [pgnls-filter start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c05000 2023-10-06T05:30:36.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.275+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:76 12.3 12:c0000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1fc00 con 0x55c498c05400 2023-10-06T05:30:36.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.275+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 16 ==== osd_op_reply(76 [pgnls-filter start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.275+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:77 12.23 12:c4000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01000 con 0x55c498c05400 2023-10-06T05:30:36.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.275+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 17 ==== osd_op_reply(77 [pgnls-filter start_epoch 79 out=49b] v77'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.275+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:78 12.13 12:c8000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0ac00 con 0x55c498c05000 2023-10-06T05:30:36.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.275+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.1 v2:172.21.15.29:6816/33422 7 ==== osd_op_reply(78 [pgnls-filter start_epoch 79 out=49b] v77'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c05000 2023-10-06T05:30:36.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.275+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:79 12.33 12:cc000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1f000 con 0x55c498c00c00 2023-10-06T05:30:36.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.279+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 11 ==== osd_op_reply(79 [pgnls-filter start_epoch 79 out=49b] v77'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.279+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:80 12.b 12:d0000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b000 con 0x55c498c05c00 2023-10-06T05:30:36.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.279+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.3 v2:172.21.15.29:6800/33419 8 ==== osd_op_reply(80 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c05c00 2023-10-06T05:30:36.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.279+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:81 12.2b 12:d4000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1f800 con 0x55c498c01400 2023-10-06T05:30:36.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.279+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 8 ==== osd_op_reply(81 [pgnls-filter start_epoch 79 out=49b] v77'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.279+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:82 12.1b 12:d8000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c00800 con 0x55c498c01400 2023-10-06T05:30:36.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.279+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 9 ==== osd_op_reply(82 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.279+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:83 12.3b 12:dc000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e000 con 0x55c498c00c00 2023-10-06T05:30:36.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.283+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 12 ==== osd_op_reply(83 [pgnls-filter start_epoch 79 out=49b] v77'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.283+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:84 12.7 12:e0000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e800 con 0x55c498c05000 2023-10-06T05:30:36.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.283+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.1 v2:172.21.15.29:6816/33422 8 ==== osd_op_reply(84 [pgnls-filter start_epoch 79 out=49b] v77'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c05000 2023-10-06T05:30:36.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.283+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:85 12.27 12:e4000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1fc00 con 0x55c498c05400 2023-10-06T05:30:36.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.283+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.0 v2:172.21.15.29:6808/33420 18 ==== osd_op_reply(85 [pgnls-filter start_epoch 79 out=49b] v77'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c05400 2023-10-06T05:30:36.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.283+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:86 12.17 12:e8000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1f400 con 0x55c498c00400 2023-10-06T05:30:36.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.283+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 9 ==== osd_op_reply(86 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.283+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:87 12.37 12:ec000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1f000 con 0x55c498c01400 2023-10-06T05:30:36.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.287+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 <== osd.4 v2:172.21.15.173:6800/33715 10 ==== osd_op_reply(87 [pgnls-filter start_epoch 79 out=49b] v77'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63440 con 0x55c498c01400 2023-10-06T05:30:36.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.287+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:88 12.f 12:f0000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1e400 con 0x55c498c00400 2023-10-06T05:30:36.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.287+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 10 ==== osd_op_reply(88 [pgnls-filter start_epoch 79 out=49b] v77'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.287+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:89 12.2f 12:f4000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498c01000 con 0x55c498c00c00 2023-10-06T05:30:36.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.287+0000 7fe77bfb3700 1 -- 172.21.15.29:0/3846293135 <== osd.2 v2:172.21.15.29:6824/33445 13 ==== osd_op_reply(89 [pgnls-filter start_epoch 79 out=49b] v77'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b63200 con 0x55c498c00c00 2023-10-06T05:30:36.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.287+0000 7fe776fa9700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:90 12.1f 12:f8000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d1ec00 con 0x55c498c00400 2023-10-06T05:30:36.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.287+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.6 v2:172.21.15.173:6816/33717 11 ==== osd_op_reply(90 [pgnls-filter start_epoch 79 out=49b] v77'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c00400 2023-10-06T05:30:36.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.287+0000 7fe7767a8700 1 -- 172.21.15.29:0/3846293135 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:91 12.3f 12:fc000000::::head [pgnls-filter start_epoch 79 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55c498d0b400 con 0x55c498c04800 2023-10-06T05:30:36.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77afb1700 1 -- 172.21.15.29:0/3846293135 <== osd.7 v2:172.21.15.173:6824/33718 9 ==== osd_op_reply(91 [pgnls-filter start_epoch 79 out=49b] v77'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c498b62fc0 con 0x55c498c04800 2023-10-06T05:30:36.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55c498c05400 msgr2=0x55c498cf0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55c498c05400 0x55c498cf0c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55c498c05000 msgr2=0x55c498cf1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55c498c05000 0x55c498cf1700 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55c498c00c00 msgr2=0x55c498b47600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55c498c00c00 0x55c498b47600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55c498c05c00 msgr2=0x55c498cf1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55c498c05c00 0x55c498cf1180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55c498c01400 msgr2=0x55c498cee000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 reap_dead start 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55c498c01400 0x55c498cee000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 reap_dead start 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55c498c04c00 msgr2=0x55c498d10000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55c498c04c00 0x55c498d10000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55c498c00400 msgr2=0x55c498b47b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55c498c00400 0x55c498b47b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55c498c04800 msgr2=0x55c498cf0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55c498c04800 0x55c498cf0680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55c498c04400 msgr2=0x55c498b49700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55c498c04400 0x55c498b49700 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55c498afdd70 tx=0x55c498bfd380 comp rx=0 tx=0).stop 2023-10-06T05:30:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aedc00 msgr2=0x55c498b48c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/3846293135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aedc00 0x55c498b48c00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x55c498be06c0 tx=0x55c498bfcc00 comp rx=0 tx=0).stop 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 reap_dead start 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 shutdown_connections 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77b7b2700 1 -- 172.21.15.29:0/3846293135 reap_dead start 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 >> 172.21.15.29:0/3846293135 conn(0x55c498aed000 msgr2=0x55c498b03800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 shutdown_connections 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/3846293135 wait complete. 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/950206150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aec800 msgr2=0x55c498b46b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/950206150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aec800 0x55c498b46b00 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x55c498b66690 tx=0x55c498b52300 comp rx=0 tx=0).stop 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/950206150 shutdown_connections 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/950206150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55c498aecc00 0x55c498b47080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/950206150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c498aec800 0x55c498b46b00 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 --2- 172.21.15.29:0/950206150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c498aec400 0x55c498b46580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/950206150 >> 172.21.15.29:0/950206150 conn(0x55c498aec000 msgr2=0x55c498b03000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/950206150 shutdown_connections 2023-10-06T05:30:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.291+0000 7fe77cff85c0 1 -- 172.21.15.29:0/950206150 wait complete. 2023-10-06T05:30:36.304 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.206645, result: 2023-10-06T05:30:36.305 DEBUG:teuthology.orchestra.run.smithi029:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-10-06T05:30:36.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.327+0000 7f00cd28f5c0 1 -- start start 2023-10-06T05:30:36.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.327+0000 7f00cd28f5c0 1 Processor -- start 2023-10-06T05:30:36.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.327+0000 7f00cd28f5c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595b2c400 0x55a595b78580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.327+0000 7f00cd28f5c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2c800 0x55a595b78b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.327+0000 7f00cd28f5c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2cc00 0x55a595b79080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.327+0000 7f00cd28f5c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a594e0adc0 con 0x55a595b2c800 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.327+0000 7f00cd28f5c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a594e0bb80 con 0x55a595b2c400 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.327+0000 7f00cd28f5c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a594e0bcc0 con 0x55a595b2cc00 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cb248700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2c800 0x55a595b78b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cb248700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2c800 0x55a595b78b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58062/0 (socket says 172.21.15.29:58062) 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cb248700 1 -- 172.21.15.29:0/1101876265 learned_addr learned my addr 172.21.15.29:0/1101876265 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cc24a700 1 --2- 172.21.15.29:0/1101876265 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2cc00 0x55a595b79080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cba49700 1 --2- 172.21.15.29:0/1101876265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595b2c400 0x55a595b78580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cb248700 1 -- 172.21.15.29:0/1101876265 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2cc00 msgr2=0x55a595b79080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cb248700 1 --2- 172.21.15.29:0/1101876265 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2cc00 0x55a595b79080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cb248700 1 -- 172.21.15.29:0/1101876265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595b2c400 msgr2=0x55a595b78580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cb248700 1 --2- 172.21.15.29:0/1101876265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595b2c400 0x55a595b78580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cb248700 1 -- 172.21.15.29:0/1101876265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a594dee000 con 0x55a595b2c800 2023-10-06T05:30:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cb248700 1 --2- 172.21.15.29:0/1101876265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2c800 0x55a595b78b00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x55a595bbc0f0 tx=0x55a595b5d140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d11fb95db2924b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00c9244700 1 -- 172.21.15.29:0/1101876265 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a594e19600 con 0x55a595b2c800 2023-10-06T05:30:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00c9244700 1 -- 172.21.15.29:0/1101876265 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a594e20900 con 0x55a595b2c800 2023-10-06T05:30:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00c9244700 1 -- 172.21.15.29:0/1101876265 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a594e191e0 con 0x55a595b2c800 2023-10-06T05:30:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1101876265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a594deeb60 con 0x55a595b2c800 2023-10-06T05:30:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1101876265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55a594deeea0 con 0x55a595b2c800 2023-10-06T05:30:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cd28f5c0 4 waiting for MDS map... 2023-10-06T05:30:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00c9244700 1 -- 172.21.15.29:0/1101876265 <== mon.0 v2:172.21.15.29:3300/0 4 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x55a595bbaa80 con 0x55a595b2c800 2023-10-06T05:30:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00c9244700 1 -- 172.21.15.29:0/1101876265 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 48) v1 ==== 2559+0+0 (secure 0 0 0) 0x55a595b8c600 con 0x55a595b2c800 2023-10-06T05:30:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cd28f5c0 4 Got MDS map 48 2023-10-06T05:30:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cd28f5c0 4 datascan.main: Using metadata pool output 2023-10-06T05:30:36.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.331+0000 7f00cd28f5c0 4 datascan.main: connecting to RADOS... 2023-10-06T05:30:36.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cd28f5c0 1 Processor -- start 2023-10-06T05:30:36.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cd28f5c0 1 -- start start 2023-10-06T05:30:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cd28f5c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2d800 0x55a595b79600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cd28f5c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b79b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cd28f5c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595c2c000 0x55a595b7a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cd28f5c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a594e0a3c0 con 0x55a595b2dc00 2023-10-06T05:30:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cd28f5c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a594e0bb80 con 0x55a595c2c000 2023-10-06T05:30:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cd28f5c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a594e0a000 con 0x55a595b2d800 2023-10-06T05:30:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cba49700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b79b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cc24a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2d800 0x55a595b79600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cc24a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2d800 0x55a595b79600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:50292/0 (socket says 172.21.15.29:50292) 2023-10-06T05:30:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cc24a700 1 -- 172.21.15.29:0/1504855363 learned_addr learned my addr 172.21.15.29:0/1504855363 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cb248700 1 --2- 172.21.15.29:0/1504855363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595c2c000 0x55a595b7a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cc24a700 1 -- 172.21.15.29:0/1504855363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595c2c000 msgr2=0x55a595b7a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cc24a700 1 --2- 172.21.15.29:0/1504855363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595c2c000 0x55a595b7a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cc24a700 1 -- 172.21.15.29:0/1504855363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 msgr2=0x55a595b79b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cc24a700 1 --2- 172.21.15.29:0/1504855363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b79b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cc24a700 1 -- 172.21.15.29:0/1504855363 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a594dee000 con 0x55a595b2d800 2023-10-06T05:30:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.335+0000 7f00cc24a700 1 --2- 172.21.15.29:0/1504855363 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2d800 0x55a595b79600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55a595bbd680 tx=0x55a595b8be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37afaf86ff9b8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00c7240700 1 -- 172.21.15.29:0/1504855363 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a594e19600 con 0x55a595b2d800 2023-10-06T05:30:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00c7240700 1 -- 172.21.15.29:0/1504855363 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a595b9e300 con 0x55a595b2d800 2023-10-06T05:30:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00c7240700 1 -- 172.21.15.29:0/1504855363 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a594e191e0 con 0x55a595b2d800 2023-10-06T05:30:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1504855363 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2d800 msgr2=0x55a595b79600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/1504855363 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2d800 0x55a595b79600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55a595bbd680 tx=0x55a595b8be60 comp rx=0 tx=0).stop 2023-10-06T05:30:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1504855363 shutdown_connections 2023-10-06T05:30:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/1504855363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595c2c000 0x55a595b7a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/1504855363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b79b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/1504855363 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2d800 0x55a595b79600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1504855363 >> 172.21.15.29:0/1504855363 conn(0x55a595b2d000 msgr2=0x55a595b43800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1504855363 shutdown_connections 2023-10-06T05:30:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1504855363 wait complete. 2023-10-06T05:30:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 Processor -- start 2023-10-06T05:30:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.339+0000 7f00cd28f5c0 1 -- start start 2023-10-06T05:30:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cd28f5c0 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b7ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cd28f5c0 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595b2d800 0x55a595b7a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cd28f5c0 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595c4e000 0x55a595b7a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cd28f5c0 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a594e0b180 con 0x55a595b2dc00 2023-10-06T05:30:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cd28f5c0 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a594e0b040 con 0x55a595b2d800 2023-10-06T05:30:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cd28f5c0 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a594e0af00 con 0x55a595c4e000 2023-10-06T05:30:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cc24a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b7ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cc24a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b7ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58082/0 (socket says 172.21.15.29:58082) 2023-10-06T05:30:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 learned_addr learned my addr 172.21.15.29:0/2372712043 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cba49700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595b2d800 0x55a595b7a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595c4e000 0x55a595b7a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595c4e000 msgr2=0x55a595b7a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595c4e000 0x55a595b7a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595b2d800 msgr2=0x55a595b7a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595b2d800 0x55a595b7a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a594def860 con 0x55a595b2dc00 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595c4e000 0x55a595b7a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b7ac00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x55a595bea600 tx=0x55a595b8bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00c5a3d700 1 -- 172.21.15.29:0/2372712043 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a594e18dc0 con 0x55a595b2dc00 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00c5a3d700 1 -- 172.21.15.29:0/2372712043 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a595b9e480 con 0x55a595b2dc00 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a594deeb60 con 0x55a595b2dc00 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00c5a3d700 1 -- 172.21.15.29:0/2372712043 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a594e19600 con 0x55a595b2dc00 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a594deeea0 con 0x55a595b2dc00 2023-10-06T05:30:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.343+0000 7f00cd28f5c0 4 datascan.init: resolving metadata pool 11 2023-10-06T05:30:36.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00c5a3d700 1 -- 172.21.15.29:0/2372712043 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x55a595b3b080 con 0x55a595b2dc00 2023-10-06T05:30:36.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00c5a3d700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55a595c50400 0x55a595b7b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00c5a3d700 1 -- 172.21.15.29:0/2372712043 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x55a595bbb880 con 0x55a595b2dc00 2023-10-06T05:30:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cd28f5c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-10-06T05:30:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cd28f5c0 4 datascan.main: resolving metadata pool 11 2023-10-06T05:30:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55a595c4e400 0x55a595b79b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cba49700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55a595c50400 0x55a595b7b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:1 11.0 11:00000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4e800 con 0x55a595c4e400 2023-10-06T05:30:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55a595c4e400 0x55a595b79b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55a595c4e400 0x55a595b79b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cba49700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55a595c50400 0x55a595b7b700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55a595b3c8a0 tx=0x55a595b8a300 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== osd_op_reply(1 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c4e400 2023-10-06T05:30:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55a595c4e800 0x55a595d32000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:2 11.10 11:08000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c50800 con 0x55a595c4e800 2023-10-06T05:30:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55a595c4e800 0x55a595d32000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.347+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55a595c4e800 0x55a595d32000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 1 ==== osd_op_reply(2 [pgnls start_epoch 79 out=177b] v78'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55a595c50800 0x55a595d32580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:3 11.8 11:10000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51000 con 0x55a595c50800 2023-10-06T05:30:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cba49700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55a595c50800 0x55a595d32580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cba49700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55a595c50800 0x55a595d32580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.3 v2:172.21.15.29:6800/33419 1 ==== osd_op_reply(3 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50800 2023-10-06T05:30:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cba49700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55a595c51000 0x55a595d32b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:4 11.18 11:18000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51800 con 0x55a595c51000 2023-10-06T05:30:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55a595c51000 0x55a595d32b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55a595c51000 0x55a595d32b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 1 ==== osd_op_reply(4 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55a595c51800 0x55a595d33080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:5 11.4 11:20000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c50c00 con 0x55a595c51800 2023-10-06T05:30:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.351+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55a595c51800 0x55a595d33080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.355+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55a595c51800 0x55a595d33080 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.355+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== osd_op_reply(5 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.355+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55a595c50c00 0x55a595d33b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.355+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:6 11.14 11:28000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51400 con 0x55a595c50c00 2023-10-06T05:30:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.355+0000 7f00cba49700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55a595c50c00 0x55a595d33b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.355+0000 7f00cba49700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55a595c50c00 0x55a595d33b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.355+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 1 ==== osd_op_reply(6 [pgnls start_epoch 79 out=149b] v79'42 uv42 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.355+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:7 11.c 11:30000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51400 con 0x55a595c4e400 2023-10-06T05:30:36.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.1 v2:172.21.15.29:6816/33422 2 ==== osd_op_reply(7 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c4e400 2023-10-06T05:30:36.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:8 11.1c 11:38000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51400 con 0x55a595c50c00 2023-10-06T05:30:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 2 ==== osd_op_reply(8 [pgnls start_epoch 79 out=73b] v78'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:9 11.2 11:40000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51400 con 0x55a595c51000 2023-10-06T05:30:36.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 2 ==== osd_op_reply(9 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:10 11.12 11:48000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51400 con 0x55a595c51800 2023-10-06T05:30:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 2 ==== osd_op_reply(10 [pgnls start_epoch 79 out=81b] v78'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:11 11.a 11:50000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51400 con 0x55a595c50800 2023-10-06T05:30:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.3 v2:172.21.15.29:6800/33419 2 ==== osd_op_reply(11 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50800 2023-10-06T05:30:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cba49700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55a595c51400 0x55a595d34680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:12 11.1a 11:58000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51c00 con 0x55a595c51400 2023-10-06T05:30:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.359+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55a595c51400 0x55a595d34680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.363+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55a595c51400 0x55a595d34680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.363+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== osd_op_reply(12 [pgnls start_epoch 79 out=49b] v79'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.363+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:13 11.6 11:60000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51c00 con 0x55a595c4e800 2023-10-06T05:30:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.363+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 2 ==== osd_op_reply(13 [pgnls start_epoch 79 out=77b] v78'6 uv6 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.363+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:14 11.16 11:68000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c51c00 con 0x55a595c51400 2023-10-06T05:30:36.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.363+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 2 ==== osd_op_reply(14 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.363+0000 7f00cb248700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55a595c51c00 0x55a595d33600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.363+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:15 11.e 11:70000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51c00 2023-10-06T05:30:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.363+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55a595c51c00 0x55a595d33600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.367+0000 7f00cc24a700 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55a595c51c00 0x55a595d33600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.367+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.4 v2:172.21.15.173:6800/33715 1 ==== osd_op_reply(15 [pgnls start_epoch 79 out=73b] v78'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51c00 2023-10-06T05:30:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.367+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:16 11.1e 11:78000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51800 2023-10-06T05:30:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.367+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 3 ==== osd_op_reply(16 [pgnls start_epoch 79 out=49b] v79'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.367+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:17 11.1 11:80000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c50c00 2023-10-06T05:30:36.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.367+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 3 ==== osd_op_reply(17 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.367+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:18 11.11 11:88000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51000 2023-10-06T05:30:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.371+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 3 ==== osd_op_reply(18 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.371+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:19 11.9 11:90000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c50800 2023-10-06T05:30:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.371+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.3 v2:172.21.15.29:6800/33419 3 ==== osd_op_reply(19 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50800 2023-10-06T05:30:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.371+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:20 11.19 11:98000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c4e800 2023-10-06T05:30:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.371+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 3 ==== osd_op_reply(20 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.371+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:21 11.5 11:a0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51800 2023-10-06T05:30:36.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.371+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 4 ==== osd_op_reply(21 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.371+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:22 11.15 11:a8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51000 2023-10-06T05:30:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.375+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 4 ==== osd_op_reply(22 [pgnls start_epoch 79 out=97b] v78'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.375+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:23 11.d 11:b0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51000 2023-10-06T05:30:36.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.375+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 5 ==== osd_op_reply(23 [pgnls start_epoch 79 out=74b] v76'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.375+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:24 11.1d 11:b8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51800 2023-10-06T05:30:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.375+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 5 ==== osd_op_reply(24 [pgnls start_epoch 79 out=73b] v78'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.375+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:25 11.3 11:c0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c50c00 2023-10-06T05:30:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.375+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 4 ==== osd_op_reply(25 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.375+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:26 11.13 11:c8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51400 2023-10-06T05:30:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 3 ==== osd_op_reply(26 [pgnls start_epoch 79 out=98b] v78'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:27 11.b 11:d0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c50800 2023-10-06T05:30:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.3 v2:172.21.15.29:6800/33419 4 ==== osd_op_reply(27 [pgnls start_epoch 79 out=76b] v79'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50800 2023-10-06T05:30:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:28 11.1b 11:d8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51c00 2023-10-06T05:30:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.4 v2:172.21.15.173:6800/33715 2 ==== osd_op_reply(28 [pgnls start_epoch 79 out=49b] v79'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51c00 2023-10-06T05:30:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:29 11.7 11:e0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51400 2023-10-06T05:30:36.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 4 ==== osd_op_reply(29 [pgnls start_epoch 79 out=105b] v79'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:30 11.17 11:e8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51800 2023-10-06T05:30:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 6 ==== osd_op_reply(30 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.379+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:31 11.f 11:f0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51800 2023-10-06T05:30:36.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 7 ==== osd_op_reply(31 [pgnls start_epoch 79 out=73b] v79'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:32 11.1f 11:f8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51000 2023-10-06T05:30:36.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 6 ==== osd_op_reply(32 [pgnls start_epoch 79 out=101b] v79'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 601.00000000 2023-10-06T05:30:36.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:33 11.10 11:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4ec00 con 0x55a595c4e800 2023-10-06T05:30:36.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 4 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 602.00000000 2023-10-06T05:30:36.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:34 11.10 11:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f000 con 0x55a595c4e800 2023-10-06T05:30:36.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 5 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-10-06T05:30:36.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.383+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:35 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f400 con 0x55a595c4e800 2023-10-06T05:30:36.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 6 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1023b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1023 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 600.00000000 2023-10-06T05:30:36.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:36 11.10 11:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f800 con 0x55a595c4e800 2023-10-06T05:30:36.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 7 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 603.00000000 2023-10-06T05:30:36.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:37 11.10 11:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4fc00 con 0x55a595c4e800 2023-10-06T05:30:36.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 8 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-10-06T05:30:36.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-10-06T05:30:36.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 200.00000000 2023-10-06T05:30:36.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-10-06T05:30:36.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 200.00000001 2023-10-06T05:30:36.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-10-06T05:30:36.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 606.00000000 2023-10-06T05:30:36.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:38 11.14 11:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4ec00 con 0x55a595c50c00 2023-10-06T05:30:36.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 5 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv37 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 607.00000000 2023-10-06T05:30:36.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.387+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:39 11.1c 11:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f000 con 0x55a595c50c00 2023-10-06T05:30:36.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2023-10-06T05:30:36.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:40 11.12 11:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51800 2023-10-06T05:30:36.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 8 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=511b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+511 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2023-10-06T05:30:36.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-10-06T05:30:36.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 608.00000000 2023-10-06T05:30:36.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:41 11.e 11:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f800 con 0x55a595c51c00 2023-10-06T05:30:36.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.4 v2:172.21.15.173:6800/33715 3 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51c00 2023-10-06T05:30:36.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 604.00000000 2023-10-06T05:30:36.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:42 11.15 11:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4fc00 con 0x55a595c51000 2023-10-06T05:30:36.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 7 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 500.00000000 2023-10-06T05:30:36.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-10-06T05:30:36.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-10-06T05:30:36.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-10-06T05:30:36.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 605.00000000 2023-10-06T05:30:36.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.391+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:43 11.1d 11:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4ec00 con 0x55a595c51800 2023-10-06T05:30:36.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 9 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-10-06T05:30:36.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-10-06T05:30:36.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 100.00000000 2023-10-06T05:30:36.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:44 11.13 11:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f000 con 0x55a595c51400 2023-10-06T05:30:36.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5075b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5075 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-10-06T05:30:36.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-10-06T05:30:36.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 609.00000000 2023-10-06T05:30:36.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:45 11.7 11:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f400 con 0x55a595c51400 2023-10-06T05:30:36.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 6 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2023-10-06T05:30:36.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:46 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f800 con 0x55a595c51400 2023-10-06T05:30:36.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 7 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1509b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1509 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 20 datascan.scan_links: injected ino detected 2023-10-06T05:30:36.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 400.00000000 2023-10-06T05:30:36.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-10-06T05:30:36.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-10-06T05:30:36.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-10-06T05:30:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 10 datascan.scan_links: step 1: handling object 1.00000000 2023-10-06T05:30:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.395+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:47 11.1f 11:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f000 con 0x55a595c51000 2023-10-06T05:30:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.399+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 8 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=512b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+512 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.399+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:48 11.0 11:00000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e800 con 0x55a595c4e400 2023-10-06T05:30:36.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.399+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.1 v2:172.21.15.29:6816/33422 3 ==== osd_op_reply(48 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c4e400 2023-10-06T05:30:36.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.399+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:49 11.10 11:08000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e800 con 0x55a595c4e800 2023-10-06T05:30:36.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.399+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 9 ==== osd_op_reply(49 [pgnls start_epoch 79 out=177b] v78'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.399+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:50 11.8 11:10000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c50800 2023-10-06T05:30:36.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.403+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.3 v2:172.21.15.29:6800/33419 5 ==== osd_op_reply(50 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50800 2023-10-06T05:30:36.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.403+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:51 11.18 11:18000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51000 2023-10-06T05:30:36.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.403+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 9 ==== osd_op_reply(51 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.403+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:52 11.4 11:20000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51800 2023-10-06T05:30:36.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.403+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 10 ==== osd_op_reply(52 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.403+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:53 11.14 11:28000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c50c00 2023-10-06T05:30:36.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.403+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 7 ==== osd_op_reply(53 [pgnls start_epoch 79 out=149b] v79'42 uv42 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.403+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- osd_op(unknown.0.0:54 11.c 11:30000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c4e400 2023-10-06T05:30:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.407+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.1 v2:172.21.15.29:6816/33422 4 ==== osd_op_reply(54 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c4e400 2023-10-06T05:30:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.407+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:55 11.1c 11:38000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c50c00 2023-10-06T05:30:36.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.407+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 8 ==== osd_op_reply(55 [pgnls start_epoch 79 out=73b] v78'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.407+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:56 11.2 11:40000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51000 2023-10-06T05:30:36.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.407+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 10 ==== osd_op_reply(56 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.407+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:57 11.12 11:48000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51800 2023-10-06T05:30:36.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.407+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 11 ==== osd_op_reply(57 [pgnls start_epoch 79 out=81b] v78'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.407+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:58 11.a 11:50000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c50800 2023-10-06T05:30:36.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.411+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.3 v2:172.21.15.29:6800/33419 6 ==== osd_op_reply(58 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50800 2023-10-06T05:30:36.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.411+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:59 11.1a 11:58000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51400 2023-10-06T05:30:36.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.411+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 8 ==== osd_op_reply(59 [pgnls start_epoch 79 out=49b] v79'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.411+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:60 11.6 11:60000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c4e800 2023-10-06T05:30:36.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.411+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 10 ==== osd_op_reply(60 [pgnls start_epoch 79 out=77b] v78'6 uv6 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.411+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:61 11.16 11:68000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51400 2023-10-06T05:30:36.419 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.411+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 9 ==== osd_op_reply(61 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.411+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:62 11.e 11:70000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51c00 2023-10-06T05:30:36.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.415+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.4 v2:172.21.15.173:6800/33715 4 ==== osd_op_reply(62 [pgnls start_epoch 79 out=73b] v78'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51c00 2023-10-06T05:30:36.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.415+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:63 11.1e 11:78000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51800 2023-10-06T05:30:36.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.415+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 12 ==== osd_op_reply(63 [pgnls start_epoch 79 out=49b] v79'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.415+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:64 11.1 11:80000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c50c00 2023-10-06T05:30:36.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.415+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 9 ==== osd_op_reply(64 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.415+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:65 11.11 11:88000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51000 2023-10-06T05:30:36.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.415+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 11 ==== osd_op_reply(65 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.415+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:66 11.9 11:90000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c50800 2023-10-06T05:30:36.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.419+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.3 v2:172.21.15.29:6800/33419 7 ==== osd_op_reply(66 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50800 2023-10-06T05:30:36.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.419+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:67 11.19 11:98000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c4e800 2023-10-06T05:30:36.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.419+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 11 ==== osd_op_reply(67 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.419+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:68 11.5 11:a0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51800 2023-10-06T05:30:36.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.419+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 13 ==== osd_op_reply(68 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.419+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:69 11.15 11:a8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51000 2023-10-06T05:30:36.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.419+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 12 ==== osd_op_reply(69 [pgnls start_epoch 79 out=97b] v78'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.419+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:70 11.d 11:b0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51000 2023-10-06T05:30:36.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.423+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 13 ==== osd_op_reply(70 [pgnls start_epoch 79 out=74b] v76'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.423+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:71 11.1d 11:b8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51800 2023-10-06T05:30:36.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.423+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 14 ==== osd_op_reply(71 [pgnls start_epoch 79 out=73b] v78'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.423+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:72 11.3 11:c0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c50c00 2023-10-06T05:30:36.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.423+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 10 ==== osd_op_reply(72 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.423+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:73 11.13 11:c8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51400 2023-10-06T05:30:36.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.423+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 10 ==== osd_op_reply(73 [pgnls start_epoch 79 out=98b] v78'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.423+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- osd_op(unknown.0.0:74 11.b 11:d0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c50800 2023-10-06T05:30:36.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.427+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.3 v2:172.21.15.29:6800/33419 8 ==== osd_op_reply(74 [pgnls start_epoch 79 out=76b] v79'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50800 2023-10-06T05:30:36.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.427+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:75 11.1b 11:d8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51c00 2023-10-06T05:30:36.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.427+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.4 v2:172.21.15.173:6800/33715 5 ==== osd_op_reply(75 [pgnls start_epoch 79 out=49b] v79'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51c00 2023-10-06T05:30:36.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.427+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:76 11.7 11:e0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51400 2023-10-06T05:30:36.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.427+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 11 ==== osd_op_reply(76 [pgnls start_epoch 79 out=105b] v79'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.427+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:77 11.17 11:e8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51800 2023-10-06T05:30:36.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.427+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 15 ==== osd_op_reply(77 [pgnls start_epoch 79 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.427+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:78 11.f 11:f0000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51800 2023-10-06T05:30:36.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 16 ==== osd_op_reply(78 [pgnls start_epoch 79 out=73b] v79'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:79 11.1f 11:f8000000::::head [pgnls start_epoch 79 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51000 2023-10-06T05:30:36.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 14 ==== osd_op_reply(79 [pgnls start_epoch 79 out=101b] v79'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 601.00000000 2023-10-06T05:30:36.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:80 11.10 11:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e400 con 0x55a595c4e800 2023-10-06T05:30:36.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 12 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 602.00000000 2023-10-06T05:30:36.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:81 11.10 11:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c4e800 2023-10-06T05:30:36.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 13 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-10-06T05:30:36.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.431+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:82 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4fc00 con 0x55a595c4e800 2023-10-06T05:30:36.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 14 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1023b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1023 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 600.00000000 2023-10-06T05:30:36.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:83 11.10 11:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e800 con 0x55a595c4e800 2023-10-06T05:30:36.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 15 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 603.00000000 2023-10-06T05:30:36.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- osd_op(unknown.0.0:84 11.10 11:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f800 con 0x55a595c4e800 2023-10-06T05:30:36.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.0 v2:172.21.15.29:6808/33420 16 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c4e800 2023-10-06T05:30:36.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-10-06T05:30:36.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-10-06T05:30:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 200.00000000 2023-10-06T05:30:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-10-06T05:30:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 200.00000001 2023-10-06T05:30:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-10-06T05:30:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 606.00000000 2023-10-06T05:30:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:85 11.14 11:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e400 con 0x55a595c50c00 2023-10-06T05:30:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 11 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv37 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 607.00000000 2023-10-06T05:30:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- osd_op(unknown.0.0:86 11.1c 11:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c50c00 2023-10-06T05:30:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.435+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 <== osd.6 v2:172.21.15.173:6816/33717 12 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9440 con 0x55a595c50c00 2023-10-06T05:30:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2023-10-06T05:30:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:87 11.12 11:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4fc00 con 0x55a595c51800 2023-10-06T05:30:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 17 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=511b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+511 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2023-10-06T05:30:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-10-06T05:30:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 608.00000000 2023-10-06T05:30:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- osd_op(unknown.0.0:88 11.e 11:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4ec00 con 0x55a595c51c00 2023-10-06T05:30:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.4 v2:172.21.15.173:6800/33715 6 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51c00 2023-10-06T05:30:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 604.00000000 2023-10-06T05:30:36.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:89 11.15 11:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4fc00 con 0x55a595c51000 2023-10-06T05:30:36.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 15 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 500.00000000 2023-10-06T05:30:36.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-10-06T05:30:36.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-10-06T05:30:36.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-10-06T05:30:36.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 605.00000000 2023-10-06T05:30:36.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- osd_op(unknown.0.0:90 11.1d 11:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4ec00 con 0x55a595c51800 2023-10-06T05:30:36.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cc24a700 1 -- 172.21.15.29:0/2372712043 <== osd.7 v2:172.21.15.173:6824/33718 18 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb9200 con 0x55a595c51800 2023-10-06T05:30:36.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-10-06T05:30:36.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-10-06T05:30:36.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 100.00000000 2023-10-06T05:30:36.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.439+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:91 11.13 11:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f000 con 0x55a595c51400 2023-10-06T05:30:36.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 12 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5075b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5075 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-10-06T05:30:36.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-10-06T05:30:36.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 609.00000000 2023-10-06T05:30:36.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:92 11.7 11:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e400 con 0x55a595c51400 2023-10-06T05:30:36.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 13 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2023-10-06T05:30:36.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:93 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4e000 con 0x55a595c51400 2023-10-06T05:30:36.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 14 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1509b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1509 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 20 datascan.scan_links: injected ino detected 2023-10-06T05:30:36.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2023-10-06T05:30:36.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 400.00000000 2023-10-06T05:30:36.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-10-06T05:30:36.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-10-06T05:30:36.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-10-06T05:30:36.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: step 2: handling object 1.00000000 2023-10-06T05:30:36.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:94 11.1f 11:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f400 con 0x55a595c51000 2023-10-06T05:30:36.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 16 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=512b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+512 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2023-10-06T05:30:36.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: removing dup dentries from 0 objects 2023-10-06T05:30:36.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-10-06T05:30:36.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: processing 1 injected_inos 2023-10-06T05:30:36.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 10 datascan.scan_links: handling injected_ino 0x100000001f7 2023-10-06T05:30:36.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2023-10-06T05:30:36.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.443+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:95 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595d4f000 con 0x55a595c51400 2023-10-06T05:30:36.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.447+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 15 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=494b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+494 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.447+0000 7f00cd28f5c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2023-10-06T05:30:36.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.447+0000 7f00cd28f5c0 20 datascan.scan_links: first is now 2 2023-10-06T05:30:36.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.447+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:96 11.7 11:e2e07930:::10000000001.00000000:head [omap-set-vals in=494b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f400 con 0x55a595c51400 2023-10-06T05:30:36.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.451+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 16 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v79'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.451+0000 7f00cd28f5c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2023-10-06T05:30:36.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.451+0000 7f00cd28f5c0 10 datascan.scan_links: updating inotable 2023-10-06T05:30:36.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.451+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:97 11.13 11:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f800 con 0x55a595c51400 2023-10-06T05:30:36.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.451+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 17 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.451+0000 7f00cd28f5c0 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2023-10-06T05:30:36.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.451+0000 7f00cd28f5c0 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2023-10-06T05:30:36.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.451+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- osd_op(unknown.0.0:98 11.13 11:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4f000 con 0x55a595c51400 2023-10-06T05:30:36.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.5 v2:172.21.15.173:6808/33716 18 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v79'6 uv6 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51400 2023-10-06T05:30:36.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 10 datascan.scan_links: updating snaptable 2023-10-06T05:30:36.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- osd_op(unknown.0.0:99 11.d 11:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79) v8 -- 0x55a595c4fc00 con 0x55a595c51000 2023-10-06T05:30:36.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cb248700 1 -- 172.21.15.29:0/2372712043 <== osd.2 v2:172.21.15.29:6824/33445 17 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55a595bb8fc0 con 0x55a595c51000 2023-10-06T05:30:36.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55a595c4e800 msgr2=0x55a595d32000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x55a595c4e800 0x55a595d32000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55a595c4e400 msgr2=0x55a595b79b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x55a595c4e400 0x55a595b79b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55a595c51000 msgr2=0x55a595d32b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x55a595c51000 0x55a595d32b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55a595c50800 msgr2=0x55a595d32580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x55a595c50800 0x55a595d32580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 reap_dead start 2023-10-06T05:30:36.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55a595c51c00 msgr2=0x55a595d33600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x55a595c51c00 0x55a595d33600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55a595c51400 msgr2=0x55a595d34680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x55a595c51400 0x55a595d34680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55a595c50c00 msgr2=0x55a595d33b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x55a595c50c00 0x55a595d33b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55a595c51800 msgr2=0x55a595d33080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x55a595c51800 0x55a595d33080 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cba49700 1 -- 172.21.15.29:0/2372712043 reap_dead start 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55a595c50400 msgr2=0x55a595b7b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55a595c50400 0x55a595b7b700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55a595b3c8a0 tx=0x55a595b8a300 comp rx=0 tx=0).stop 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 msgr2=0x55a595b7ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b7ac00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x55a595bea600 tx=0x55a595b8bf20 comp rx=0 tx=0).stop 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 shutdown_connections 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x55a595c50400 0x55a595b7b700 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/2372712043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2dc00 0x55a595b7ac00 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 >> 172.21.15.29:0/2372712043 conn(0x55a595b2d000 msgr2=0x55a595b43800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:36.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 shutdown_connections 2023-10-06T05:30:36.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.455+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/2372712043 wait complete. 2023-10-06T05:30:36.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.459+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1101876265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2c800 msgr2=0x55a595b78b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.459+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/1101876265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2c800 0x55a595b78b00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x55a595bbc0f0 tx=0x55a595b5d140 comp rx=0 tx=0).stop 2023-10-06T05:30:36.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.459+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1101876265 shutdown_connections 2023-10-06T05:30:36.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.459+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/1101876265 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55a595b2cc00 0x55a595b79080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.459+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/1101876265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a595b2c800 0x55a595b78b00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.459+0000 7f00cd28f5c0 1 --2- 172.21.15.29:0/1101876265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a595b2c400 0x55a595b78580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.459+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1101876265 >> 172.21.15.29:0/1101876265 conn(0x55a595b2c000 msgr2=0x55a595b43000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:36.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.459+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1101876265 shutdown_connections 2023-10-06T05:30:36.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.459+0000 7f00cd28f5c0 1 -- 172.21.15.29:0/1101876265 wait complete. 2023-10-06T05:30:36.470 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.165514, result: 2023-10-06T05:30:36.471 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:30:36.474 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:30:36.502 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-10-06T05:30:36.502 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2023-10-06T05:30:36.502 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:30:36.502 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2023-10-06T05:30:36.502 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:30:36.503 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2023-10-06T05:30:36.504 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.504 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:30:36.504 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:30:36.504 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.504 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2023-10-06T05:30:36.504 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.504 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2023-10-06T05:30:36.504 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.505 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:30:36.506 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.506 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2023-10-06T05:30:36.506 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.506 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2023-10-06T05:30:36.506 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.506 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2023-10-06T05:30:36.506 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2023-10-06T05:30:36.506 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2023-10-06T05:30:36.506 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:30:36.507 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:30:36.507 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.507 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2023-10-06T05:30:36.507 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2023-10-06T05:30:36.507 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.507 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2023-10-06T05:30:36.507 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2023-10-06T05:30:36.507 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:30:36.507 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.508 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2023-10-06T05:30:36.508 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2023-10-06T05:30:36.508 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.508 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2023-10-06T05:30:36.508 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2023-10-06T05:30:36.508 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2023-10-06T05:30:36.508 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.508 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2023-10-06T05:30:36.508 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2023-10-06T05:30:36.509 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.509 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:30:36.509 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.509 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2023-10-06T05:30:36.509 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.509 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2023-10-06T05:30:36.509 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.509 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2023-10-06T05:30:36.510 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2023-10-06T05:30:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.512 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2023-10-06T05:30:36.512 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:30:36.512 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:30:36.512 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:36.512 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:36.512 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2023-10-06T05:30:36.512 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.512 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2023-10-06T05:30:36.512 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.513 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:30:36.513 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2023-10-06T05:30:36.513 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:30:36.513 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2023-10-06T05:30:36.513 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2023-10-06T05:30:36.513 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:36.513 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2023-10-06T05:30:36.513 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2023-10-06T05:30:36.513 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:30:36.514 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-06T05:30:36.515 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = "" 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2023-10-06T05:30:36.516 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2023-10-06T05:30:36.517 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.517 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2023-10-06T05:30:36.517 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = False 2023-10-06T05:30:36.517 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2023-10-06T05:30:36.517 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2023-10-06T05:30:36.517 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:30:36.517 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:30:36.517 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.519 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.520 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.521 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.522 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2023-10-06T05:30:36.523 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2023-10-06T05:30:36.524 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: bdev async discard = True 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: bdev enable discard = True 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore allocator = bitmap 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 1/20 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 1/20 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2023-10-06T05:30:36.525 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 4/10 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:30:36.526 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2023-10-06T05:30:36.527 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:30:36.528 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: mon op complaint time = 120 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:30:36.529 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout: client mount timeout = 600 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout: debug client = 20 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = "" 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-10-06T05:30:36.530 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout:[mds] 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds = 20 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug frag = True 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug scatterstat = False 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout: mds op complaint time = 180 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout: mds verify scatter = True 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:30:36.531 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:30:36.532 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:30:36.562 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T05:30:36.598 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-10-06T05:30:36.598 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2023-10-06T05:30:36.598 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:30:36.598 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2023-10-06T05:30:36.598 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.598 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.599 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2023-10-06T05:30:36.600 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2023-10-06T05:30:36.601 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2023-10-06T05:30:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2023-10-06T05:30:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2023-10-06T05:30:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2023-10-06T05:30:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2023-10-06T05:30:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2023-10-06T05:30:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:30:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2023-10-06T05:30:36.604 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2023-10-06T05:30:36.605 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2023-10-06T05:30:36.605 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2023-10-06T05:30:36.605 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2023-10-06T05:30:36.605 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2023-10-06T05:30:36.605 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.605 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2023-10-06T05:30:36.605 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2023-10-06T05:30:36.605 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:30:36.606 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2023-10-06T05:30:36.606 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:30:36.606 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:30:36.606 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2023-10-06T05:30:36.606 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.607 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:36.608 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:30:36.609 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2023-10-06T05:30:36.610 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:36.610 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2023-10-06T05:30:36.610 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2023-10-06T05:30:36.610 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2023-10-06T05:30:36.610 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2023-10-06T05:30:36.610 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:30:36.610 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:30:36.610 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2023-10-06T05:30:36.610 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-06T05:30:36.611 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.611 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = "" 2023-10-06T05:30:36.611 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:30:36.611 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:30:36.611 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2023-10-06T05:30:36.611 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2023-10-06T05:30:36.611 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2023-10-06T05:30:36.612 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-06T05:30:36.613 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-06T05:30:36.613 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-06T05:30:36.614 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2023-10-06T05:30:36.615 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2023-10-06T05:30:36.615 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T05:30:36.615 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2023-10-06T05:30:36.615 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.615 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2023-10-06T05:30:36.615 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.615 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.616 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T05:30:36.617 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T05:30:36.617 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.617 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2023-10-06T05:30:36.617 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.617 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2023-10-06T05:30:36.617 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2023-10-06T05:30:36.617 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2023-10-06T05:30:36.617 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2023-10-06T05:30:36.617 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2023-10-06T05:30:36.618 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2023-10-06T05:30:36.618 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2023-10-06T05:30:36.618 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T05:30:36.618 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T05:30:36.618 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2023-10-06T05:30:36.618 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.618 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T05:30:36.618 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.619 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2023-10-06T05:30:36.619 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.619 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2023-10-06T05:30:36.619 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.619 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2023-10-06T05:30:36.619 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2023-10-06T05:30:36.619 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2023-10-06T05:30:36.620 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.29,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-10-06T05:30:36.620 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = bd99696d-d9bf-47c8-93f5-f978334ae590 2023-10-06T05:30:36.620 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.620 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2023-10-06T05:30:36.620 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2023-10-06T05:30:36.620 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.620 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2023-10-06T05:30:36.620 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2023-10-06T05:30:36.621 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2023-10-06T05:30:36.621 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.621 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2023-10-06T05:30:36.621 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2023-10-06T05:30:36.621 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.621 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2023-10-06T05:30:36.621 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2023-10-06T05:30:36.621 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.622 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: bdev async discard = True 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: bdev enable discard = True 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore allocator = bitmap 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 1/20 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 1/20 2023-10-06T05:30:36.623 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 4/10 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.625 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-10-06T05:30:36.626 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.627 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: mon op complaint time = 120 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2023-10-06T05:30:36.628 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout: client mount timeout = 600 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout: debug client = 20 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = "" 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2023-10-06T05:30:36.629 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout:[mds] 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds = 20 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug frag = True 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug scatterstat = True 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout: mds op complaint time = 180 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout: mds verify scatter = True 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2023-10-06T05:30:36.630 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2023-10-06T05:30:36.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T05:30:36.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.747+0000 7ff8e359e700 1 Processor -- start 2023-10-06T05:30:36.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.747+0000 7ff8e359e700 1 -- start start 2023-10-06T05:30:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.747+0000 7ff8e359e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e41559d0 0x7ff8e40c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.747+0000 7ff8e359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e41596e0 con 0x7ff8e40cb590 2023-10-06T05:30:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.747+0000 7ff8e359e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e415a520 con 0x7ff8e4155da0 2023-10-06T05:30:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.747+0000 7ff8e359e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40ae800 con 0x7ff8e41559d0 2023-10-06T05:30:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e2d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff8e40cb590 0x7ff8e406a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57120/0 (socket says 172.21.15.29:57120) 2023-10-06T05:30:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e2d9d700 1 -- 172.21.15.29:0/1570386937 learned_addr learned my addr 172.21.15.29:0/1570386937 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e259c700 1 --2- 172.21.15.29:0/1570386937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e41559d0 0x7ff8e40c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e159a700 1 -- 172.21.15.29:0/1570386937 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383582423 0 0) 0x7ff8e41596e0 con 0x7ff8e40cb590 2023-10-06T05:30:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e159a700 1 -- 172.21.15.29:0/1570386937 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8cc003570 con 0x7ff8e40cb590 2023-10-06T05:30:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e159a700 1 -- 172.21.15.29:0/1570386937 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144888613 0 0) 0x7ff8e415a520 con 0x7ff8e4155da0 2023-10-06T05:30:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e259c700 1 -- 172.21.15.29:0/1570386937 >> v1:172.21.15.173:6789/0 conn(0x7ff8e4155da0 legacy=0x7ff8e40cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e259c700 1 -- 172.21.15.29:0/1570386937 >> v1:172.21.15.29:6789/0 conn(0x7ff8e40cb590 legacy=0x7ff8e406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e259c700 1 -- 172.21.15.29:0/1570386937 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e4159910 con 0x7ff8e41559d0 2023-10-06T05:30:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e259c700 1 --2- 172.21.15.29:0/1570386937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e41559d0 0x7ff8e40c8470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009910 tx=0x7ff8d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a652d57e77486c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e159a700 1 -- 172.21.15.29:0/1570386937 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800b680 con 0x7ff8e41559d0 2023-10-06T05:30:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e159a700 1 -- 172.21.15.29:0/1570386937 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d800b7e0 con 0x7ff8e41559d0 2023-10-06T05:30:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e159a700 1 -- 172.21.15.29:0/1570386937 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800bba0 con 0x7ff8e41559d0 2023-10-06T05:30:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e359e700 1 -- 172.21.15.29:0/1570386937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e41559d0 msgr2=0x7ff8e40c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e359e700 1 --2- 172.21.15.29:0/1570386937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e41559d0 0x7ff8e40c8470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009910 tx=0x7ff8d80091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e359e700 1 -- 172.21.15.29:0/1570386937 shutdown_connections 2023-10-06T05:30:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e359e700 1 --2- 172.21.15.29:0/1570386937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e41559d0 0x7ff8e40c8470 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e359e700 1 -- 172.21.15.29:0/1570386937 >> 172.21.15.29:0/1570386937 conn(0x7ff8e406c6c0 msgr2=0x7ff8e406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e359e700 1 -- 172.21.15.29:0/1570386937 shutdown_connections 2023-10-06T05:30:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.751+0000 7ff8e359e700 1 -- 172.21.15.29:0/1570386937 wait complete. 2023-10-06T05:30:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e359e700 1 Processor -- start 2023-10-06T05:30:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e359e700 1 -- start start 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e359e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e40cb590 0x7ff8e40c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e359e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e41559d0 0x7ff8e414ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8e4155da0 0x7ff8e414d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e416d680 con 0x7ff8e4155da0 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e359e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e416db10 con 0x7ff8e41559d0 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e359e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e416a5a0 con 0x7ff8e40cb590 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8e4155da0 0x7ff8e414d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8e4155da0 0x7ff8e414d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58088/0 (socket says 172.21.15.29:58088) 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e2d9d700 1 -- 172.21.15.29:0/1926389055 learned_addr learned my addr 172.21.15.29:0/1926389055 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e259c700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e40cb590 0x7ff8e40c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e1d9b700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e41559d0 0x7ff8e414ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e2d9d700 1 -- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e40cb590 msgr2=0x7ff8e40c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e2d9d700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e40cb590 0x7ff8e40c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e2d9d700 1 -- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e41559d0 msgr2=0x7ff8e414ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e2d9d700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e41559d0 0x7ff8e414ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e2d9d700 1 -- 172.21.15.29:0/1926389055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d8009420 con 0x7ff8e4155da0 2023-10-06T05:30:36.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.755+0000 7ff8e2d9d700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8e4155da0 0x7ff8e414d3f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00cc40 tx=0x7ff8dc001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.759+0000 7ff8d27fc700 1 -- 172.21.15.29:0/1926389055 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc00a8b0 con 0x7ff8e4155da0 2023-10-06T05:30:36.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.759+0000 7ff8d27fc700 1 -- 172.21.15.29:0/1926389055 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc00aa10 con 0x7ff8e4155da0 2023-10-06T05:30:36.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.759+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e416cd50 con 0x7ff8e4155da0 2023-10-06T05:30:36.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.759+0000 7ff8d27fc700 1 -- 172.21.15.29:0/1926389055 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc00ad90 con 0x7ff8e4155da0 2023-10-06T05:30:36.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.759+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e416d310 con 0x7ff8e4155da0 2023-10-06T05:30:36.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.759+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e40c60c0 con 0x7ff8e4155da0 2023-10-06T05:30:36.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.759+0000 7ff8d27fc700 1 -- 172.21.15.29:0/1926389055 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff8dc007300 con 0x7ff8e4155da0 2023-10-06T05:30:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.763+0000 7ff8d27fc700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff8c4060550 0x7ff8c4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.763+0000 7ff8d27fc700 1 -- 172.21.15.29:0/1926389055 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7ff8dc07d5f0 con 0x7ff8e4155da0 2023-10-06T05:30:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.763+0000 7ff8e259c700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff8c4060550 0x7ff8c4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:36.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.763+0000 7ff8e259c700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff8c4060550 0x7ff8c4062a00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80093f0 tx=0x7ff8d8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:36.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.767+0000 7ff8d27fc700 1 -- 172.21.15.29:0/1926389055 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff8dc04db30 con 0x7ff8e4155da0 2023-10-06T05:30:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:36.967+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7ff8e40c60c0 con 0x7ff8e4155da0 2023-10-06T05:30:37.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.843+0000 7ff8d27fc700 1 -- 172.21.15.29:0/1926389055 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v50) v1 ==== 162+0+0 (secure 0 0 0) 0x7ff8e40c60c0 con 0x7ff8e4155da0 2023-10-06T05:30:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff8c4060550 msgr2=0x7ff8c4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff8c4060550 0x7ff8c4062a00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80093f0 tx=0x7ff8d8017000 comp rx=0 tx=0).stop 2023-10-06T05:30:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8e4155da0 msgr2=0x7ff8e414d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8e4155da0 0x7ff8e414d3f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00cc40 tx=0x7ff8dc001aa0 comp rx=0 tx=0).stop 2023-10-06T05:30:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 shutdown_connections 2023-10-06T05:30:37.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8e4155da0 0x7ff8e414d3f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:37.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff8c4060550 0x7ff8c4062a00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:37.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8e41559d0 0x7ff8e414ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:37.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 --2- 172.21.15.29:0/1926389055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8e40cb590 0x7ff8e40c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:37.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 >> 172.21.15.29:0/1926389055 conn(0x7ff8e406c6c0 msgr2=0x7ff8e40c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:37.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 shutdown_connections 2023-10-06T05:30:37.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.847+0000 7ff8e359e700 1 -- 172.21.15.29:0/1926389055 wait complete. 2023-10-06T05:30:37.855 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T05:30:37.873 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:37.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.975+0000 7f7610db4700 1 Processor -- start 2023-10-06T05:30:37.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.975+0000 7f7610db4700 1 -- start start 2023-10-06T05:30:37.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f760c155880 0x7f760c0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:37.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0c8370 con 0x7f760c06dde0 2023-10-06T05:30:37.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0c6d60 con 0x7f760c0670a0 2023-10-06T05:30:37.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0c7730 con 0x7f760c155880 2023-10-06T05:30:37.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760bfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f760c06dde0 0x7f760c155c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57122/0 (socket says 172.21.15.29:57122) 2023-10-06T05:30:37.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760bfff700 1 -- 172.21.15.29:0/975112333 learned_addr learned my addr 172.21.15.29:0/975112333 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:37.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760b7fe700 1 --2- 172.21.15.29:0/975112333 >> v2:172.21.15.173:3300/0 conn(0x7f760c155880 0x7f760c0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:37.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760affd700 1 -- 172.21.15.29:0/975112333 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197587649 0 0) 0x7f760c0c8370 con 0x7f760c06dde0 2023-10-06T05:30:37.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760affd700 1 -- 172.21.15.29:0/975112333 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f8003570 con 0x7f760c06dde0 2023-10-06T05:30:37.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760b7fe700 1 -- 172.21.15.29:0/975112333 >> v1:172.21.15.173:6789/0 conn(0x7f760c0670a0 legacy=0x7f760c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:37.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760b7fe700 1 -- 172.21.15.29:0/975112333 >> v1:172.21.15.29:6789/0 conn(0x7f760c06dde0 legacy=0x7f760c155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:37.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760b7fe700 1 -- 172.21.15.29:0/975112333 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c063170 con 0x7f760c155880 2023-10-06T05:30:37.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760b7fe700 1 --2- 172.21.15.29:0/975112333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c155880 0x7f760c0c71f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0098e0 tx=0x7f75fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9578a07fef0249dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:37.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760affd700 1 -- 172.21.15.29:0/975112333 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00b640 con 0x7f760c155880 2023-10-06T05:30:37.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760affd700 1 -- 172.21.15.29:0/975112333 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc00b7a0 con 0x7f760c155880 2023-10-06T05:30:37.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f760affd700 1 -- 172.21.15.29:0/975112333 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00bb40 con 0x7f760c155880 2023-10-06T05:30:37.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 -- 172.21.15.29:0/975112333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c155880 msgr2=0x7f760c0c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 --2- 172.21.15.29:0/975112333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c155880 0x7f760c0c71f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0098e0 tx=0x7f75fc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 -- 172.21.15.29:0/975112333 shutdown_connections 2023-10-06T05:30:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 --2- 172.21.15.29:0/975112333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c155880 0x7f760c0c71f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 -- 172.21.15.29:0/975112333 >> 172.21.15.29:0/975112333 conn(0x7f760c06aaf0 msgr2=0x7f760c06aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 -- 172.21.15.29:0/975112333 shutdown_connections 2023-10-06T05:30:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.979+0000 7f7610db4700 1 -- 172.21.15.29:0/975112333 wait complete. 2023-10-06T05:30:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7610db4700 1 Processor -- start 2023-10-06T05:30:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7610db4700 1 -- start start 2023-10-06T05:30:37.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7610db4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f760c0670a0 0x7f760c1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:37.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7610db4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c06dde0 0x7f760c141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:37.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7610db4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f760c155880 0x7f760c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:37.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7610db4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c158f30 con 0x7f760c155880 2023-10-06T05:30:37.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7610db4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c158320 con 0x7f760c06dde0 2023-10-06T05:30:37.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7610db4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c158600 con 0x7f760c0670a0 2023-10-06T05:30:37.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f760bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f760c155880 0x7f760c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:37.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f760b7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f760c0670a0 0x7f760c1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:37.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7602ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c06dde0 0x7f760c141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:37.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f760b7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f760c0670a0 0x7f760c1593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:50320/0 (socket says 172.21.15.29:50320) 2023-10-06T05:30:37.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f7602ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c06dde0 0x7f760c141c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:39032/0 (socket says 172.21.15.29:39032) 2023-10-06T05:30:37.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.983+0000 7f760b7fe700 1 -- 172.21.15.29:0/89345823 learned_addr learned my addr 172.21.15.29:0/89345823 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f760b7fe700 1 -- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c06dde0 msgr2=0x7f760c141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f760b7fe700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c06dde0 0x7f760c141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f760b7fe700 1 -- 172.21.15.29:0/89345823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f760c155880 msgr2=0x7f760c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f760b7fe700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f760c155880 0x7f760c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f760b7fe700 1 -- 172.21.15.29:0/89345823 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc009420 con 0x7f760c0670a0 2023-10-06T05:30:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f760b7fe700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f760c0670a0 0x7f760c1593c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f760c06f3a0 tx=0x7f75fc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f7603fff700 1 -- 172.21.15.29:0/89345823 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc000d10 con 0x7f760c0670a0 2023-10-06T05:30:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f7603fff700 1 -- 172.21.15.29:0/89345823 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc00bb20 con 0x7f760c0670a0 2023-10-06T05:30:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c1588e0 con 0x7f760c0670a0 2023-10-06T05:30:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f7603fff700 1 -- 172.21.15.29:0/89345823 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc011650 con 0x7f760c0670a0 2023-10-06T05:30:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c142140 con 0x7f760c0670a0 2023-10-06T05:30:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c04be00 con 0x7f760c0670a0 2023-10-06T05:30:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.987+0000 7f7603fff700 1 -- 172.21.15.29:0/89345823 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f75fc0119c0 con 0x7f760c0670a0 2023-10-06T05:30:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.991+0000 7f7603fff700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f75ec060520 0x7f75ec0629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.991+0000 7f7603fff700 1 -- 172.21.15.29:0/89345823 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f75fc07e040 con 0x7f760c0670a0 2023-10-06T05:30:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.991+0000 7f7602ffd700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f75ec060520 0x7f75ec0629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.991+0000 7f7602ffd700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f75ec060520 0x7f75ec0629d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f760c0c2070 tx=0x7f75f4007f50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:38.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:37.999+0000 7f7603fff700 1 -- 172.21.15.29:0/89345823 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f75fc04e380 con 0x7f760c0670a0 2023-10-06T05:30:38.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.199+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f760c0cc540 con 0x7f760c0670a0 2023-10-06T05:30:38.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.199+0000 7f7603fff700 1 -- 172.21.15.29:0/89345823 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f75fc0519a0 con 0x7f760c0670a0 2023-10-06T05:30:38.208 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:38.208 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:37.847750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":51,"state":"up:replay","state_seq":1,"addr":"172.21.15.29:6835/1984531371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1984531371},{"type":"v1","addr":"172.21.15.29:6835","nonce":1984531371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f75ec060520 msgr2=0x7f75ec0629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f75ec060520 0x7f75ec0629d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f760c0c2070 tx=0x7f75f4007f50 comp rx=0 tx=0).stop 2023-10-06T05:30:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f760c0670a0 msgr2=0x7f760c1593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f760c0670a0 0x7f760c1593c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f760c06f3a0 tx=0x7f75fc017000 comp rx=0 tx=0).stop 2023-10-06T05:30:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 shutdown_connections 2023-10-06T05:30:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f760c155880 0x7f760c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f75ec060520 0x7f75ec0629d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f760c06dde0 0x7f760c141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 --2- 172.21.15.29:0/89345823 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f760c0670a0 0x7f760c1593c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 >> 172.21.15.29:0/89345823 conn(0x7f760c06aaf0 msgr2=0x7f760c152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 shutdown_connections 2023-10-06T05:30:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:38.203+0000 7f7610db4700 1 -- 172.21.15.29:0/89345823 wait complete. 2023-10-06T05:30:38.212 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 51 2023-10-06T05:30:38.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:29:53.859418+0000', 'modified': '2023-10-06T05:30:37.847750+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 79, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6870}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6870': {'gid': 6870, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.29:6835/1984531371', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 1984531371}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 1984531371}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:30:38.624 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6870:up:replay 2023-10-06T05:30:39.625 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:39.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f9458811700 1 Processor -- start 2023-10-06T05:30:39.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f9458811700 1 -- start start 2023-10-06T05:30:39.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f9458811700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9454158c00 0x7f945406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:39.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f9458811700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945406b250 con 0x7f94540ce740 2023-10-06T05:30:39.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f9458811700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945406a640 con 0x7f94540cebc0 2023-10-06T05:30:39.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f9458811700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945406a920 con 0x7f9454158c00 2023-10-06T05:30:39.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f944affd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f94540ce740 0x7f94540cfb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57124/0 (socket says 172.21.15.29:57124) 2023-10-06T05:30:39.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f944affd700 1 -- 172.21.15.29:0/2741175775 learned_addr learned my addr 172.21.15.29:0/2741175775 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:39.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f94537fe700 1 --2- 172.21.15.29:0/2741175775 >> v2:172.21.15.173:3300/0 conn(0x7f9454158c00 0x7f945406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:39.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f9452ffd700 1 -- 172.21.15.29:0/2741175775 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179917657 0 0) 0x7f945406b250 con 0x7f94540ce740 2023-10-06T05:30:39.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f9452ffd700 1 -- 172.21.15.29:0/2741175775 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9440003570 con 0x7f94540ce740 2023-10-06T05:30:39.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f94537fe700 1 -- 172.21.15.29:0/2741175775 >> v1:172.21.15.173:6789/0 conn(0x7f94540cebc0 legacy=0x7f945415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:39.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f94537fe700 1 -- 172.21.15.29:0/2741175775 >> v1:172.21.15.29:6789/0 conn(0x7f94540ce740 legacy=0x7f94540cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:39.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f94537fe700 1 -- 172.21.15.29:0/2741175775 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945406ac00 con 0x7f9454158c00 2023-10-06T05:30:39.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.735+0000 7f94537fe700 1 --2- 172.21.15.29:0/2741175775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9454158c00 0x7f945406b6e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f94440098e0 tx=0x7f94440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4dc70cc95740752 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:39.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9452ffd700 1 -- 172.21.15.29:0/2741175775 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400b640 con 0x7f9454158c00 2023-10-06T05:30:39.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9452ffd700 1 -- 172.21.15.29:0/2741175775 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400b7a0 con 0x7f9454158c00 2023-10-06T05:30:39.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9452ffd700 1 -- 172.21.15.29:0/2741175775 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400bb20 con 0x7f9454158c00 2023-10-06T05:30:39.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9458811700 1 -- 172.21.15.29:0/2741175775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9454158c00 msgr2=0x7f945406b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:39.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9458811700 1 --2- 172.21.15.29:0/2741175775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9454158c00 0x7f945406b6e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f94440098e0 tx=0x7f94440091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:39.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9458811700 1 -- 172.21.15.29:0/2741175775 shutdown_connections 2023-10-06T05:30:39.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9458811700 1 --2- 172.21.15.29:0/2741175775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9454158c00 0x7f945406b6e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:39.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9458811700 1 -- 172.21.15.29:0/2741175775 >> 172.21.15.29:0/2741175775 conn(0x7f94540670a0 msgr2=0x7f9454067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:39.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9458811700 1 -- 172.21.15.29:0/2741175775 shutdown_connections 2023-10-06T05:30:39.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9458811700 1 -- 172.21.15.29:0/2741175775 wait complete. 2023-10-06T05:30:39.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9458811700 1 Processor -- start 2023-10-06T05:30:39.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.739+0000 7f9458811700 1 -- start start 2023-10-06T05:30:39.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9458811700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94540ce740 0x7f94540b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9458811700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94540cebc0 0x7f94540b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9458811700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9454158c00 0x7f94541515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9458811700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94540c9c70 con 0x7f94540cebc0 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9458811700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94540c89e0 con 0x7f94540ce740 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9458811700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94540b31c0 con 0x7f9454158c00 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94540cebc0 0x7f94540b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94540cebc0 0x7f94540b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58096/0 (socket says 172.21.15.29:58096) 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944affd700 1 -- 172.21.15.29:0/704407011 learned_addr learned my addr 172.21.15.29:0/704407011 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f94537fe700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94540ce740 0x7f94540b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9453fff700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9454158c00 0x7f94541515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:39.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944affd700 1 -- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9454158c00 msgr2=0x7f94541515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:39.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944affd700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9454158c00 0x7f94541515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:39.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944affd700 1 -- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94540ce740 msgr2=0x7f94540b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:39.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944affd700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94540ce740 0x7f94540b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:39.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944affd700 1 -- 172.21.15.29:0/704407011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9444009420 con 0x7f94540cebc0 2023-10-06T05:30:39.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9453fff700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9454158c00 0x7f94541515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:39.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944affd700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94540cebc0 0x7f94540b2c80 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f943c00c820 tx=0x7f943c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:39.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944bfff700 1 -- 172.21.15.29:0/704407011 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c005b30 con 0x7f94540cebc0 2023-10-06T05:30:39.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944bfff700 1 -- 172.21.15.29:0/704407011 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c005cb0 con 0x7f94540cebc0 2023-10-06T05:30:39.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9454151ae0 con 0x7f94540cebc0 2023-10-06T05:30:39.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f944bfff700 1 -- 172.21.15.29:0/704407011 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c007320 con 0x7f94540cebc0 2023-10-06T05:30:39.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.743+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94540c80b0 con 0x7f94540cebc0 2023-10-06T05:30:39.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.747+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945404be00 con 0x7f94540cebc0 2023-10-06T05:30:39.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.747+0000 7f944bfff700 1 -- 172.21.15.29:0/704407011 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f943c01b3b0 con 0x7f94540cebc0 2023-10-06T05:30:39.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.747+0000 7f944bfff700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9434060550 0x7f9434062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:39.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.747+0000 7f944bfff700 1 -- 172.21.15.29:0/704407011 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f943c07bff0 con 0x7f94540cebc0 2023-10-06T05:30:39.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.747+0000 7f94537fe700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9434060550 0x7f9434062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:39.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.747+0000 7f94537fe700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9434060550 0x7f9434062a00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f94440093f0 tx=0x7f9444017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.755+0000 7f944bfff700 1 -- 172.21.15.29:0/704407011 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f943c04c390 con 0x7f94540cebc0 2023-10-06T05:30:39.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.951+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94540c8b20 con 0x7f94540cebc0 2023-10-06T05:30:39.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.951+0000 7f944bfff700 1 -- 172.21.15.29:0/704407011 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f943c017090 con 0x7f94540cebc0 2023-10-06T05:30:39.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:39.960 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":53,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:39.865012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":51,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.29:6835/1984531371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1984531371},{"type":"v1","addr":"172.21.15.29:6835","nonce":1984531371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:39.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9434060550 msgr2=0x7f9434062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:39.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9434060550 0x7f9434062a00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f94440093f0 tx=0x7f9444017000 comp rx=0 tx=0).stop 2023-10-06T05:30:39.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94540cebc0 msgr2=0x7f94540b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:39.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94540cebc0 0x7f94540b2c80 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f943c00c820 tx=0x7f943c007e00 comp rx=0 tx=0).stop 2023-10-06T05:30:39.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 shutdown_connections 2023-10-06T05:30:39.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9454158c00 0x7f94541515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:39.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94540cebc0 0x7f94540b2c80 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:39.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9434060550 0x7f9434062a00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:39.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 --2- 172.21.15.29:0/704407011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94540ce740 0x7f94540b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:39.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 >> 172.21.15.29:0/704407011 conn(0x7f94540670a0 msgr2=0x7f945415bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:39.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 shutdown_connections 2023-10-06T05:30:39.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:39.955+0000 7f9458811700 1 -- 172.21.15.29:0/704407011 wait complete. 2023-10-06T05:30:39.964 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 53 2023-10-06T05:30:40.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:29:53.859418+0000', 'modified': '2023-10-06T05:30:39.865012+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 79, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6870}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6870': {'gid': 6870, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.29:6835/1984531371', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 1984531371}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 1984531371}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:30:40.377 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6870:up:rejoin 2023-10-06T05:30:40.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:30:40.524 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:30:41.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:41.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.487+0000 7f5438ae9700 1 Processor -- start 2023-10-06T05:30:41.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.487+0000 7f5438ae9700 1 -- start start 2023-10-06T05:30:41.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5434158c00 0x7f543406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:41.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f54340ce740 0x7f54340cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:41.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543406b250 con 0x7f54340cebc0 2023-10-06T05:30:41.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543406a640 con 0x7f54340ce740 2023-10-06T05:30:41.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543406a920 con 0x7f5434158c00 2023-10-06T05:30:41.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5432ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f54340ce740 0x7f54340cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:41.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5433fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f54340cebc0 0x7f543415a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57128/0 (socket says 172.21.15.29:57128) 2023-10-06T05:30:41.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5433fff700 1 -- 172.21.15.29:0/684452769 learned_addr learned my addr 172.21.15.29:0/684452769 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:41.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5432ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f54340ce740 0x7f54340cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58100/0 (socket says 172.21.15.29:58100) 2023-10-06T05:30:41.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f54337fe700 1 --2- 172.21.15.29:0/684452769 >> v2:172.21.15.173:3300/0 conn(0x7f5434158c00 0x7f543406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:41.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f54327fc700 1 -- 172.21.15.29:0/684452769 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320363076 0 0) 0x7f543406b250 con 0x7f54340cebc0 2023-10-06T05:30:41.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5432ffd700 1 -- 172.21.15.29:0/684452769 >> v2:172.21.15.173:3300/0 conn(0x7f5434158c00 msgr2=0x7f543406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:41.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5432ffd700 1 --2- 172.21.15.29:0/684452769 >> v2:172.21.15.173:3300/0 conn(0x7f5434158c00 0x7f543406b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5432ffd700 1 -- 172.21.15.29:0/684452769 >> v1:172.21.15.29:6789/0 conn(0x7f54340cebc0 legacy=0x7f543415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:41.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5432ffd700 1 -- 172.21.15.29:0/684452769 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543406ac00 con 0x7f54340ce740 2023-10-06T05:30:41.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f54337fe700 1 --2- 172.21.15.29:0/684452769 >> v2:172.21.15.173:3300/0 conn(0x7f5434158c00 0x7f543406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:41.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5432ffd700 1 --2- 172.21.15.29:0/684452769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340ce740 0x7f54340cfb60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5434069a30 tx=0x7f54280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153a4767f563337d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f54327fc700 1 -- 172.21.15.29:0/684452769 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542800b6b0 con 0x7f54340ce740 2023-10-06T05:30:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f54327fc700 1 -- 172.21.15.29:0/684452769 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542800b810 con 0x7f54340ce740 2023-10-06T05:30:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f54327fc700 1 -- 172.21.15.29:0/684452769 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542800bbb0 con 0x7f54340ce740 2023-10-06T05:30:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 -- 172.21.15.29:0/684452769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340ce740 msgr2=0x7f54340cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 --2- 172.21.15.29:0/684452769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340ce740 0x7f54340cfb60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5434069a30 tx=0x7f54280091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 -- 172.21.15.29:0/684452769 shutdown_connections 2023-10-06T05:30:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 --2- 172.21.15.29:0/684452769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340ce740 0x7f54340cfb60 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 --2- 172.21.15.29:0/684452769 >> v2:172.21.15.173:3300/0 conn(0x7f5434158c00 0x7f543406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 -- 172.21.15.29:0/684452769 >> 172.21.15.29:0/684452769 conn(0x7f54340670a0 msgr2=0x7f5434067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 -- 172.21.15.29:0/684452769 shutdown_connections 2023-10-06T05:30:41.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.491+0000 7f5438ae9700 1 -- 172.21.15.29:0/684452769 wait complete. 2023-10-06T05:30:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5438ae9700 1 Processor -- start 2023-10-06T05:30:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5438ae9700 1 -- start start 2023-10-06T05:30:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5438ae9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54340ce740 0x7f54340b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5438ae9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340cebc0 0x7f54340c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5438ae9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5434158c00 0x7f54340b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:41.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5438ae9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54340b3350 con 0x7f54340cebc0 2023-10-06T05:30:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5438ae9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54340c8ce0 con 0x7f54340ce740 2023-10-06T05:30:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5438ae9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5434151be0 con 0x7f5434158c00 2023-10-06T05:30:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5432ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340cebc0 0x7f54340c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5432ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340cebc0 0x7f54340c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58108/0 (socket says 172.21.15.29:58108) 2023-10-06T05:30:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5432ffd700 1 -- 172.21.15.29:0/1906387928 learned_addr learned my addr 172.21.15.29:0/1906387928 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:41.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f54337fe700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54340ce740 0x7f54340b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5433fff700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5434158c00 0x7f54340b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5432ffd700 1 -- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5434158c00 msgr2=0x7f54340b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5432ffd700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5434158c00 0x7f54340b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5432ffd700 1 -- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54340ce740 msgr2=0x7f54340b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5432ffd700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54340ce740 0x7f54340b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5432ffd700 1 -- 172.21.15.29:0/1906387928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428009420 con 0x7f54340cebc0 2023-10-06T05:30:41.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f54337fe700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54340ce740 0x7f54340b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:41.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.495+0000 7f5432ffd700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340cebc0 0x7f54340c87a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f543406e4d0 tx=0x7f5428017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.499+0000 7f541b7fe700 1 -- 172.21.15.29:0/1906387928 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542800bb90 con 0x7f54340cebc0 2023-10-06T05:30:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.499+0000 7f541b7fe700 1 -- 172.21.15.29:0/1906387928 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428011420 con 0x7f54340cebc0 2023-10-06T05:30:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.499+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54340c8f30 con 0x7f54340cebc0 2023-10-06T05:30:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.499+0000 7f541b7fe700 1 -- 172.21.15.29:0/1906387928 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54280117a0 con 0x7f54340cebc0 2023-10-06T05:30:41.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.499+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54340c94f0 con 0x7f54340cebc0 2023-10-06T05:30:41.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.499+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543404be00 con 0x7f54340cebc0 2023-10-06T05:30:41.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.499+0000 7f541b7fe700 1 -- 172.21.15.29:0/1906387928 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5428011b90 con 0x7f54340cebc0 2023-10-06T05:30:41.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.499+0000 7f541b7fe700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5420060550 0x7f5420062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:41.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.503+0000 7f541b7fe700 1 -- 172.21.15.29:0/1906387928 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f542807e2e0 con 0x7f54340cebc0 2023-10-06T05:30:41.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.503+0000 7f54337fe700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5420060550 0x7f5420062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:41.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.503+0000 7f54337fe700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5420060550 0x7f5420062a00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5424006f00 tx=0x7f5424008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:41.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.511+0000 7f541b7fe700 1 -- 172.21.15.29:0/1906387928 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f542804e6c0 con 0x7f54340cebc0 2023-10-06T05:30:41.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.703+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f543406aee0 con 0x7f54340cebc0 2023-10-06T05:30:41.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.703+0000 7f541b7fe700 1 -- 172.21.15.29:0/1906387928 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f5428051ce0 con 0x7f54340cebc0 2023-10-06T05:30:41.711 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:41.711 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:40.875741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/1984531371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1984531371},{"type":"v1","addr":"172.21.15.29:6835","nonce":1984531371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5420060550 msgr2=0x7f5420062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5420060550 0x7f5420062a00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5424006f00 tx=0x7f5424008040 comp rx=0 tx=0).stop 2023-10-06T05:30:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340cebc0 msgr2=0x7f54340c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340cebc0 0x7f54340c87a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f543406e4d0 tx=0x7f5428017000 comp rx=0 tx=0).stop 2023-10-06T05:30:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 shutdown_connections 2023-10-06T05:30:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5434158c00 0x7f54340b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54340cebc0 0x7f54340c87a0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5420060550 0x7f5420062a00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 --2- 172.21.15.29:0/1906387928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54340ce740 0x7f54340b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 >> 172.21.15.29:0/1906387928 conn(0x7f54340670a0 msgr2=0x7f5434153580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 shutdown_connections 2023-10-06T05:30:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:41.707+0000 7f5438ae9700 1 -- 172.21.15.29:0/1906387928 wait complete. 2023-10-06T05:30:41.714 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 54 2023-10-06T05:30:42.128 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T05:29:53.859418+0000', 'modified': '2023-10-06T05:30:40.875741+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 79, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6870}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6870': {'gid': 6870, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.29:6835/1984531371', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 1984531371}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 1984531371}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T05:30:42.128 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T05:30:42.128 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T05:30:42.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.239+0000 7fcb5ab15700 1 Processor -- start 2023-10-06T05:30:42.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.239+0000 7fcb5ab15700 1 -- start start 2023-10-06T05:30:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb540ce690 0x7fcb54156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5406c6c0 0x7fcb5406cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb540cbc90 con 0x7fcb54156a90 2023-10-06T05:30:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5406d040 con 0x7fcb540ce690 2023-10-06T05:30:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540cb940 con 0x7fcb5406c6c0 2023-10-06T05:30:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb59312700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb540ce690 0x7fcb54156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb59312700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb540ce690 0x7fcb54156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58114/0 (socket says 172.21.15.29:58114) 2023-10-06T05:30:42.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb59312700 1 -- 172.21.15.29:0/3140112380 learned_addr learned my addr 172.21.15.29:0/3140112380 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:42.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5a314700 1 --2- 172.21.15.29:0/3140112380 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5406c6c0 0x7fcb5406cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb59312700 1 -- 172.21.15.29:0/3140112380 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5406c6c0 msgr2=0x7fcb5406cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb59312700 1 --2- 172.21.15.29:0/3140112380 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5406c6c0 0x7fcb5406cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb59312700 1 -- 172.21.15.29:0/3140112380 >> v1:172.21.15.173:6789/0 conn(0x7fcb54156a90 legacy=0x7fcb540ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb59312700 1 -- 172.21.15.29:0/3140112380 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540ad010 con 0x7fcb540ce690 2023-10-06T05:30:42.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb59312700 1 --2- 172.21.15.29:0/3140112380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb540ce690 0x7fcb54156e60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fcb500099b0 tx=0x7fcb50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a216375038df80d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb58b11700 1 -- 172.21.15.29:0/3140112380 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50009ea0 con 0x7fcb540ce690 2023-10-06T05:30:42.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb58b11700 1 -- 172.21.15.29:0/3140112380 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5000b860 con 0x7fcb540ce690 2023-10-06T05:30:42.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb58b11700 1 -- 172.21.15.29:0/3140112380 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5000bc00 con 0x7fcb540ce690 2023-10-06T05:30:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 -- 172.21.15.29:0/3140112380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb540ce690 msgr2=0x7fcb54156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 --2- 172.21.15.29:0/3140112380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb540ce690 0x7fcb54156e60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fcb500099b0 tx=0x7fcb50009250 comp rx=0 tx=0).stop 2023-10-06T05:30:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 -- 172.21.15.29:0/3140112380 shutdown_connections 2023-10-06T05:30:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 --2- 172.21.15.29:0/3140112380 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5406c6c0 0x7fcb5406cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 --2- 172.21.15.29:0/3140112380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb540ce690 0x7fcb54156e60 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 -- 172.21.15.29:0/3140112380 >> 172.21.15.29:0/3140112380 conn(0x7fcb54069d30 msgr2=0x7fcb540cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 -- 172.21.15.29:0/3140112380 shutdown_connections 2023-10-06T05:30:42.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.243+0000 7fcb5ab15700 1 -- 172.21.15.29:0/3140112380 wait complete. 2023-10-06T05:30:42.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.247+0000 7fcb5ab15700 1 Processor -- start 2023-10-06T05:30:42.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.247+0000 7fcb5ab15700 1 -- start start 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.247+0000 7fcb5ab15700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb5406c6c0 0x7fcb5414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.247+0000 7fcb5ab15700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb540ce690 0x7fcb540b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.247+0000 7fcb5ab15700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb54156a90 0x7fcb540c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.247+0000 7fcb5ab15700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54147770 con 0x7fcb5406c6c0 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.247+0000 7fcb5ab15700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540b23d0 con 0x7fcb54156a90 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.247+0000 7fcb5ab15700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540b1aa0 con 0x7fcb540ce690 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59b13700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb5406c6c0 0x7fcb5414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb5a314700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb54156a90 0x7fcb540c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59312700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb540ce690 0x7fcb540b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb5a314700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb54156a90 0x7fcb540c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:39078/0 (socket says 172.21.15.29:39078) 2023-10-06T05:30:42.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb5a314700 1 -- 172.21.15.29:0/1231947022 learned_addr learned my addr 172.21.15.29:0/1231947022 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:42.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59b13700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb5406c6c0 0x7fcb5414aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58122/0 (socket says 172.21.15.29:58122) 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59312700 1 -- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb54156a90 msgr2=0x7fcb540c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59312700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb54156a90 0x7fcb540c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59312700 1 -- 172.21.15.29:0/1231947022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb5406c6c0 msgr2=0x7fcb5414aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59312700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb5406c6c0 0x7fcb5414aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59312700 1 -- 172.21.15.29:0/1231947022 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb500094f0 con 0x7fcb540ce690 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59b13700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb5406c6c0 0x7fcb5414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb59312700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb540ce690 0x7fcb540b2860 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcb5406d7f0 tx=0x7fcb50017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb45ffb700 1 -- 172.21.15.29:0/1231947022 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50000d10 con 0x7fcb540ce690 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb5ab15700 1 -- 172.21.15.29:0/1231947022 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb540b1d80 con 0x7fcb540ce690 2023-10-06T05:30:42.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb45ffb700 1 -- 172.21.15.29:0/1231947022 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5000bbe0 con 0x7fcb540ce690 2023-10-06T05:30:42.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb45ffb700 1 -- 172.21.15.29:0/1231947022 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500116b0 con 0x7fcb540ce690 2023-10-06T05:30:42.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.251+0000 7fcb5ab15700 1 -- 172.21.15.29:0/1231947022 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb54147e90 con 0x7fcb540ce690 2023-10-06T05:30:42.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.255+0000 7fcb45ffb700 1 -- 172.21.15.29:0/1231947022 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcb50011aa0 con 0x7fcb540ce690 2023-10-06T05:30:42.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.255+0000 7fcb45ffb700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcb38060550 0x7fcb38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.255+0000 7fcb45ffb700 1 -- 172.21.15.29:0/1231947022 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fcb5007e330 con 0x7fcb540ce690 2023-10-06T05:30:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.255+0000 7fcb59b13700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcb38060550 0x7fcb38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.255+0000 7fcb5e020740 1 Processor -- start 2023-10-06T05:30:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.255+0000 7fcb5e020740 1 -- start start 2023-10-06T05:30:42.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.255+0000 7fcb59b13700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcb38060550 0x7fcb38062a00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcb54067a80 tx=0x7fcb48009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x1523f30 con 0x1378ae0 2023-10-06T05:30:42.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x151fed0 con 0x1378710 2023-10-06T05:30:42.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x14e60b0 con 0x13c3790 2023-10-06T05:30:42.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59b13700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59b13700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58124/0 (socket says 172.21.15.29:58124) 2023-10-06T05:30:42.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59b13700 1 -- 172.21.15.29:0/2489435324 learned_addr learned my addr 172.21.15.29:0/2489435324 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:42.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59312700 1 --2- 172.21.15.29:0/2489435324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5a314700 1 --2- 172.21.15.29:0/2489435324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59b13700 1 -- 172.21.15.29:0/2489435324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 msgr2=0x15f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59b13700 1 --2- 172.21.15.29:0/2489435324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59b13700 1 -- 172.21.15.29:0/2489435324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 msgr2=0x15f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59b13700 1 --2- 172.21.15.29:0/2489435324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59b13700 1 -- 172.21.15.29:0/2489435324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x13c49e0 con 0x1378ae0 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb59b13700 1 --2- 172.21.15.29:0/2489435324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f5630 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800fc10 tx=0x7fcb48015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3877d4ac24787c96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb3effd700 1 -- 172.21.15.29:0/2489435324 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48014760 con 0x1378ae0 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb3effd700 1 -- 172.21.15.29:0/2489435324 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb480148c0 con 0x1378ae0 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb3effd700 1 -- 172.21.15.29:0/2489435324 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48014c40 con 0x1378ae0 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 -- 172.21.15.29:0/2489435324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 msgr2=0x15f5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 --2- 172.21.15.29:0/2489435324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f5630 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800fc10 tx=0x7fcb48015000 comp rx=0 tx=0).stop 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 -- 172.21.15.29:0/2489435324 shutdown_connections 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 --2- 172.21.15.29:0/2489435324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 --2- 172.21.15.29:0/2489435324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 --2- 172.21.15.29:0/2489435324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f5630 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 -- 172.21.15.29:0/2489435324 >> 172.21.15.29:0/2489435324 conn(0x1378eb0 msgr2=0x15b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:42.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 -- 172.21.15.29:0/2489435324 shutdown_connections 2023-10-06T05:30:42.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.259+0000 7fcb5e020740 1 -- 172.21.15.29:0/2489435324 wait complete. 2023-10-06T05:30:42.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 1 -- start start 2023-10-06T05:30:42.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 1 Processor -- start 2023-10-06T05:30:42.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15fa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x14e5d50 con 0x1378ae0 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x14be970 con 0x1378710 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x14d1550 con 0x13c3790 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 10 client.0 _ll_register_callbacks cb 0x14c2b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59312700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59b13700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59b13700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:39092/0 (socket says 172.21.15.29:39092) 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59b13700 1 -- 172.21.15.29:0/3737989718 learned_addr learned my addr 172.21.15.29:0/3737989718 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59312700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15fa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58136/0 (socket says 172.21.15.29:58136) 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5a314700 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59b13700 1 -- 172.21.15.29:0/3737989718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 msgr2=0x15afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59b13700 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59b13700 1 -- 172.21.15.29:0/3737989718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 msgr2=0x15fa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59b13700 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15fa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59b13700 1 -- 172.21.15.29:0/3737989718 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb540cbc90 con 0x1378710 2023-10-06T05:30:42.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59312700 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:42.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb59b13700 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f9c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcb48023040 tx=0x7fcb48019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6be82b517f48f0fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb33fff700 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2023-10-06T05:30:42.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb33fff700 1 -- 172.21.15.29:0/3737989718 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48014e80 con 0x1378710 2023-10-06T05:30:42.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb33fff700 1 -- 172.21.15.29:0/3737989718 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fcb4801c040 con 0x1378710 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 1 -- 172.21.15.29:0/3737989718 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14becc0 con 0x1378710 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb33fff700 1 -- 172.21.15.29:0/3737989718 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb48020e70 con 0x1378710 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.263+0000 7fcb5e020740 10 client.6919 fetch_fsmap learned FSMap version 54 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 -- 172.21.15.29:0/3737989718 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x14ee370 con 0x1378710 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb33fff700 1 -- 172.21.15.29:0/3737989718 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14becc0 con 0x1378710 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb33fff700 1 -- 172.21.15.29:0/3737989718 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcb4802a410 con 0x1378710 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 10 client.6919 fetch_fsmap finished waiting for FSMap version 54 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 10 client.6919 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 20 client.6919 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] conn(0x15b1250 0x1604de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 4 client.6919 mds_command: new command op to 6870 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T05:30:42.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 -- 172.21.15.29:0/3737989718 --> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14c23e0 con 0x15b1250 2023-10-06T05:30:42.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb59312700 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] conn(0x15b1250 0x1604de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb33fff700 10 client.6919 ms_handle_connect on v2:172.21.15.29:6834/1984531371 2023-10-06T05:30:42.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb59312700 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] conn(0x15b1250 0x1604de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7838db95d90b425 server_cookie=48f5da7f65e1b8cb in_seq=0 out_seq=0 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb33fff700 1 -- 172.21.15.29:0/3737989718 <== mds.0 v2:172.21.15.29:6834/1984531371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x14c23e0 con 0x15b1250 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb33fff700 10 client.6919 handle_command_reply: tid=0 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 client.6919 shutdown 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 -- 172.21.15.29:0/3737989718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 msgr2=0x15f9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f9c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcb48023040 tx=0x7fcb48019000 comp rx=0 tx=0).stop 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 -- 172.21.15.29:0/3737989718 shutdown_connections 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] conn(0x15b1250 0x1604de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb33fff700 0 client.6919 ms_handle_reset on v2:172.21.15.29:6834/1984531371 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3737989718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f9c40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 -- 172.21.15.29:0/3737989718 >> 172.21.15.29:0/3737989718 conn(0x1378eb0 msgr2=0x15d91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:42.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 -- 172.21.15.29:0/3737989718 shutdown_connections 2023-10-06T05:30:42.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.267+0000 7fcb5e020740 1 -- 172.21.15.29:0/3737989718 wait complete. 2023-10-06T05:30:42.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.271+0000 7fcb5e020740 20 client.6919 trim_cache size 0 max 16384 2023-10-06T05:30:42.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb5e020740 1 Processor -- start 2023-10-06T05:30:42.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb5e020740 1 -- start start 2023-10-06T05:30:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15b1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb5e020740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x13f5650 con 0x1378ae0 2023-10-06T05:30:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb5e020740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x151c150 con 0x1378710 2023-10-06T05:30:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb5e020740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x1464940 con 0x13c3790 2023-10-06T05:30:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb59312700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.287+0000 7fcb59312700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58144/0 (socket says 172.21.15.29:58144) 2023-10-06T05:30:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb59312700 1 -- 172.21.15.29:0/2590468948 learned_addr learned my addr 172.21.15.29:0/2590468948 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb59b13700 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5a314700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb59312700 1 -- 172.21.15.29:0/2590468948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 msgr2=0x15b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb59312700 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb59312700 1 -- 172.21.15.29:0/2590468948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 msgr2=0x15f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb59312700 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb59312700 1 -- 172.21.15.29:0/2590468948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540b3100 con 0x1378ae0 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb59b13700 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5a314700 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb59312700 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f8b90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009290 tx=0x7fcb50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92276b6eeb613c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb3f7fe700 1 -- 172.21.15.29:0/2590468948 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500555c0 con 0x1378ae0 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb3f7fe700 1 -- 172.21.15.29:0/2590468948 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb50006e90 con 0x1378ae0 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb3f7fe700 1 -- 172.21.15.29:0/2590468948 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50059310 con 0x1378ae0 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 -- 172.21.15.29:0/2590468948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 msgr2=0x15f8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f8b90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009290 tx=0x7fcb50008040 comp rx=0 tx=0).stop 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 -- 172.21.15.29:0/2590468948 shutdown_connections 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x13c3790 0x15b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x1378ae0 0x15f8b90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 --2- 172.21.15.29:0/2590468948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 -- 172.21.15.29:0/2590468948 >> 172.21.15.29:0/2590468948 conn(0x1378eb0 msgr2=0x15ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:42.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 -- 172.21.15.29:0/2590468948 shutdown_connections 2023-10-06T05:30:42.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 -- 172.21.15.29:0/2590468948 wait complete. 2023-10-06T05:30:42.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 -- start start 2023-10-06T05:30:42.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.291+0000 7fcb5e020740 1 Processor -- start 2023-10-06T05:30:42.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1378ae0 0x15d6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x13c3790 0x1603da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x14d9430 con 0x13c3790 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x15b2790 con 0x1378710 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x14e8920 con 0x1378ae0 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 10 client.0 _ll_register_callbacks cb 0x14eb110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5a314700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x13c3790 0x1603da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5a314700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x13c3790 0x1603da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58158/0 (socket says 172.21.15.29:58158) 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5a314700 1 -- 172.21.15.29:0/3818462646 learned_addr learned my addr 172.21.15.29:0/3818462646 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb59b13700 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb59312700 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1378ae0 0x15d6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5a314700 1 -- 172.21.15.29:0/3818462646 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1378ae0 msgr2=0x15d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5a314700 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1378ae0 0x15d6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5a314700 1 -- 172.21.15.29:0/3818462646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 msgr2=0x15d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5a314700 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15d6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5a314700 1 -- 172.21.15.29:0/3818462646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x14ee370 con 0x13c3790 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb33fff700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5a314700 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x13c3790 0x1603da0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c018780 tx=0x7fcb4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570c55cc7979d280 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb33fff700 1 -- 172.21.15.29:0/3818462646 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c01d070 con 0x13c3790 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 -- 172.21.15.29:0/3818462646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb480148c0 con 0x13c3790 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb33fff700 1 -- 172.21.15.29:0/3818462646 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fcb4c015460 con 0x13c3790 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb33fff700 1 -- 172.21.15.29:0/3818462646 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb4c00e040 con 0x13c3790 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 10 client.6975 fetch_fsmap learned FSMap version 54 2023-10-06T05:30:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 -- 172.21.15.29:0/3818462646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x7fcb4c012610 con 0x13c3790 2023-10-06T05:30:42.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb33fff700 1 -- 172.21.15.29:0/3818462646 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb480148c0 con 0x13c3790 2023-10-06T05:30:42.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb33fff700 1 -- 172.21.15.29:0/3818462646 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 54) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcb4c015830 con 0x13c3790 2023-10-06T05:30:42.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 10 client.6975 fetch_fsmap finished waiting for FSMap version 54 2023-10-06T05:30:42.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 10 client.6975 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T05:30:42.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 20 client.6975 populate_metadata read hostname 'smithi029' 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] conn(0x1655880 0x1657c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 4 client.6975 mds_command: new command op to 6870 tid=0[{"prefix": "status"}] 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb5e020740 1 -- 172.21.15.29:0/3818462646 --> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] -- command(tid 0: {"prefix": "status"}) v1 -- 0x14f4410 con 0x1655880 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb59b13700 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] conn(0x1655880 0x1657c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb59b13700 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] conn(0x1655880 0x1657c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=222d8700ad3eee00 server_cookie=c0e8cfa56590cb0f in_seq=0 out_seq=0 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.295+0000 7fcb33fff700 10 client.6975 ms_handle_connect on v2:172.21.15.29:6834/1984531371 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb33fff700 1 -- 172.21.15.29:0/3818462646 <== mds.0 v2:172.21.15.29:6834/1984531371 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x14f4410 con 0x1655880 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb33fff700 10 client.6975 handle_command_reply: tid=0 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 client.6975 shutdown 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 -- 172.21.15.29:0/3818462646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x13c3790 msgr2=0x1603da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x13c3790 0x1603da0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c018780 tx=0x7fcb4c00b040 comp rx=0 tx=0).stop 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 -- 172.21.15.29:0/3818462646 shutdown_connections 2023-10-06T05:30:42.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.29:6834/1984531371,v1:172.21.15.29:6835/1984531371] conn(0x1655880 0x1657c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x13c3790 0x1603da0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x1378ae0 0x15d6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 --2- 172.21.15.29:0/3818462646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x1378710 0x15d6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 -- 172.21.15.29:0/3818462646 >> 172.21.15.29:0/3818462646 conn(0x1378eb0 msgr2=0x15b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb33fff700 0 client.6975 ms_handle_reset on v2:172.21.15.29:6834/1984531371 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 -- 172.21.15.29:0/3818462646 shutdown_connections 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 1 -- 172.21.15.29:0/3818462646 wait complete. 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5e020740 20 client.6975 trim_cache size 0 max 16384 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:42.308 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "bd99696d-d9bf-47c8-93f5-f978334ae590", 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6870, 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 4.4477855970000002, 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 54, 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 79, 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 79, 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 6.4300853440000001 2023-10-06T05:30:42.309 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:42.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 -- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcb38060550 msgr2=0x7fcb38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcb38060550 0x7fcb38062a00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcb54067a80 tx=0x7fcb48009040 comp rx=0 tx=0).stop 2023-10-06T05:30:42.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 -- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb540ce690 msgr2=0x7fcb540b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb540ce690 0x7fcb540b2860 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcb5406d7f0 tx=0x7fcb50017000 comp rx=0 tx=0).stop 2023-10-06T05:30:42.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 -- 172.21.15.29:0/1231947022 shutdown_connections 2023-10-06T05:30:42.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcb38060550 0x7fcb38062a00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb54156a90 0x7fcb540c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb540ce690 0x7fcb540b2860 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 --2- 172.21.15.29:0/1231947022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb5406c6c0 0x7fcb5414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 -- 172.21.15.29:0/1231947022 >> 172.21.15.29:0/1231947022 conn(0x7fcb54069d30 msgr2=0x7fcb540cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:42.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 -- 172.21.15.29:0/1231947022 shutdown_connections 2023-10-06T05:30:42.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.299+0000 7fcb5ab15700 1 -- 172.21.15.29:0/1231947022 wait complete. 2023-10-06T05:30:42.323 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T05:30:42.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a88ae700 1 Processor -- start 2023-10-06T05:30:42.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a88ae700 1 -- start start 2023-10-06T05:30:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a88ae700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a4158c00 0x7fb2a406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a88ae700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2a40ce740 0x7fb2a40cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a88ae700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a406b250 con 0x7fb2a40ceb90 2023-10-06T05:30:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a88ae700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a406a640 con 0x7fb2a40ce740 2023-10-06T05:30:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a88ae700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406a920 con 0x7fb2a4158c00 2023-10-06T05:30:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a259c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2a40ce740 0x7fb2a40cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a259c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2a40ce740 0x7fb2a40cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58164/0 (socket says 172.21.15.29:58164) 2023-10-06T05:30:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a259c700 1 -- 172.21.15.29:0/369580188 learned_addr learned my addr 172.21.15.29:0/369580188 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a2d9d700 1 --2- 172.21.15.29:0/369580188 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a4158c00 0x7fb2a406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a259c700 1 -- 172.21.15.29:0/369580188 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a4158c00 msgr2=0x7fb2a406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:42.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a259c700 1 --2- 172.21.15.29:0/369580188 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a4158c00 0x7fb2a406b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a259c700 1 -- 172.21.15.29:0/369580188 >> v1:172.21.15.173:6789/0 conn(0x7fb2a40ceb90 legacy=0x7fb2a415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a259c700 1 -- 172.21.15.29:0/369580188 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a406ac00 con 0x7fb2a40ce740 2023-10-06T05:30:42.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a2d9d700 1 --2- 172.21.15.29:0/369580188 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a4158c00 0x7fb2a406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:42.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a259c700 1 --2- 172.21.15.29:0/369580188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 0x7fb2a40cfb60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0099b0 tx=0x7fb28c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2e9e9ee0a7924c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a1d9b700 1 -- 172.21.15.29:0/369580188 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00b860 con 0x7fb2a40ce740 2023-10-06T05:30:42.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a1d9b700 1 -- 172.21.15.29:0/369580188 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c00b9c0 con 0x7fb2a40ce740 2023-10-06T05:30:42.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.427+0000 7fb2a1d9b700 1 -- 172.21.15.29:0/369580188 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00bd60 con 0x7fb2a40ce740 2023-10-06T05:30:42.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.431+0000 7fb2a88ae700 1 -- 172.21.15.29:0/369580188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 msgr2=0x7fb2a40cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.431+0000 7fb2a88ae700 1 --2- 172.21.15.29:0/369580188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 0x7fb2a40cfb60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0099b0 tx=0x7fb28c009250 comp rx=0 tx=0).stop 2023-10-06T05:30:42.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.431+0000 7fb2a88ae700 1 -- 172.21.15.29:0/369580188 shutdown_connections 2023-10-06T05:30:42.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.431+0000 7fb2a88ae700 1 --2- 172.21.15.29:0/369580188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 0x7fb2a40cfb60 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.431+0000 7fb2a88ae700 1 --2- 172.21.15.29:0/369580188 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a4158c00 0x7fb2a406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.431+0000 7fb2a88ae700 1 -- 172.21.15.29:0/369580188 >> 172.21.15.29:0/369580188 conn(0x7fb2a40670a0 msgr2=0x7fb2a4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:42.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.431+0000 7fb2a88ae700 1 -- 172.21.15.29:0/369580188 shutdown_connections 2023-10-06T05:30:42.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.431+0000 7fb2a88ae700 1 -- 172.21.15.29:0/369580188 wait complete. 2023-10-06T05:30:42.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.431+0000 7fb2a88ae700 1 Processor -- start 2023-10-06T05:30:42.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a88ae700 1 -- start start 2023-10-06T05:30:42.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a88ae700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 0x7fb2a4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a88ae700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40ceb90 0x7fb2a40c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a88ae700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158c00 0x7fb2a40c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a88ae700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40b3dc0 con 0x7fb2a40ce740 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a88ae700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40b3930 con 0x7fb2a4158c00 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a88ae700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4152fa0 con 0x7fb2a40ceb90 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 0x7fb2a4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 0x7fb2a4152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58168/0 (socket says 172.21.15.29:58168) 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a2d9d700 1 -- 172.21.15.29:0/934923680 learned_addr learned my addr 172.21.15.29:0/934923680 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a259c700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40ceb90 0x7fb2a40c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a359e700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158c00 0x7fb2a40c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a2d9d700 1 -- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40ceb90 msgr2=0x7fb2a40c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a2d9d700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40ceb90 0x7fb2a40c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a2d9d700 1 -- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158c00 msgr2=0x7fb2a40c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a2d9d700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158c00 0x7fb2a40c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a2d9d700 1 -- 172.21.15.29:0/934923680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c0094f0 con 0x7fb2a40ce740 2023-10-06T05:30:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a359e700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158c00 0x7fb2a40c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a2d9d700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 0x7fb2a4152a60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb29400d1b0 tx=0x7fb2940099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb29affd700 1 -- 172.21.15.29:0/934923680 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400dda0 con 0x7fb2a40ce740 2023-10-06T05:30:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb29affd700 1 -- 172.21.15.29:0/934923680 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29400f040 con 0x7fb2a40ce740 2023-10-06T05:30:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a40b2d20 con 0x7fb2a40ce740 2023-10-06T05:30:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb29affd700 1 -- 172.21.15.29:0/934923680 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294015670 con 0x7fb2a40ce740 2023-10-06T05:30:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.435+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a40b32e0 con 0x7fb2a40ce740 2023-10-06T05:30:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.439+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a404be00 con 0x7fb2a40ce740 2023-10-06T05:30:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.439+0000 7fb29affd700 1 -- 172.21.15.29:0/934923680 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb294015a60 con 0x7fb2a40ce740 2023-10-06T05:30:42.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.439+0000 7fb29affd700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb284060550 0x7fb284062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:42.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.439+0000 7fb29affd700 1 -- 172.21.15.29:0/934923680 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fb29407ce00 con 0x7fb2a40ce740 2023-10-06T05:30:42.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.439+0000 7fb2a259c700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb284060550 0x7fb284062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:42.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.439+0000 7fb2a259c700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb284060550 0x7fb284062a00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0099b0 tx=0x7fb28c017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:42.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.447+0000 7fb29affd700 1 -- 172.21.15.29:0/934923680 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb29404d1f0 con 0x7fb2a40ce740 2023-10-06T05:30:42.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.655+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb2a406aee0 con 0x7fb2a40ce740 2023-10-06T05:30:42.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.655+0000 7fb29affd700 1 -- 172.21.15.29:0/934923680 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb294050810 con 0x7fb2a40ce740 2023-10-06T05:30:42.664 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb284060550 msgr2=0x7fb284062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb284060550 0x7fb284062a00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0099b0 tx=0x7fb28c017000 comp rx=0 tx=0).stop 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 msgr2=0x7fb2a4152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 0x7fb2a4152a60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb29400d1b0 tx=0x7fb2940099f0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 shutdown_connections 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb284060550 0x7fb284062a00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158c00 0x7fb2a40c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40ceb90 0x7fb2a40c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 --2- 172.21.15.29:0/934923680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2a40ce740 0x7fb2a4152a60 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 >> 172.21.15.29:0/934923680 conn(0x7fb2a40670a0 msgr2=0x7fb2a4158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:42.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 shutdown_connections 2023-10-06T05:30:42.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:42.659+0000 7fb2a88ae700 1 -- 172.21.15.29:0/934923680 wait complete. 2023-10-06T05:30:42.678 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T05:30:42.678 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T05:30:42.679 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-06T05:30:42.679 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T05:30:42.679 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:42.679 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T05:30:42.679 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T05:30:42.679 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T05:30:42.679 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:42.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:42.679 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-06T05:30:42.687 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T05:30:42.688 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42285sec preferred_lft 42285sec 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ad:37:e7:1d brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff 2023-10-06T05:30:42.689 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::38dc:3fff:fed0:feb0/64 scope link 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5e:88:ce:77:b6:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5c88:ceff:fe77:b613/64 scope link 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether aa:ad:a4:57:7d:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a8ad:a4ff:fe57:7d6d/64 scope link 2023-10-06T05:30:42.690 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-06T05:30:42.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:42.691 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T05:30:42.747 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:30:42.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:42.748 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-06T05:30:42.757 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-06T05:30:42.757 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T05:30:42.758 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T05:30:42.758 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T05:30:42.758 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T05:30:42.758 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T05:30:42.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:42.758 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-06T05:30:42.758 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-06T05:30:42.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T05:30:42.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T05:30:42.759 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T05:30:42.759 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-06T05:30:42.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:42.795 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:30:42.803 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T05:30:42.803 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:30:42.803 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:42.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:42.803 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-06T05:30:42.861 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T05:30:42.861 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:30:42.861 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:42.868 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T05:30:42.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T05:30:42.869 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:42.874 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:42.892 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:42.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:42.947 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:42.948 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:42.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:42.949 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:42.955 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T05:30:42.956 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T05:30:42.958 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:42.976 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:42.976 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:43.038 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:43.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:43.038 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:43.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2023-10-06T05:30:43.035+0000 7fcdc2b26380 -1 init, newargv = 0x557bf10a8d10 newargc=15 2023-10-06T05:30:43.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[49502]: starting ceph client 2023-10-06T05:30:43.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[49502]: starting fuse 2023-10-06T05:30:44.146 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2023-10-06T05:30:44.165 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T05:30:44.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T05:30:44.180 INFO:teuthology.orchestra.run.smithi029.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T05:30:44.181 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T05:30:44.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:44.182 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2023-10-06T05:30:44.188 INFO:teuthology.orchestra.run.smithi029.stdout:52 2023-10-06T05:30:44.188 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-06T05:30:44.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:44.188 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2023-10-06T05:30:44.188 DEBUG:teuthology.orchestra.run.smithi029:> import re 2023-10-06T05:30:44.188 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2023-10-06T05:30:44.189 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> return f 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2023-10-06T05:30:44.190 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:44.316 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.49502.asok 2023-10-06T05:30:44.500 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49502.asok 2023-10-06T05:30:44.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:44.500 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49502.asok status 2023-10-06T05:30:44.600 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:44.600 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2023-10-06T05:30:44.600 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T05:30:44.600 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "49502", 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 6987, 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2023-10-06T05:30:44.601 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 6987 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2366021032 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2366021032 2023-10-06T05:30:44.602 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-06T05:30:44.603 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.6987 192.168.0.1:0/2366021032", 2023-10-06T05:30:44.603 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/2366021032", 2023-10-06T05:30:44.603 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2023-10-06T05:30:44.603 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 54, 2023-10-06T05:30:44.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 79, 2023-10-06T05:30:44.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2023-10-06T05:30:44.603 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2023-10-06T05:30:44.603 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2023-10-06T05:30:44.603 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:44.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:44.611 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2023-10-06T05:30:44.611 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:44.619 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2023-10-06T05:30:44.620 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:44.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:44.620 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:44.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T05:30:44.677 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T05:30:44.707 INFO:teuthology.orchestra.run.smithi029.stdout:./ 2023-10-06T05:30:44.708 INFO:teuthology.orchestra.run.smithi029.stdout:./parent 2023-10-06T05:30:44.708 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed 2023-10-06T05:30:44.708 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed/charlie 2023-10-06T05:30:44.708 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed/alpha 2023-10-06T05:30:44.708 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/flushed/bravo 2023-10-06T05:30:44.708 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/unflushed 2023-10-06T05:30:44.708 INFO:teuthology.orchestra.run.smithi029.stdout:./parent/unflushed/jfile 2023-10-06T05:30:44.709 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:44.709 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:44.709 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:44.709 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:44.709 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T05:30:44.709 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:44.778 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-06T05:30:44.967 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:44.967 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:44.967 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:44.967 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:44.968 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2023-10-06T05:30:44.968 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:45.038 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627776 2023-10-06T05:30:45.228 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:45.228 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:45.228 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:45.228 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:45.228 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2023-10-06T05:30:45.228 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:45.300 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627777 2023-10-06T05:30:45.487 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:45.487 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:45.487 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:45.487 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:45.487 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2023-10-06T05:30:45.488 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:45.601 INFO:teuthology.orchestra.run.smithi029.stdout:1099511628280 2023-10-06T05:30:45.788 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:45.788 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:45.788 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:45.788 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:45.788 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2023-10-06T05:30:45.788 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:45.858 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627778 2023-10-06T05:30:46.046 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:46.047 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:46.047 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:46.047 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:46.047 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2023-10-06T05:30:46.047 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:46.115 INFO:teuthology.orchestra.run.smithi029.stdout:1099511628279 2023-10-06T05:30:46.307 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:46.307 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:46.307 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:46.307 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:46.307 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2023-10-06T05:30:46.307 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:46.417 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627779 2023-10-06T05:30:46.606 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T05:30:46.606 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-06T05:30:46.606 DEBUG:teuthology.orchestra.run.smithi029:> import stat 2023-10-06T05:30:46.606 DEBUG:teuthology.orchestra.run.smithi029:> 2023-10-06T05:30:46.606 DEBUG:teuthology.orchestra.run.smithi029:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2023-10-06T05:30:46.607 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-06T05:30:46.677 INFO:teuthology.orchestra.run.smithi029.stdout:1099511627780 2023-10-06T05:30:46.864 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T05:30:46.864 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:30:46.881 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T05:30:46.901 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T05:30:46.902 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2023-10-06T05:30:46.902 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T05:30:46.902 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T05:30:46.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[49502]: fuse finished with error 0 and tester_r 0 2023-10-06T05:30:46.941 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:30:46.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:46.942 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T05:30:47.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:30:47.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:47.041 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T05:30:47.048 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T05:30:47.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:30:47.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:30:47.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:47.049 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T05:30:47.056 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T05:30:47.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:30:47.057 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:30:47.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:47.058 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T05:30:47.066 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T05:30:47.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:30:47.068 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:47.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff129a73700 1 Processor -- start 2023-10-06T05:30:47.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff129a73700 1 -- start start 2023-10-06T05:30:47.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff129a73700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff12406e960 0x7ff12406ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff129a73700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1240c8100 0x7ff124156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff129a73700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff12415a080 0x7ff12414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff129a73700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff124159bf0 con 0x7ff1240c8100 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff129a73700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1241598c0 con 0x7ff12415a080 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff129a73700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff124156b90 con 0x7ff12406e960 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff122ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1240c8100 0x7ff124156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff122ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff1240c8100 0x7ff124156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49800/0 (socket says 172.21.15.29:49800) 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff122ffd700 1 -- 172.21.15.29:0/4226142795 learned_addr learned my addr 172.21.15.29:0/4226142795 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff123fff700 1 --2- 172.21.15.29:0/4226142795 >> v2:172.21.15.173:3300/0 conn(0x7ff12415a080 0x7ff12414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff1237fe700 1 --2- 172.21.15.29:0/4226142795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff12406e960 0x7ff12406ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff122ffd700 1 -- 172.21.15.29:0/4226142795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff12406e960 msgr2=0x7ff12406ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff122ffd700 1 --2- 172.21.15.29:0/4226142795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff12406e960 0x7ff12406ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff122ffd700 1 -- 172.21.15.29:0/4226142795 >> v2:172.21.15.173:3300/0 conn(0x7ff12415a080 msgr2=0x7ff12414fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:47.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff122ffd700 1 --2- 172.21.15.29:0/4226142795 >> v2:172.21.15.173:3300/0 conn(0x7ff12415a080 0x7ff12414fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.207+0000 7ff122ffd700 1 -- 172.21.15.29:0/4226142795 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124156e70 con 0x7ff1240c8100 2023-10-06T05:30:47.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff1237fe700 1 --2- 172.21.15.29:0/4226142795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff12406e960 0x7ff12406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:30:47.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff122ffd700 1 --2- 172.21.15.29:0/4226142795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1240c8100 0x7ff124156220 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff12406a260 tx=0x7ff118009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814c4348667b9afb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:47.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff1227fc700 1 -- 172.21.15.29:0/4226142795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11800b860 con 0x7ff1240c8100 2023-10-06T05:30:47.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff1227fc700 1 -- 172.21.15.29:0/4226142795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11800b9c0 con 0x7ff1240c8100 2023-10-06T05:30:47.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff1227fc700 1 -- 172.21.15.29:0/4226142795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11800bd60 con 0x7ff1240c8100 2023-10-06T05:30:47.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff129a73700 1 -- 172.21.15.29:0/4226142795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1240c8100 msgr2=0x7ff124156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff129a73700 1 --2- 172.21.15.29:0/4226142795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1240c8100 0x7ff124156220 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff12406a260 tx=0x7ff118009250 comp rx=0 tx=0).stop 2023-10-06T05:30:47.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff129a73700 1 -- 172.21.15.29:0/4226142795 shutdown_connections 2023-10-06T05:30:47.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff129a73700 1 --2- 172.21.15.29:0/4226142795 >> v2:172.21.15.173:3300/0 conn(0x7ff12415a080 0x7ff12414fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff129a73700 1 --2- 172.21.15.29:0/4226142795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1240c8100 0x7ff124156220 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff129a73700 1 --2- 172.21.15.29:0/4226142795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff12406e960 0x7ff12406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff129a73700 1 -- 172.21.15.29:0/4226142795 >> 172.21.15.29:0/4226142795 conn(0x7ff124067b70 msgr2=0x7ff12406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:47.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff129a73700 1 -- 172.21.15.29:0/4226142795 shutdown_connections 2023-10-06T05:30:47.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.211+0000 7ff129a73700 1 -- 172.21.15.29:0/4226142795 wait complete. 2023-10-06T05:30:47.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff129a73700 1 Processor -- start 2023-10-06T05:30:47.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff129a73700 1 -- start start 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff129a73700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff12406e960 0x7ff1240ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff129a73700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1240c8100 0x7ff1240acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff129a73700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff12415a080 0x7ff1240ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff129a73700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240adfd0 con 0x7ff12415a080 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff129a73700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240ad3c0 con 0x7ff12406e960 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff129a73700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240ad6a0 con 0x7ff1240c8100 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff123fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff12415a080 0x7ff1240ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff123fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff12415a080 0x7ff1240ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49812/0 (socket says 172.21.15.29:49812) 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff123fff700 1 -- 172.21.15.29:0/2161116746 learned_addr learned my addr 172.21.15.29:0/2161116746 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff1237fe700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff12406e960 0x7ff1240ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff122ffd700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1240c8100 0x7ff1240acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff123fff700 1 -- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1240c8100 msgr2=0x7ff1240acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff123fff700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1240c8100 0x7ff1240acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff123fff700 1 -- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff12406e960 msgr2=0x7ff1240ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff123fff700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff12406e960 0x7ff1240ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.215+0000 7ff123fff700 1 -- 172.21.15.29:0/2161116746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1180094f0 con 0x7ff12415a080 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.219+0000 7ff123fff700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff12415a080 0x7ff1240ab380 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff11c007f20 tx=0x7ff11c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.219+0000 7ff10b7fe700 1 -- 172.21.15.29:0/2161116746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00eb90 con 0x7ff12415a080 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.219+0000 7ff10b7fe700 1 -- 172.21.15.29:0/2161116746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c00ed10 con 0x7ff12415a080 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.219+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1240ad980 con 0x7ff12415a080 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.219+0000 7ff10b7fe700 1 -- 172.21.15.29:0/2161116746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c014670 con 0x7ff12415a080 2023-10-06T05:30:47.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.219+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1240ad0d0 con 0x7ff12415a080 2023-10-06T05:30:47.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.219+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1240ae140 con 0x7ff12415a080 2023-10-06T05:30:47.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.219+0000 7ff10b7fe700 1 -- 172.21.15.29:0/2161116746 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff11c0149e0 con 0x7ff12415a080 2023-10-06T05:30:47.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.223+0000 7ff10b7fe700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff110060550 0x7ff110062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.223+0000 7ff10b7fe700 1 -- 172.21.15.29:0/2161116746 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7ff11c07cf90 con 0x7ff12415a080 2023-10-06T05:30:47.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.223+0000 7ff1237fe700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff110060550 0x7ff110062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.223+0000 7ff1237fe700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff110060550 0x7ff110062a00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff1140114a0 tx=0x7ff114006f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:47.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.231+0000 7ff10b7fe700 1 -- 172.21.15.29:0/2161116746 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff11c0acbe0 con 0x7ff12415a080 2023-10-06T05:30:47.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.427+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff12404be00 con 0x7ff12415a080 2023-10-06T05:30:47.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.427+0000 7ff10b7fe700 1 -- 172.21.15.29:0/2161116746 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4606 (secure 0 0 0) 0x7ff11c04d370 con 0x7ff12415a080 2023-10-06T05:30:47.435 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:47.435 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:40.875741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/1984531371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1984531371},{"type":"v1","addr":"172.21.15.29:6835","nonce":1984531371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff110060550 msgr2=0x7ff110062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff110060550 0x7ff110062a00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff1140114a0 tx=0x7ff114006f90 comp rx=0 tx=0).stop 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff12415a080 msgr2=0x7ff1240ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff12415a080 0x7ff1240ab380 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff11c007f20 tx=0x7ff11c009860 comp rx=0 tx=0).stop 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 shutdown_connections 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff12415a080 0x7ff1240ab380 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff1240c8100 0x7ff1240acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff110060550 0x7ff110062a00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 --2- 172.21.15.29:0/2161116746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff12406e960 0x7ff1240ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 >> 172.21.15.29:0/2161116746 conn(0x7ff124067b70 msgr2=0x7ff124157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:47.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 shutdown_connections 2023-10-06T05:30:47.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.431+0000 7ff129a73700 1 -- 172.21.15.29:0/2161116746 wait complete. 2023-10-06T05:30:47.439 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 54 2023-10-06T05:30:47.449 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:30:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161c9f9700 1 Processor -- start 2023-10-06T05:30:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161c9f9700 1 -- start start 2023-10-06T05:30:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161c9f9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16180b1da0 0x7f16181541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161c9f9700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f161815d810 0x7f161806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161c9f9700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16180ac160 con 0x7f1618153de0 2023-10-06T05:30:47.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161c9f9700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161815e7e0 con 0x7f161815d810 2023-10-06T05:30:47.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161c9f9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16181546f0 con 0x7f16180b1da0 2023-10-06T05:30:47.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f1615d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16180b1da0 0x7f16181541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f1616d9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f161815d810 0x7f161806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161659c700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f1618153de0 0x7f16180ac5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:44000/0 (socket says 172.21.15.29:44000) 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161659c700 1 -- 172.21.15.29:0/830821869 learned_addr learned my addr 172.21.15.29:0/830821869 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161559a700 1 -- 172.21.15.29:0/830821869 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701567239 0 0) 0x7f16180ac160 con 0x7f1618153de0 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161559a700 1 -- 172.21.15.29:0/830821869 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1604003570 con 0x7f1618153de0 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f1615d9b700 1 -- 172.21.15.29:0/830821869 >> v2:172.21.15.173:3300/0 conn(0x7f161815d810 msgr2=0x7f161806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f1615d9b700 1 --2- 172.21.15.29:0/830821869 >> v2:172.21.15.173:3300/0 conn(0x7f161815d810 0x7f161806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f1615d9b700 1 -- 172.21.15.29:0/830821869 >> v1:172.21.15.173:6789/0 conn(0x7f1618153de0 legacy=0x7f16180ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f1615d9b700 1 -- 172.21.15.29:0/830821869 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161815e220 con 0x7f16180b1da0 2023-10-06T05:30:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f1615d9b700 1 --2- 172.21.15.29:0/830821869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16180b1da0 0x7f16181541b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1610009e60 tx=0x7f1610009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7326d67e292f33b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161559a700 1 -- 172.21.15.29:0/830821869 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000e070 con 0x7f16180b1da0 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161559a700 1 -- 172.21.15.29:0/830821869 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000bab0 con 0x7f16180b1da0 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.551+0000 7f161559a700 1 -- 172.21.15.29:0/830821869 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000be70 con 0x7f16180b1da0 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 -- 172.21.15.29:0/830821869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16180b1da0 msgr2=0x7f16181541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 --2- 172.21.15.29:0/830821869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16180b1da0 0x7f16181541b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1610009e60 tx=0x7f1610009780 comp rx=0 tx=0).stop 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 -- 172.21.15.29:0/830821869 shutdown_connections 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 --2- 172.21.15.29:0/830821869 >> v2:172.21.15.173:3300/0 conn(0x7f161815d810 0x7f161806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 --2- 172.21.15.29:0/830821869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16180b1da0 0x7f16181541b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 -- 172.21.15.29:0/830821869 >> 172.21.15.29:0/830821869 conn(0x7f161806b770 msgr2=0x7f16180690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 -- 172.21.15.29:0/830821869 shutdown_connections 2023-10-06T05:30:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 -- 172.21.15.29:0/830821869 wait complete. 2023-10-06T05:30:47.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 Processor -- start 2023-10-06T05:30:47.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 -- start start 2023-10-06T05:30:47.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b1da0 0x7f161815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1618153de0 0x7f1618158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f161815d810 0x7f1618161570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618158d50 con 0x7f161815d810 2023-10-06T05:30:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618159b70 con 0x7f16180b1da0 2023-10-06T05:30:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.555+0000 7f161c9f9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1618158f60 con 0x7f1618153de0 2023-10-06T05:30:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b1da0 0x7f161815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f1615d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1618153de0 0x7f1618158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b1da0 0x7f161815fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:39452/0 (socket says 172.21.15.29:39452) 2023-10-06T05:30:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161659c700 1 -- 172.21.15.29:0/2650849700 learned_addr learned my addr 172.21.15.29:0/2650849700 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:47.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f1616d9d700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f161815d810 0x7f1618161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161659c700 1 -- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1618153de0 msgr2=0x7f1618158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161659c700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1618153de0 0x7f1618158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161659c700 1 -- 172.21.15.29:0/2650849700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f161815d810 msgr2=0x7f1618161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161659c700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f161815d810 0x7f1618161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161659c700 1 -- 172.21.15.29:0/2650849700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1610009a20 con 0x7f16180b1da0 2023-10-06T05:30:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f1616d9d700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f161815d810 0x7f1618161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161659c700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b1da0 0x7f161815fe50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f160000c7c0 tx=0x7f1600007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f160e7fc700 1 -- 172.21.15.29:0/2650849700 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600005cd0 con 0x7f16180b1da0 2023-10-06T05:30:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f160e7fc700 1 -- 172.21.15.29:0/2650849700 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1600005e30 con 0x7f16180b1da0 2023-10-06T05:30:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618159240 con 0x7f16180b1da0 2023-10-06T05:30:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f160e7fc700 1 -- 172.21.15.29:0/2650849700 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600007320 con 0x7f16180b1da0 2023-10-06T05:30:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1618159800 con 0x7f16180b1da0 2023-10-06T05:30:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161804be00 con 0x7f16180b1da0 2023-10-06T05:30:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.559+0000 7f160e7fc700 1 -- 172.21.15.29:0/2650849700 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f160001b3b0 con 0x7f16180b1da0 2023-10-06T05:30:47.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.563+0000 7f160e7fc700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15f8060550 0x7f15f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.563+0000 7f160e7fc700 1 -- 172.21.15.29:0/2650849700 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f160007c050 con 0x7f16180b1da0 2023-10-06T05:30:47.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.563+0000 7f1615d9b700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15f8060550 0x7f15f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.563+0000 7f1615d9b700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15f8060550 0x7f15f8062a00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f16180b2170 tx=0x7f1610019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:47.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.571+0000 7f160e7fc700 1 -- 172.21.15.29:0/2650849700 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f160004c430 con 0x7f16180b1da0 2023-10-06T05:30:47.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.731+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f161815e500 con 0x7f16180b1da0 2023-10-06T05:30:47.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.735+0000 7f160e7fc700 1 -- 172.21.15.29:0/2650849700 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17126 (secure 0 0 0) 0x7f1600017020 con 0x7f16180b1da0 2023-10-06T05:30:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:47.743 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":79,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:30:35.833868+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:29:51.644444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T05:29:52.853119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6834/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6835/3515782118":"2023-10-07T05:30:18.733272+0000","172.21.15.29:6834/3515782118":"2023-10-07T05:30:18.733272+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:30:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15f8060550 msgr2=0x7f15f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15f8060550 0x7f15f8062a00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f16180b2170 tx=0x7f1610019000 comp rx=0 tx=0).stop 2023-10-06T05:30:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b1da0 msgr2=0x7f161815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b1da0 0x7f161815fe50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f160000c7c0 tx=0x7f1600007e00 comp rx=0 tx=0).stop 2023-10-06T05:30:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 shutdown_connections 2023-10-06T05:30:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f161815d810 0x7f1618161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1618153de0 0x7f1618158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f15f8060550 0x7f15f8062a00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 --2- 172.21.15.29:0/2650849700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16180b1da0 0x7f161815fe50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 >> 172.21.15.29:0/2650849700 conn(0x7f161806b770 msgr2=0x7f16181534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 shutdown_connections 2023-10-06T05:30:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.739+0000 7f161c9f9700 1 -- 172.21.15.29:0/2650849700 wait complete. 2023-10-06T05:30:47.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T05:25:28.706509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T05:25:34.287336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T05:29:51.644444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T05:29:52.853119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T05:30:47.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T05:30:47.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31ec7e700 1 Processor -- start 2023-10-06T05:30:47.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31ec7e700 1 -- start start 2023-10-06T05:30:47.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31ec7e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb3181559d0 0x7fb3180c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31ec7e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb318155da0 0x7fb3180c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31ec7e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb3180cae80 0x7fb3180cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31ec7e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3180cb860 con 0x7fb3180cae80 2023-10-06T05:30:47.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31ec7e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3181596e0 con 0x7fb3181559d0 2023-10-06T05:30:47.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31ec7e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31815a520 con 0x7fb318155da0 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31e47d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb3180cae80 0x7fb3180cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31e47d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb3180cae80 0x7fb3180cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49826/0 (socket says 172.21.15.29:49826) 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31e47d700 1 -- 172.21.15.29:0/861085637 learned_addr learned my addr 172.21.15.29:0/861085637 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31d47b700 1 --2- 172.21.15.29:0/861085637 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb318155da0 0x7fb3180c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31dc7c700 1 --2- 172.21.15.29:0/861085637 >> v2:172.21.15.173:3300/0 conn(0x7fb3181559d0 0x7fb3180c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31e47d700 1 -- 172.21.15.29:0/861085637 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb318155da0 msgr2=0x7fb3180c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31e47d700 1 --2- 172.21.15.29:0/861085637 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb318155da0 0x7fb3180c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31e47d700 1 -- 172.21.15.29:0/861085637 >> v2:172.21.15.173:3300/0 conn(0x7fb3181559d0 msgr2=0x7fb3180c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31e47d700 1 --2- 172.21.15.29:0/861085637 >> v2:172.21.15.173:3300/0 conn(0x7fb3181559d0 0x7fb3180c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31e47d700 1 -- 172.21.15.29:0/861085637 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3180ae800 con 0x7fb3180cae80 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31e47d700 1 --2- 172.21.15.29:0/861085637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3180cae80 0x7fb3180cb320 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb318068860 tx=0x7fb310009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842d851d8048e627 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:47.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31cc7a700 1 -- 172.21.15.29:0/861085637 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31000b860 con 0x7fb3180cae80 2023-10-06T05:30:47.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31cc7a700 1 -- 172.21.15.29:0/861085637 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31000b9c0 con 0x7fb3180cae80 2023-10-06T05:30:47.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.867+0000 7fb31cc7a700 1 -- 172.21.15.29:0/861085637 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31000bd60 con 0x7fb3180cae80 2023-10-06T05:30:47.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 -- 172.21.15.29:0/861085637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3180cae80 msgr2=0x7fb3180cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/861085637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3180cae80 0x7fb3180cb320 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb318068860 tx=0x7fb310009250 comp rx=0 tx=0).stop 2023-10-06T05:30:47.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 -- 172.21.15.29:0/861085637 shutdown_connections 2023-10-06T05:30:47.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/861085637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3180cae80 0x7fb3180cb320 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/861085637 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb318155da0 0x7fb3180c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/861085637 >> v2:172.21.15.173:3300/0 conn(0x7fb3181559d0 0x7fb3180c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 -- 172.21.15.29:0/861085637 >> 172.21.15.29:0/861085637 conn(0x7fb31806c6c0 msgr2=0x7fb31806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:47.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 -- 172.21.15.29:0/861085637 shutdown_connections 2023-10-06T05:30:47.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 -- 172.21.15.29:0/861085637 wait complete. 2023-10-06T05:30:47.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 Processor -- start 2023-10-06T05:30:47.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 -- start start 2023-10-06T05:30:47.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3180cae80 0x7fb318152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3181559d0 0x7fb318145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.871+0000 7fb31ec7e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318155da0 0x7fb3180ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31ec7e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180afa60 con 0x7fb318155da0 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31ec7e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180af4a0 con 0x7fb3180cae80 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31ec7e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3180af780 con 0x7fb3181559d0 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31e47d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318155da0 0x7fb3180ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31e47d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318155da0 0x7fb3180ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49834/0 (socket says 172.21.15.29:49834) 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31e47d700 1 -- 172.21.15.29:0/3493627776 learned_addr learned my addr 172.21.15.29:0/3493627776 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31dc7c700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3180cae80 0x7fb318152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31d47b700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3181559d0 0x7fb318145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31e47d700 1 -- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3181559d0 msgr2=0x7fb318145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31e47d700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3181559d0 0x7fb318145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31e47d700 1 -- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3180cae80 msgr2=0x7fb318152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31e47d700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3180cae80 0x7fb318152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:47.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31e47d700 1 -- 172.21.15.29:0/3493627776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3100094f0 con 0x7fb318155da0 2023-10-06T05:30:47.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31d47b700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3181559d0 0x7fb318145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:47.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31dc7c700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3180cae80 0x7fb318152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:47.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31e47d700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318155da0 0x7fb3180ae9e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb318068f20 tx=0x7fb310017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:47.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb315ffb700 1 -- 172.21.15.29:0/3493627776 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31001a630 con 0x7fb318155da0 2023-10-06T05:30:47.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb315ffb700 1 -- 172.21.15.29:0/3493627776 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31001a7b0 con 0x7fb318155da0 2023-10-06T05:30:47.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb318156310 con 0x7fb318155da0 2023-10-06T05:30:47.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb315ffb700 1 -- 172.21.15.29:0/3493627776 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31001ab70 con 0x7fb318155da0 2023-10-06T05:30:47.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb318145970 con 0x7fb318155da0 2023-10-06T05:30:47.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb318156170 con 0x7fb318155da0 2023-10-06T05:30:47.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.875+0000 7fb315ffb700 1 -- 172.21.15.29:0/3493627776 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb31002d440 con 0x7fb318155da0 2023-10-06T05:30:47.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.879+0000 7fb315ffb700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb304060550 0x7fb304062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:47.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.879+0000 7fb315ffb700 1 -- 172.21.15.29:0/3493627776 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fb31007e690 con 0x7fb318155da0 2023-10-06T05:30:47.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.879+0000 7fb31dc7c700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb304060550 0x7fb304062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:47.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.879+0000 7fb31dc7c700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb304060550 0x7fb304062a00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb308006fd0 tx=0x7fb308008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:47.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:47.887+0000 7fb315ffb700 1 -- 172.21.15.29:0/3493627776 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb318156170 con 0x7fb318155da0 2023-10-06T05:30:48.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.043+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb318156170 con 0x7fb318155da0 2023-10-06T05:30:48.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.043+0000 7fb315ffb700 1 -- 172.21.15.29:0/3493627776 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb318156170 con 0x7fb318155da0 2023-10-06T05:30:48.051 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-06T05:30:48.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb304060550 msgr2=0x7fb304062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb304060550 0x7fb304062a00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb308006fd0 tx=0x7fb308008040 comp rx=0 tx=0).stop 2023-10-06T05:30:48.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318155da0 msgr2=0x7fb3180ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318155da0 0x7fb3180ae9e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb318068f20 tx=0x7fb310017000 comp rx=0 tx=0).stop 2023-10-06T05:30:48.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 shutdown_connections 2023-10-06T05:30:48.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318155da0 0x7fb3180ae9e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3181559d0 0x7fb318145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb304060550 0x7fb304062a00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 --2- 172.21.15.29:0/3493627776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3180cae80 0x7fb318152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 >> 172.21.15.29:0/3493627776 conn(0x7fb31806c6c0 msgr2=0x7fb3180c7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:48.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 shutdown_connections 2023-10-06T05:30:48.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.047+0000 7fb31ec7e700 1 -- 172.21.15.29:0/3493627776 wait complete. 2023-10-06T05:30:48.066 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T05:30:48.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.171+0000 7f4201ffc700 1 Processor -- start 2023-10-06T05:30:48.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.171+0000 7f4201ffc700 1 -- start start 2023-10-06T05:30:48.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f41fc158c40 0x7f41fc0d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc159010 0x7f41fc06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f41fc0ce320 0x7f41fc0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc0ced00 con 0x7f41fc158c40 2023-10-06T05:30:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc0cae30 con 0x7f41fc0ce320 2023-10-06T05:30:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc06ba70 con 0x7f41fc159010 2023-10-06T05:30:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4200ffa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f41fc158c40 0x7f41fc0d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4200ffa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f41fc158c40 0x7f41fc0d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49838/0 (socket says 172.21.15.29:49838) 2023-10-06T05:30:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f42017fb700 1 --2- 172.21.15.29:0/786329620 >> v2:172.21.15.173:3300/0 conn(0x7f41fc0ce320 0x7f41fc0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f41fbfff700 1 --2- 172.21.15.29:0/786329620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc159010 0x7f41fc06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4200ffa700 1 -- 172.21.15.29:0/786329620 learned_addr learned my addr 172.21.15.29:0/786329620 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:48.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f42017fb700 1 -- 172.21.15.29:0/786329620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc159010 msgr2=0x7f41fc06aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f42017fb700 1 --2- 172.21.15.29:0/786329620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc159010 0x7f41fc06aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f42017fb700 1 -- 172.21.15.29:0/786329620 >> v2:172.21.15.29:3300/0 conn(0x7f41fc158c40 msgr2=0x7f41fc0d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f42017fb700 1 --2- 172.21.15.29:0/786329620 >> v2:172.21.15.29:3300/0 conn(0x7f41fc158c40 0x7f41fc0d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f42017fb700 1 -- 172.21.15.29:0/786329620 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc06b1e0 con 0x7f41fc0ce320 2023-10-06T05:30:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4200ffa700 1 --2- 172.21.15.29:0/786329620 >> v2:172.21.15.29:3300/0 conn(0x7f41fc158c40 0x7f41fc0d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f42017fb700 1 --2- 172.21.15.29:0/786329620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 0x7f41fc0ce7c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f41fc15dae0 tx=0x7f41f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c4cd404deb633e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f41fb7fe700 1 -- 172.21.15.29:0/786329620 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400e070 con 0x7f41fc0ce320 2023-10-06T05:30:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f41fb7fe700 1 -- 172.21.15.29:0/786329620 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f400bab0 con 0x7f41fc0ce320 2023-10-06T05:30:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f41fb7fe700 1 -- 172.21.15.29:0/786329620 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400be70 con 0x7f41fc0ce320 2023-10-06T05:30:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 -- 172.21.15.29:0/786329620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 msgr2=0x7f41fc0ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 --2- 172.21.15.29:0/786329620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 0x7f41fc0ce7c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f41fc15dae0 tx=0x7f41f4009780 comp rx=0 tx=0).stop 2023-10-06T05:30:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 -- 172.21.15.29:0/786329620 shutdown_connections 2023-10-06T05:30:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 --2- 172.21.15.29:0/786329620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 0x7f41fc0ce7c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 --2- 172.21.15.29:0/786329620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc159010 0x7f41fc06aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 --2- 172.21.15.29:0/786329620 >> v2:172.21.15.29:3300/0 conn(0x7f41fc158c40 0x7f41fc0d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 -- 172.21.15.29:0/786329620 >> 172.21.15.29:0/786329620 conn(0x7f41fc0670a0 msgr2=0x7f41fc0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 -- 172.21.15.29:0/786329620 shutdown_connections 2023-10-06T05:30:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.175+0000 7f4201ffc700 1 -- 172.21.15.29:0/786329620 wait complete. 2023-10-06T05:30:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.179+0000 7f4201ffc700 1 Processor -- start 2023-10-06T05:30:48.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.179+0000 7f4201ffc700 1 -- start start 2023-10-06T05:30:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4201ffc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 0x7f41fc15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4201ffc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc158c40 0x7f41fc0c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4201ffc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41fc159010 0x7f41fc0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4201ffc700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc15b910 con 0x7f41fc159010 2023-10-06T05:30:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4201ffc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc1594b0 con 0x7f41fc0ce320 2023-10-06T05:30:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4201ffc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc0b5160 con 0x7f41fc158c40 2023-10-06T05:30:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4200ffa700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 0x7f41fc15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f42017fb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41fc159010 0x7f41fc0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f42017fb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41fc159010 0x7f41fc0c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49842/0 (socket says 172.21.15.29:49842) 2023-10-06T05:30:48.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f42017fb700 1 -- 172.21.15.29:0/3349944573 learned_addr learned my addr 172.21.15.29:0/3349944573 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:48.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f41fbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc158c40 0x7f41fc0c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4200ffa700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 0x7f41fc15b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:39488/0 (socket says 172.21.15.29:39488) 2023-10-06T05:30:48.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f42017fb700 1 -- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc158c40 msgr2=0x7f41fc0c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f42017fb700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc158c40 0x7f41fc0c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f42017fb700 1 -- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 msgr2=0x7f41fc15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f42017fb700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 0x7f41fc15b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f42017fb700 1 -- 172.21.15.29:0/3349944573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00094f0 con 0x7f41fc159010 2023-10-06T05:30:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f42017fb700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41fc159010 0x7f41fc0c83d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0caf70 tx=0x7f41f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f41f8ff9700 1 -- 172.21.15.29:0/3349944573 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4012dd0 con 0x7f41fc159010 2023-10-06T05:30:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f41f8ff9700 1 -- 172.21.15.29:0/3349944573 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4027470 con 0x7f41fc159010 2023-10-06T05:30:48.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f4009a20 con 0x7f41fc159010 2023-10-06T05:30:48.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f41f8ff9700 1 -- 172.21.15.29:0/3349944573 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4027830 con 0x7f41fc159010 2023-10-06T05:30:48.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.183+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41fc0b5720 con 0x7f41fc159010 2023-10-06T05:30:48.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.187+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41fc159620 con 0x7f41fc159010 2023-10-06T05:30:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.187+0000 7f41f8ff9700 1 -- 172.21.15.29:0/3349944573 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f41f4024070 con 0x7f41fc159010 2023-10-06T05:30:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.187+0000 7f41f8ff9700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41e0060550 0x7f41e0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.187+0000 7f41f8ff9700 1 -- 172.21.15.29:0/3349944573 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f41f407eff0 con 0x7f41fc159010 2023-10-06T05:30:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.187+0000 7f4200ffa700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41e0060550 0x7f41e0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.187+0000 7f4200ffa700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41e0060550 0x7f41e0062a00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f41f0006d20 tx=0x7f41f0009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.195+0000 7f41f8ff9700 1 -- 172.21.15.29:0/3349944573 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f41f40aebe0 con 0x7f41fc159010 2023-10-06T05:30:48.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.359+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f41fc06b4b0 con 0x7f41fc159010 2023-10-06T05:30:48.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f41f8ff9700 1 -- 172.21.15.29:0/3349944573 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7f41fc159620 con 0x7f41fc159010 2023-10-06T05:30:48.369 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2023-10-06T05:30:48.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41e0060550 msgr2=0x7f41e0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41e0060550 0x7f41e0062a00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f41f0006d20 tx=0x7f41f0009250 comp rx=0 tx=0).stop 2023-10-06T05:30:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41fc159010 msgr2=0x7f41fc0c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41fc159010 0x7f41fc0c83d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0caf70 tx=0x7f41f4019000 comp rx=0 tx=0).stop 2023-10-06T05:30:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 shutdown_connections 2023-10-06T05:30:48.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41fc159010 0x7f41fc0c83d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41fc158c40 0x7f41fc0c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f41e0060550 0x7f41e0062a00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 --2- 172.21.15.29:0/3349944573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41fc0ce320 0x7f41fc15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 >> 172.21.15.29:0/3349944573 conn(0x7f41fc0670a0 msgr2=0x7f41fc0c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:48.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 shutdown_connections 2023-10-06T05:30:48.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.363+0000 7f4201ffc700 1 -- 172.21.15.29:0/3349944573 wait complete. 2023-10-06T05:30:48.384 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T05:30:48.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.487+0000 7f4843178700 1 Processor -- start 2023-10-06T05:30:48.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.487+0000 7f4843178700 1 -- start start 2023-10-06T05:30:48.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c13f080 0x7f483c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f483c06dde0 0x7f483c0c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483c0c8930 con 0x7f483c13ecb0 2023-10-06T05:30:48.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c0688a0 con 0x7f483c06dde0 2023-10-06T05:30:48.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0c7d20 con 0x7f483c13f080 2023-10-06T05:30:48.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4842176700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f483c13ecb0 0x7f483c06d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41114/0 (socket says 172.21.15.29:41114) 2023-10-06T05:30:48.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4842977700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f483c06dde0 0x7f483c0c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4842176700 1 -- 172.21.15.29:0/2145378304 learned_addr learned my addr 172.21.15.29:0/2145378304 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4841975700 1 --2- 172.21.15.29:0/2145378304 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c13f080 0x7f483c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4842977700 1 -- 172.21.15.29:0/2145378304 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c13f080 msgr2=0x7f483c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4842977700 1 --2- 172.21.15.29:0/2145378304 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c13f080 0x7f483c159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4842977700 1 -- 172.21.15.29:0/2145378304 >> v1:172.21.15.29:6789/0 conn(0x7f483c13ecb0 legacy=0x7f483c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4841174700 1 -- 172.21.15.29:0/2145378304 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490969196 0 0) 0x7f483c0c8930 con 0x7f483c13ecb0 2023-10-06T05:30:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4842977700 1 -- 172.21.15.29:0/2145378304 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0c8000 con 0x7f483c06dde0 2023-10-06T05:30:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4842977700 1 --2- 172.21.15.29:0/2145378304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06dde0 0x7f483c0c9f50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4834009e60 tx=0x7f4834009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72042360134e16f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:48.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4841174700 1 -- 172.21.15.29:0/2145378304 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483400e070 con 0x7f483c06dde0 2023-10-06T05:30:48.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4841174700 1 -- 172.21.15.29:0/2145378304 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483400bc30 con 0x7f483c06dde0 2023-10-06T05:30:48.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4841174700 1 -- 172.21.15.29:0/2145378304 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834012430 con 0x7f483c06dde0 2023-10-06T05:30:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 -- 172.21.15.29:0/2145378304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06dde0 msgr2=0x7f483c0c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 --2- 172.21.15.29:0/2145378304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06dde0 0x7f483c0c9f50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4834009e60 tx=0x7f4834009780 comp rx=0 tx=0).stop 2023-10-06T05:30:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 -- 172.21.15.29:0/2145378304 shutdown_connections 2023-10-06T05:30:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 --2- 172.21.15.29:0/2145378304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c06dde0 0x7f483c0c9f50 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 --2- 172.21.15.29:0/2145378304 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c13f080 0x7f483c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 -- 172.21.15.29:0/2145378304 >> 172.21.15.29:0/2145378304 conn(0x7f483c0c9830 msgr2=0x7f483c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 -- 172.21.15.29:0/2145378304 shutdown_connections 2023-10-06T05:30:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.491+0000 7f4843178700 1 -- 172.21.15.29:0/2145378304 wait complete. 2023-10-06T05:30:48.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.495+0000 7f4843178700 1 Processor -- start 2023-10-06T05:30:48.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.495+0000 7f4843178700 1 -- start start 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4843178700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c06dde0 0x7f483c0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4843178700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f483c13ecb0 0x7f483c137af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4843178700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c13f080 0x7f483c13b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4843178700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0c5340 con 0x7f483c13f080 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4843178700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0c4d20 con 0x7f483c13ecb0 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4843178700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0b1870 con 0x7f483c06dde0 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842977700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c13f080 0x7f483c13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842977700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c13f080 0x7f483c13b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49872/0 (socket says 172.21.15.29:49872) 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842977700 1 -- 172.21.15.29:0/622929412 learned_addr learned my addr 172.21.15.29:0/622929412 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842176700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c06dde0 0x7f483c0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4841975700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f483c13ecb0 0x7f483c137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842977700 1 -- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c06dde0 msgr2=0x7f483c0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842977700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c06dde0 0x7f483c0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842977700 1 -- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f483c13ecb0 msgr2=0x7f483c137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842977700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f483c13ecb0 0x7f483c137af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842977700 1 -- 172.21.15.29:0/622929412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4834009a20 con 0x7f483c13f080 2023-10-06T05:30:48.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4842977700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c13f080 0x7f483c13b430 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4834013000 tx=0x7f4834019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:48.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f48327fc700 1 -- 172.21.15.29:0/622929412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834012e70 con 0x7f483c13f080 2023-10-06T05:30:48.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f48327fc700 1 -- 172.21.15.29:0/622929412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483401d630 con 0x7f483c13f080 2023-10-06T05:30:48.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c0b1b50 con 0x7f483c13f080 2023-10-06T05:30:48.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.499+0000 7f48327fc700 1 -- 172.21.15.29:0/622929412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483401d9d0 con 0x7f483c13f080 2023-10-06T05:30:48.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.503+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c0c4fd0 con 0x7f483c13f080 2023-10-06T05:30:48.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.503+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c0c54f0 con 0x7f483c13f080 2023-10-06T05:30:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.503+0000 7f48327fc700 1 -- 172.21.15.29:0/622929412 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4834024070 con 0x7f483c13f080 2023-10-06T05:30:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.503+0000 7f48327fc700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4820060550 0x7f4820062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.503+0000 7f48327fc700 1 -- 172.21.15.29:0/622929412 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f483407f260 con 0x7f483c13f080 2023-10-06T05:30:48.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.503+0000 7f4842176700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4820060550 0x7f4820062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.507+0000 7f4842176700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4820060550 0x7f4820062a00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4838007fd0 tx=0x7f4838007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:48.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.515+0000 7f48327fc700 1 -- 172.21.15.29:0/622929412 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f483c0c54f0 con 0x7f483c13f080 2023-10-06T05:30:48.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.675+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f483c0c54f0 con 0x7f483c13f080 2023-10-06T05:30:48.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.675+0000 7f48327fc700 1 -- 172.21.15.29:0/622929412 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f483c0c54f0 con 0x7f483c13f080 2023-10-06T05:30:48.683 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-06T05:30:48.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4820060550 msgr2=0x7f4820062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4820060550 0x7f4820062a00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4838007fd0 tx=0x7f4838007d30 comp rx=0 tx=0).stop 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c13f080 msgr2=0x7f483c13b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c13f080 0x7f483c13b430 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4834013000 tx=0x7f4834019000 comp rx=0 tx=0).stop 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 shutdown_connections 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f483c13f080 0x7f483c13b430 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4820060550 0x7f4820062a00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f483c13ecb0 0x7f483c137af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 --2- 172.21.15.29:0/622929412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c06dde0 0x7f483c0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 >> 172.21.15.29:0/622929412 conn(0x7f483c0c9830 msgr2=0x7f483c06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 shutdown_connections 2023-10-06T05:30:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.679+0000 7f4843178700 1 -- 172.21.15.29:0/622929412 wait complete. 2023-10-06T05:30:48.699 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T05:30:48.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.803+0000 7f6a6a2f9700 1 Processor -- start 2023-10-06T05:30:48.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.803+0000 7f6a6a2f9700 1 -- start start 2023-10-06T05:30:48.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 0x7f6a640c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a64155da0 0x7f6a640c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a641596e0 con 0x7f6a640cae80 2023-10-06T05:30:48.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6415a520 con 0x7f6a64155da0 2023-10-06T05:30:48.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640ae800 con 0x7f6a641559d0 2023-10-06T05:30:48.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a68af6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a64155da0 0x7f6a640c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a69af8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6a640cae80 0x7f6a640c95d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41128/0 (socket says 172.21.15.29:41128) 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a68af6700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a64155da0 0x7f6a640c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49878/0 (socket says 172.21.15.29:49878) 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a69af8700 1 -- 172.21.15.29:0/498801728 learned_addr learned my addr 172.21.15.29:0/498801728 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a692f7700 1 --2- 172.21.15.29:0/498801728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 0x7f6a640c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a68af6700 1 -- 172.21.15.29:0/498801728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 msgr2=0x7f6a640c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a68af6700 1 --2- 172.21.15.29:0/498801728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 0x7f6a640c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a68af6700 1 -- 172.21.15.29:0/498801728 >> v1:172.21.15.29:6789/0 conn(0x7f6a640cae80 legacy=0x7f6a640c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a68af6700 1 -- 172.21.15.29:0/498801728 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a64159910 con 0x7f6a64155da0 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a5bfff700 1 -- 172.21.15.29:0/498801728 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738269517 0 0) 0x7f6a641596e0 con 0x7f6a640cae80 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a68af6700 1 --2- 172.21.15.29:0/498801728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a64155da0 0x7f6a640c89b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f6a600098e0 tx=0x7f6a600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa4aaa408ee00c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a5bfff700 1 -- 172.21.15.29:0/498801728 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000b640 con 0x7f6a64155da0 2023-10-06T05:30:48.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a5bfff700 1 -- 172.21.15.29:0/498801728 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6000b7a0 con 0x7f6a64155da0 2023-10-06T05:30:48.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a5bfff700 1 -- 172.21.15.29:0/498801728 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000bb40 con 0x7f6a64155da0 2023-10-06T05:30:48.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/498801728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a64155da0 msgr2=0x7f6a640c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 --2- 172.21.15.29:0/498801728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a64155da0 0x7f6a640c89b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f6a600098e0 tx=0x7f6a600091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/498801728 shutdown_connections 2023-10-06T05:30:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 --2- 172.21.15.29:0/498801728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a64155da0 0x7f6a640c89b0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 --2- 172.21.15.29:0/498801728 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 0x7f6a640c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/498801728 >> 172.21.15.29:0/498801728 conn(0x7f6a6406c6c0 msgr2=0x7f6a6406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/498801728 shutdown_connections 2023-10-06T05:30:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.807+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/498801728 wait complete. 2023-10-06T05:30:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a6a2f9700 1 Processor -- start 2023-10-06T05:30:48.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a6a2f9700 1 -- start start 2023-10-06T05:30:48.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a6a2f9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a640cae80 0x7f6a640af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a6a2f9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 0x7f6a64145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a6a2f9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a64155da0 0x7f6a64168f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a6a2f9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641537e0 con 0x7f6a640cae80 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a6a2f9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640af910 con 0x7f6a64155da0 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a6a2f9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640afb90 con 0x7f6a641559d0 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a692f7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a640cae80 0x7f6a640af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a692f7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a640cae80 0x7f6a640af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49880/0 (socket says 172.21.15.29:49880) 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a692f7700 1 -- 172.21.15.29:0/2102687300 learned_addr learned my addr 172.21.15.29:0/2102687300 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a69af8700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a64155da0 0x7f6a64168f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a68af6700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 0x7f6a64145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a692f7700 1 -- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 msgr2=0x7f6a64145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a692f7700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 0x7f6a64145370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a692f7700 1 -- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a64155da0 msgr2=0x7f6a64168f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a692f7700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a64155da0 0x7f6a64168f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a692f7700 1 -- 172.21.15.29:0/2102687300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60009420 con 0x7f6a640cae80 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.811+0000 7f6a692f7700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a640cae80 0x7f6a640af3d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400ecb0 tx=0x7f6a540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a597fa700 1 -- 172.21.15.29:0/2102687300 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400c9d0 con 0x7f6a640cae80 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a597fa700 1 -- 172.21.15.29:0/2102687300 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5400cb30 con 0x7f6a640cae80 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a640afe70 con 0x7f6a640cae80 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a597fa700 1 -- 172.21.15.29:0/2102687300 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400ced0 con 0x7f6a640cae80 2023-10-06T05:30:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a64153420 con 0x7f6a640cae80 2023-10-06T05:30:48.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6404be00 con 0x7f6a640cae80 2023-10-06T05:30:48.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a597fa700 1 -- 172.21.15.29:0/2102687300 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6a54013680 con 0x7f6a640cae80 2023-10-06T05:30:48.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a597fa700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a48060550 0x7f6a48062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a597fa700 1 -- 172.21.15.29:0/2102687300 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f6a5407ce30 con 0x7f6a640cae80 2023-10-06T05:30:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.815+0000 7f6a68af6700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a48060550 0x7f6a48062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.819+0000 7f6a68af6700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a48060550 0x7f6a48062a00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6a600093f0 tx=0x7f6a60017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:48.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.823+0000 7f6a597fa700 1 -- 172.21.15.29:0/2102687300 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6a5404d170 con 0x7f6a640cae80 2023-10-06T05:30:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.979+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a64159bf0 con 0x7f6a640cae80 2023-10-06T05:30:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.979+0000 7f6a597fa700 1 -- 172.21.15.29:0/2102687300 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a54050790 con 0x7f6a640cae80 2023-10-06T05:30:48.987 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-06T05:30:48.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a48060550 msgr2=0x7f6a48062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a48060550 0x7f6a48062a00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6a600093f0 tx=0x7f6a60017000 comp rx=0 tx=0).stop 2023-10-06T05:30:48.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a640cae80 msgr2=0x7f6a640af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:48.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a640cae80 0x7f6a640af3d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400ecb0 tx=0x7f6a540091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 shutdown_connections 2023-10-06T05:30:48.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6a48060550 0x7f6a48062a00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a64155da0 0x7f6a64168f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a641559d0 0x7f6a64145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 --2- 172.21.15.29:0/2102687300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a640cae80 0x7f6a640af3d0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:48.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 >> 172.21.15.29:0/2102687300 conn(0x7f6a6406c6c0 msgr2=0x7f6a640c8400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:48.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 shutdown_connections 2023-10-06T05:30:48.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:48.983+0000 7f6a6a2f9700 1 -- 172.21.15.29:0/2102687300 wait complete. 2023-10-06T05:30:49.001 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.103+0000 7f4c9b1cc700 1 Processor -- start 2023-10-06T05:30:49.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.103+0000 7f4c9b1cc700 1 -- start start 2023-10-06T05:30:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c941569f0 0x7f4c940c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c940cdb00 0x7f4c940cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940c9490 con 0x7f4c94156dc0 2023-10-06T05:30:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940c8950 con 0x7f4c941569f0 2023-10-06T05:30:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940ce490 con 0x7f4c940cdb00 2023-10-06T05:30:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9a1ca700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c941569f0 0x7f4c940c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9a1ca700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c941569f0 0x7f4c940c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49892/0 (socket says 172.21.15.29:49892) 2023-10-06T05:30:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9a1ca700 1 -- 172.21.15.29:0/1037566524 learned_addr learned my addr 172.21.15.29:0/1037566524 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:49.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9a9cb700 1 --2- 172.21.15.29:0/1037566524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c940cdb00 0x7f4c940cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9a1ca700 1 -- 172.21.15.29:0/1037566524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c940cdb00 msgr2=0x7f4c940cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:49.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9a1ca700 1 --2- 172.21.15.29:0/1037566524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c940cdb00 0x7f4c940cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c991c8700 1 -- 172.21.15.29:0/1037566524 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260765814 0 0) 0x7f4c940c9490 con 0x7f4c94156dc0 2023-10-06T05:30:49.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9a1ca700 1 -- 172.21.15.29:0/1037566524 >> v1:172.21.15.173:6789/0 conn(0x7f4c94156dc0 legacy=0x7f4c940caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9a1ca700 1 -- 172.21.15.29:0/1037566524 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940c9e60 con 0x7f4c941569f0 2023-10-06T05:30:49.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9a1ca700 1 --2- 172.21.15.29:0/1037566524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c941569f0 0x7f4c940c9920 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4c900099b0 tx=0x7f4c90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c0659415986ca4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:49.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c991c8700 1 -- 172.21.15.29:0/1037566524 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90009ea0 con 0x7f4c941569f0 2023-10-06T05:30:49.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c991c8700 1 -- 172.21.15.29:0/1037566524 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000b8f0 con 0x7f4c941569f0 2023-10-06T05:30:49.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c991c8700 1 -- 172.21.15.29:0/1037566524 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000bc90 con 0x7f4c941569f0 2023-10-06T05:30:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/1037566524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c941569f0 msgr2=0x7f4c940c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 --2- 172.21.15.29:0/1037566524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c941569f0 0x7f4c940c9920 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4c900099b0 tx=0x7f4c90009250 comp rx=0 tx=0).stop 2023-10-06T05:30:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/1037566524 shutdown_connections 2023-10-06T05:30:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 --2- 172.21.15.29:0/1037566524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c940cdb00 0x7f4c940cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 --2- 172.21.15.29:0/1037566524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c941569f0 0x7f4c940c9920 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/1037566524 >> 172.21.15.29:0/1037566524 conn(0x7f4c940692b0 msgr2=0x7f4c94069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/1037566524 shutdown_connections 2023-10-06T05:30:49.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.107+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/1037566524 wait complete. 2023-10-06T05:30:49.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9b1cc700 1 Processor -- start 2023-10-06T05:30:49.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9b1cc700 1 -- start start 2023-10-06T05:30:49.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9b1cc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c940cdb00 0x7f4c94156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9b1cc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c94156dc0 0x7f4c940c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9b1cc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c940c2dc0 0x7f4c9415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9b1cc700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940c3260 con 0x7f4c940cdb00 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9b1cc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940c7cf0 con 0x7f4c940c2dc0 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9b1cc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940c4060 con 0x7f4c94156dc0 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9a1ca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c940cdb00 0x7f4c94156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9a1ca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c940cdb00 0x7f4c94156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49904/0 (socket says 172.21.15.29:49904) 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9a1ca700 1 -- 172.21.15.29:0/712365087 learned_addr learned my addr 172.21.15.29:0/712365087 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c999c9700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c94156dc0 0x7f4c940c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9a9cb700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c940c2dc0 0x7f4c9415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9a1ca700 1 -- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c94156dc0 msgr2=0x7f4c940c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9a1ca700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c94156dc0 0x7f4c940c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9a1ca700 1 -- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c940c2dc0 msgr2=0x7f4c9415cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9a1ca700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c940c2dc0 0x7f4c9415cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.111+0000 7f4c9a1ca700 1 -- 172.21.15.29:0/712365087 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900094f0 con 0x7f4c940cdb00 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.115+0000 7f4c9a1ca700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c940cdb00 0x7f4c94156320 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4c9406eb00 tx=0x7f4c90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.115+0000 7f4c867fc700 1 -- 172.21.15.29:0/712365087 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000ba60 con 0x7f4c940cdb00 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.115+0000 7f4c867fc700 1 -- 172.21.15.29:0/712365087 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000bbc0 con 0x7f4c940cdb00 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.115+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c940c3450 con 0x7f4c940cdb00 2023-10-06T05:30:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.115+0000 7f4c867fc700 1 -- 172.21.15.29:0/712365087 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90011670 con 0x7f4c940cdb00 2023-10-06T05:30:49.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.115+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c940c3a10 con 0x7f4c940cdb00 2023-10-06T05:30:49.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.115+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9404be00 con 0x7f4c940cdb00 2023-10-06T05:30:49.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.115+0000 7f4c867fc700 1 -- 172.21.15.29:0/712365087 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4c900119e0 con 0x7f4c940cdb00 2023-10-06T05:30:49.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.119+0000 7f4c867fc700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c78060550 0x7f4c78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.119+0000 7f4c867fc700 1 -- 172.21.15.29:0/712365087 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f4c9007e250 con 0x7f4c940cdb00 2023-10-06T05:30:49.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.119+0000 7f4c999c9700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c78060550 0x7f4c78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.119+0000 7f4c999c9700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c78060550 0x7f4c78062a00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4c9416a2a0 tx=0x7f4c88001640 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:49.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.123+0000 7f4c867fc700 1 -- 172.21.15.29:0/712365087 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c9004e630 con 0x7f4c940cdb00 2023-10-06T05:30:49.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c940c8b60 con 0x7f4c940cdb00 2023-10-06T05:30:49.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c867fc700 1 -- 172.21.15.29:0/712365087 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f4c90051c50 con 0x7f4c940cdb00 2023-10-06T05:30:49.334 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:49.334 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:40.875741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/1984531371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1984531371},{"type":"v1","addr":"172.21.15.29:6835","nonce":1984531371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c78060550 msgr2=0x7f4c78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c78060550 0x7f4c78062a00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4c9416a2a0 tx=0x7f4c88001640 comp rx=0 tx=0).stop 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c940cdb00 msgr2=0x7f4c94156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c940cdb00 0x7f4c94156320 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4c9406eb00 tx=0x7f4c90017000 comp rx=0 tx=0).stop 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 shutdown_connections 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4c78060550 0x7f4c78062a00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c940c2dc0 0x7f4c9415cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c94156dc0 0x7f4c940c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 --2- 172.21.15.29:0/712365087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c940cdb00 0x7f4c94156320 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.327+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 >> 172.21.15.29:0/712365087 conn(0x7f4c940692b0 msgr2=0x7f4c940ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:49.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.331+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 shutdown_connections 2023-10-06T05:30:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.331+0000 7f4c9b1cc700 1 -- 172.21.15.29:0/712365087 wait complete. 2023-10-06T05:30:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 54 2023-10-06T05:30:49.349 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:30:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.447+0000 7f0c0083b700 1 Processor -- start 2023-10-06T05:30:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.447+0000 7f0c0083b700 1 -- start start 2023-10-06T05:30:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0bfc0c6540 0x7f0bfc0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc0c2980 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc0ca630 con 0x7f0bfc1605e0 2023-10-06T05:30:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc0c69c0 con 0x7f0bfc0c6540 2023-10-06T05:30:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bf3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0bfc0c6540 0x7f0bfc0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bf3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0bfc0c6540 0x7f0bfc0c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49920/0 (socket says 172.21.15.29:49920) 2023-10-06T05:30:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bf3fff700 1 -- 172.21.15.29:0/1313583138 learned_addr learned my addr 172.21.15.29:0/1313583138 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bf3fff700 1 -- 172.21.15.29:0/1313583138 >> v1:172.21.15.173:6789/0 conn(0x7f0bfc1605e0 legacy=0x7f0bfc06b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bf3fff700 1 -- 172.21.15.29:0/1313583138 >> v1:172.21.15.29:6789/0 conn(0x7f0bfc0ca1f0 legacy=0x7f0bfc0c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bf3fff700 1 -- 172.21.15.29:0/1313583138 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc0c6bb0 con 0x7f0bfc0c6540 2023-10-06T05:30:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bf3fff700 1 --2- 172.21.15.29:0/1313583138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc0c6540 0x7f0bfc0c9cb0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0be40099b0 tx=0x7f0be4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5632bc78e2e5b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bfa59c700 1 -- 172.21.15.29:0/1313583138 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400b860 con 0x7f0bfc0c6540 2023-10-06T05:30:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bfa59c700 1 -- 172.21.15.29:0/1313583138 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400b9c0 con 0x7f0bfc0c6540 2023-10-06T05:30:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0bfa59c700 1 -- 172.21.15.29:0/1313583138 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400bd60 con 0x7f0bfc0c6540 2023-10-06T05:30:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 -- 172.21.15.29:0/1313583138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc0c6540 msgr2=0x7f0bfc0c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 --2- 172.21.15.29:0/1313583138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc0c6540 0x7f0bfc0c9cb0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0be40099b0 tx=0x7f0be4009250 comp rx=0 tx=0).stop 2023-10-06T05:30:49.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 -- 172.21.15.29:0/1313583138 shutdown_connections 2023-10-06T05:30:49.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 --2- 172.21.15.29:0/1313583138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc0c6540 0x7f0bfc0c9cb0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 -- 172.21.15.29:0/1313583138 >> 172.21.15.29:0/1313583138 conn(0x7f0bfc0670a0 msgr2=0x7f0bfc0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:49.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 -- 172.21.15.29:0/1313583138 shutdown_connections 2023-10-06T05:30:49.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.451+0000 7f0c0083b700 1 -- 172.21.15.29:0/1313583138 wait complete. 2023-10-06T05:30:49.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.455+0000 7f0c0083b700 1 Processor -- start 2023-10-06T05:30:49.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.455+0000 7f0c0083b700 1 -- start start 2023-10-06T05:30:49.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.455+0000 7f0c0083b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc0c6540 0x7f0bfc155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.455+0000 7f0c0083b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bfc0ca1f0 0x7f0bfc0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.455+0000 7f0c0083b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc1605e0 0x7f0bfc0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.455+0000 7f0c0083b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc153790 con 0x7f0bfc1605e0 2023-10-06T05:30:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.455+0000 7f0c0083b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc0af7f0 con 0x7f0bfc0c6540 2023-10-06T05:30:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.455+0000 7f0c0083b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc155a50 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.455+0000 7f0bfb59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc1605e0 0x7f0bfc0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bfb59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc1605e0 0x7f0bfc0c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49936/0 (socket says 172.21.15.29:49936) 2023-10-06T05:30:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bfb59e700 1 -- 172.21.15.29:0/1995475186 learned_addr learned my addr 172.21.15.29:0/1995475186 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bfad9d700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc0c6540 0x7f0bfc155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf3fff700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bfc0ca1f0 0x7f0bfc0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf3fff700 1 -- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc0c6540 msgr2=0x7f0bfc155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf3fff700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc0c6540 0x7f0bfc155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf3fff700 1 -- 172.21.15.29:0/1995475186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc1605e0 msgr2=0x7f0bfc0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf3fff700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc1605e0 0x7f0bfc0c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf3fff700 1 -- 172.21.15.29:0/1995475186 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40094f0 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bfb59e700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc1605e0 0x7f0bfc0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf3fff700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bfc0ca1f0 0x7f0bfc0c4430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0caf40 tx=0x7f0be4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf2ffd700 1 -- 172.21.15.29:0/1995475186 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4024440 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf2ffd700 1 -- 172.21.15.29:0/1995475186 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be40245a0 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc0aebe0 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf2ffd700 1 -- 172.21.15.29:0/1995475186 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4024920 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc0af1a0 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bfc0af960 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.459+0000 7f0bf2ffd700 1 -- 172.21.15.29:0/1995475186 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0be4024d50 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.463+0000 7f0bf2ffd700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0bdc060550 0x7f0bdc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.463+0000 7f0bf2ffd700 1 -- 172.21.15.29:0/1995475186 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f0be407ebb0 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.463+0000 7f0bfad9d700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0bdc060550 0x7f0bdc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.463+0000 7f0bfad9d700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0bdc060550 0x7f0bdc062a00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0039e0 tx=0x7f0bec007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.471+0000 7f0bf2ffd700 1 -- 172.21.15.29:0/1995475186 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0be404ef70 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.639+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bfc04be00 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0bf2ffd700 1 -- 172.21.15.29:0/1995475186 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17126 (secure 0 0 0) 0x7f0be4052590 con 0x7f0bfc0ca1f0 2023-10-06T05:30:49.650 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:49.650 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":79,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:30:35.833868+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:29:51.644444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T05:29:52.853119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6834/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6835/3515782118":"2023-10-07T05:30:18.733272+0000","172.21.15.29:6834/3515782118":"2023-10-07T05:30:18.733272+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:30:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0bdc060550 msgr2=0x7f0bdc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0bdc060550 0x7f0bdc062a00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0039e0 tx=0x7f0bec007ec0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bfc0ca1f0 msgr2=0x7f0bfc0c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bfc0ca1f0 0x7f0bfc0c4430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0caf40 tx=0x7f0be4017000 comp rx=0 tx=0).stop 2023-10-06T05:30:49.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 shutdown_connections 2023-10-06T05:30:49.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bfc1605e0 0x7f0bfc0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0bfc0ca1f0 0x7f0bfc0c4430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0bdc060550 0x7f0bdc062a00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 --2- 172.21.15.29:0/1995475186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc0c6540 0x7f0bfc155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 >> 172.21.15.29:0/1995475186 conn(0x7f0bfc0670a0 msgr2=0x7f0bfc15e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:49.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 shutdown_connections 2023-10-06T05:30:49.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.643+0000 7f0c0083b700 1 -- 172.21.15.29:0/1995475186 wait complete. 2023-10-06T05:30:49.664 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T05:30:49.665 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.759+0000 7f823132b700 1 Processor -- start 2023-10-06T05:30:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.759+0000 7f823132b700 1 -- start start 2023-10-06T05:30:49.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f823132b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f822c14ffd0 0x7f822c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f823132b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c0b1340 0x7f822c06dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f823132b700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822c156cb0 con 0x7f822c1503a0 2023-10-06T05:30:49.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f823132b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822c0ae750 con 0x7f822c14ffd0 2023-10-06T05:30:49.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f823132b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c156170 con 0x7f822c0b1340 2023-10-06T05:30:49.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f822c14ffd0 0x7f822c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f822c14ffd0 0x7f822c06d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49946/0 (socket says 172.21.15.29:49946) 2023-10-06T05:30:49.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822affd700 1 -- 172.21.15.29:0/2669252396 learned_addr learned my addr 172.21.15.29:0/2669252396 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:49.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822b7fe700 1 --2- 172.21.15.29:0/2669252396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c0b1340 0x7f822c06dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822affd700 1 -- 172.21.15.29:0/2669252396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c0b1340 msgr2=0x7f822c06dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822affd700 1 --2- 172.21.15.29:0/2669252396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c0b1340 0x7f822c06dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822affd700 1 -- 172.21.15.29:0/2669252396 >> v1:172.21.15.173:6789/0 conn(0x7f822c1503a0 legacy=0x7f822c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822affd700 1 -- 172.21.15.29:0/2669252396 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c0af150 con 0x7f822c14ffd0 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822b7fe700 1 --2- 172.21.15.29:0/2669252396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c0b1340 0x7f822c06dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f822affd700 1 --2- 172.21.15.29:0/2669252396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 0x7f822c06d6d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f821c0099b0 tx=0x7f821c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e895bcb7de6e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f8229ffb700 1 -- 172.21.15.29:0/2669252396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c00b860 con 0x7f822c14ffd0 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f8229ffb700 1 -- 172.21.15.29:0/2669252396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c00b9c0 con 0x7f822c14ffd0 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.763+0000 7f8229ffb700 1 -- 172.21.15.29:0/2669252396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c00bd60 con 0x7f822c14ffd0 2023-10-06T05:30:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 -- 172.21.15.29:0/2669252396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 msgr2=0x7f822c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 --2- 172.21.15.29:0/2669252396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 0x7f822c06d6d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f821c0099b0 tx=0x7f821c009250 comp rx=0 tx=0).stop 2023-10-06T05:30:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 -- 172.21.15.29:0/2669252396 shutdown_connections 2023-10-06T05:30:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 --2- 172.21.15.29:0/2669252396 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c0b1340 0x7f822c06dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 --2- 172.21.15.29:0/2669252396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 0x7f822c06d6d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 -- 172.21.15.29:0/2669252396 >> 172.21.15.29:0/2669252396 conn(0x7f822c06b770 msgr2=0x7f822c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 -- 172.21.15.29:0/2669252396 shutdown_connections 2023-10-06T05:30:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 -- 172.21.15.29:0/2669252396 wait complete. 2023-10-06T05:30:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 Processor -- start 2023-10-06T05:30:49.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 -- start start 2023-10-06T05:30:49.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822c0b1340 0x7f822c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 0x7f822c1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c1503a0 0x7f822c168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c150820 con 0x7f822c14ffd0 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c1513a0 con 0x7f822c0b1340 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f823132b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c150a70 con 0x7f822c1503a0 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 0x7f822c1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822b7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c1503a0 0x7f822c168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 0x7f822c1534e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49956/0 (socket says 172.21.15.29:49956) 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822a7fc700 1 -- 172.21.15.29:0/259780906 learned_addr learned my addr 172.21.15.29:0/259780906 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822affd700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822c0b1340 0x7f822c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822a7fc700 1 -- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c1503a0 msgr2=0x7f822c168720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822a7fc700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c1503a0 0x7f822c168720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822a7fc700 1 -- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822c0b1340 msgr2=0x7f822c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822a7fc700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822c0b1340 0x7f822c152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.767+0000 7f822a7fc700 1 -- 172.21.15.29:0/259780906 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0094f0 con 0x7f822c14ffd0 2023-10-06T05:30:49.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f822a7fc700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 0x7f822c1534e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f822000c590 tx=0x7f822000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:49.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f8212ffd700 1 -- 172.21.15.29:0/259780906 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220011590 con 0x7f822c14ffd0 2023-10-06T05:30:49.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f8212ffd700 1 -- 172.21.15.29:0/259780906 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8220011710 con 0x7f822c14ffd0 2023-10-06T05:30:49.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c150d50 con 0x7f822c14ffd0 2023-10-06T05:30:49.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c168c60 con 0x7f822c14ffd0 2023-10-06T05:30:49.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f8212ffd700 1 -- 172.21.15.29:0/259780906 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220011ad0 con 0x7f822c14ffd0 2023-10-06T05:30:49.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822c151510 con 0x7f822c14ffd0 2023-10-06T05:30:49.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f8212ffd700 1 -- 172.21.15.29:0/259780906 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f822001b3b0 con 0x7f822c14ffd0 2023-10-06T05:30:49.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f8212ffd700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060580 0x7f8218062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:49.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f8212ffd700 1 -- 172.21.15.29:0/259780906 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f822007bec0 con 0x7f822c14ffd0 2023-10-06T05:30:49.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.771+0000 7f822affd700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060580 0x7f8218062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:49.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.775+0000 7f822affd700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060580 0x7f8218062a30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f821c0099b0 tx=0x7f821c019000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:49.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.779+0000 7f8212ffd700 1 -- 172.21.15.29:0/259780906 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f822004c200 con 0x7f822c14ffd0 2023-10-06T05:30:49.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.979+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f822c04be00 con 0x7f822c14ffd0 2023-10-06T05:30:49.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f8212ffd700 1 -- 172.21.15.29:0/259780906 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f822004f820 con 0x7f822c14ffd0 2023-10-06T05:30:49.989 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:49.989 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:40.875741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/1984531371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1984531371},{"type":"v1","addr":"172.21.15.29:6835","nonce":1984531371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:49.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060580 msgr2=0x7f8218062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060580 0x7f8218062a30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f821c0099b0 tx=0x7f821c019000 comp rx=0 tx=0).stop 2023-10-06T05:30:49.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 msgr2=0x7f822c1534e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:49.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 0x7f822c1534e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f822000c590 tx=0x7f822000c8a0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 shutdown_connections 2023-10-06T05:30:49.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f822c1503a0 0x7f822c168720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f822c14ffd0 0x7f822c1534e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8218060580 0x7f8218062a30 secure :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f821c0099b0 tx=0x7f821c019000 comp rx=0 tx=0).stop 2023-10-06T05:30:49.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 --2- 172.21.15.29:0/259780906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f822c0b1340 0x7f822c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:49.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 >> 172.21.15.29:0/259780906 conn(0x7f822c06b770 msgr2=0x7f822c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:49.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 shutdown_connections 2023-10-06T05:30:49.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:49.983+0000 7f823132b700 1 -- 172.21.15.29:0/259780906 wait complete. 2023-10-06T05:30:49.993 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 54 2023-10-06T05:30:50.002 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:30:50.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbdf59e700 1 Processor -- start 2023-10-06T05:30:50.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbdf59e700 1 -- start start 2023-10-06T05:30:50.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbdf59e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbbe00cc9a0 0x7fbbe00ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbdf59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe0158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbdf59e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe00cb5f0 con 0x7fbbe00ca870 2023-10-06T05:30:50.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbdf59e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe00cb400 con 0x7fbbe00cc9a0 2023-10-06T05:30:50.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbdf59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00cb8d0 con 0x7fbbe0158870 2023-10-06T05:30:50.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbddd9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe0158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbddd9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe0158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:52444/0 (socket says 172.21.15.29:52444) 2023-10-06T05:30:50.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbddd9b700 1 -- 172.21.15.29:0/4272299966 learned_addr learned my addr 172.21.15.29:0/4272299966 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:50.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbde59c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbbe00cc9a0 0x7fbbe00ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbdd59a700 1 -- 172.21.15.29:0/4272299966 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424394987 0 0) 0x7fbbe00cb5f0 con 0x7fbbe00ca870 2023-10-06T05:30:50.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbddd9b700 1 -- 172.21.15.29:0/4272299966 >> v2:172.21.15.173:3300/0 conn(0x7fbbe00cc9a0 msgr2=0x7fbbe00ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:50.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbddd9b700 1 --2- 172.21.15.29:0/4272299966 >> v2:172.21.15.173:3300/0 conn(0x7fbbe00cc9a0 0x7fbbe00ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbddd9b700 1 -- 172.21.15.29:0/4272299966 >> v1:172.21.15.173:6789/0 conn(0x7fbbe00ca870 legacy=0x7fbbe00cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbddd9b700 1 -- 172.21.15.29:0/4272299966 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00cbbb0 con 0x7fbbe0158870 2023-10-06T05:30:50.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.103+0000 7fbbddd9b700 1 --2- 172.21.15.29:0/4272299966 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe0158cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80099b0 tx=0x7fbbc8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3cdf5577e180b21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:50.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdd59a700 1 -- 172.21.15.29:0/4272299966 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8009ea0 con 0x7fbbe0158870 2023-10-06T05:30:50.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdd59a700 1 -- 172.21.15.29:0/4272299966 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc800b860 con 0x7fbbe0158870 2023-10-06T05:30:50.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdd59a700 1 -- 172.21.15.29:0/4272299966 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800bc00 con 0x7fbbe0158870 2023-10-06T05:30:50.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdf59e700 1 -- 172.21.15.29:0/4272299966 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 msgr2=0x7fbbe0158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdf59e700 1 --2- 172.21.15.29:0/4272299966 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe0158cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80099b0 tx=0x7fbbc8009250 comp rx=0 tx=0).stop 2023-10-06T05:30:50.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdf59e700 1 -- 172.21.15.29:0/4272299966 shutdown_connections 2023-10-06T05:30:50.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdf59e700 1 --2- 172.21.15.29:0/4272299966 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe0158cc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdf59e700 1 --2- 172.21.15.29:0/4272299966 >> v2:172.21.15.173:3300/0 conn(0x7fbbe00cc9a0 0x7fbbe00ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdf59e700 1 -- 172.21.15.29:0/4272299966 >> 172.21.15.29:0/4272299966 conn(0x7fbbe0067b30 msgr2=0x7fbbe006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:50.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdf59e700 1 -- 172.21.15.29:0/4272299966 shutdown_connections 2023-10-06T05:30:50.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.107+0000 7fbbdf59e700 1 -- 172.21.15.29:0/4272299966 wait complete. 2023-10-06T05:30:50.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbdf59e700 1 Processor -- start 2023-10-06T05:30:50.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbdf59e700 1 -- start start 2023-10-06T05:30:50.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbdf59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbe00ca870 0x7fbbe0142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbdf59e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbe00cc9a0 0x7fbbe0159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbdf59e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe00c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbdf59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe0142880 con 0x7fbbe00ca870 2023-10-06T05:30:50.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbdf59e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe015a220 con 0x7fbbe00cc9a0 2023-10-06T05:30:50.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbdf59e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe015c390 con 0x7fbbe0158870 2023-10-06T05:30:50.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbde59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbe00ca870 0x7fbbe0142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbde59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbe00ca870 0x7fbbe0142340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49970/0 (socket says 172.21.15.29:49970) 2023-10-06T05:30:50.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbde59c700 1 -- 172.21.15.29:0/2268695218 learned_addr learned my addr 172.21.15.29:0/2268695218 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:50.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbddd9b700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbe00cc9a0 0x7fbbe0159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbded9d700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe00c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbde59c700 1 -- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 msgr2=0x7fbbe00c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbde59c700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe00c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbde59c700 1 -- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbe00cc9a0 msgr2=0x7fbbe0159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbde59c700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbe00cc9a0 0x7fbbe0159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbde59c700 1 -- 172.21.15.29:0/2268695218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80094f0 con 0x7fbbe00ca870 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbddd9b700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbe00cc9a0 0x7fbbe0159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbde59c700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbe00ca870 0x7fbbe0142340 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000ec80 tx=0x7fbbd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbd67fc700 1 -- 172.21.15.29:0/2268695218 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000c850 con 0x7fbbe00ca870 2023-10-06T05:30:50.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbd67fc700 1 -- 172.21.15.29:0/2268695218 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd000c9b0 con 0x7fbbe00ca870 2023-10-06T05:30:50.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe015c670 con 0x7fbbe00ca870 2023-10-06T05:30:50.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.111+0000 7fbbd67fc700 1 -- 172.21.15.29:0/2268695218 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000cd50 con 0x7fbbe00ca870 2023-10-06T05:30:50.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.115+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe015cc30 con 0x7fbbe00ca870 2023-10-06T05:30:50.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.115+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe004be00 con 0x7fbbe00ca870 2023-10-06T05:30:50.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.115+0000 7fbbd67fc700 1 -- 172.21.15.29:0/2268695218 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbbd0013680 con 0x7fbbe00ca870 2023-10-06T05:30:50.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.115+0000 7fbbd67fc700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbbc0060580 0x7fbbc0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.115+0000 7fbbd67fc700 1 -- 172.21.15.29:0/2268695218 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fbbd007cc80 con 0x7fbbe00ca870 2023-10-06T05:30:50.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.115+0000 7fbbddd9b700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbbc0060580 0x7fbbc0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.119+0000 7fbbddd9b700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbbc0060580 0x7fbbc0062a30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80099b0 tx=0x7fbbc8017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:50.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.127+0000 7fbbd67fc700 1 -- 172.21.15.29:0/2268695218 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbbd004cfc0 con 0x7fbbe00ca870 2023-10-06T05:30:50.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.327+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbe00cbe90 con 0x7fbbe00ca870 2023-10-06T05:30:50.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.327+0000 7fbbd67fc700 1 -- 172.21.15.29:0/2268695218 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fbbd00505e0 con 0x7fbbe00ca870 2023-10-06T05:30:50.335 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:50.335 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T05:29:53.859418+0000","modified":"2023-10-06T05:30:40.875741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6835/1984531371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1984531371},{"type":"v1","addr":"172.21.15.29:6835","nonce":1984531371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T05:30:50.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbbc0060580 msgr2=0x7fbbc0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbbc0060580 0x7fbbc0062a30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80099b0 tx=0x7fbbc8017000 comp rx=0 tx=0).stop 2023-10-06T05:30:50.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbe00ca870 msgr2=0x7fbbe0142340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbe00ca870 0x7fbbe0142340 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000ec80 tx=0x7fbbd00091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 shutdown_connections 2023-10-06T05:30:50.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbbe0158870 0x7fbbe00c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbbc0060580 0x7fbbc0062a30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbe00cc9a0 0x7fbbe0159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 --2- 172.21.15.29:0/2268695218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbe00ca870 0x7fbbe0142340 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 >> 172.21.15.29:0/2268695218 conn(0x7fbbe0067b30 msgr2=0x7fbbe0154930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:50.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 shutdown_connections 2023-10-06T05:30:50.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.331+0000 7fbbdf59e700 1 -- 172.21.15.29:0/2268695218 wait complete. 2023-10-06T05:30:50.340 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 54 2023-10-06T05:30:50.356 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:30:50.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f6205fe7700 1 Processor -- start 2023-10-06T05:30:50.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f6205fe7700 1 -- start start 2023-10-06T05:30:50.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f6205fe7700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62000c8c70 0x7f6200159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f6205fe7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62000c9040 0x7f62000ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f6205fe7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62000cc1b0 con 0x7f62001556d0 2023-10-06T05:30:50.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f6205fe7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6200156260 con 0x7f62000c9040 2023-10-06T05:30:50.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f6205fe7700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620015a850 con 0x7f62000c8c70 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61feffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62000c9040 0x7f62000ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61feffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62000c9040 0x7f62000ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49984/0 (socket says 172.21.15.29:49984) 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61feffd700 1 -- 172.21.15.29:0/535395352 learned_addr learned my addr 172.21.15.29:0/535395352 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61fffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f62001556d0 0x7f6200155b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41146/0 (socket says 172.21.15.29:41146) 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61ff7fe700 1 --2- 172.21.15.29:0/535395352 >> v2:172.21.15.173:3300/0 conn(0x7f62000c8c70 0x7f6200159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61feffd700 1 -- 172.21.15.29:0/535395352 >> v2:172.21.15.173:3300/0 conn(0x7f62000c8c70 msgr2=0x7f6200159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61feffd700 1 --2- 172.21.15.29:0/535395352 >> v2:172.21.15.173:3300/0 conn(0x7f62000c8c70 0x7f6200159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61feffd700 1 -- 172.21.15.29:0/535395352 >> v1:172.21.15.29:6789/0 conn(0x7f62001556d0 legacy=0x7f6200155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61feffd700 1 -- 172.21.15.29:0/535395352 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000cd650 con 0x7f62000c9040 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61feffd700 1 --2- 172.21.15.29:0/535395352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c9040 0x7f62000ca030 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009f20 tx=0x7f61f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0ee3ec1af0fad5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:50.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61fe7fc700 1 -- 172.21.15.29:0/535395352 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f800e070 con 0x7f62000c9040 2023-10-06T05:30:50.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61fe7fc700 1 -- 172.21.15.29:0/535395352 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f800ba40 con 0x7f62000c9040 2023-10-06T05:30:50.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.455+0000 7f61fe7fc700 1 -- 172.21.15.29:0/535395352 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f80092e0 con 0x7f62000c9040 2023-10-06T05:30:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 -- 172.21.15.29:0/535395352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c9040 msgr2=0x7f62000ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 --2- 172.21.15.29:0/535395352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c9040 0x7f62000ca030 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009f20 tx=0x7f61f8009840 comp rx=0 tx=0).stop 2023-10-06T05:30:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 -- 172.21.15.29:0/535395352 shutdown_connections 2023-10-06T05:30:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 --2- 172.21.15.29:0/535395352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c9040 0x7f62000ca030 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 --2- 172.21.15.29:0/535395352 >> v2:172.21.15.173:3300/0 conn(0x7f62000c8c70 0x7f6200159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 -- 172.21.15.29:0/535395352 >> 172.21.15.29:0/535395352 conn(0x7f620006d7d0 msgr2=0x7f620006dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:50.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 -- 172.21.15.29:0/535395352 shutdown_connections 2023-10-06T05:30:50.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 -- 172.21.15.29:0/535395352 wait complete. 2023-10-06T05:30:50.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 Processor -- start 2023-10-06T05:30:50.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.459+0000 7f6205fe7700 1 -- start start 2023-10-06T05:30:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f6205fe7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c8c70 0x7f6200143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f6205fe7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62000c9040 0x7f6200147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f6205fe7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62001556d0 0x7f62001411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f6205fe7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62000b1f50 con 0x7f62000c8c70 2023-10-06T05:30:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f6205fe7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620014b210 con 0x7f62000c9040 2023-10-06T05:30:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f6205fe7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62000b23e0 con 0x7f62001556d0 2023-10-06T05:30:50.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61ff7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c8c70 0x7f6200143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61ff7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c8c70 0x7f6200143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49994/0 (socket says 172.21.15.29:49994) 2023-10-06T05:30:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61ff7fe700 1 -- 172.21.15.29:0/4162838187 learned_addr learned my addr 172.21.15.29:0/4162838187 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61feffd700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62000c9040 0x7f6200147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61fffff700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62001556d0 0x7f62001411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61ff7fe700 1 -- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62001556d0 msgr2=0x7f62001411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61ff7fe700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62001556d0 0x7f62001411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61ff7fe700 1 -- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62000c9040 msgr2=0x7f6200147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61ff7fe700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62000c9040 0x7f6200147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61ff7fe700 1 -- 172.21.15.29:0/4162838187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8009ae0 con 0x7f62000c8c70 2023-10-06T05:30:50.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61ff7fe700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c8c70 0x7f6200143010 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f61f400d890 tx=0x7f61f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:50.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61e77fe700 1 -- 172.21.15.29:0/4162838187 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f40125f0 con 0x7f62000c8c70 2023-10-06T05:30:50.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61e77fe700 1 -- 172.21.15.29:0/4162838187 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f4012750 con 0x7f62000c8c70 2023-10-06T05:30:50.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620014b460 con 0x7f62000c8c70 2023-10-06T05:30:50.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f61e77fe700 1 -- 172.21.15.29:0/4162838187 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4012ad0 con 0x7f62000c8c70 2023-10-06T05:30:50.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.463+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62000b1be0 con 0x7f62000c8c70 2023-10-06T05:30:50.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.467+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620004be00 con 0x7f62000c8c70 2023-10-06T05:30:50.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.467+0000 7f61e77fe700 1 -- 172.21.15.29:0/4162838187 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f61f401e460 con 0x7f62000c8c70 2023-10-06T05:30:50.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.467+0000 7f61e77fe700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61ec064960 0x7f61ec066e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.467+0000 7f61e77fe700 1 -- 172.21.15.29:0/4162838187 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f61f407c820 con 0x7f62000c8c70 2023-10-06T05:30:50.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.467+0000 7f61feffd700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61ec064960 0x7f61ec066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.467+0000 7f61feffd700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61ec064960 0x7f61ec066e10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009880 tx=0x7f61f8018000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:50.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.475+0000 7f61e77fe700 1 -- 172.21.15.29:0/4162838187 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f61f4050600 con 0x7f62000c8c70 2023-10-06T05:30:50.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.635+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6200159fb0 con 0x7f62000c8c70 2023-10-06T05:30:50.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f61e77fe700 1 -- 172.21.15.29:0/4162838187 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17126 (secure 0 0 0) 0x7f61f4050190 con 0x7f62000c8c70 2023-10-06T05:30:50.646 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:50.646 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":79,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:30:35.833868+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T05:29:51.644444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T05:29:52.853119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6834/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6835/3515782118":"2023-10-07T05:30:18.733272+0000","172.21.15.29:6834/3515782118":"2023-10-07T05:30:18.733272+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:30:50.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61ec064960 msgr2=0x7f61ec066e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61ec064960 0x7f61ec066e10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009880 tx=0x7f61f8018000 comp rx=0 tx=0).stop 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c8c70 msgr2=0x7f6200143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c8c70 0x7f6200143010 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f61f400d890 tx=0x7f61f4008040 comp rx=0 tx=0).stop 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 shutdown_connections 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62001556d0 0x7f62001411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f61ec064960 0x7f61ec066e10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62000c9040 0x7f6200147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 --2- 172.21.15.29:0/4162838187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62000c8c70 0x7f6200143010 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.639+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 >> 172.21.15.29:0/4162838187 conn(0x7f620006d7d0 msgr2=0x7f6200155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.643+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 shutdown_connections 2023-10-06T05:30:50.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.643+0000 7f6205fe7700 1 -- 172.21.15.29:0/4162838187 wait complete. 2023-10-06T05:30:50.661 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T05:30:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d6ddd700 1 Processor -- start 2023-10-06T05:30:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d6ddd700 1 -- start start 2023-10-06T05:30:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d6ddd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19d0159110 0x7f19d015d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d6ddd700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d00cb000 con 0x7f19d015cd00 2023-10-06T05:30:50.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d6ddd700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d006b340 con 0x7f19d00c5d50 2023-10-06T05:30:50.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d6ddd700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d006bb90 con 0x7f19d0159110 2023-10-06T05:30:50.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d5ddb700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f19d015cd00 0x7f19d006ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41150/0 (socket says 172.21.15.29:41150) 2023-10-06T05:30:50.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d65dc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19d0159110 0x7f19d015d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d5ddb700 1 -- 172.21.15.29:0/1937516690 learned_addr learned my addr 172.21.15.29:0/1937516690 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:50.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d4dd9700 1 -- 172.21.15.29:0/1937516690 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201275819 0 0) 0x7f19d00cb000 con 0x7f19d015cd00 2023-10-06T05:30:50.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d4dd9700 1 -- 172.21.15.29:0/1937516690 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19bc003570 con 0x7f19d015cd00 2023-10-06T05:30:50.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d65dc700 1 -- 172.21.15.29:0/1937516690 >> v1:172.21.15.173:6789/0 conn(0x7f19d00c5d50 legacy=0x7f19d0158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d65dc700 1 -- 172.21.15.29:0/1937516690 >> v1:172.21.15.29:6789/0 conn(0x7f19d015cd00 legacy=0x7f19d006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d65dc700 1 -- 172.21.15.29:0/1937516690 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d006b5d0 con 0x7f19d0159110 2023-10-06T05:30:50.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d65dc700 1 --2- 172.21.15.29:0/1937516690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d0159110 0x7f19d015d0d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009e60 tx=0x7f19c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1082887b950520 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:50.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d4dd9700 1 -- 172.21.15.29:0/1937516690 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c800e070 con 0x7f19d0159110 2023-10-06T05:30:50.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d4dd9700 1 -- 172.21.15.29:0/1937516690 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c800bb60 con 0x7f19d0159110 2023-10-06T05:30:50.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.763+0000 7f19d4dd9700 1 -- 172.21.15.29:0/1937516690 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8012430 con 0x7f19d0159110 2023-10-06T05:30:50.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1937516690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d0159110 msgr2=0x7f19d015d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 --2- 172.21.15.29:0/1937516690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d0159110 0x7f19d015d0d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009e60 tx=0x7f19c8009780 comp rx=0 tx=0).stop 2023-10-06T05:30:50.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1937516690 shutdown_connections 2023-10-06T05:30:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 --2- 172.21.15.29:0/1937516690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d0159110 0x7f19d015d0d0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1937516690 >> 172.21.15.29:0/1937516690 conn(0x7f19d006c6c0 msgr2=0x7f19d006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1937516690 shutdown_connections 2023-10-06T05:30:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1937516690 wait complete. 2023-10-06T05:30:50.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 Processor -- start 2023-10-06T05:30:50.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 -- start start 2023-10-06T05:30:50.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d00c5d50 0x7f19d0150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19d0159110 0x7f19d00b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d015cd00 0x7f19d0153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c8130 con 0x7f19d015cd00 2023-10-06T05:30:50.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c83f0 con 0x7f19d00c5d50 2023-10-06T05:30:50.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d6ddd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c86d0 con 0x7f19d0159110 2023-10-06T05:30:50.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d65dc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d015cd00 0x7f19d0153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d65dc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d015cd00 0x7f19d0153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50024/0 (socket says 172.21.15.29:50024) 2023-10-06T05:30:50.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d65dc700 1 -- 172.21.15.29:0/1959641012 learned_addr learned my addr 172.21.15.29:0/1959641012 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:50.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d5ddb700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d00c5d50 0x7f19d0150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.767+0000 7f19d55da700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19d0159110 0x7f19d00b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d65dc700 1 -- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19d0159110 msgr2=0x7f19d00b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d65dc700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19d0159110 0x7f19d00b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d65dc700 1 -- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d00c5d50 msgr2=0x7f19d0150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:50.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d65dc700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d00c5d50 0x7f19d0150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:50.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d65dc700 1 -- 172.21.15.29:0/1959641012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8009a20 con 0x7f19d015cd00 2023-10-06T05:30:50.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d55da700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19d0159110 0x7f19d00b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T05:30:50.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d65dc700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d015cd00 0x7f19d0153380 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f19d006e7a0 tx=0x7f19c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:50.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19c5ffb700 1 -- 172.21.15.29:0/1959641012 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8012e00 con 0x7f19d015cd00 2023-10-06T05:30:50.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19c5ffb700 1 -- 172.21.15.29:0/1959641012 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c801d630 con 0x7f19d015cd00 2023-10-06T05:30:50.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d00c89b0 con 0x7f19d015cd00 2023-10-06T05:30:50.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19c5ffb700 1 -- 172.21.15.29:0/1959641012 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c801d9f0 con 0x7f19d015cd00 2023-10-06T05:30:50.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d0151340 con 0x7f19d015cd00 2023-10-06T05:30:50.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d00c8eb0 con 0x7f19d015cd00 2023-10-06T05:30:50.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.771+0000 7f19c5ffb700 1 -- 172.21.15.29:0/1959641012 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f19c8024070 con 0x7f19d015cd00 2023-10-06T05:30:50.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.775+0000 7f19c5ffb700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19b4060550 0x7f19b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:50.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.775+0000 7f19c5ffb700 1 -- 172.21.15.29:0/1959641012 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f19c807f190 con 0x7f19d015cd00 2023-10-06T05:30:50.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.775+0000 7f19d5ddb700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19b4060550 0x7f19b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:50.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.775+0000 7f19d5ddb700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19b4060550 0x7f19b4062a00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0058d0 tx=0x7f19cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:50.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.779+0000 7f19c5ffb700 1 -- 172.21.15.29:0/1959641012 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f19c804f570 con 0x7f19d015cd00 2023-10-06T05:30:50.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.979+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f19d004be00 con 0x7f19d015cd00 2023-10-06T05:30:50.986 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-06T05:30:50.979+0000 7fe44aab2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T05:30:50.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.987+0000 7f19c5ffb700 1 -- 172.21.15.29:0/1959641012 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f19c8052b90 con 0x7f19d015cd00 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19b4060550 msgr2=0x7f19b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19b4060550 0x7f19b4062a00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0058d0 tx=0x7f19cc009040 comp rx=0 tx=0).stop 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d015cd00 msgr2=0x7f19d0153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d015cd00 0x7f19d0153380 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f19d006e7a0 tx=0x7f19c8019000 comp rx=0 tx=0).stop 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 shutdown_connections 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19d015cd00 0x7f19d0153380 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19d0159110 0x7f19d00b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f19b4060550 0x7f19b4062a00 secure :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0058d0 tx=0x7f19cc009040 comp rx=0 tx=0).stop 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 --2- 172.21.15.29:0/1959641012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19d00c5d50 0x7f19d0150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:51.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 >> 172.21.15.29:0/1959641012 conn(0x7f19d006c6c0 msgr2=0x7f19d00cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:51.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 shutdown_connections 2023-10-06T05:30:51.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:50.991+0000 7f19d6ddd700 1 -- 172.21.15.29:0/1959641012 wait complete. 2023-10-06T05:30:51.001 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T05:30:51.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T05:30:51.017 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-06T05:30:51.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.111+0000 7fb713318700 1 Processor -- start 2023-10-06T05:30:51.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.111+0000 7fb713318700 1 -- start start 2023-10-06T05:30:51.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.111+0000 7fb713318700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb70c0c8c70 0x7fb70c0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:51.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.111+0000 7fb713318700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c15a1d0 0x7fb70c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:51.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.111+0000 7fb713318700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c15d580 con 0x7fb70c159e00 2023-10-06T05:30:51.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.111+0000 7fb713318700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb70c15da10 con 0x7fb70c0c8c70 2023-10-06T05:30:51.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.111+0000 7fb713318700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c15cc50 con 0x7fb70c15a1d0 2023-10-06T05:30:51.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7108b3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb70c0c8c70 0x7fb70c0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:51.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7110b4700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb70c159e00 0x7fb70c0c8560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:44074/0 (socket says 172.21.15.29:44074) 2023-10-06T05:30:51.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7110b4700 1 -- 172.21.15.29:0/2520902429 learned_addr learned my addr 172.21.15.29:0/2520902429 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:51.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7118b5700 1 --2- 172.21.15.29:0/2520902429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c15a1d0 0x7fb70c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:51.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb703fff700 1 -- 172.21.15.29:0/2520902429 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630656687 0 0) 0x7fb70c15d580 con 0x7fb70c159e00 2023-10-06T05:30:51.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb703fff700 1 -- 172.21.15.29:0/2520902429 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f8003570 con 0x7fb70c159e00 2023-10-06T05:30:51.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7118b5700 1 -- 172.21.15.29:0/2520902429 >> v2:172.21.15.29:3300/0 conn(0x7fb70c0c8c70 msgr2=0x7fb70c0c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:51.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7118b5700 1 --2- 172.21.15.29:0/2520902429 >> v2:172.21.15.29:3300/0 conn(0x7fb70c0c8c70 0x7fb70c0c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:51.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7118b5700 1 -- 172.21.15.29:0/2520902429 >> v1:172.21.15.173:6789/0 conn(0x7fb70c159e00 legacy=0x7fb70c0c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:51.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7118b5700 1 -- 172.21.15.29:0/2520902429 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c15cf30 con 0x7fb70c15a1d0 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7108b3700 1 --2- 172.21.15.29:0/2520902429 >> v2:172.21.15.29:3300/0 conn(0x7fb70c0c8c70 0x7fb70c0c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb7118b5700 1 --2- 172.21.15.29:0/2520902429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c15a1d0 0x7fb70c0ca4e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb7080098e0 tx=0x7fb7080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25d247e389c0c37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb703fff700 1 -- 172.21.15.29:0/2520902429 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708011630 con 0x7fb70c15a1d0 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb703fff700 1 -- 172.21.15.29:0/2520902429 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708011790 con 0x7fb70c15a1d0 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb703fff700 1 -- 172.21.15.29:0/2520902429 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708011b30 con 0x7fb70c15a1d0 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 -- 172.21.15.29:0/2520902429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c15a1d0 msgr2=0x7fb70c0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 --2- 172.21.15.29:0/2520902429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c15a1d0 0x7fb70c0ca4e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb7080098e0 tx=0x7fb7080091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 -- 172.21.15.29:0/2520902429 shutdown_connections 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 --2- 172.21.15.29:0/2520902429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c15a1d0 0x7fb70c0ca4e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 --2- 172.21.15.29:0/2520902429 >> v2:172.21.15.29:3300/0 conn(0x7fb70c0c8c70 0x7fb70c0c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 -- 172.21.15.29:0/2520902429 >> 172.21.15.29:0/2520902429 conn(0x7fb70c0670a0 msgr2=0x7fb70c0674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 -- 172.21.15.29:0/2520902429 shutdown_connections 2023-10-06T05:30:51.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 -- 172.21.15.29:0/2520902429 wait complete. 2023-10-06T05:30:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 Processor -- start 2023-10-06T05:30:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.115+0000 7fb713318700 1 -- start start 2023-10-06T05:30:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb713318700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb70c0c8c70 0x7fb70c152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb713318700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c159e00 0x7fb70c0c2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb713318700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb70c15a1d0 0x7fb70c0aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb713318700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c0c1dd0 con 0x7fb70c0c8c70 2023-10-06T05:30:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb713318700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c152860 con 0x7fb70c15a1d0 2023-10-06T05:30:51.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb713318700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c0c27a0 con 0x7fb70c159e00 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7110b4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb70c0c8c70 0x7fb70c152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7110b4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb70c0c8c70 0x7fb70c152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50050/0 (socket says 172.21.15.29:50050) 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7110b4700 1 -- 172.21.15.29:0/2760923855 learned_addr learned my addr 172.21.15.29:0/2760923855 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7108b3700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c159e00 0x7fb70c0c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7118b5700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb70c15a1d0 0x7fb70c0aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7108b3700 1 -- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb70c15a1d0 msgr2=0x7fb70c0aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7108b3700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb70c15a1d0 0x7fb70c0aaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7108b3700 1 -- 172.21.15.29:0/2760923855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb70c0c8c70 msgr2=0x7fb70c152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7108b3700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb70c0c8c70 0x7fb70c152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7108b3700 1 -- 172.21.15.29:0/2760923855 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc009420 con 0x7fb70c159e00 2023-10-06T05:30:51.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7108b3700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c159e00 0x7fb70c0c2260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00ecb0 tx=0x7fb6fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7017fa700 1 -- 172.21.15.29:0/2760923855 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00c850 con 0x7fb70c159e00 2023-10-06T05:30:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7017fa700 1 -- 172.21.15.29:0/2760923855 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc00c9b0 con 0x7fb70c159e00 2023-10-06T05:30:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb708009420 con 0x7fb70c159e00 2023-10-06T05:30:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb7017fa700 1 -- 172.21.15.29:0/2760923855 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00cd50 con 0x7fb70c159e00 2023-10-06T05:30:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c0c14a0 con 0x7fb70c159e00 2023-10-06T05:30:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.119+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c0c1f80 con 0x7fb70c159e00 2023-10-06T05:30:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.123+0000 7fb7017fa700 1 -- 172.21.15.29:0/2760923855 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb6fc013680 con 0x7fb70c159e00 2023-10-06T05:30:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.123+0000 7fb7017fa700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6f0060550 0x7fb6f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.123+0000 7fb7017fa700 1 -- 172.21.15.29:0/2760923855 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fb6fc07cc00 con 0x7fb70c159e00 2023-10-06T05:30:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.123+0000 7fb7110b4700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6f0060550 0x7fb6f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:51.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.123+0000 7fb7110b4700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6f0060550 0x7fb6f0062a00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb70c15ec50 tx=0x7fb704009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:51.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.131+0000 7fb7017fa700 1 -- 172.21.15.29:0/2760923855 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb70c0c1f80 con 0x7fb70c159e00 2023-10-06T05:30:51.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.335+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb70c0c1f80 con 0x7fb70c159e00 2023-10-06T05:30:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.991+0000 7fb7017fa700 1 -- 172.21.15.29:0/2760923855 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb70c0c1f80 con 0x7fb70c159e00 2023-10-06T05:30:52.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6f0060550 msgr2=0x7fb6f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:52.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6f0060550 0x7fb6f0062a00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb70c15ec50 tx=0x7fb704009040 comp rx=0 tx=0).stop 2023-10-06T05:30:52.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c159e00 msgr2=0x7fb70c0c2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:52.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c159e00 0x7fb70c0c2260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00ecb0 tx=0x7fb6fc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:52.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 shutdown_connections 2023-10-06T05:30:52.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fb6f0060550 0x7fb6f0062a00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:52.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb70c15a1d0 0x7fb70c0aaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:52.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb70c159e00 0x7fb70c0c2260 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:52.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 --2- 172.21.15.29:0/2760923855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb70c0c8c70 0x7fb70c152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:52.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 >> 172.21.15.29:0/2760923855 conn(0x7fb70c0670a0 msgr2=0x7fb70c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:52.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 shutdown_connections 2023-10-06T05:30:52.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:51.995+0000 7fb713318700 1 -- 172.21.15.29:0/2760923855 wait complete. 2023-10-06T05:30:52.021 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T05:30:52.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.139+0000 7fdbac81e700 1 Processor -- start 2023-10-06T05:30:52.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.139+0000 7fdbac81e700 1 -- start start 2023-10-06T05:30:52.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdbac81e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba80cada0 0x7fdba8161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:52.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdbac81e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba80c4380 con 0x7fdba8156b50 2023-10-06T05:30:52.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdbac81e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba80c4810 con 0x7fdba8156f20 2023-10-06T05:30:52.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdbac81e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80c3770 con 0x7fdba80cada0 2023-10-06T05:30:52.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba6d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdba8156b50 0x7fdba80c8ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41158/0 (socket says 172.21.15.29:41158) 2023-10-06T05:30:52.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba6d9d700 1 -- 172.21.15.29:0/3409842503 learned_addr learned my addr 172.21.15.29:0/3409842503 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:52.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba759e700 1 --2- 172.21.15.29:0/3409842503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba80cada0 0x7fdba8161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba659c700 1 -- 172.21.15.29:0/3409842503 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655230492 0 0) 0x7fdba80c4810 con 0x7fdba8156f20 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba659c700 1 -- 172.21.15.29:0/3409842503 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb88003570 con 0x7fdba8156f20 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba659c700 1 -- 172.21.15.29:0/3409842503 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926178101 0 0) 0x7fdba80c4380 con 0x7fdba8156b50 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba659c700 1 -- 172.21.15.29:0/3409842503 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba80c4810 con 0x7fdba8156b50 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba759e700 1 -- 172.21.15.29:0/3409842503 >> v1:172.21.15.173:6789/0 conn(0x7fdba8156f20 legacy=0x7fdba80ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba759e700 1 -- 172.21.15.29:0/3409842503 >> v1:172.21.15.29:6789/0 conn(0x7fdba8156b50 legacy=0x7fdba80c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba759e700 1 -- 172.21.15.29:0/3409842503 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80c3a50 con 0x7fdba80cada0 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba759e700 1 --2- 172.21.15.29:0/3409842503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba80cada0 0x7fdba8161ca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009e90 tx=0x7fdba0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=885ef785041ef2df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba659c700 1 -- 172.21.15.29:0/3409842503 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba000e070 con 0x7fdba80cada0 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba659c700 1 -- 172.21.15.29:0/3409842503 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba000bb80 con 0x7fdba80cada0 2023-10-06T05:30:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.143+0000 7fdba659c700 1 -- 172.21.15.29:0/3409842503 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0012430 con 0x7fdba80cada0 2023-10-06T05:30:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 -- 172.21.15.29:0/3409842503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba80cada0 msgr2=0x7fdba8161ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 --2- 172.21.15.29:0/3409842503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba80cada0 0x7fdba8161ca0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009e90 tx=0x7fdba0009780 comp rx=0 tx=0).stop 2023-10-06T05:30:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 -- 172.21.15.29:0/3409842503 shutdown_connections 2023-10-06T05:30:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 --2- 172.21.15.29:0/3409842503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba80cada0 0x7fdba8161ca0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 -- 172.21.15.29:0/3409842503 >> 172.21.15.29:0/3409842503 conn(0x7fdba8069d50 msgr2=0x7fdba806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 -- 172.21.15.29:0/3409842503 shutdown_connections 2023-10-06T05:30:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 -- 172.21.15.29:0/3409842503 wait complete. 2023-10-06T05:30:52.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 Processor -- start 2023-10-06T05:30:52.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 -- start start 2023-10-06T05:30:52.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdba80cada0 0x7fdba814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdba8156b50 0x7fdba814f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba8156f20 0x7fdba80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8169d40 con 0x7fdba80cada0 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba816ab60 con 0x7fdba8156b50 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdbac81e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8169f50 con 0x7fdba8156f20 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdba6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdba80cada0 0x7fdba814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdba6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdba80cada0 0x7fdba814ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50056/0 (socket says 172.21.15.29:50056) 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdba6d9d700 1 -- 172.21.15.29:0/3344878306 learned_addr learned my addr 172.21.15.29:0/3344878306 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdb9ffff700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdba8156b50 0x7fdba814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdba759e700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba8156f20 0x7fdba80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdba6d9d700 1 -- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba8156f20 msgr2=0x7fdba80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdba6d9d700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba8156f20 0x7fdba80aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdba6d9d700 1 -- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdba8156b50 msgr2=0x7fdba814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdba6d9d700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdba8156b50 0x7fdba814f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.147+0000 7fdba6d9d700 1 -- 172.21.15.29:0/3344878306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0009a20 con 0x7fdba80cada0 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.151+0000 7fdba6d9d700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdba80cada0 0x7fdba814ebd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800c7c0 tx=0x7fdb98007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.151+0000 7fdb9effd700 1 -- 172.21.15.29:0/3344878306 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98005cd0 con 0x7fdba80cada0 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.151+0000 7fdb9effd700 1 -- 172.21.15.29:0/3344878306 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb98005e30 con 0x7fdba80cada0 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.151+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba816a230 con 0x7fdba80cada0 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.151+0000 7fdb9effd700 1 -- 172.21.15.29:0/3344878306 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98007320 con 0x7fdba80cada0 2023-10-06T05:30:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.151+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba816a7f0 con 0x7fdba80cada0 2023-10-06T05:30:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.151+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba804be00 con 0x7fdba80cada0 2023-10-06T05:30:52.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.151+0000 7fdb9effd700 1 -- 172.21.15.29:0/3344878306 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdb9801b3b0 con 0x7fdba80cada0 2023-10-06T05:30:52.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.151+0000 7fdb9effd700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb8c060550 0x7fdb8c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:52.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.155+0000 7fdb9effd700 1 -- 172.21.15.29:0/3344878306 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fdb9807c070 con 0x7fdba80cada0 2023-10-06T05:30:52.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.155+0000 7fdb9ffff700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb8c060550 0x7fdb8c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:52.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.155+0000 7fdb9ffff700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb8c060550 0x7fdb8c062a00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdba81557c0 tx=0x7fdb90007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.159+0000 7fdb9effd700 1 -- 172.21.15.29:0/3344878306 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdb9804c400 con 0x7fdba80cada0 2023-10-06T05:30:52.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.323+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdba80c8c60 con 0x7fdba80cada0 2023-10-06T05:30:53.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.995+0000 7fdb9effd700 1 -- 172.21.15.29:0/3344878306 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdb980170d0 con 0x7fdba80cada0 2023-10-06T05:30:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.999+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb8c060550 msgr2=0x7fdb8c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.999+0000 7fdbac81e700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb8c060550 0x7fdb8c062a00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdba81557c0 tx=0x7fdb90007d50 comp rx=0 tx=0).stop 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.999+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdba80cada0 msgr2=0x7fdba814ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:52.999+0000 7fdbac81e700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdba80cada0 0x7fdba814ebd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800c7c0 tx=0x7fdb98007e00 comp rx=0 tx=0).stop 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.003+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 shutdown_connections 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.003+0000 7fdbac81e700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdba8156f20 0x7fdba80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.003+0000 7fdbac81e700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fdb8c060550 0x7fdb8c062a00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.003+0000 7fdbac81e700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdba8156b50 0x7fdba814f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.003+0000 7fdbac81e700 1 --2- 172.21.15.29:0/3344878306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdba80cada0 0x7fdba814ebd0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.003+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 >> 172.21.15.29:0/3344878306 conn(0x7fdba8069d50 msgr2=0x7fdba8152730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.003+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 shutdown_connections 2023-10-06T05:30:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.003+0000 7fdbac81e700 1 -- 172.21.15.29:0/3344878306 wait complete. 2023-10-06T05:30:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2023-10-06T05:30:53.023 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T05:30:53.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14bada2700 1 Processor -- start 2023-10-06T05:30:53.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14bada2700 1 -- start start 2023-10-06T05:30:53.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14bada2700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f14b4158c40 0x7f14b40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14bada2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b40ce320 0x7f14b40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14bada2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40cecc0 con 0x7f14b4159010 2023-10-06T05:30:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14bada2700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40cae30 con 0x7f14b4158c40 2023-10-06T05:30:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14bada2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b406ba70 con 0x7f14b40ce320 2023-10-06T05:30:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14b959f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f14b4159010 0x7f14b406aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41168/0 (socket says 172.21.15.29:41168) 2023-10-06T05:30:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14b959f700 1 -- 172.21.15.29:0/2032940179 learned_addr learned my addr 172.21.15.29:0/2032940179 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:53.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14b9da0700 1 --2- 172.21.15.29:0/2032940179 >> v2:172.21.15.173:3300/0 conn(0x7f14b4158c40 0x7f14b40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:53.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14ba5a1700 1 --2- 172.21.15.29:0/2032940179 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b40ce320 0x7f14b40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:53.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14b8d9e700 1 -- 172.21.15.29:0/2032940179 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509918535 0 0) 0x7f14a8001110 con 0x7f14b4159010 2023-10-06T05:30:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14b8d9e700 1 -- 172.21.15.29:0/2032940179 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f149c003570 con 0x7f14b4159010 2023-10-06T05:30:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14ba5a1700 1 -- 172.21.15.29:0/2032940179 >> v2:172.21.15.173:3300/0 conn(0x7f14b4158c40 msgr2=0x7f14b40d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14ba5a1700 1 --2- 172.21.15.29:0/2032940179 >> v2:172.21.15.173:3300/0 conn(0x7f14b4158c40 0x7f14b40d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14ba5a1700 1 -- 172.21.15.29:0/2032940179 >> v1:172.21.15.29:6789/0 conn(0x7f14b4159010 legacy=0x7f14b406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14ba5a1700 1 -- 172.21.15.29:0/2032940179 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b406b4b0 con 0x7f14b40ce320 2023-10-06T05:30:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14ba5a1700 1 --2- 172.21.15.29:0/2032940179 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b40ce320 0x7f14b40ce780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f14a40098e0 tx=0x7f14a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3d440bc188e5b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14b8d9e700 1 -- 172.21.15.29:0/2032940179 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4011630 con 0x7f14b40ce320 2023-10-06T05:30:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14b8d9e700 1 -- 172.21.15.29:0/2032940179 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4011790 con 0x7f14b40ce320 2023-10-06T05:30:53.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.127+0000 7f14b8d9e700 1 -- 172.21.15.29:0/2032940179 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4011b10 con 0x7f14b40ce320 2023-10-06T05:30:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 -- 172.21.15.29:0/2032940179 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b40ce320 msgr2=0x7f14b40ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 --2- 172.21.15.29:0/2032940179 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b40ce320 0x7f14b40ce780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f14a40098e0 tx=0x7f14a40091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 -- 172.21.15.29:0/2032940179 shutdown_connections 2023-10-06T05:30:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 --2- 172.21.15.29:0/2032940179 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b40ce320 0x7f14b40ce780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 --2- 172.21.15.29:0/2032940179 >> v2:172.21.15.173:3300/0 conn(0x7f14b4158c40 0x7f14b40d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 -- 172.21.15.29:0/2032940179 >> 172.21.15.29:0/2032940179 conn(0x7f14b40670a0 msgr2=0x7f14b40674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:53.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 -- 172.21.15.29:0/2032940179 shutdown_connections 2023-10-06T05:30:53.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 -- 172.21.15.29:0/2032940179 wait complete. 2023-10-06T05:30:53.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 Processor -- start 2023-10-06T05:30:53.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.131+0000 7f14bada2700 1 -- start start 2023-10-06T05:30:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14bada2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b40ce320 0x7f14b4151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14bada2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b4158c40 0x7f14b40b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14bada2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b4159010 0x7f14b40b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14bada2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c8e00 con 0x7f14b40ce320 2023-10-06T05:30:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14bada2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c81f0 con 0x7f14b4158c40 2023-10-06T05:30:53.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14bada2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c84d0 con 0x7f14b4159010 2023-10-06T05:30:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b9da0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b40ce320 0x7f14b4151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b9da0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b40ce320 0x7f14b4151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50070/0 (socket says 172.21.15.29:50070) 2023-10-06T05:30:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b9da0700 1 -- 172.21.15.29:0/3484171297 learned_addr learned my addr 172.21.15.29:0/3484171297 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14ba5a1700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b4159010 0x7f14b40b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:53.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b959f700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b4158c40 0x7f14b40b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b9da0700 1 -- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b4159010 msgr2=0x7f14b40b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b9da0700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b4159010 0x7f14b40b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b9da0700 1 -- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b4158c40 msgr2=0x7f14b40b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b9da0700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b4158c40 0x7f14b40b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b9da0700 1 -- 172.21.15.29:0/3484171297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4009420 con 0x7f14b40ce320 2023-10-06T05:30:53.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14ba5a1700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b4159010 0x7f14b40b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b9da0700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b40ce320 0x7f14b4151010 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009ef0 tx=0x7f14ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b1ffb700 1 -- 172.21.15.29:0/3484171297 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00cc50 con 0x7f14b40ce320 2023-10-06T05:30:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b1ffb700 1 -- 172.21.15.29:0/3484171297 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00f040 con 0x7f14b40ce320 2023-10-06T05:30:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b40c87b0 con 0x7f14b40ce320 2023-10-06T05:30:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14b1ffb700 1 -- 172.21.15.29:0/3484171297 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac014480 con 0x7f14b40ce320 2023-10-06T05:30:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b40b3230 con 0x7f14b40ce320 2023-10-06T05:30:53.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.135+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b40b34b0 con 0x7f14b40ce320 2023-10-06T05:30:53.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.139+0000 7f14b1ffb700 1 -- 172.21.15.29:0/3484171297 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f14ac0147f0 con 0x7f14b40ce320 2023-10-06T05:30:53.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.139+0000 7f14b1ffb700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f14a0060550 0x7f14a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:53.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.139+0000 7f14b1ffb700 1 -- 172.21.15.29:0/3484171297 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f14ac07d600 con 0x7f14b40ce320 2023-10-06T05:30:53.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.139+0000 7f14b959f700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f14a0060550 0x7f14a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.139+0000 7f14b959f700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f14a0060550 0x7f14a0062a00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f14b40b5c70 tx=0x7f14a8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:53.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.147+0000 7f14b1ffb700 1 -- 172.21.15.29:0/3484171297 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f14ac04db40 con 0x7f14b40ce320 2023-10-06T05:30:53.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:53.315+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f14b40c8c30 con 0x7f14b40ce320 2023-10-06T05:30:54.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.003+0000 7f14b1ffb700 1 -- 172.21.15.29:0/3484171297 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 169+0+0 (secure 0 0 0) 0x7f14ac051160 con 0x7f14b40ce320 2023-10-06T05:30:54.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f14a0060550 msgr2=0x7f14a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f14a0060550 0x7f14a0062a00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f14b40b5c70 tx=0x7f14a8009040 comp rx=0 tx=0).stop 2023-10-06T05:30:54.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b40ce320 msgr2=0x7f14b4151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b40ce320 0x7f14b4151010 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009ef0 tx=0x7f14ac00b040 comp rx=0 tx=0).stop 2023-10-06T05:30:54.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 shutdown_connections 2023-10-06T05:30:54.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f14b4159010 0x7f14b40b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f14a0060550 0x7f14a0062a00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b4158c40 0x7f14b40b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 --2- 172.21.15.29:0/3484171297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b40ce320 0x7f14b4151010 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 >> 172.21.15.29:0/3484171297 conn(0x7f14b40670a0 msgr2=0x7f14b40cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:54.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 shutdown_connections 2023-10-06T05:30:54.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.007+0000 7f14bada2700 1 -- 172.21.15.29:0/3484171297 wait complete. 2023-10-06T05:30:54.016 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2023-10-06T05:30:54.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T05:30:54.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.139+0000 7fa42aa2f700 1 Processor -- start 2023-10-06T05:30:54.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.139+0000 7fa42aa2f700 1 -- start start 2023-10-06T05:30:54.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.139+0000 7fa42aa2f700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa4240694e0 0x7fa4240698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.139+0000 7fa42aa2f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa4240cd2e0 0x7fa42415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.139+0000 7fa42aa2f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 0x7fa42415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.139+0000 7fa42aa2f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4240cce50 con 0x7fa4240cd2e0 2023-10-06T05:30:54.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.139+0000 7fa42aa2f700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4240cc280 con 0x7fa4240694e0 2023-10-06T05:30:54.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.139+0000 7fa42aa2f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4240cc520 con 0x7fa4240ce660 2023-10-06T05:30:54.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42922c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa4240cd2e0 0x7fa42415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42922c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa4240cd2e0 0x7fa42415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50084/0 (socket says 172.21.15.29:50084) 2023-10-06T05:30:54.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42922c700 1 -- 172.21.15.29:0/3515910260 learned_addr learned my addr 172.21.15.29:0/3515910260 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:54.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa429a2d700 1 --2- 172.21.15.29:0/3515910260 >> v2:172.21.15.173:3300/0 conn(0x7fa4240694e0 0x7fa4240698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42a22e700 1 --2- 172.21.15.29:0/3515910260 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 0x7fa42415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42922c700 1 -- 172.21.15.29:0/3515910260 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 msgr2=0x7fa42415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:54.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42922c700 1 --2- 172.21.15.29:0/3515910260 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 0x7fa42415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42922c700 1 -- 172.21.15.29:0/3515910260 >> v2:172.21.15.173:3300/0 conn(0x7fa4240694e0 msgr2=0x7fa4240698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42922c700 1 --2- 172.21.15.29:0/3515910260 >> v2:172.21.15.173:3300/0 conn(0x7fa4240694e0 0x7fa4240698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42922c700 1 -- 172.21.15.29:0/3515910260 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240cc800 con 0x7fa4240cd2e0 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42922c700 1 --2- 172.21.15.29:0/3515910260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240cd2e0 0x7fa42415aab0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa424070a10 tx=0x7fa420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd741033e7dabead server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa428a2b700 1 -- 172.21.15.29:0/3515910260 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000b640 con 0x7fa4240cd2e0 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa428a2b700 1 -- 172.21.15.29:0/3515910260 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42000b7a0 con 0x7fa4240cd2e0 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa428a2b700 1 -- 172.21.15.29:0/3515910260 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000bb60 con 0x7fa4240cd2e0 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42aa2f700 1 -- 172.21.15.29:0/3515910260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240cd2e0 msgr2=0x7fa42415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/3515910260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240cd2e0 0x7fa42415aab0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa424070a10 tx=0x7fa420009250 comp rx=0 tx=0).stop 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42aa2f700 1 -- 172.21.15.29:0/3515910260 shutdown_connections 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/3515910260 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 0x7fa42415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/3515910260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240cd2e0 0x7fa42415aab0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/3515910260 >> v2:172.21.15.173:3300/0 conn(0x7fa4240694e0 0x7fa4240698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42aa2f700 1 -- 172.21.15.29:0/3515910260 >> 172.21.15.29:0/3515910260 conn(0x7fa42406d150 msgr2=0x7fa4240cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:54.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42aa2f700 1 -- 172.21.15.29:0/3515910260 shutdown_connections 2023-10-06T05:30:54.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.143+0000 7fa42aa2f700 1 -- 172.21.15.29:0/3515910260 wait complete. 2023-10-06T05:30:54.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42aa2f700 1 Processor -- start 2023-10-06T05:30:54.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42aa2f700 1 -- start start 2023-10-06T05:30:54.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42aa2f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240694e0 0x7fa4240b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42aa2f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4240cd2e0 0x7fa4240b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42aa2f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 0x7fa4240b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42aa2f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4240b32c0 con 0x7fa4240694e0 2023-10-06T05:30:54.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42aa2f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4240b26b0 con 0x7fa4240cd2e0 2023-10-06T05:30:54.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42aa2f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4240b2990 con 0x7fa4240ce660 2023-10-06T05:30:54.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa429a2d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240694e0 0x7fa4240b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa429a2d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240694e0 0x7fa4240b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50100/0 (socket says 172.21.15.29:50100) 2023-10-06T05:30:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa429a2d700 1 -- 172.21.15.29:0/1312112302 learned_addr learned my addr 172.21.15.29:0/1312112302 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42922c700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4240cd2e0 0x7fa4240b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.147+0000 7fa42a22e700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 0x7fa4240b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa429a2d700 1 -- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 msgr2=0x7fa4240b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa429a2d700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 0x7fa4240b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa429a2d700 1 -- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4240cd2e0 msgr2=0x7fa4240b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa429a2d700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4240cd2e0 0x7fa4240b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa429a2d700 1 -- 172.21.15.29:0/1312112302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4200094f0 con 0x7fa4240694e0 2023-10-06T05:30:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa42a22e700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 0x7fa4240b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:54.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa429a2d700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240694e0 0x7fa4240b1e60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa41400ec80 tx=0x7fa4140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:54.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa419ffb700 1 -- 172.21.15.29:0/1312112302 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41400c850 con 0x7fa4240694e0 2023-10-06T05:30:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa419ffb700 1 -- 172.21.15.29:0/1312112302 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41400c9b0 con 0x7fa4240694e0 2023-10-06T05:30:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4240b2c70 con 0x7fa4240694e0 2023-10-06T05:30:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa419ffb700 1 -- 172.21.15.29:0/1312112302 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41400cd50 con 0x7fa4240694e0 2023-10-06T05:30:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4240b23a0 con 0x7fa4240694e0 2023-10-06T05:30:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4240b30f0 con 0x7fa4240694e0 2023-10-06T05:30:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.151+0000 7fa419ffb700 1 -- 172.21.15.29:0/1312112302 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa414013680 con 0x7fa4240694e0 2023-10-06T05:30:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.155+0000 7fa419ffb700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa408060550 0x7fa408062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.155+0000 7fa419ffb700 1 -- 172.21.15.29:0/1312112302 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa41407cd30 con 0x7fa4240694e0 2023-10-06T05:30:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.155+0000 7fa42922c700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa408060550 0x7fa408062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.155+0000 7fa42922c700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa408060550 0x7fa408062a00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa424070a10 tx=0x7fa420017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.163+0000 7fa419ffb700 1 -- 172.21.15.29:0/1312112302 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa41404d370 con 0x7fa4240694e0 2023-10-06T05:30:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.323+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa42404be00 con 0x7fa4240694e0 2023-10-06T05:30:54.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa419ffb700 1 -- 172.21.15.29:0/1312112302 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa414050990 con 0x7fa4240694e0 2023-10-06T05:30:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa408060550 msgr2=0x7fa408062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa408060550 0x7fa408062a00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa424070a10 tx=0x7fa420017000 comp rx=0 tx=0).stop 2023-10-06T05:30:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240694e0 msgr2=0x7fa4240b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240694e0 0x7fa4240b1e60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa41400ec80 tx=0x7fa4140091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 shutdown_connections 2023-10-06T05:30:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4240ce660 0x7fa4240b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa408060550 0x7fa408062a00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4240cd2e0 0x7fa4240b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 --2- 172.21.15.29:0/1312112302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4240694e0 0x7fa4240b1e60 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.331+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 >> 172.21.15.29:0/1312112302 conn(0x7fa42406d150 msgr2=0x7fa4240cacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:54.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.335+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 shutdown_connections 2023-10-06T05:30:54.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.335+0000 7fa42aa2f700 1 -- 172.21.15.29:0/1312112302 wait complete. 2023-10-06T05:30:54.354 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2023-10-06T05:30:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c759e700 1 Processor -- start 2023-10-06T05:30:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c759e700 1 -- start start 2023-10-06T05:30:54.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c81605e0 0x7f70c80c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c759e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70c80ca3c0 0x7f70c80c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c80c2980 con 0x7f70c806b320 2023-10-06T05:30:54.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c759e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c80c6bb0 con 0x7f70c80ca3c0 2023-10-06T05:30:54.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c80c6e90 con 0x7f70c81605e0 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c6d9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70c80ca3c0 0x7f70c80c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c81605e0 0x7f70c80c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c6d9d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f70c80ca3c0 0x7f70c80c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.29:52834/0 (socket says 172.21.15.29:52834) 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c6d9d700 1 -- 172.21.15.29:0/985829082 learned_addr learned my addr 172.21.15.29:0/985829082 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c81605e0 0x7f70c80c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:56094/0 (socket says 172.21.15.29:56094) 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c6d9d700 1 -- 172.21.15.29:0/985829082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c81605e0 msgr2=0x7f70c80c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c6d9d700 1 --2- 172.21.15.29:0/985829082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c81605e0 0x7f70c80c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c6d9d700 1 -- 172.21.15.29:0/985829082 >> v1:172.21.15.173:6789/0 conn(0x7f70c806b320 legacy=0x7f70c80c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c6d9d700 1 -- 172.21.15.29:0/985829082 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c80c7170 con 0x7f70c80ca3c0 2023-10-06T05:30:54.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.459+0000 7f70c559a700 1 -- 172.21.15.29:0/985829082 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038846315 0 0) 0x7f70c80c2980 con 0x7f70c806b320 2023-10-06T05:30:54.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c6d9d700 1 --2- 172.21.15.29:0/985829082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70c80ca3c0 0x7f70c80c7c50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009f20 tx=0x7f70c0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e12d789f5be9e73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:54.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c559a700 1 -- 172.21.15.29:0/985829082 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c000e070 con 0x7f70c80ca3c0 2023-10-06T05:30:54.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c559a700 1 -- 172.21.15.29:0/985829082 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c000b9d0 con 0x7f70c80ca3c0 2023-10-06T05:30:54.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c559a700 1 -- 172.21.15.29:0/985829082 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00092e0 con 0x7f70c80ca3c0 2023-10-06T05:30:54.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 -- 172.21.15.29:0/985829082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70c80ca3c0 msgr2=0x7f70c80c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 --2- 172.21.15.29:0/985829082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70c80ca3c0 0x7f70c80c7c50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009f20 tx=0x7f70c0009840 comp rx=0 tx=0).stop 2023-10-06T05:30:54.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 -- 172.21.15.29:0/985829082 shutdown_connections 2023-10-06T05:30:54.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 --2- 172.21.15.29:0/985829082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70c80ca3c0 0x7f70c80c7c50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 --2- 172.21.15.29:0/985829082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c81605e0 0x7f70c80c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 -- 172.21.15.29:0/985829082 >> 172.21.15.29:0/985829082 conn(0x7f70c80670a0 msgr2=0x7f70c80674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:54.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 -- 172.21.15.29:0/985829082 shutdown_connections 2023-10-06T05:30:54.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 -- 172.21.15.29:0/985829082 wait complete. 2023-10-06T05:30:54.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 Processor -- start 2023-10-06T05:30:54.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 -- start start 2023-10-06T05:30:54.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c806b320 0x7f70c815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70c80ca3c0 0x7f70c8150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70c81605e0 0x7f70c80c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c8151220 con 0x7f70c81605e0 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c815d040 con 0x7f70c80ca3c0 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c815d320 con 0x7f70c806b320 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70c81605e0 0x7f70c80c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c806b320 0x7f70c815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c5d9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70c80ca3c0 0x7f70c8150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70c81605e0 0x7f70c80c17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37974/0 (socket says 172.21.15.29:37974) 2023-10-06T05:30:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.463+0000 7f70c6d9d700 1 -- 172.21.15.29:0/2965914182 learned_addr learned my addr 172.21.15.29:0/2965914182 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70c6d9d700 1 -- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c806b320 msgr2=0x7f70c815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70c6d9d700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c806b320 0x7f70c815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70c6d9d700 1 -- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70c80ca3c0 msgr2=0x7f70c8150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70c6d9d700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70c80ca3c0 0x7f70c8150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70c6d9d700 1 -- 172.21.15.29:0/2965914182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c0009ae0 con 0x7f70c81605e0 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70c6d9d700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70c81605e0 0x7f70c80c17b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f70c806df30 tx=0x7f70c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70be7fc700 1 -- 172.21.15.29:0/2965914182 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0008b10 con 0x7f70c81605e0 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70be7fc700 1 -- 172.21.15.29:0/2965914182 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0008c90 con 0x7f70c81605e0 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c815d600 con 0x7f70c81605e0 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70be7fc700 1 -- 172.21.15.29:0/2965914182 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00266b0 con 0x7f70c81605e0 2023-10-06T05:30:54.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c815dbc0 con 0x7f70c81605e0 2023-10-06T05:30:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.467+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c815ea20 con 0x7f70c81605e0 2023-10-06T05:30:54.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.471+0000 7f70be7fc700 1 -- 172.21.15.29:0/2965914182 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f70c0003040 con 0x7f70c81605e0 2023-10-06T05:30:54.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.471+0000 7f70be7fc700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f70a8060550 0x7f70a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:54.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.471+0000 7f70be7fc700 1 -- 172.21.15.29:0/2965914182 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f70c007e4e0 con 0x7f70c81605e0 2023-10-06T05:30:54.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.471+0000 7f70c659c700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f70a8060550 0x7f70a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:54.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.471+0000 7f70c659c700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f70a8060550 0x7f70a8062a00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009d10 tx=0x7f70b80091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.479+0000 7f70be7fc700 1 -- 172.21.15.29:0/2965914182 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f70c815ea20 con 0x7f70c81605e0 2023-10-06T05:30:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:54.695+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f70c815ea20 con 0x7f70c81605e0 2023-10-06T05:30:55.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.007+0000 7f70be7fc700 1 -- 172.21.15.29:0/2965914182 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v257) v1 ==== 144+0+0 (secure 0 0 0) 0x7f70c815ea20 con 0x7f70c81605e0 2023-10-06T05:30:55.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f70a8060550 msgr2=0x7f70a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f70a8060550 0x7f70a8062a00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009d10 tx=0x7f70b80091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70c81605e0 msgr2=0x7f70c80c17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70c81605e0 0x7f70c80c17b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f70c806df30 tx=0x7f70c0018000 comp rx=0 tx=0).stop 2023-10-06T05:30:55.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 shutdown_connections 2023-10-06T05:30:55.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70c81605e0 0x7f70c80c17b0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f70a8060550 0x7f70a8062a00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70c80ca3c0 0x7f70c8150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 --2- 172.21.15.29:0/2965914182 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70c806b320 0x7f70c815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 >> 172.21.15.29:0/2965914182 conn(0x7f70c80670a0 msgr2=0x7f70c813c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:55.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 shutdown_connections 2023-10-06T05:30:55.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.027+0000 7f70c759e700 1 -- 172.21.15.29:0/2965914182 wait complete. 2023-10-06T05:30:55.060 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-10-06T05:30:55.060 INFO:tasks.cephfs_test_runner: 2023-10-06T05:30:55.060 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T05:30:55.061 INFO:tasks.cephfs_test_runner:Ran 4 tests in 284.524s 2023-10-06T05:30:55.061 INFO:tasks.cephfs_test_runner: 2023-10-06T05:30:55.061 INFO:tasks.cephfs_test_runner:OK 2023-10-06T05:30:55.061 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T05:30:55.072 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T05:30:55.112 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T05:30:55.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:55.112 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-06T05:30:55.120 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T05:30:55.120 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T05:30:55.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:55.120 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T05:30:55.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:55.134 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T05:30:55.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:55.145 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-06T05:30:55.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:55.323 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-10-06T05:30:55.330 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T05:30:55.331 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T05:30:55.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:55.331 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T05:30:55.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:55.349 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T05:30:55.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T05:30:55.359 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2023-10-06T05:30:55.499 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T05:30:55.508 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T05:30:55.508 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:30:55.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcbfff700 1 Processor -- start 2023-10-06T05:30:55.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcbfff700 1 -- start start 2023-10-06T05:30:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc158c00 0x7f4bcc06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcbfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc06b250 con 0x7f4bcc0ceb90 2023-10-06T05:30:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcbfff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc06a640 con 0x7f4bcc0ce740 2023-10-06T05:30:55.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcbfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc06a920 con 0x7f4bcc158c00 2023-10-06T05:30:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcb7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4bcc0ceb90 0x7f4bcc15a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56458/0 (socket says 172.21.15.29:56458) 2023-10-06T05:30:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcb7fe700 1 -- 172.21.15.29:0/1439427300 learned_addr learned my addr 172.21.15.29:0/1439427300 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcaffd700 1 --2- 172.21.15.29:0/1439427300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc158c00 0x7f4bcc06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bc9ffb700 1 -- 172.21.15.29:0/1439427300 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248433778 0 0) 0x7f4bcc06b250 con 0x7f4bcc0ceb90 2023-10-06T05:30:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bc9ffb700 1 -- 172.21.15.29:0/1439427300 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb8003570 con 0x7f4bcc0ceb90 2023-10-06T05:30:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bc9ffb700 1 -- 172.21.15.29:0/1439427300 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112631841 0 0) 0x7f4bcc06a640 con 0x7f4bcc0ce740 2023-10-06T05:30:55.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bc9ffb700 1 -- 172.21.15.29:0/1439427300 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bcc06b250 con 0x7f4bcc0ce740 2023-10-06T05:30:55.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcaffd700 1 -- 172.21.15.29:0/1439427300 >> v1:172.21.15.173:6789/0 conn(0x7f4bcc0ce740 legacy=0x7f4bcc0cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcaffd700 1 -- 172.21.15.29:0/1439427300 >> v1:172.21.15.29:6789/0 conn(0x7f4bcc0ceb90 legacy=0x7f4bcc15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.615+0000 7f4bcaffd700 1 -- 172.21.15.29:0/1439427300 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc06ac00 con 0x7f4bcc158c00 2023-10-06T05:30:55.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcaffd700 1 --2- 172.21.15.29:0/1439427300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc158c00 0x7f4bcc06b6e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009910 tx=0x7f4bbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73c0e2cda9d276e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:55.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bc9ffb700 1 -- 172.21.15.29:0/1439427300 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc011630 con 0x7f4bcc158c00 2023-10-06T05:30:55.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bc9ffb700 1 -- 172.21.15.29:0/1439427300 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc011790 con 0x7f4bcc158c00 2023-10-06T05:30:55.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bc9ffb700 1 -- 172.21.15.29:0/1439427300 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc011b10 con 0x7f4bcc158c00 2023-10-06T05:30:55.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcbfff700 1 -- 172.21.15.29:0/1439427300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc158c00 msgr2=0x7f4bcc06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcbfff700 1 --2- 172.21.15.29:0/1439427300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc158c00 0x7f4bcc06b6e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009910 tx=0x7f4bbc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcbfff700 1 -- 172.21.15.29:0/1439427300 shutdown_connections 2023-10-06T05:30:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcbfff700 1 --2- 172.21.15.29:0/1439427300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc158c00 0x7f4bcc06b6e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcbfff700 1 -- 172.21.15.29:0/1439427300 >> 172.21.15.29:0/1439427300 conn(0x7f4bcc0670a0 msgr2=0x7f4bcc067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcbfff700 1 -- 172.21.15.29:0/1439427300 shutdown_connections 2023-10-06T05:30:55.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcbfff700 1 -- 172.21.15.29:0/1439427300 wait complete. 2023-10-06T05:30:55.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcbfff700 1 Processor -- start 2023-10-06T05:30:55.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.619+0000 7f4bcbfff700 1 -- start start 2023-10-06T05:30:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bcc0ce740 0x7f4bcc0c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc0ceb90 0x7f4bcc0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bcc158c00 0x7f4bcc145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcbfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc145d50 con 0x7f4bcc158c00 2023-10-06T05:30:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcbfff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0b3c30 con 0x7f4bcc0ce740 2023-10-06T05:30:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcbfff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0b3390 con 0x7f4bcc0ceb90 2023-10-06T05:30:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bcc158c00 0x7f4bcc145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bcc158c00 0x7f4bcc145810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37980/0 (socket says 172.21.15.29:37980) 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcb7fe700 1 -- 172.21.15.29:0/2558694002 learned_addr learned my addr 172.21.15.29:0/2558694002 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcaffd700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bcc0ce740 0x7f4bcc0c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bca7fc700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc0ceb90 0x7f4bcc0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcb7fe700 1 -- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc0ceb90 msgr2=0x7f4bcc0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcb7fe700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc0ceb90 0x7f4bcc0b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcb7fe700 1 -- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bcc0ce740 msgr2=0x7f4bcc0c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcb7fe700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bcc0ce740 0x7f4bcc0c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcb7fe700 1 -- 172.21.15.29:0/2558694002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc009420 con 0x7f4bcc158c00 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcb7fe700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bcc158c00 0x7f4bcc145810 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4001460 tx=0x7f4bc4001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bc2ffd700 1 -- 172.21.15.29:0/2558694002 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc400a8b0 con 0x7f4bcc158c00 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bc2ffd700 1 -- 172.21.15.29:0/2558694002 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc400aa10 con 0x7f4bcc158c00 2023-10-06T05:30:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc0b3670 con 0x7f4bcc158c00 2023-10-06T05:30:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bc2ffd700 1 -- 172.21.15.29:0/2558694002 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc400adb0 con 0x7f4bcc158c00 2023-10-06T05:30:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.623+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc0b4390 con 0x7f4bcc158c00 2023-10-06T05:30:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.627+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc0b45b0 con 0x7f4bcc158c00 2023-10-06T05:30:55.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.627+0000 7f4bc2ffd700 1 -- 172.21.15.29:0/2558694002 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4bc4007300 con 0x7f4bcc158c00 2023-10-06T05:30:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.627+0000 7f4bc2ffd700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4bac060550 0x7f4bac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.627+0000 7f4bc2ffd700 1 -- 172.21.15.29:0/2558694002 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4bc407c9a0 con 0x7f4bcc158c00 2023-10-06T05:30:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.627+0000 7f4bcaffd700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4bac060550 0x7f4bac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.627+0000 7f4bcaffd700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4bac060550 0x7f4bac062a00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009860 tx=0x7f4bbc017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:55.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.635+0000 7f4bc2ffd700 1 -- 172.21.15.29:0/2558694002 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4bc404d100 con 0x7f4bcc158c00 2023-10-06T05:30:55.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.795+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bcc04be00 con 0x7f4bcc158c00 2023-10-06T05:30:55.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.795+0000 7f4bc2ffd700 1 -- 172.21.15.29:0/2558694002 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+14038 (secure 0 0 0) 0x7f4bc4050720 con 0x7f4bcc158c00 2023-10-06T05:30:55.804 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:55.805 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":82,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:30:53.993389+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/1984531371":"2023-10-07T05:30:50.984022+0000","172.21.15.29:6834/1984531371":"2023-10-07T05:30:50.984022+0000","172.21.15.29:6835/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6834/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6835/3515782118":"2023-10-07T05:30:18.733272+0000","172.21.15.29:6834/3515782118":"2023-10-07T05:30:18.733272+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:30:55.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4bac060550 msgr2=0x7f4bac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4bac060550 0x7f4bac062a00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009860 tx=0x7f4bbc017000 comp rx=0 tx=0).stop 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bcc158c00 msgr2=0x7f4bcc145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bcc158c00 0x7f4bcc145810 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4001460 tx=0x7f4bc4001ac0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 shutdown_connections 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bcc158c00 0x7f4bcc145810 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4bcc0ceb90 0x7f4bcc0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f4bac060550 0x7f4bac062a00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 --2- 172.21.15.29:0/2558694002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bcc0ce740 0x7f4bcc0c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 >> 172.21.15.29:0/2558694002 conn(0x7f4bcc0670a0 msgr2=0x7f4bcc0c4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:55.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 shutdown_connections 2023-10-06T05:30:55.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.799+0000 7f4bcbfff700 1 -- 172.21.15.29:0/2558694002 wait complete. 2023-10-06T05:30:55.818 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T05:30:55.818 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:30:55.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f818aa59700 1 Processor -- start 2023-10-06T05:30:55.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f818aa59700 1 -- start start 2023-10-06T05:30:55.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f818aa59700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81841569f0 0x7f81840c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f818aa59700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81840cdb00 0x7f81840cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f818aa59700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840c9490 con 0x7f8184156dc0 2023-10-06T05:30:55.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f818aa59700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840c8950 con 0x7f81841569f0 2023-10-06T05:30:55.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f818aa59700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840ce490 con 0x7f81840cdb00 2023-10-06T05:30:55.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8189a57700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81841569f0 0x7f81840c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8189a57700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81841569f0 0x7f81840c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37994/0 (socket says 172.21.15.29:37994) 2023-10-06T05:30:55.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8189a57700 1 -- 172.21.15.29:0/343553380 learned_addr learned my addr 172.21.15.29:0/343553380 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:55.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f818a258700 1 --2- 172.21.15.29:0/343553380 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81840cdb00 0x7f81840cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8189a57700 1 -- 172.21.15.29:0/343553380 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81840cdb00 msgr2=0x7f81840cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:55.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8189a57700 1 --2- 172.21.15.29:0/343553380 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81840cdb00 0x7f81840cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8189a57700 1 -- 172.21.15.29:0/343553380 >> v1:172.21.15.173:6789/0 conn(0x7f8184156dc0 legacy=0x7f81840caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8189a57700 1 -- 172.21.15.29:0/343553380 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840c9e60 con 0x7f81841569f0 2023-10-06T05:30:55.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8189a57700 1 --2- 172.21.15.29:0/343553380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81841569f0 0x7f81840c9920 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f81800099b0 tx=0x7f8180009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71d19f252b46736 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:55.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8188a55700 1 -- 172.21.15.29:0/343553380 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818000b8f0 con 0x7f81841569f0 2023-10-06T05:30:55.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8188a55700 1 -- 172.21.15.29:0/343553380 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818000ba50 con 0x7f81841569f0 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.915+0000 7f8188a55700 1 -- 172.21.15.29:0/343553380 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818000bdf0 con 0x7f81841569f0 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 -- 172.21.15.29:0/343553380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81841569f0 msgr2=0x7f81840c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 --2- 172.21.15.29:0/343553380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81841569f0 0x7f81840c9920 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f81800099b0 tx=0x7f8180009250 comp rx=0 tx=0).stop 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 -- 172.21.15.29:0/343553380 shutdown_connections 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 --2- 172.21.15.29:0/343553380 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81840cdb00 0x7f81840cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 --2- 172.21.15.29:0/343553380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81841569f0 0x7f81840c9920 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 -- 172.21.15.29:0/343553380 >> 172.21.15.29:0/343553380 conn(0x7f81840692b0 msgr2=0x7f8184069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 -- 172.21.15.29:0/343553380 shutdown_connections 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 -- 172.21.15.29:0/343553380 wait complete. 2023-10-06T05:30:55.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 Processor -- start 2023-10-06T05:30:55.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 -- start start 2023-10-06T05:30:55.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81840cdb00 0x7f8184155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81841569f0 0x7f81840c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8184156dc0 0x7f818415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818416aaf0 con 0x7f8184156dc0 2023-10-06T05:30:55.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81840c5fc0 con 0x7f81840cdb00 2023-10-06T05:30:55.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818aa59700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840c62a0 con 0x7f81841569f0 2023-10-06T05:30:55.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818a258700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8184156dc0 0x7f818415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818a258700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8184156dc0 0x7f818415cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38008/0 (socket says 172.21.15.29:38008) 2023-10-06T05:30:55.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818a258700 1 -- 172.21.15.29:0/4026278524 learned_addr learned my addr 172.21.15.29:0/4026278524 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:55.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f8189a57700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81840cdb00 0x7f8184155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f8189256700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81841569f0 0x7f81840c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818a258700 1 -- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81841569f0 msgr2=0x7f81840c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818a258700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81841569f0 0x7f81840c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818a258700 1 -- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81840cdb00 msgr2=0x7f8184155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:55.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818a258700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81840cdb00 0x7f8184155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:55.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818a258700 1 -- 172.21.15.29:0/4026278524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81800094f0 con 0x7f8184156dc0 2023-10-06T05:30:55.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f818a258700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8184156dc0 0x7f818415cb60 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f817c009fa0 tx=0x7f817c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:55.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.919+0000 7f8179ffb700 1 -- 172.21.15.29:0/4026278524 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c00ebc0 con 0x7f8184156dc0 2023-10-06T05:30:55.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f8179ffb700 1 -- 172.21.15.29:0/4026278524 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c00ed20 con 0x7f8184156dc0 2023-10-06T05:30:55.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818416a4a0 con 0x7f8184156dc0 2023-10-06T05:30:55.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f8179ffb700 1 -- 172.21.15.29:0/4026278524 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c014670 con 0x7f8184156dc0 2023-10-06T05:30:55.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81841558d0 con 0x7f8184156dc0 2023-10-06T05:30:55.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818416aca0 con 0x7f8184156dc0 2023-10-06T05:30:55.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f8179ffb700 1 -- 172.21.15.29:0/4026278524 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f817c0149e0 con 0x7f8184156dc0 2023-10-06T05:30:55.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f8179ffb700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8168060550 0x7f8168062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:55.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f8179ffb700 1 -- 172.21.15.29:0/4026278524 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f817c07cd70 con 0x7f8184156dc0 2023-10-06T05:30:55.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f8189a57700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8168060550 0x7f8168062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:55.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.923+0000 7f8189a57700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8168060550 0x7f8168062a00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f81800099b0 tx=0x7f8180017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:55.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:55.931+0000 7f8179ffb700 1 -- 172.21.15.29:0/4026278524 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f818416aca0 con 0x7f8184156dc0 2023-10-06T05:30:56.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.087+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f818404be00 con 0x7f8168060550 2023-10-06T05:30:56.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.095+0000 7f8179ffb700 1 -- 172.21.15.29:0/4026278524 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71045 (secure 0 0 0) 0x7f818404be00 con 0x7f8168060550 2023-10-06T05:30:56.104 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:56.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8168060550 msgr2=0x7f8168062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8168060550 0x7f8168062a00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f81800099b0 tx=0x7f8180017000 comp rx=0 tx=0).stop 2023-10-06T05:30:56.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8184156dc0 msgr2=0x7f818415cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8184156dc0 0x7f818415cb60 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f817c009fa0 tx=0x7f817c009900 comp rx=0 tx=0).stop 2023-10-06T05:30:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 shutdown_connections 2023-10-06T05:30:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8184156dc0 0x7f818415cb60 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81841569f0 0x7f81840c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8168060550 0x7f8168062a00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 --2- 172.21.15.29:0/4026278524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81840cdb00 0x7f8184155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 >> 172.21.15.29:0/4026278524 conn(0x7f81840692b0 msgr2=0x7f8184157200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 shutdown_connections 2023-10-06T05:30:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.099+0000 7f818aa59700 1 -- 172.21.15.29:0/4026278524 wait complete. 2023-10-06T05:30:56.107 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:30:56.119 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-10-06T05:30:54.762791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436320,"kb_used_data":25248,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752538400,"statfs":{"total":773094113280,"available":770599321600,"internally_reserved":0,"allocated":25853952,"data_stored":21463816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390673,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-198,"num_read_kb":-192,"num_write":-166,"num_write_kb":-8287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002705"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.916745+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:30:35.916745+0000","last_peered":"2023-10-06T05:30:35.916745+0000","last_clean":"2023-10-06T05:30:35.916745+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:30:35.916745+0000","last_undegraded":"2023-10-06T05:30:35.916745+0000","last_fullsized":"2023-10-06T05:30:35.916745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.847235+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:30:35.847235+0000","last_peered":"2023-10-06T05:30:35.847235+0000","last_clean":"2023-10-06T05:30:35.847235+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:30:35.847235+0000","last_undegraded":"2023-10-06T05:30:35.847235+0000","last_fullsized":"2023-10-06T05:30:35.847235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.916658+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:30:35.916658+0000","last_peered":"2023-10-06T05:30:35.916658+0000","last_clean":"2023-10-06T05:30:35.916658+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:30:35.916658+0000","last_undegraded":"2023-10-06T05:30:35.916658+0000","last_fullsized":"2023-10-06T05:30:35.916658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.932567+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:30:35.932567+0000","last_peered":"2023-10-06T05:30:35.932567+0000","last_clean":"2023-10-06T05:30:35.932567+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:30:35.932567+0000","last_undegraded":"2023-10-06T05:30:35.932567+0000","last_fullsized":"2023-10-06T05:30:35.932567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.847766+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:30:35.847766+0000","last_peered":"2023-10-06T05:30:35.847766+0000","last_clean":"2023-10-06T05:30:35.847766+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:30:35.847766+0000","last_undegraded":"2023-10-06T05:30:35.847766+0000","last_fullsized":"2023-10-06T05:30:35.847766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.842322+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:30:35.842322+0000","last_peered":"2023-10-06T05:30:35.842322+0000","last_clean":"2023-10-06T05:30:35.842322+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:30:35.842322+0000","last_undegraded":"2023-10-06T05:30:35.842322+0000","last_fullsized":"2023-10-06T05:30:35.842322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.917279+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:30:35.917279+0000","last_peered":"2023-10-06T05:30:35.917279+0000","last_clean":"2023-10-06T05:30:35.917279+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:30:35.917279+0000","last_undegraded":"2023-10-06T05:30:35.917279+0000","last_fullsized":"2023-10-06T05:30:35.917279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.842686+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:30:35.842686+0000","last_peered":"2023-10-06T05:30:35.842686+0000","last_clean":"2023-10-06T05:30:35.842686+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:30:35.842686+0000","last_undegraded":"2023-10-06T05:30:35.842686+0000","last_fullsized":"2023-10-06T05:30:35.842686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.926069+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:30:35.926069+0000","last_peered":"2023-10-06T05:30:35.926069+0000","last_clean":"2023-10-06T05:30:35.926069+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:30:35.926069+0000","last_undegraded":"2023-10-06T05:30:35.926069+0000","last_fullsized":"2023-10-06T05:30:35.926069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1572864,"data_stored":1027704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88200000000000001,"15min":0.85199999999999998},"min":{"1min":0.51200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.92100000000000004},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.131,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93400000000000005}]},{"osd":1,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.167},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90700000000000003,"15min":0.90600000000000003},"min":{"1min":0.621,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.65400000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.878},{"interface":"front","average":{"1min":1.01,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.626,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.2270000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.77600000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.113,"15min":1.113},"min":{"1min":0.94699999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0229999999999999,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5660000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.179,"15min":1.2010000000000001},"min":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.194}]},{"osd":6,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.119,"15min":1.141},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0129999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.1339999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306448,"kb_used_data":5064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065392,"statfs":{"total":96636764160,"available":96322961408,"internally_reserved":0,"allocated":5185536,"data_stored":4634512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85799999999999998,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.2330000000000001,"5min":1.623,"15min":1.623},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65500000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.048,"5min":1.403,"15min":1.403},"last":0.87}]},{"osd":1,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.23,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.444},{"interface":"front","average":{"1min":1.022,"5min":0.99399999999999999,"15min":0.97099999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3640000000000001,"5min":1.679,"15min":1.679},"last":1.266}]},{"osd":2,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.88100000000000001,"15min":0.83299999999999996},"min":{"1min":0.61899999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.111,"5min":1.643,"15min":1.643},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97399999999999998,"15min":0.89400000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.202,"5min":1.784,"15min":1.784},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.92500000000000004,"15min":0.92100000000000004},"min":{"1min":0.73499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1819999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.022},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.109,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.278,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96299999999999997,"15min":0.95899999999999996},"min":{"1min":0.60499999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.292,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.417},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.071},"min":{"1min":0.73499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.262,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.69499999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3380000000000001,"5min":1.583,"15min":1.583},"last":1.246},{"interface":"front","average":{"1min":1.155,"5min":1.117,"15min":1.0760000000000001},"min":{"1min":0.77300000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4430000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.353}]},{"osd":7,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0149999999999999,"15min":1.0089999999999999},"min":{"1min":0.75900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1919999999999999,"5min":1.833,"15min":1.833},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.1220000000000001},"min":{"1min":0.88,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.409,"5min":1.899,"15min":1.899},"last":1.4890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302348,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069492,"statfs":{"total":96636764160,"available":96327159808,"internally_reserved":0,"allocated":987136,"data_stored":437360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.91100000000000003,"15min":0.86599999999999999},"min":{"1min":0.61399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3100000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.55600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.095,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.21}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90500000000000003,"15min":0.91500000000000004},"min":{"1min":0.58699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2310000000000001,"5min":1.409,"15min":1.409},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.93799999999999994},"min":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.411,"15min":1.411},"last":1.113}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91900000000000004,"15min":0.93899999999999995},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.98199999999999998,"15min":0.96399999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1559999999999999,"5min":1.54,"15min":1.54},"last":1.4159999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98599999999999999,"15min":0.95599999999999996},"min":{"1min":0.66500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2669999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.76200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.1419999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.999},"min":{"1min":0.69399999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1299999999999999,"5min":1.419,"15min":1.419},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1259999999999999,"15min":1.173},"min":{"1min":0.90700000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.347,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.236}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.022,"15min":1.0940000000000001},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.264,"5min":1.508,"15min":1.508},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0389999999999999,"15min":1.079},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3129999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.093,"15min":1.1339999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.399,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.159,"5min":1.173,"15min":1.2270000000000001},"min":{"1min":0.96999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3340000000000001,"5min":1.732,"15min":1.732},"last":1.042}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302356,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069484,"statfs":{"total":96636764160,"available":96327151616,"internally_reserved":0,"allocated":995328,"data_stored":440307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.873,"15min":0.80500000000000005},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2010000000000001,"5min":1.329,"15min":1.329},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.236,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88600000000000001,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0920000000000001,"5min":1.266,"15min":1.266},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.98299999999999998},"min":{"1min":0.62,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.458,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.127},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97599999999999998},"min":{"1min":0.64700000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1539999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1,"5min":0.97799999999999998,"15min":0.97399999999999998},"min":{"1min":0.76200000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2490000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.2070000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":1.0389999999999999},"min":{"1min":0.66400000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.02,"15min":1.038},"min":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3640000000000001,"5min":1.458,"15min":1.458},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.323,"5min":1.429,"15min":1.429},"last":1.069},{"interface":"front","average":{"1min":1.105,"5min":1.1359999999999999,"15min":1.167},"min":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.542,"5min":1.548,"15min":1.548},"last":1.2529999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.415,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.79000000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.425,"5min":1.75,"15min":1.75},"last":1.3049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":983040,"data_stored":437873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.071,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.111,"5min":1.379,"15min":1.379},"last":0.64700000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.72999999999999998,"15min":0.71499999999999997},"min":{"1min":0.55200000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":1.389,"15min":1.389},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81200000000000006,"15min":0.77100000000000002},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1279999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.47499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2110000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90300000000000002,"15min":0.86399999999999999},"min":{"1min":0.72199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.26,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.84699999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96499999999999997,"15min":0.99099999999999999},"min":{"1min":0.66300000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3340000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.81599999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4099999999999999,"5min":1.861,"15min":1.861},"last":1.1200000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.117,"15min":1.1240000000000001},"min":{"1min":0.93000000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.607,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.1359999999999999,"15min":1.105},"min":{"1min":0.876,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.51,"5min":1.732,"15min":1.732},"last":1.143}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0900000000000001,"15min":1.0860000000000001},"min":{"1min":0.89500000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4330000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.2030000000000001,"15min":1.2},"min":{"1min":1.01,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.55,"5min":1.968,"15min":1.968},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.194,"15min":1.171},"min":{"1min":0.79900000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.587,"5min":1.762,"15min":1.762},"last":1.278},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.93899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5009999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.026}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306444,"kb_used_data":5060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065396,"statfs":{"total":96636764160,"available":96322965504,"internally_reserved":0,"allocated":5181440,"data_stored":4632332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.51300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.107,"5min":1.29,"15min":1.29},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.93300000000000005},"min":{"1min":0.59699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.383,"15min":1.383},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.335,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.79800000000000004,"15min":0.84299999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":1.0920000000000001},"min":{"1min":0.66600000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9119999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.145,"15min":1.2210000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4219999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1000000000000001,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.752,"5min":1.829,"15min":1.829},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.111,"15min":1.175},"min":{"1min":0.80100000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8109999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2190000000000001,"15min":1.2669999999999999},"min":{"1min":0.69399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1679999999999999,"15min":1.22},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.0209999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1819999999999999,"15min":1.2589999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.6100000000000001,"5min":1.972,"15min":1.972},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.22,"5min":1.2969999999999999,"15min":1.365},"min":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.859,"5min":2.04,"15min":2.04},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306444,"kb_used_data":5060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065396,"statfs":{"total":96636764160,"available":96322965504,"internally_reserved":0,"allocated":5181440,"data_stored":4631735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0580000000000001,"5min":1.468,"15min":1.468},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.73799999999999999},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0469999999999999,"5min":1.294,"15min":1.294},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.61799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.872},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81000000000000005,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.167,"5min":1.419,"15min":1.419},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.87,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.6890000000000001,"5min":3.6890000000000001,"15min":3.6890000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.133,"15min":1.165},"min":{"1min":0.94099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.046}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.127,"15min":1.1890000000000001},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.1659999999999999,"15min":1.2230000000000001},"min":{"1min":0.92600000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.464,"5min":2.02,"15min":2.02},"last":1.1279999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1399999999999999,"15min":1.1299999999999999},"min":{"1min":0.90600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.222,"15min":1.23},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.2889999999999999},"min":{"1min":0.96499999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.4119999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.2709999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.157}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307016,"kb_used_data":5632,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94064824,"statfs":{"total":96636764160,"available":96322379776,"internally_reserved":0,"allocated":5767168,"data_stored":5221993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.077,"5min":1.208,"15min":1.208},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.71299999999999997},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89800000000000002,"15min":0.89300000000000002},"min":{"1min":0.63800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.88200000000000001}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.008,"15min":1.0129999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2929999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.004,"15min":1.016},"min":{"1min":0.74399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.169,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1759999999999999,"5min":1.49,"15min":1.49},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.159,"5min":1.155,"15min":1.157},"min":{"1min":0.877,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.403,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.236},"min":{"1min":1,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4870000000000001,"5min":1.696,"15min":1.696},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1679999999999999,"15min":1.202},"min":{"1min":0.83699999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3919999999999999,"5min":1.738,"15min":1.738},"last":1.139}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.202,"15min":1.252},"min":{"1min":0.88500000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.347,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1799999999999999,"15min":1.2270000000000001},"min":{"1min":0.81999999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2649999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.302}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:30:56.121 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:30:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f3c995700 1 Processor -- start 2023-10-06T05:30:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f3c995700 1 -- start start 2023-10-06T05:30:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f3c995700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f3806b3a0 0x7f0f380ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f3c995700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f380cb5f0 con 0x7f0f38158f80 2023-10-06T05:30:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f3c995700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f380cb8d0 con 0x7f0f380cc9a0 2023-10-06T05:30:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f3c995700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380cbbb0 con 0x7f0f3806b3a0 2023-10-06T05:30:56.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f36ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0f38158f80 0x7f0f380ca870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56470/0 (socket says 172.21.15.29:56470) 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f36ffd700 1 -- 172.21.15.29:0/229875586 learned_addr learned my addr 172.21.15.29:0/229875586 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f37fff700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f3806b3a0 0x7f0f380ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906039456 0 0) 0x7f0f380cb5f0 con 0x7f0f38158f80 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f18003570 con 0x7f0f38158f80 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825946427 0 0) 0x7f0f18003570 con 0x7f0f38158f80 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f3806b3a0 msgr2=0x7f0f380ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f3806b3a0 0x7f0f380ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 >> v1:172.21.15.173:6789/0 conn(0x7f0f380cc9a0 legacy=0x7f0f38158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380cbe90 con 0x7f0f38158f80 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f0f300017f0 con 0x7f0f38158f80 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 >> v1:172.21.15.29:6789/0 conn(0x7f0f38158f80 legacy=0x7f0f380ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f18003a90 0x7f0f18003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f18004810 0x7f0f18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f3806b3a0 0x7f0f180051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380cbbb0 con 0x7f0f18003a90 2023-10-06T05:30:56.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1800bb60 con 0x7f0f18004810 2023-10-06T05:30:56.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1800bd20 con 0x7f0f3806b3a0 2023-10-06T05:30:56.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f377fe700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f18003a90 0x7f0f18003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f36ffd700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f18004810 0x7f0f18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f37fff700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f3806b3a0 0x7f0f180051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f377fe700 1 -- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f3806b3a0 msgr2=0x7f0f180051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f377fe700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f3806b3a0 0x7f0f180051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f377fe700 1 -- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f18004810 msgr2=0x7f0f18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f377fe700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f18004810 0x7f0f18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f377fe700 1 -- 172.21.15.29:0/229875586 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f18003570 con 0x7f0f18003a90 2023-10-06T05:30:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.219+0000 7f0f36ffd700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f18004810 0x7f0f18004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f377fe700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f18003a90 0x7f0f18003ea0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0f200018b0 tx=0x7f0f20007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ef6a0610781c0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20012420 con 0x7f0f18003a90 2023-10-06T05:30:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f20012580 con 0x7f0f18003a90 2023-10-06T05:30:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f367fc700 1 -- 172.21.15.29:0/229875586 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20012920 con 0x7f0f18003a90 2023-10-06T05:30:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f3c995700 1 -- 172.21.15.29:0/229875586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f18003a90 msgr2=0x7f0f18003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f3c995700 1 --2- 172.21.15.29:0/229875586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f18003a90 0x7f0f18003ea0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0f200018b0 tx=0x7f0f20007d30 comp rx=0 tx=0).stop 2023-10-06T05:30:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f37fff700 1 -- 172.21.15.29:0/229875586 reap_dead start 2023-10-06T05:30:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f3c995700 1 -- 172.21.15.29:0/229875586 shutdown_connections 2023-10-06T05:30:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f3c995700 1 -- 172.21.15.29:0/229875586 >> 172.21.15.29:0/229875586 conn(0x7f0f38067b30 msgr2=0x7f0f3806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f3c995700 1 -- 172.21.15.29:0/229875586 shutdown_connections 2023-10-06T05:30:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f3c995700 1 -- 172.21.15.29:0/229875586 wait complete. 2023-10-06T05:30:56.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f3c995700 1 Processor -- start 2023-10-06T05:30:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.223+0000 7f0f3c995700 1 -- start start 2023-10-06T05:30:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f3c995700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f18003a90 0x7f0f381446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f3c995700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f380c8e30 0x7f0f38154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f3c995700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f381546b0 0x7f0f3815b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f3c995700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f38154b20 con 0x7f0f380c8e30 2023-10-06T05:30:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f3c995700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3815c490 con 0x7f0f381546b0 2023-10-06T05:30:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f3c995700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3815c770 con 0x7f0f18003a90 2023-10-06T05:30:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f36ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f380c8e30 0x7f0f38154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f36ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f380c8e30 0x7f0f38154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38026/0 (socket says 172.21.15.29:38026) 2023-10-06T05:30:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f36ffd700 1 -- 172.21.15.29:0/1460479235 learned_addr learned my addr 172.21.15.29:0/1460479235 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f377fe700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f18003a90 0x7f0f381446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f37fff700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f381546b0 0x7f0f3815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f36ffd700 1 -- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f18003a90 msgr2=0x7f0f381446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f36ffd700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f18003a90 0x7f0f381446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f36ffd700 1 -- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f381546b0 msgr2=0x7f0f3815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f36ffd700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f381546b0 0x7f0f3815b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f36ffd700 1 -- 172.21.15.29:0/1460479235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3815ca50 con 0x7f0f380c8e30 2023-10-06T05:30:56.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f37fff700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f381546b0 0x7f0f3815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:30:56.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f36ffd700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f380c8e30 0x7f0f38154170 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001f80 tx=0x7f0f381593d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:56.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f2f7fe700 1 -- 172.21.15.29:0/1460479235 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300133f0 con 0x7f0f380c8e30 2023-10-06T05:30:56.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f2f7fe700 1 -- 172.21.15.29:0/1460479235 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f30013550 con 0x7f0f380c8e30 2023-10-06T05:30:56.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3815cd30 con 0x7f0f380c8e30 2023-10-06T05:30:56.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f2f7fe700 1 -- 172.21.15.29:0/1460479235 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300138d0 con 0x7f0f380c8e30 2023-10-06T05:30:56.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f38144c00 con 0x7f0f380c8e30 2023-10-06T05:30:56.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.227+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3815d230 con 0x7f0f380c8e30 2023-10-06T05:30:56.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.231+0000 7f0f2f7fe700 1 -- 172.21.15.29:0/1460479235 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0f30013c40 con 0x7f0f380c8e30 2023-10-06T05:30:56.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.231+0000 7f0f2f7fe700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f1c060550 0x7f0f1c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.231+0000 7f0f2f7fe700 1 -- 172.21.15.29:0/1460479235 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0f3007d710 con 0x7f0f380c8e30 2023-10-06T05:30:56.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.231+0000 7f0f377fe700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f1c060550 0x7f0f1c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.231+0000 7f0f377fe700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f1c060550 0x7f0f1c062a00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0f20001010 tx=0x7f0f20015000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:56.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.235+0000 7f0f2f7fe700 1 -- 172.21.15.29:0/1460479235 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0f3004ddf0 con 0x7f0f380c8e30 2023-10-06T05:30:56.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.399+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f3804be00 con 0x7f0f1c060550 2023-10-06T05:30:56.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f2f7fe700 1 -- 172.21.15.29:0/1460479235 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71045 (secure 0 0 0) 0x7f0f3804be00 con 0x7f0f1c060550 2023-10-06T05:30:56.413 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:56.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f1c060550 msgr2=0x7f0f1c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f1c060550 0x7f0f1c062a00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0f20001010 tx=0x7f0f20015000 comp rx=0 tx=0).stop 2023-10-06T05:30:56.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f380c8e30 msgr2=0x7f0f38154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f380c8e30 0x7f0f38154170 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001f80 tx=0x7f0f381593d0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 shutdown_connections 2023-10-06T05:30:56.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f0f1c060550 0x7f0f1c062a00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f381546b0 0x7f0f3815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f380c8e30 0x7f0f38154170 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 --2- 172.21.15.29:0/1460479235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f18003a90 0x7f0f381446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 >> 172.21.15.29:0/1460479235 conn(0x7f0f38067b30 msgr2=0x7f0f380c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:56.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 shutdown_connections 2023-10-06T05:30:56.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.407+0000 7f0f3c995700 1 -- 172.21.15.29:0/1460479235 wait complete. 2023-10-06T05:30:56.417 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:30:56.429 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-10-06T05:30:54.762791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436320,"kb_used_data":25248,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752538400,"statfs":{"total":773094113280,"available":770599321600,"internally_reserved":0,"allocated":25853952,"data_stored":21463816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390673,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-198,"num_read_kb":-192,"num_write":-166,"num_write_kb":-8287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002705"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.916745+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:30:35.916745+0000","last_peered":"2023-10-06T05:30:35.916745+0000","last_clean":"2023-10-06T05:30:35.916745+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:30:35.916745+0000","last_undegraded":"2023-10-06T05:30:35.916745+0000","last_fullsized":"2023-10-06T05:30:35.916745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.847235+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:30:35.847235+0000","last_peered":"2023-10-06T05:30:35.847235+0000","last_clean":"2023-10-06T05:30:35.847235+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:30:35.847235+0000","last_undegraded":"2023-10-06T05:30:35.847235+0000","last_fullsized":"2023-10-06T05:30:35.847235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.916658+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:30:35.916658+0000","last_peered":"2023-10-06T05:30:35.916658+0000","last_clean":"2023-10-06T05:30:35.916658+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:30:35.916658+0000","last_undegraded":"2023-10-06T05:30:35.916658+0000","last_fullsized":"2023-10-06T05:30:35.916658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.932567+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:30:35.932567+0000","last_peered":"2023-10-06T05:30:35.932567+0000","last_clean":"2023-10-06T05:30:35.932567+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:30:35.932567+0000","last_undegraded":"2023-10-06T05:30:35.932567+0000","last_fullsized":"2023-10-06T05:30:35.932567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.847766+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:30:35.847766+0000","last_peered":"2023-10-06T05:30:35.847766+0000","last_clean":"2023-10-06T05:30:35.847766+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:30:35.847766+0000","last_undegraded":"2023-10-06T05:30:35.847766+0000","last_fullsized":"2023-10-06T05:30:35.847766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.842322+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:30:35.842322+0000","last_peered":"2023-10-06T05:30:35.842322+0000","last_clean":"2023-10-06T05:30:35.842322+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:30:35.842322+0000","last_undegraded":"2023-10-06T05:30:35.842322+0000","last_fullsized":"2023-10-06T05:30:35.842322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.917279+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:30:35.917279+0000","last_peered":"2023-10-06T05:30:35.917279+0000","last_clean":"2023-10-06T05:30:35.917279+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:30:35.917279+0000","last_undegraded":"2023-10-06T05:30:35.917279+0000","last_fullsized":"2023-10-06T05:30:35.917279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.842686+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:30:35.842686+0000","last_peered":"2023-10-06T05:30:35.842686+0000","last_clean":"2023-10-06T05:30:35.842686+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:30:35.842686+0000","last_undegraded":"2023-10-06T05:30:35.842686+0000","last_fullsized":"2023-10-06T05:30:35.842686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.926069+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:30:35.926069+0000","last_peered":"2023-10-06T05:30:35.926069+0000","last_clean":"2023-10-06T05:30:35.926069+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:30:35.926069+0000","last_undegraded":"2023-10-06T05:30:35.926069+0000","last_fullsized":"2023-10-06T05:30:35.926069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1572864,"data_stored":1027704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88200000000000001,"15min":0.85199999999999998},"min":{"1min":0.51200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.92100000000000004},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.131,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93400000000000005}]},{"osd":1,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.167},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90700000000000003,"15min":0.90600000000000003},"min":{"1min":0.621,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.65400000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.878},{"interface":"front","average":{"1min":1.01,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.626,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.2270000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.77600000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.113,"15min":1.113},"min":{"1min":0.94699999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0229999999999999,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5660000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.179,"15min":1.2010000000000001},"min":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.194}]},{"osd":6,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.119,"15min":1.141},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0129999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.1339999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306448,"kb_used_data":5064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065392,"statfs":{"total":96636764160,"available":96322961408,"internally_reserved":0,"allocated":5185536,"data_stored":4634512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85799999999999998,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.2330000000000001,"5min":1.623,"15min":1.623},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65500000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.048,"5min":1.403,"15min":1.403},"last":0.87}]},{"osd":1,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.23,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.444},{"interface":"front","average":{"1min":1.022,"5min":0.99399999999999999,"15min":0.97099999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3640000000000001,"5min":1.679,"15min":1.679},"last":1.266}]},{"osd":2,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.88100000000000001,"15min":0.83299999999999996},"min":{"1min":0.61899999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.111,"5min":1.643,"15min":1.643},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97399999999999998,"15min":0.89400000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.202,"5min":1.784,"15min":1.784},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.92500000000000004,"15min":0.92100000000000004},"min":{"1min":0.73499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1819999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.022},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.109,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.278,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96299999999999997,"15min":0.95899999999999996},"min":{"1min":0.60499999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.292,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.417},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.071},"min":{"1min":0.73499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.262,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.69499999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3380000000000001,"5min":1.583,"15min":1.583},"last":1.246},{"interface":"front","average":{"1min":1.155,"5min":1.117,"15min":1.0760000000000001},"min":{"1min":0.77300000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4430000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.353}]},{"osd":7,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0149999999999999,"15min":1.0089999999999999},"min":{"1min":0.75900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1919999999999999,"5min":1.833,"15min":1.833},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.1220000000000001},"min":{"1min":0.88,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.409,"5min":1.899,"15min":1.899},"last":1.4890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302348,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069492,"statfs":{"total":96636764160,"available":96327159808,"internally_reserved":0,"allocated":987136,"data_stored":437360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.91100000000000003,"15min":0.86599999999999999},"min":{"1min":0.61399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3100000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.55600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.095,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.21}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90500000000000003,"15min":0.91500000000000004},"min":{"1min":0.58699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2310000000000001,"5min":1.409,"15min":1.409},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.93799999999999994},"min":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.411,"15min":1.411},"last":1.113}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91900000000000004,"15min":0.93899999999999995},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.98199999999999998,"15min":0.96399999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1559999999999999,"5min":1.54,"15min":1.54},"last":1.4159999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98599999999999999,"15min":0.95599999999999996},"min":{"1min":0.66500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2669999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.76200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.1419999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.999},"min":{"1min":0.69399999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1299999999999999,"5min":1.419,"15min":1.419},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1259999999999999,"15min":1.173},"min":{"1min":0.90700000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.347,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.236}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.022,"15min":1.0940000000000001},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.264,"5min":1.508,"15min":1.508},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0389999999999999,"15min":1.079},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3129999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.093,"15min":1.1339999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.399,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.159,"5min":1.173,"15min":1.2270000000000001},"min":{"1min":0.96999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3340000000000001,"5min":1.732,"15min":1.732},"last":1.042}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302356,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069484,"statfs":{"total":96636764160,"available":96327151616,"internally_reserved":0,"allocated":995328,"data_stored":440307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.873,"15min":0.80500000000000005},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2010000000000001,"5min":1.329,"15min":1.329},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.236,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88600000000000001,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0920000000000001,"5min":1.266,"15min":1.266},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.98299999999999998},"min":{"1min":0.62,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.458,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.127},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97599999999999998},"min":{"1min":0.64700000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1539999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1,"5min":0.97799999999999998,"15min":0.97399999999999998},"min":{"1min":0.76200000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2490000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.2070000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":1.0389999999999999},"min":{"1min":0.66400000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.02,"15min":1.038},"min":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3640000000000001,"5min":1.458,"15min":1.458},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.323,"5min":1.429,"15min":1.429},"last":1.069},{"interface":"front","average":{"1min":1.105,"5min":1.1359999999999999,"15min":1.167},"min":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.542,"5min":1.548,"15min":1.548},"last":1.2529999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.415,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.79000000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.425,"5min":1.75,"15min":1.75},"last":1.3049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":983040,"data_stored":437873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.071,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.111,"5min":1.379,"15min":1.379},"last":0.64700000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.72999999999999998,"15min":0.71499999999999997},"min":{"1min":0.55200000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":1.389,"15min":1.389},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81200000000000006,"15min":0.77100000000000002},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1279999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.47499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2110000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90300000000000002,"15min":0.86399999999999999},"min":{"1min":0.72199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.26,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.84699999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96499999999999997,"15min":0.99099999999999999},"min":{"1min":0.66300000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3340000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.81599999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4099999999999999,"5min":1.861,"15min":1.861},"last":1.1200000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.117,"15min":1.1240000000000001},"min":{"1min":0.93000000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.607,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.1359999999999999,"15min":1.105},"min":{"1min":0.876,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.51,"5min":1.732,"15min":1.732},"last":1.143}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0900000000000001,"15min":1.0860000000000001},"min":{"1min":0.89500000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4330000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.2030000000000001,"15min":1.2},"min":{"1min":1.01,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.55,"5min":1.968,"15min":1.968},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.194,"15min":1.171},"min":{"1min":0.79900000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.587,"5min":1.762,"15min":1.762},"last":1.278},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.93899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5009999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.026}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306444,"kb_used_data":5060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065396,"statfs":{"total":96636764160,"available":96322965504,"internally_reserved":0,"allocated":5181440,"data_stored":4632332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.51300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.107,"5min":1.29,"15min":1.29},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.93300000000000005},"min":{"1min":0.59699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.383,"15min":1.383},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.335,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.79800000000000004,"15min":0.84299999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":1.0920000000000001},"min":{"1min":0.66600000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9119999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.145,"15min":1.2210000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4219999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1000000000000001,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.752,"5min":1.829,"15min":1.829},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.111,"15min":1.175},"min":{"1min":0.80100000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8109999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2190000000000001,"15min":1.2669999999999999},"min":{"1min":0.69399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1679999999999999,"15min":1.22},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.0209999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1819999999999999,"15min":1.2589999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.6100000000000001,"5min":1.972,"15min":1.972},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.22,"5min":1.2969999999999999,"15min":1.365},"min":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.859,"5min":2.04,"15min":2.04},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306444,"kb_used_data":5060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065396,"statfs":{"total":96636764160,"available":96322965504,"internally_reserved":0,"allocated":5181440,"data_stored":4631735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0580000000000001,"5min":1.468,"15min":1.468},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.73799999999999999},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0469999999999999,"5min":1.294,"15min":1.294},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.61799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.872},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81000000000000005,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.167,"5min":1.419,"15min":1.419},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.87,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.6890000000000001,"5min":3.6890000000000001,"15min":3.6890000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.133,"15min":1.165},"min":{"1min":0.94099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.046}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.127,"15min":1.1890000000000001},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.1659999999999999,"15min":1.2230000000000001},"min":{"1min":0.92600000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.464,"5min":2.02,"15min":2.02},"last":1.1279999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1399999999999999,"15min":1.1299999999999999},"min":{"1min":0.90600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.222,"15min":1.23},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.2889999999999999},"min":{"1min":0.96499999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.4119999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.2709999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.157}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307016,"kb_used_data":5632,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94064824,"statfs":{"total":96636764160,"available":96322379776,"internally_reserved":0,"allocated":5767168,"data_stored":5221993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.077,"5min":1.208,"15min":1.208},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.71299999999999997},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89800000000000002,"15min":0.89300000000000002},"min":{"1min":0.63800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.88200000000000001}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.008,"15min":1.0129999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2929999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.004,"15min":1.016},"min":{"1min":0.74399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.169,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1759999999999999,"5min":1.49,"15min":1.49},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.159,"5min":1.155,"15min":1.157},"min":{"1min":0.877,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.403,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.236},"min":{"1min":1,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4870000000000001,"5min":1.696,"15min":1.696},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1679999999999999,"15min":1.202},"min":{"1min":0.83699999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3919999999999999,"5min":1.738,"15min":1.738},"last":1.139}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.202,"15min":1.252},"min":{"1min":0.88500000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.347,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1799999999999999,"15min":1.2270000000000001},"min":{"1min":0.81999999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2649999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.302}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:30:56.431 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T05:30:56.431 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:30:56.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fcce0eea700 1 Processor -- start 2023-10-06T05:30:56.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fcce0eea700 1 -- start start 2023-10-06T05:30:56.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fcce0eea700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fccdc0cc750 0x7fccdc159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fcce0eea700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0c8870 con 0x7fccdc155980 2023-10-06T05:30:56.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fcce0eea700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc15a760 con 0x7fccdc155d50 2023-10-06T05:30:56.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fcce0eea700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc159ec0 con 0x7fccdc0cc750 2023-10-06T05:30:56.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fccd9d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fccdc0cc750 0x7fccdc159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fccd9d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fccdc0cc750 0x7fccdc159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38030/0 (socket says 172.21.15.29:38030) 2023-10-06T05:30:56.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fccd9d9b700 1 -- 172.21.15.29:0/4070861090 learned_addr learned my addr 172.21.15.29:0/4070861090 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:56.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fccd9d9b700 1 -- 172.21.15.29:0/4070861090 >> v1:172.21.15.173:6789/0 conn(0x7fccdc155d50 legacy=0x7fccdc0c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fccd9d9b700 1 -- 172.21.15.29:0/4070861090 >> v1:172.21.15.29:6789/0 conn(0x7fccdc155980 legacy=0x7fccdc0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fccd9d9b700 1 -- 172.21.15.29:0/4070861090 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc15a1a0 con 0x7fccdc0cc750 2023-10-06T05:30:56.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fccd959a700 1 -- 172.21.15.29:0/4070861090 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496800512 0 0) 0x7fccdc0c8870 con 0x7fccdc155980 2023-10-06T05:30:56.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fccd9d9b700 1 --2- 172.21.15.29:0/4070861090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 0x7fccdc159800 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fccc400bc50 tx=0x7fccc400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf81e83f758162d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:56.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.527+0000 7fccd959a700 1 -- 172.21.15.29:0/4070861090 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc400be60 con 0x7fccdc0cc750 2023-10-06T05:30:56.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fccd959a700 1 -- 172.21.15.29:0/4070861090 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc400de00 con 0x7fccdc0cc750 2023-10-06T05:30:56.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fccd959a700 1 -- 172.21.15.29:0/4070861090 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc40196b0 con 0x7fccdc0cc750 2023-10-06T05:30:56.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fcce0eea700 1 -- 172.21.15.29:0/4070861090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 msgr2=0x7fccdc159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fcce0eea700 1 --2- 172.21.15.29:0/4070861090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 0x7fccdc159800 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fccc400bc50 tx=0x7fccc400b4f0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fcce0eea700 1 -- 172.21.15.29:0/4070861090 shutdown_connections 2023-10-06T05:30:56.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fcce0eea700 1 --2- 172.21.15.29:0/4070861090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 0x7fccdc159800 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fcce0eea700 1 -- 172.21.15.29:0/4070861090 >> 172.21.15.29:0/4070861090 conn(0x7fccdc06e270 msgr2=0x7fccdc0675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:56.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fcce0eea700 1 -- 172.21.15.29:0/4070861090 shutdown_connections 2023-10-06T05:30:56.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fcce0eea700 1 -- 172.21.15.29:0/4070861090 wait complete. 2023-10-06T05:30:56.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fcce0eea700 1 Processor -- start 2023-10-06T05:30:56.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.531+0000 7fcce0eea700 1 -- start start 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fcce0eea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 0x7fccdc165790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fcce0eea700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccdc155980 0x7fccdc14edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fcce0eea700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccdc155d50 0x7fccdc156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fcce0eea700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c4f20 con 0x7fccdc0cc750 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fcce0eea700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc165cd0 con 0x7fccdc155d50 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fcce0eea700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c4710 con 0x7fccdc155980 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccda59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 0x7fccdc165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccda59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 0x7fccdc165790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38040/0 (socket says 172.21.15.29:38040) 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccda59c700 1 -- 172.21.15.29:0/973691191 learned_addr learned my addr 172.21.15.29:0/973691191 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccd9d9b700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccdc155980 0x7fccdc14edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccdad9d700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccdc155d50 0x7fccdc156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccda59c700 1 -- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccdc155980 msgr2=0x7fccdc14edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccda59c700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccdc155980 0x7fccdc14edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccda59c700 1 -- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccdc155d50 msgr2=0x7fccdc156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccda59c700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccdc155d50 0x7fccdc156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccda59c700 1 -- 172.21.15.29:0/973691191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc400b790 con 0x7fccdc0cc750 2023-10-06T05:30:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccda59c700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 0x7fccdc165790 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00cb60 tx=0x7fcccc001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccd27fc700 1 -- 172.21.15.29:0/973691191 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00a7e0 con 0x7fccdc0cc750 2023-10-06T05:30:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccd27fc700 1 -- 172.21.15.29:0/973691191 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc00a960 con 0x7fccdc0cc750 2023-10-06T05:30:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc165300 con 0x7fccdc0cc750 2023-10-06T05:30:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fccd27fc700 1 -- 172.21.15.29:0/973691191 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00ad20 con 0x7fccdc0cc750 2023-10-06T05:30:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.535+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc0c4960 con 0x7fccdc0cc750 2023-10-06T05:30:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.539+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc04be00 con 0x7fccdc0cc750 2023-10-06T05:30:56.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.539+0000 7fccd27fc700 1 -- 172.21.15.29:0/973691191 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcccc003030 con 0x7fccdc0cc750 2023-10-06T05:30:56.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.539+0000 7fccd27fc700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fccbc060550 0x7fccbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.539+0000 7fccd27fc700 1 -- 172.21.15.29:0/973691191 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcccc07c850 con 0x7fccdc0cc750 2023-10-06T05:30:56.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.539+0000 7fccd9d9b700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fccbc060550 0x7fccbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.539+0000 7fccd9d9b700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fccbc060550 0x7fccbc062a00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fccc400bc50 tx=0x7fccc401b000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:56.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.547+0000 7fccd27fc700 1 -- 172.21.15.29:0/973691191 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcccc04ce90 con 0x7fccdc0cc750 2023-10-06T05:30:56.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.707+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fccdc15a480 con 0x7fccbc060550 2023-10-06T05:30:56.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fccd27fc700 1 -- 172.21.15.29:0/973691191 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71045 (secure 0 0 0) 0x7fccdc15a480 con 0x7fccbc060550 2023-10-06T05:30:56.723 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:56.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fccbc060550 msgr2=0x7fccbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fccbc060550 0x7fccbc062a00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fccc400bc50 tx=0x7fccc401b000 comp rx=0 tx=0).stop 2023-10-06T05:30:56.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 msgr2=0x7fccdc165790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 0x7fccdc165790 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00cb60 tx=0x7fcccc001770 comp rx=0 tx=0).stop 2023-10-06T05:30:56.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 shutdown_connections 2023-10-06T05:30:56.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fccbc060550 0x7fccbc062a00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccdc155d50 0x7fccdc156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fccdc155980 0x7fccdc14edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 --2- 172.21.15.29:0/973691191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fccdc0cc750 0x7fccdc165790 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 >> 172.21.15.29:0/973691191 conn(0x7fccdc06e270 msgr2=0x7fccdc151780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:56.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 shutdown_connections 2023-10-06T05:30:56.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.715+0000 7fcce0eea700 1 -- 172.21.15.29:0/973691191 wait complete. 2023-10-06T05:30:56.728 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:30:56.739 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-10-06T05:30:54.762791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436320,"kb_used_data":25248,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752538400,"statfs":{"total":773094113280,"available":770599321600,"internally_reserved":0,"allocated":25853952,"data_stored":21463816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390673,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-198,"num_read_kb":-192,"num_write":-166,"num_write_kb":-8287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002705"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.916745+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:30:35.916745+0000","last_peered":"2023-10-06T05:30:35.916745+0000","last_clean":"2023-10-06T05:30:35.916745+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:30:35.916745+0000","last_undegraded":"2023-10-06T05:30:35.916745+0000","last_fullsized":"2023-10-06T05:30:35.916745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.847235+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:30:35.847235+0000","last_peered":"2023-10-06T05:30:35.847235+0000","last_clean":"2023-10-06T05:30:35.847235+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:30:35.847235+0000","last_undegraded":"2023-10-06T05:30:35.847235+0000","last_fullsized":"2023-10-06T05:30:35.847235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.916658+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:30:35.916658+0000","last_peered":"2023-10-06T05:30:35.916658+0000","last_clean":"2023-10-06T05:30:35.916658+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:30:35.916658+0000","last_undegraded":"2023-10-06T05:30:35.916658+0000","last_fullsized":"2023-10-06T05:30:35.916658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.932567+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:30:35.932567+0000","last_peered":"2023-10-06T05:30:35.932567+0000","last_clean":"2023-10-06T05:30:35.932567+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:30:35.932567+0000","last_undegraded":"2023-10-06T05:30:35.932567+0000","last_fullsized":"2023-10-06T05:30:35.932567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.847766+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:30:35.847766+0000","last_peered":"2023-10-06T05:30:35.847766+0000","last_clean":"2023-10-06T05:30:35.847766+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:30:35.847766+0000","last_undegraded":"2023-10-06T05:30:35.847766+0000","last_fullsized":"2023-10-06T05:30:35.847766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.842322+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:30:35.842322+0000","last_peered":"2023-10-06T05:30:35.842322+0000","last_clean":"2023-10-06T05:30:35.842322+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:30:35.842322+0000","last_undegraded":"2023-10-06T05:30:35.842322+0000","last_fullsized":"2023-10-06T05:30:35.842322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.917279+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:30:35.917279+0000","last_peered":"2023-10-06T05:30:35.917279+0000","last_clean":"2023-10-06T05:30:35.917279+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:30:35.917279+0000","last_undegraded":"2023-10-06T05:30:35.917279+0000","last_fullsized":"2023-10-06T05:30:35.917279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.842686+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:30:35.842686+0000","last_peered":"2023-10-06T05:30:35.842686+0000","last_clean":"2023-10-06T05:30:35.842686+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:30:35.842686+0000","last_undegraded":"2023-10-06T05:30:35.842686+0000","last_fullsized":"2023-10-06T05:30:35.842686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-06T05:30:35.926069+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:30:35.926069+0000","last_peered":"2023-10-06T05:30:35.926069+0000","last_clean":"2023-10-06T05:30:35.926069+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:30:35.926069+0000","last_undegraded":"2023-10-06T05:30:35.926069+0000","last_fullsized":"2023-10-06T05:30:35.926069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1572864,"data_stored":1027704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88200000000000001,"15min":0.85199999999999998},"min":{"1min":0.51200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.92100000000000004},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.131,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93400000000000005}]},{"osd":1,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.167},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90700000000000003,"15min":0.90600000000000003},"min":{"1min":0.621,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.65400000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.878},{"interface":"front","average":{"1min":1.01,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.626,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.2270000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.77600000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.113,"15min":1.113},"min":{"1min":0.94699999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0229999999999999,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5660000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.179,"15min":1.2010000000000001},"min":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.194}]},{"osd":6,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.119,"15min":1.141},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0129999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.1339999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306448,"kb_used_data":5064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065392,"statfs":{"total":96636764160,"available":96322961408,"internally_reserved":0,"allocated":5185536,"data_stored":4634512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85799999999999998,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.2330000000000001,"5min":1.623,"15min":1.623},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65500000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.048,"5min":1.403,"15min":1.403},"last":0.87}]},{"osd":1,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.23,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.444},{"interface":"front","average":{"1min":1.022,"5min":0.99399999999999999,"15min":0.97099999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3640000000000001,"5min":1.679,"15min":1.679},"last":1.266}]},{"osd":2,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.88100000000000001,"15min":0.83299999999999996},"min":{"1min":0.61899999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.111,"5min":1.643,"15min":1.643},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97399999999999998,"15min":0.89400000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.202,"5min":1.784,"15min":1.784},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.92500000000000004,"15min":0.92100000000000004},"min":{"1min":0.73499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1819999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.022},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.109,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.278,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.3899999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96299999999999997,"15min":0.95899999999999996},"min":{"1min":0.60499999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.292,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.417},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.071},"min":{"1min":0.73499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.262,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.69499999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3380000000000001,"5min":1.583,"15min":1.583},"last":1.246},{"interface":"front","average":{"1min":1.155,"5min":1.117,"15min":1.0760000000000001},"min":{"1min":0.77300000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4430000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.353}]},{"osd":7,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0149999999999999,"15min":1.0089999999999999},"min":{"1min":0.75900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1919999999999999,"5min":1.833,"15min":1.833},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.1220000000000001},"min":{"1min":0.88,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.409,"5min":1.899,"15min":1.899},"last":1.4890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302348,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069492,"statfs":{"total":96636764160,"available":96327159808,"internally_reserved":0,"allocated":987136,"data_stored":437360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.91100000000000003,"15min":0.86599999999999999},"min":{"1min":0.61399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3100000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.55600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.095,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.21}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90500000000000003,"15min":0.91500000000000004},"min":{"1min":0.58699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2310000000000001,"5min":1.409,"15min":1.409},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.93799999999999994},"min":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.411,"15min":1.411},"last":1.113}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91900000000000004,"15min":0.93899999999999995},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.98199999999999998,"15min":0.96399999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1559999999999999,"5min":1.54,"15min":1.54},"last":1.4159999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98599999999999999,"15min":0.95599999999999996},"min":{"1min":0.66500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2669999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.76200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.1419999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.999},"min":{"1min":0.69399999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1299999999999999,"5min":1.419,"15min":1.419},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1259999999999999,"15min":1.173},"min":{"1min":0.90700000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.347,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.236}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.022,"15min":1.0940000000000001},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.264,"5min":1.508,"15min":1.508},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0389999999999999,"15min":1.079},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3129999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.093,"15min":1.1339999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.399,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.159,"5min":1.173,"15min":1.2270000000000001},"min":{"1min":0.96999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3340000000000001,"5min":1.732,"15min":1.732},"last":1.042}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302356,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069484,"statfs":{"total":96636764160,"available":96327151616,"internally_reserved":0,"allocated":995328,"data_stored":440307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.873,"15min":0.80500000000000005},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2010000000000001,"5min":1.329,"15min":1.329},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.236,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88600000000000001,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0920000000000001,"5min":1.266,"15min":1.266},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.98299999999999998},"min":{"1min":0.62,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.458,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.127},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97599999999999998},"min":{"1min":0.64700000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1539999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1,"5min":0.97799999999999998,"15min":0.97399999999999998},"min":{"1min":0.76200000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2490000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.2070000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":1.0389999999999999},"min":{"1min":0.66400000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.02,"15min":1.038},"min":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3640000000000001,"5min":1.458,"15min":1.458},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.323,"5min":1.429,"15min":1.429},"last":1.069},{"interface":"front","average":{"1min":1.105,"5min":1.1359999999999999,"15min":1.167},"min":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.542,"5min":1.548,"15min":1.548},"last":1.2529999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.415,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.79000000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.425,"5min":1.75,"15min":1.75},"last":1.3049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":983040,"data_stored":437873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.071,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.111,"5min":1.379,"15min":1.379},"last":0.64700000000000002}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.72999999999999998,"15min":0.71499999999999997},"min":{"1min":0.55200000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":1.389,"15min":1.389},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81200000000000006,"15min":0.77100000000000002},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1279999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.47499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2110000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90300000000000002,"15min":0.86399999999999999},"min":{"1min":0.72199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.26,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.84699999999999998}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96499999999999997,"15min":0.99099999999999999},"min":{"1min":0.66300000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3340000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.81599999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4099999999999999,"5min":1.861,"15min":1.861},"last":1.1200000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.117,"15min":1.1240000000000001},"min":{"1min":0.93000000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.607,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.1359999999999999,"15min":1.105},"min":{"1min":0.876,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.51,"5min":1.732,"15min":1.732},"last":1.143}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0900000000000001,"15min":1.0860000000000001},"min":{"1min":0.89500000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4330000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.2030000000000001,"15min":1.2},"min":{"1min":1.01,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.55,"5min":1.968,"15min":1.968},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.194,"15min":1.171},"min":{"1min":0.79900000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.587,"5min":1.762,"15min":1.762},"last":1.278},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.93899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5009999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.026}]}]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306444,"kb_used_data":5060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065396,"statfs":{"total":96636764160,"available":96322965504,"internally_reserved":0,"allocated":5181440,"data_stored":4632332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.51300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.107,"5min":1.29,"15min":1.29},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.93300000000000005},"min":{"1min":0.59699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.383,"15min":1.383},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.335,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.79800000000000004,"15min":0.84299999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":1.0920000000000001},"min":{"1min":0.66600000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9119999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.145,"15min":1.2210000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4219999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1000000000000001,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.752,"5min":1.829,"15min":1.829},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.111,"15min":1.175},"min":{"1min":0.80100000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8109999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2190000000000001,"15min":1.2669999999999999},"min":{"1min":0.69399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1679999999999999,"15min":1.22},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.0209999999999999}]},{"osd":7,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1819999999999999,"15min":1.2589999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.6100000000000001,"5min":1.972,"15min":1.972},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.22,"5min":1.2969999999999999,"15min":1.365},"min":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.859,"5min":2.04,"15min":2.04},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306444,"kb_used_data":5060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065396,"statfs":{"total":96636764160,"available":96322965504,"internally_reserved":0,"allocated":5181440,"data_stored":4631735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0580000000000001,"5min":1.468,"15min":1.468},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.73799999999999999},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0469999999999999,"5min":1.294,"15min":1.294},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.61799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.872},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81000000000000005,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.167,"5min":1.419,"15min":1.419},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.87,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.6890000000000001,"5min":3.6890000000000001,"15min":3.6890000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.133,"15min":1.165},"min":{"1min":0.94099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.046}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.127,"15min":1.1890000000000001},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.1659999999999999,"15min":1.2230000000000001},"min":{"1min":0.92600000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.464,"5min":2.02,"15min":2.02},"last":1.1279999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1399999999999999,"15min":1.1299999999999999},"min":{"1min":0.90600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.222,"15min":1.23},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.2889999999999999},"min":{"1min":0.96499999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.4119999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.2709999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.157}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307016,"kb_used_data":5632,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94064824,"statfs":{"total":96636764160,"available":96322379776,"internally_reserved":0,"allocated":5767168,"data_stored":5221993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.077,"5min":1.208,"15min":1.208},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.71299999999999997},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89800000000000002,"15min":0.89300000000000002},"min":{"1min":0.63800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.88200000000000001}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.008,"15min":1.0129999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2929999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.004,"15min":1.016},"min":{"1min":0.74399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.169,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1759999999999999,"5min":1.49,"15min":1.49},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.159,"5min":1.155,"15min":1.157},"min":{"1min":0.877,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.403,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.236},"min":{"1min":1,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4870000000000001,"5min":1.696,"15min":1.696},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1679999999999999,"15min":1.202},"min":{"1min":0.83699999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3919999999999999,"5min":1.738,"15min":1.738},"last":1.139}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.202,"15min":1.252},"min":{"1min":0.88500000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.347,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1799999999999999,"15min":1.2270000000000001},"min":{"1min":0.81999999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2649999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.302}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:30:56.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T05:30:56.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12759e700 1 Processor -- start 2023-10-06T05:30:56.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12759e700 1 -- start start 2023-10-06T05:30:56.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa12806c8f0 0x7fa12806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1280c9e80 0x7fa12806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12806b9e0 con 0x7fa1281555a0 2023-10-06T05:30:56.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1280cb7e0 con 0x7fa1280c9e80 2023-10-06T05:30:56.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280caf80 con 0x7fa12806c8f0 2023-10-06T05:30:56.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa125d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1280c9e80 0x7fa12806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa125d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1280c9e80 0x7fa12806b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38054/0 (socket says 172.21.15.29:38054) 2023-10-06T05:30:56.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa125d9b700 1 -- 172.21.15.29:0/3689226827 learned_addr learned my addr 172.21.15.29:0/3689226827 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:56.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12659c700 1 --2- 172.21.15.29:0/3689226827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa12806c8f0 0x7fa12806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12559a700 1 -- 172.21.15.29:0/3689226827 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249754585 0 0) 0x7fa120001490 con 0x7fa1281555a0 2023-10-06T05:30:56.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa12559a700 1 -- 172.21.15.29:0/3689226827 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa110003570 con 0x7fa1281555a0 2023-10-06T05:30:56.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa125d9b700 1 -- 172.21.15.29:0/3689226827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa12806c8f0 msgr2=0x7fa12806ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:56.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa125d9b700 1 --2- 172.21.15.29:0/3689226827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa12806c8f0 0x7fa12806ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa125d9b700 1 -- 172.21.15.29:0/3689226827 >> v1:172.21.15.173:6789/0 conn(0x7fa1281555a0 legacy=0x7fa128155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa125d9b700 1 -- 172.21.15.29:0/3689226827 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280c7660 con 0x7fa1280c9e80 2023-10-06T05:30:56.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.843+0000 7fa125d9b700 1 --2- 172.21.15.29:0/3689226827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1280c9e80 0x7fa12806b4a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa1180099b0 tx=0x7fa118009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f72296c823a924 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:56.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12559a700 1 -- 172.21.15.29:0/3689226827 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11800b680 con 0x7fa1280c9e80 2023-10-06T05:30:56.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12559a700 1 -- 172.21.15.29:0/3689226827 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11800b7e0 con 0x7fa1280c9e80 2023-10-06T05:30:56.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12559a700 1 -- 172.21.15.29:0/3689226827 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11800bb80 con 0x7fa1280c9e80 2023-10-06T05:30:56.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 -- 172.21.15.29:0/3689226827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1280c9e80 msgr2=0x7fa12806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 --2- 172.21.15.29:0/3689226827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1280c9e80 0x7fa12806b4a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa1180099b0 tx=0x7fa118009250 comp rx=0 tx=0).stop 2023-10-06T05:30:56.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 -- 172.21.15.29:0/3689226827 shutdown_connections 2023-10-06T05:30:56.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 --2- 172.21.15.29:0/3689226827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1280c9e80 0x7fa12806b4a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 --2- 172.21.15.29:0/3689226827 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa12806c8f0 0x7fa12806ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 -- 172.21.15.29:0/3689226827 >> 172.21.15.29:0/3689226827 conn(0x7fa1280670a0 msgr2=0x7fa1280674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:56.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 -- 172.21.15.29:0/3689226827 shutdown_connections 2023-10-06T05:30:56.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 -- 172.21.15.29:0/3689226827 wait complete. 2023-10-06T05:30:56.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 Processor -- start 2023-10-06T05:30:56.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 -- start start 2023-10-06T05:30:56.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa12806c8f0 0x7fa1280c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1280c9e80 0x7fa128149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1281555a0 0x7fa12814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa128147b00 con 0x7fa12806c8f0 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa128146ef0 con 0x7fa1280c9e80 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1281471d0 con 0x7fa1281555a0 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa12806c8f0 0x7fa1280c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa12806c8f0 0x7fa1280c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38064/0 (socket says 172.21.15.29:38064) 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12659c700 1 -- 172.21.15.29:0/474706699 learned_addr learned my addr 172.21.15.29:0/474706699 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa125d9b700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1280c9e80 0x7fa128149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa126d9d700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1281555a0 0x7fa12814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12659c700 1 -- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1281555a0 msgr2=0x7fa12814c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12659c700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1281555a0 0x7fa12814c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12659c700 1 -- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1280c9e80 msgr2=0x7fa128149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12659c700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1280c9e80 0x7fa128149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.847+0000 7fa12659c700 1 -- 172.21.15.29:0/474706699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1180094f0 con 0x7fa12806c8f0 2023-10-06T05:30:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa12659c700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa12806c8f0 0x7fa1280c3c60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00ec80 tx=0x7fa11c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:56.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa1167fc700 1 -- 172.21.15.29:0/474706699 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00c850 con 0x7fa12806c8f0 2023-10-06T05:30:56.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa1167fc700 1 -- 172.21.15.29:0/474706699 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c00c9b0 con 0x7fa12806c8f0 2023-10-06T05:30:56.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1281474b0 con 0x7fa12806c8f0 2023-10-06T05:30:56.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa1167fc700 1 -- 172.21.15.29:0/474706699 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00cd50 con 0x7fa12806c8f0 2023-10-06T05:30:56.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa128146b80 con 0x7fa12806c8f0 2023-10-06T05:30:56.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12804be00 con 0x7fa12806c8f0 2023-10-06T05:30:56.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa1167fc700 1 -- 172.21.15.29:0/474706699 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa11c013680 con 0x7fa12806c8f0 2023-10-06T05:30:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa1167fc700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa108060550 0x7fa108062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.851+0000 7fa1167fc700 1 -- 172.21.15.29:0/474706699 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa11c07c9f0 con 0x7fa12806c8f0 2023-10-06T05:30:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.855+0000 7fa125d9b700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa108060550 0x7fa108062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:56.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.855+0000 7fa125d9b700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa108060550 0x7fa108062a00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa1180099b0 tx=0x7fa118017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:56.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:56.859+0000 7fa1167fc700 1 -- 172.21.15.29:0/474706699 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa11c04d030 con 0x7fa12806c8f0 2023-10-06T05:30:57.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.019+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1280ca450 con 0x7fa12806c8f0 2023-10-06T05:30:57.030 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.023+0000 7fa1167fc700 1 -- 172.21.15.29:0/474706699 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+14038 (secure 0 0 0) 0x7fa11c050650 con 0x7fa12806c8f0 2023-10-06T05:30:57.030 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:30:57.030 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":82,"fsid":"bd99696d-d9bf-47c8-93f5-f978334ae590","created":"2023-10-06T05:25:16.452734+0000","modified":"2023-10-06T05:30:53.993389+0000","last_up_change":"2023-10-06T05:25:27.371106+0000","last_in_change":"2023-10-06T05:25:18.494830+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T05:25:28.706509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T05:25:34.287336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"173fd818-55ca-4663-aa50-f790d1d4a7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":33420},{"type":"v1","addr":"172.21.15.29:6809","nonce":33420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":33420},{"type":"v1","addr":"172.21.15.29:6811","nonce":33420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":33420},{"type":"v1","addr":"172.21.15.29:6815","nonce":33420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":33420},{"type":"v1","addr":"172.21.15.29:6813","nonce":33420}]},"public_addr":"172.21.15.29:6809/33420","cluster_addr":"172.21.15.29:6811/33420","heartbeat_back_addr":"172.21.15.29:6815/33420","heartbeat_front_addr":"172.21.15.29:6813/33420","state":["exists","up"]},{"osd":1,"uuid":"c542c63a-d8e3-4801-bf14-463fe97f2050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":33422},{"type":"v1","addr":"172.21.15.29:6817","nonce":33422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":33422},{"type":"v1","addr":"172.21.15.29:6819","nonce":33422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":33422},{"type":"v1","addr":"172.21.15.29:6823","nonce":33422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":33422},{"type":"v1","addr":"172.21.15.29:6821","nonce":33422}]},"public_addr":"172.21.15.29:6817/33422","cluster_addr":"172.21.15.29:6819/33422","heartbeat_back_addr":"172.21.15.29:6823/33422","heartbeat_front_addr":"172.21.15.29:6821/33422","state":["exists","up"]},{"osd":2,"uuid":"2c935c18-c609-497e-a1b5-c5466cf7512d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":33445},{"type":"v1","addr":"172.21.15.29:6825","nonce":33445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":33445},{"type":"v1","addr":"172.21.15.29:6827","nonce":33445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":33445},{"type":"v1","addr":"172.21.15.29:6831","nonce":33445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":33445},{"type":"v1","addr":"172.21.15.29:6829","nonce":33445}]},"public_addr":"172.21.15.29:6825/33445","cluster_addr":"172.21.15.29:6827/33445","heartbeat_back_addr":"172.21.15.29:6831/33445","heartbeat_front_addr":"172.21.15.29:6829/33445","state":["exists","up"]},{"osd":3,"uuid":"82b46cc2-deb2-4edb-8a49-13ede4929823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":33419},{"type":"v1","addr":"172.21.15.29:6801","nonce":33419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":33419},{"type":"v1","addr":"172.21.15.29:6803","nonce":33419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":33419},{"type":"v1","addr":"172.21.15.29:6807","nonce":33419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":33419},{"type":"v1","addr":"172.21.15.29:6805","nonce":33419}]},"public_addr":"172.21.15.29:6801/33419","cluster_addr":"172.21.15.29:6803/33419","heartbeat_back_addr":"172.21.15.29:6807/33419","heartbeat_front_addr":"172.21.15.29:6805/33419","state":["exists","up"]},{"osd":4,"uuid":"65623c1f-2877-4c8a-b98e-971bf3daa989","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":33715},{"type":"v1","addr":"172.21.15.173:6801","nonce":33715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":33715},{"type":"v1","addr":"172.21.15.173:6803","nonce":33715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":33715},{"type":"v1","addr":"172.21.15.173:6807","nonce":33715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":33715},{"type":"v1","addr":"172.21.15.173:6805","nonce":33715}]},"public_addr":"172.21.15.173:6801/33715","cluster_addr":"172.21.15.173:6803/33715","heartbeat_back_addr":"172.21.15.173:6807/33715","heartbeat_front_addr":"172.21.15.173:6805/33715","state":["exists","up"]},{"osd":5,"uuid":"b85ba67b-ccee-4e35-8511-c0c0e09290e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":33716},{"type":"v1","addr":"172.21.15.173:6809","nonce":33716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":33716},{"type":"v1","addr":"172.21.15.173:6811","nonce":33716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":33716},{"type":"v1","addr":"172.21.15.173:6815","nonce":33716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":33716},{"type":"v1","addr":"172.21.15.173:6813","nonce":33716}]},"public_addr":"172.21.15.173:6809/33716","cluster_addr":"172.21.15.173:6811/33716","heartbeat_back_addr":"172.21.15.173:6815/33716","heartbeat_front_addr":"172.21.15.173:6813/33716","state":["exists","up"]},{"osd":6,"uuid":"a7812b7e-f82f-46e3-8af9-5795240f1c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":33717},{"type":"v1","addr":"172.21.15.173:6817","nonce":33717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":33717},{"type":"v1","addr":"172.21.15.173:6819","nonce":33717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":33717},{"type":"v1","addr":"172.21.15.173:6823","nonce":33717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":33717},{"type":"v1","addr":"172.21.15.173:6821","nonce":33717}]},"public_addr":"172.21.15.173:6817/33717","cluster_addr":"172.21.15.173:6819/33717","heartbeat_back_addr":"172.21.15.173:6823/33717","heartbeat_front_addr":"172.21.15.173:6821/33717","state":["exists","up"]},{"osd":7,"uuid":"e5379453-6e30-4146-9eee-a50156c3287a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":33718},{"type":"v1","addr":"172.21.15.173:6825","nonce":33718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":33718},{"type":"v1","addr":"172.21.15.173:6827","nonce":33718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":33718},{"type":"v1","addr":"172.21.15.173:6831","nonce":33718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":33718},{"type":"v1","addr":"172.21.15.173:6829","nonce":33718}]},"public_addr":"172.21.15.173:6825/33718","cluster_addr":"172.21.15.173:6827/33718","heartbeat_back_addr":"172.21.15.173:6831/33718","heartbeat_front_addr":"172.21.15.173:6829/33718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.706216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.832487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.819323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.683379+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.703269+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.752974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.893316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T05:25:23.785636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/1984531371":"2023-10-07T05:30:50.984022+0000","172.21.15.29:6834/1984531371":"2023-10-07T05:30:50.984022+0000","172.21.15.29:6835/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6834/763503157":"2023-10-07T05:30:35.833812+0000","172.21.15.29:6835/3515782118":"2023-10-07T05:30:18.733272+0000","172.21.15.29:6834/3515782118":"2023-10-07T05:30:18.733272+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T05:30:57.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.023+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa108060550 msgr2=0x7fa108062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:57.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.023+0000 7fa12759e700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa108060550 0x7fa108062a00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa1180099b0 tx=0x7fa118017000 comp rx=0 tx=0).stop 2023-10-06T05:30:57.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.023+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa12806c8f0 msgr2=0x7fa1280c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:57.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.023+0000 7fa12759e700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa12806c8f0 0x7fa1280c3c60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00ec80 tx=0x7fa11c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:57.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.023+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 shutdown_connections 2023-10-06T05:30:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.023+0000 7fa12759e700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1281555a0 0x7fa12814c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.027+0000 7fa12759e700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fa108060550 0x7fa108062a00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.027+0000 7fa12759e700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1280c9e80 0x7fa128149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.027+0000 7fa12759e700 1 --2- 172.21.15.29:0/474706699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa12806c8f0 0x7fa1280c3c60 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.027+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 >> 172.21.15.29:0/474706699 conn(0x7fa1280670a0 msgr2=0x7fa12806cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.027+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 shutdown_connections 2023-10-06T05:30:57.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:57.027+0000 7fa12759e700 1 -- 172.21.15.29:0/474706699 wait complete. 2023-10-06T05:30:58.046 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T05:30:58.046 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T05:30:58.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bdaad3700 1 Processor -- start 2023-10-06T05:30:58.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bdaad3700 1 -- start start 2023-10-06T05:30:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bdaad3700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8bd4155f30 0x7f8bd40686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bdaad3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8bd415a410 0x7f8bd406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bdaad3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd406bbd0 con 0x7f8bd4155b60 2023-10-06T05:30:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bdaad3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd4159ff0 con 0x7f8bd415a410 2023-10-06T05:30:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bdaad3700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd406beb0 con 0x7f8bd4155f30 2023-10-06T05:30:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bd9ad1700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8bd4155b60 0x7f8bd406b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56492/0 (socket says 172.21.15.29:56492) 2023-10-06T05:30:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bd9ad1700 1 -- 172.21.15.29:0/3691930898 learned_addr learned my addr 172.21.15.29:0/3691930898 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bda2d2700 1 --2- 172.21.15.29:0/3691930898 >> v2:172.21.15.29:3300/0 conn(0x7f8bd415a410 0x7f8bd406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bd92d0700 1 --2- 172.21.15.29:0/3691930898 >> v2:172.21.15.173:3300/0 conn(0x7f8bd4155f30 0x7f8bd40686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bd8acf700 1 -- 172.21.15.29:0/3691930898 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638524449 0 0) 0x7f8bd406bbd0 con 0x7f8bd4155b60 2023-10-06T05:30:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bd8acf700 1 -- 172.21.15.29:0/3691930898 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bc0003570 con 0x7f8bd4155b60 2023-10-06T05:30:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bda2d2700 1 -- 172.21.15.29:0/3691930898 >> v2:172.21.15.173:3300/0 conn(0x7f8bd4155f30 msgr2=0x7f8bd40686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bda2d2700 1 --2- 172.21.15.29:0/3691930898 >> v2:172.21.15.173:3300/0 conn(0x7f8bd4155f30 0x7f8bd40686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bda2d2700 1 -- 172.21.15.29:0/3691930898 >> v1:172.21.15.29:6789/0 conn(0x7f8bd4155b60 legacy=0x7f8bd406b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.163+0000 7f8bda2d2700 1 -- 172.21.15.29:0/3691930898 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd4159930 con 0x7f8bd415a410 2023-10-06T05:30:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bda2d2700 1 --2- 172.21.15.29:0/3691930898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 0x7f8bd406d6d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8bd406c110 tx=0x7f8bcc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef6fb99d625f086 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bd8acf700 1 -- 172.21.15.29:0/3691930898 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00e070 con 0x7f8bd415a410 2023-10-06T05:30:58.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bd8acf700 1 -- 172.21.15.29:0/3691930898 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc00bb40 con 0x7f8bd415a410 2023-10-06T05:30:58.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bd8acf700 1 -- 172.21.15.29:0/3691930898 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc012430 con 0x7f8bd415a410 2023-10-06T05:30:58.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 -- 172.21.15.29:0/3691930898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 msgr2=0x7f8bd406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 --2- 172.21.15.29:0/3691930898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 0x7f8bd406d6d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8bd406c110 tx=0x7f8bcc009780 comp rx=0 tx=0).stop 2023-10-06T05:30:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 -- 172.21.15.29:0/3691930898 shutdown_connections 2023-10-06T05:30:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 --2- 172.21.15.29:0/3691930898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 0x7f8bd406d6d0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 --2- 172.21.15.29:0/3691930898 >> v2:172.21.15.173:3300/0 conn(0x7f8bd4155f30 0x7f8bd40686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 -- 172.21.15.29:0/3691930898 >> 172.21.15.29:0/3691930898 conn(0x7f8bd40c9830 msgr2=0x7f8bd406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 -- 172.21.15.29:0/3691930898 shutdown_connections 2023-10-06T05:30:58.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 -- 172.21.15.29:0/3691930898 wait complete. 2023-10-06T05:30:58.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 Processor -- start 2023-10-06T05:30:58.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.167+0000 7f8bdaad3700 1 -- start start 2023-10-06T05:30:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bdaad3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd4155b60 0x7f8bd40af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bdaad3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd4155f30 0x7f8bd40b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bdaad3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 0x7f8bd413e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bdaad3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40c3a90 con 0x7f8bd415a410 2023-10-06T05:30:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bdaad3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40b1a40 con 0x7f8bd4155f30 2023-10-06T05:30:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bdaad3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40b1ca0 con 0x7f8bd4155b60 2023-10-06T05:30:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bda2d2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 0x7f8bd413e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bda2d2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 0x7f8bd413e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38094/0 (socket says 172.21.15.29:38094) 2023-10-06T05:30:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bda2d2700 1 -- 172.21.15.29:0/796734745 learned_addr learned my addr 172.21.15.29:0/796734745 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bd9ad1700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd4155b60 0x7f8bd40af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bd92d0700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd4155f30 0x7f8bd40b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bda2d2700 1 -- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd4155b60 msgr2=0x7f8bd40af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bda2d2700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8bd4155b60 0x7f8bd40af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bda2d2700 1 -- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd4155f30 msgr2=0x7f8bd40b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bda2d2700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bd4155f30 0x7f8bd40b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bda2d2700 1 -- 172.21.15.29:0/796734745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc009a20 con 0x7f8bd415a410 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bda2d2700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 0x7f8bd413e690 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009fd0 tx=0x7f8bcc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bc9ffb700 1 -- 172.21.15.29:0/796734745 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc027470 con 0x7f8bd415a410 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bc9ffb700 1 -- 172.21.15.29:0/796734745 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc0275f0 con 0x7f8bd415a410 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd40b1f80 con 0x7f8bd415a410 2023-10-06T05:30:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bc9ffb700 1 -- 172.21.15.29:0/796734745 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0279b0 con 0x7f8bd415a410 2023-10-06T05:30:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.171+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd40c3720 con 0x7f8bd415a410 2023-10-06T05:30:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bd404be00 con 0x7f8bd415a410 2023-10-06T05:30:58.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bc9ffb700 1 -- 172.21.15.29:0/796734745 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8bcc024070 con 0x7f8bd415a410 2023-10-06T05:30:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bc9ffb700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8bb8060580 0x7f8bb8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bc9ffb700 1 -- 172.21.15.29:0/796734745 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8bcc07ef80 con 0x7f8bd415a410 2023-10-06T05:30:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bd9ad1700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8bb8060580 0x7f8bb8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bc9ffb700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f8bb8066b30 0x7f8bb8068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bc9ffb700 1 -- 172.21.15.29:0/796734745 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bb80695f0 con 0x7f8bb8066b30 2023-10-06T05:30:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bc9ffb700 1 -- 172.21.15.29:0/796734745 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bcc081560 con 0x7f8bd415a410 2023-10-06T05:30:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bd92d0700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f8bb8066b30 0x7f8bb8068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bd92d0700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f8bb8066b30 0x7f8bb8068f40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bd9ad1700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8bb8060580 0x7f8bb8062a30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0007fd0 tx=0x7f8bd0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.175+0000 7f8bc9ffb700 1 -- 172.21.15.29:0/796734745 <== osd.0 v2:172.21.15.29:6808/33420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8bb80695f0 con 0x7f8bb8066b30 2023-10-06T05:30:58.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 --> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8bd40aebc0 con 0x7f8bb8066b30 2023-10-06T05:30:58.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bc9ffb700 1 -- 172.21.15.29:0/796734745 <== osd.0 v2:172.21.15.29:6808/33420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8bd40aebc0 con 0x7f8bb8066b30 2023-10-06T05:30:58.202 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:58.202 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T05:30:58.202 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:58.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f8bb8066b30 msgr2=0x7f8bb8068f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.29:6808/33420,v1:172.21.15.29:6809/33420] conn(0x7f8bb8066b30 0x7f8bb8068f40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8bb8060580 msgr2=0x7f8bb8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8bb8060580 0x7f8bb8062a30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0007fd0 tx=0x7f8bd0009040 comp rx=0 tx=0).stop 2023-10-06T05:30:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 msgr2=0x7f8bd413e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 --2- 172.21.15.29:0/796734745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd415a410 0x7f8bd413e690 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009fd0 tx=0x7f8bcc019000 comp rx=0 tx=0).stop 2023-10-06T05:30:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bda2d2700 1 -- 172.21.15.29:0/796734745 reap_dead start 2023-10-06T05:30:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 shutdown_connections 2023-10-06T05:30:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 >> 172.21.15.29:0/796734745 conn(0x7f8bd40c9830 msgr2=0x7f8bd40ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 shutdown_connections 2023-10-06T05:30:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.195+0000 7f8bdaad3700 1 -- 172.21.15.29:0/796734745 wait complete. 2023-10-06T05:30:58.216 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T05:30:58.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 Processor -- start 2023-10-06T05:30:58.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 -- start start 2023-10-06T05:30:58.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815ace0 0x7f7c6806b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c680c9ea0 0x7f7c680ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c680cc8b0 con 0x7f7c6815e490 2023-10-06T05:30:58.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6806b280 con 0x7f7c680c9ea0 2023-10-06T05:30:58.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6806bc50 con 0x7f7c6815ace0 2023-10-06T05:30:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6c9c2700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7c6815e490 0x7f7c680cc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56504/0 (socket says 172.21.15.29:56504) 2023-10-06T05:30:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6c9c2700 1 -- 172.21.15.29:0/1695943596 learned_addr learned my addr 172.21.15.29:0/1695943596 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6d9c4700 1 --2- 172.21.15.29:0/1695943596 >> v2:172.21.15.29:3300/0 conn(0x7f7c680c9ea0 0x7f7c680ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6d1c3700 1 --2- 172.21.15.29:0/1695943596 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815ace0 0x7f7c6806b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c67fff700 1 -- 172.21.15.29:0/1695943596 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864964062 0 0) 0x7f7c680cc8b0 con 0x7f7c6815e490 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c67fff700 1 -- 172.21.15.29:0/1695943596 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c50003570 con 0x7f7c6815e490 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6d9c4700 1 -- 172.21.15.29:0/1695943596 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815ace0 msgr2=0x7f7c6806b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6d9c4700 1 --2- 172.21.15.29:0/1695943596 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815ace0 0x7f7c6806b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6d9c4700 1 -- 172.21.15.29:0/1695943596 >> v1:172.21.15.29:6789/0 conn(0x7f7c6815e490 legacy=0x7f7c680cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6d9c4700 1 -- 172.21.15.29:0/1695943596 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c680ca860 con 0x7f7c680c9ea0 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6d9c4700 1 --2- 172.21.15.29:0/1695943596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 0x7f7c680ca320 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f7c580098e0 tx=0x7f7c580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4add4b6e6192acd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c67fff700 1 -- 172.21.15.29:0/1695943596 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58011630 con 0x7f7c680c9ea0 2023-10-06T05:30:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c67fff700 1 -- 172.21.15.29:0/1695943596 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58011790 con 0x7f7c680c9ea0 2023-10-06T05:30:58.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c67fff700 1 -- 172.21.15.29:0/1695943596 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58011b10 con 0x7f7c680c9ea0 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/1695943596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 msgr2=0x7f7c680ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 --2- 172.21.15.29:0/1695943596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 0x7f7c680ca320 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f7c580098e0 tx=0x7f7c580091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/1695943596 shutdown_connections 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 --2- 172.21.15.29:0/1695943596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 0x7f7c680ca320 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 --2- 172.21.15.29:0/1695943596 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815ace0 0x7f7c6806b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/1695943596 >> 172.21.15.29:0/1695943596 conn(0x7f7c680670a0 msgr2=0x7f7c68067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/1695943596 shutdown_connections 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.331+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/1695943596 wait complete. 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 Processor -- start 2023-10-06T05:30:58.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 -- start start 2023-10-06T05:30:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 0x7f7c6816db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c6815ace0 0x7f7c6814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815e490 0x7f7c680ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6816e0d0 con 0x7f7c680c9ea0 2023-10-06T05:30:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6816d700 con 0x7f7c6815ace0 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6816d110 con 0x7f7c6815e490 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d1c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 0x7f7c6816db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d1c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 0x7f7c6816db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38120/0 (socket says 172.21.15.29:38120) 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d1c3700 1 -- 172.21.15.29:0/28706064 learned_addr learned my addr 172.21.15.29:0/28706064 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6c9c2700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c6815ace0 0x7f7c6814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d9c4700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815e490 0x7f7c680ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d1c3700 1 -- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815e490 msgr2=0x7f7c680ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d1c3700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815e490 0x7f7c680ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d1c3700 1 -- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c6815ace0 msgr2=0x7f7c6814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d1c3700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c6815ace0 0x7f7c6814ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d1c3700 1 -- 172.21.15.29:0/28706064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58009420 con 0x7f7c680c9ea0 2023-10-06T05:30:58.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6d1c3700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 0x7f7c6816db90 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00ec80 tx=0x7f7c5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c657fa700 1 -- 172.21.15.29:0/28706064 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00c850 con 0x7f7c680c9ea0 2023-10-06T05:30:58.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c657fa700 1 -- 172.21.15.29:0/28706064 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c00c9b0 con 0x7f7c680c9ea0 2023-10-06T05:30:58.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c680af2f0 con 0x7f7c680c9ea0 2023-10-06T05:30:58.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c657fa700 1 -- 172.21.15.29:0/28706064 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00cd50 con 0x7f7c680c9ea0 2023-10-06T05:30:58.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.335+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6816d390 con 0x7f7c680c9ea0 2023-10-06T05:30:58.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.339+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c680c61b0 con 0x7f7c680c9ea0 2023-10-06T05:30:58.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.339+0000 7f7c657fa700 1 -- 172.21.15.29:0/28706064 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7c5c013680 con 0x7f7c680c9ea0 2023-10-06T05:30:58.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.339+0000 7f7c657fa700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c54060620 0x7f7c54062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.339+0000 7f7c657fa700 1 -- 172.21.15.29:0/28706064 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7c5c07c8f0 con 0x7f7c680c9ea0 2023-10-06T05:30:58.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.339+0000 7f7c6c9c2700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c54060620 0x7f7c54062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.339+0000 7f7c6c9c2700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c54060620 0x7f7c54062ad0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7c680cc8f0 tx=0x7f7c60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.347+0000 7f7c657fa700 1 -- 172.21.15.29:0/28706064 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7c680c61b0 con 0x7f7c680c9ea0 2023-10-06T05:30:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.507+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c680c61b0 con 0x7f7c54060620 2023-10-06T05:30:58.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c657fa700 1 -- 172.21.15.29:0/28706064 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c680c61b0 con 0x7f7c54060620 2023-10-06T05:30:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c54060620 msgr2=0x7f7c54062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c54060620 0x7f7c54062ad0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7c680cc8f0 tx=0x7f7c60009040 comp rx=0 tx=0).stop 2023-10-06T05:30:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 msgr2=0x7f7c6816db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 0x7f7c6816db90 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00ec80 tx=0x7f7c5c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 shutdown_connections 2023-10-06T05:30:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c6815e490 0x7f7c680ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7c54060620 0x7f7c54062ad0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c6815ace0 0x7f7c6814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 --2- 172.21.15.29:0/28706064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c680c9ea0 0x7f7c6816db90 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 >> 172.21.15.29:0/28706064 conn(0x7f7c680670a0 msgr2=0x7f7c680c1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 shutdown_connections 2023-10-06T05:30:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.511+0000 7f7c6e1c5700 1 -- 172.21.15.29:0/28706064 wait complete. 2023-10-06T05:30:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T05:30:58.531 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T05:30:58.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T05:30:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.635+0000 7f348359e700 1 Processor -- start 2023-10-06T05:30:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.635+0000 7f348359e700 1 -- start start 2023-10-06T05:30:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.635+0000 7f348359e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3484155ac0 0x7f34840c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.635+0000 7f348359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34840cb8c0 0x7f34840c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.635+0000 7f348359e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34840c9ed0 con 0x7f34840c9ab0 2023-10-06T05:30:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34840c8ce0 con 0x7f34840cb8c0 2023-10-06T05:30:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34840c8060 con 0x7f3484155ac0 2023-10-06T05:30:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f3481d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34840cb8c0 0x7f34840c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f3481d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34840cb8c0 0x7f34840c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38132/0 (socket says 172.21.15.29:38132) 2023-10-06T05:30:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f3481d9b700 1 -- 172.21.15.29:0/3923361753 learned_addr learned my addr 172.21.15.29:0/3923361753 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348259c700 1 --2- 172.21.15.29:0/3923361753 >> v2:172.21.15.173:3300/0 conn(0x7f3484155ac0 0x7f34840c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f3481d9b700 1 -- 172.21.15.29:0/3923361753 >> v2:172.21.15.173:3300/0 conn(0x7f3484155ac0 msgr2=0x7f34840c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f3481d9b700 1 --2- 172.21.15.29:0/3923361753 >> v2:172.21.15.173:3300/0 conn(0x7f3484155ac0 0x7f34840c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f3481d9b700 1 -- 172.21.15.29:0/3923361753 >> v1:172.21.15.173:6789/0 conn(0x7f34840c9ab0 legacy=0x7f3484159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f3481d9b700 1 -- 172.21.15.29:0/3923361753 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840c8340 con 0x7f34840cb8c0 2023-10-06T05:30:58.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f3481d9b700 1 --2- 172.21.15.29:0/3923361753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34840cb8c0 0x7f34840c9570 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f348406af00 tx=0x7f3478009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb8b65086b3abc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348159a700 1 -- 172.21.15.29:0/3923361753 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478009e70 con 0x7f34840cb8c0 2023-10-06T05:30:58.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348159a700 1 -- 172.21.15.29:0/3923361753 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347800b860 con 0x7f34840cb8c0 2023-10-06T05:30:58.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348159a700 1 -- 172.21.15.29:0/3923361753 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347800bc00 con 0x7f34840cb8c0 2023-10-06T05:30:58.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 -- 172.21.15.29:0/3923361753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34840cb8c0 msgr2=0x7f34840c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 --2- 172.21.15.29:0/3923361753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34840cb8c0 0x7f34840c9570 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f348406af00 tx=0x7f3478009250 comp rx=0 tx=0).stop 2023-10-06T05:30:58.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 -- 172.21.15.29:0/3923361753 shutdown_connections 2023-10-06T05:30:58.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 --2- 172.21.15.29:0/3923361753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34840cb8c0 0x7f34840c9570 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 --2- 172.21.15.29:0/3923361753 >> v2:172.21.15.173:3300/0 conn(0x7f3484155ac0 0x7f34840c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 -- 172.21.15.29:0/3923361753 >> 172.21.15.29:0/3923361753 conn(0x7f348406ba30 msgr2=0x7f3484095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:58.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 -- 172.21.15.29:0/3923361753 shutdown_connections 2023-10-06T05:30:58.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.639+0000 7f348359e700 1 -- 172.21.15.29:0/3923361753 wait complete. 2023-10-06T05:30:58.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f348359e700 1 Processor -- start 2023-10-06T05:30:58.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f348359e700 1 -- start start 2023-10-06T05:30:58.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f348359e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34840c9ab0 0x7f3484148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f348359e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34840cb8c0 0x7f34840c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f348359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3484155ac0 0x7f34840aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f348359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34840ae9e0 con 0x7f3484155ac0 2023-10-06T05:30:58.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f348359e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484148fc0 con 0x7f34840c9ab0 2023-10-06T05:30:58.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f348359e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34840addd0 con 0x7f34840cb8c0 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f3482d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3484155ac0 0x7f34840aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f348259c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34840c9ab0 0x7f3484148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f3482d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3484155ac0 0x7f34840aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38142/0 (socket says 172.21.15.29:38142) 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f3482d9d700 1 -- 172.21.15.29:0/2424843065 learned_addr learned my addr 172.21.15.29:0/2424843065 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f3481d9b700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34840cb8c0 0x7f34840c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f3482d9d700 1 -- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34840cb8c0 msgr2=0x7f34840c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f3482d9d700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34840cb8c0 0x7f34840c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f3482d9d700 1 -- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34840c9ab0 msgr2=0x7f3484148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f3482d9d700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34840c9ab0 0x7f3484148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.643+0000 7f3482d9d700 1 -- 172.21.15.29:0/2424843065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34780094f0 con 0x7f3484155ac0 2023-10-06T05:30:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f3482d9d700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3484155ac0 0x7f34840aee70 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c910 tx=0x7f347c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f34727fc700 1 -- 172.21.15.29:0/2424843065 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c012630 con 0x7f3484155ac0 2023-10-06T05:30:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f34727fc700 1 -- 172.21.15.29:0/2424843065 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c012790 con 0x7f3484155ac0 2023-10-06T05:30:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f34727fc700 1 -- 172.21.15.29:0/2424843065 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c012b50 con 0x7f3484155ac0 2023-10-06T05:30:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34840ae0b0 con 0x7f3484155ac0 2023-10-06T05:30:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34840ae670 con 0x7f3484155ac0 2023-10-06T05:30:58.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f348404be00 con 0x7f3484155ac0 2023-10-06T05:30:58.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f34727fc700 1 -- 172.21.15.29:0/2424843065 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f347c01a3a0 con 0x7f3484155ac0 2023-10-06T05:30:58.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f34727fc700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3464060550 0x7f3464062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f34727fc700 1 -- 172.21.15.29:0/2424843065 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f347c07c970 con 0x7f3484155ac0 2023-10-06T05:30:58.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f34727fc700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f3464066b00 0x7f3464068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f348259c700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3464060550 0x7f3464062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f34727fc700 1 -- 172.21.15.29:0/2424843065 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34640695c0 con 0x7f3464066b00 2023-10-06T05:30:58.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.647+0000 7f34727fc700 1 -- 172.21.15.29:0/2424843065 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f347c081240 con 0x7f3484155ac0 2023-10-06T05:30:58.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.651+0000 7f3481d9b700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f3464066b00 0x7f3464068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.651+0000 7f3481d9b700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f3464066b00 0x7f3464068f10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.651+0000 7f348259c700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3464060550 0x7f3464062a00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3474009d00 tx=0x7f3474009120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.651+0000 7f34727fc700 1 -- 172.21.15.29:0/2424843065 <== osd.1 v2:172.21.15.29:6816/33422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f34640695c0 con 0x7f3464066b00 2023-10-06T05:30:58.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 --> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34840c8620 con 0x7f3464066b00 2023-10-06T05:30:58.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f34727fc700 1 -- 172.21.15.29:0/2424843065 <== osd.1 v2:172.21.15.29:6816/33422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f34840c8620 con 0x7f3464066b00 2023-10-06T05:30:58.674 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:58.674 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T05:30:58.674 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:58.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f3464066b00 msgr2=0x7f3464068f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.29:6816/33422,v1:172.21.15.29:6817/33422] conn(0x7f3464066b00 0x7f3464068f10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3464060550 msgr2=0x7f3464062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f3464060550 0x7f3464062a00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3474009d00 tx=0x7f3474009120 comp rx=0 tx=0).stop 2023-10-06T05:30:58.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3484155ac0 msgr2=0x7f34840aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 --2- 172.21.15.29:0/2424843065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3484155ac0 0x7f34840aee70 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c910 tx=0x7f347c001710 comp rx=0 tx=0).stop 2023-10-06T05:30:58.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f3482d9d700 1 -- 172.21.15.29:0/2424843065 reap_dead start 2023-10-06T05:30:58.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 shutdown_connections 2023-10-06T05:30:58.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 >> 172.21.15.29:0/2424843065 conn(0x7f348406ba30 msgr2=0x7f34841498e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:58.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 shutdown_connections 2023-10-06T05:30:58.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.667+0000 7f348359e700 1 -- 172.21.15.29:0/2424843065 wait complete. 2023-10-06T05:30:58.686 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T05:30:58.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.783+0000 7f8b0d872700 1 Processor -- start 2023-10-06T05:30:58.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.783+0000 7f8b0d872700 1 -- start start 2023-10-06T05:30:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8b080c81b0 0x7f8b080cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b081568a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b080cb750 con 0x7f8b0815a220 2023-10-06T05:30:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b080c78e0 con 0x7f8b080c81b0 2023-10-06T05:30:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b080c9c10 con 0x7f8b0806c6c0 2023-10-06T05:30:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b077fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b081568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b06ffd700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8b080c81b0 0x7f8b080cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b077fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b081568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:56232/0 (socket says 172.21.15.29:56232) 2023-10-06T05:30:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b077fe700 1 -- 172.21.15.29:0/3075918864 learned_addr learned my addr 172.21.15.29:0/3075918864 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b067fc700 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f8b0815a220 0x7f8b080c8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:56656/0 (socket says 172.21.15.29:56656) 2023-10-06T05:30:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b077fe700 1 -- 172.21.15.29:0/3075918864 >> v2:172.21.15.173:3300/0 conn(0x7f8b080c81b0 msgr2=0x7f8b080cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b077fe700 1 --2- 172.21.15.29:0/3075918864 >> v2:172.21.15.173:3300/0 conn(0x7f8b080c81b0 0x7f8b080cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b077fe700 1 -- 172.21.15.29:0/3075918864 >> v1:172.21.15.173:6789/0 conn(0x7f8b0815a220 legacy=0x7f8b080c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b077fe700 1 -- 172.21.15.29:0/3075918864 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08156410 con 0x7f8b0806c6c0 2023-10-06T05:30:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b05ffb700 1 -- 172.21.15.29:0/3075918864 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571355598 0 0) 0x7f8afc001110 con 0x7f8b0815a220 2023-10-06T05:30:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b077fe700 1 --2- 172.21.15.29:0/3075918864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b081568a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009f20 tx=0x7f8b00009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b1c1cba18d5d600 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b05ffb700 1 -- 172.21.15.29:0/3075918864 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000e070 con 0x7f8b0806c6c0 2023-10-06T05:30:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b05ffb700 1 -- 172.21.15.29:0/3075918864 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0000b9d0 con 0x7f8b0806c6c0 2023-10-06T05:30:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b05ffb700 1 -- 172.21.15.29:0/3075918864 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b000092e0 con 0x7f8b0806c6c0 2023-10-06T05:30:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 -- 172.21.15.29:0/3075918864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 msgr2=0x7f8b081568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 --2- 172.21.15.29:0/3075918864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b081568a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009f20 tx=0x7f8b00009840 comp rx=0 tx=0).stop 2023-10-06T05:30:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 -- 172.21.15.29:0/3075918864 shutdown_connections 2023-10-06T05:30:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 --2- 172.21.15.29:0/3075918864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b081568a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 --2- 172.21.15.29:0/3075918864 >> v2:172.21.15.173:3300/0 conn(0x7f8b080c81b0 0x7f8b080cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 -- 172.21.15.29:0/3075918864 >> 172.21.15.29:0/3075918864 conn(0x7f8b080ccef0 msgr2=0x7f8b080c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 -- 172.21.15.29:0/3075918864 shutdown_connections 2023-10-06T05:30:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.787+0000 7f8b0d872700 1 -- 172.21.15.29:0/3075918864 wait complete. 2023-10-06T05:30:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b0d872700 1 Processor -- start 2023-10-06T05:30:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b0d872700 1 -- start start 2023-10-06T05:30:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b0d872700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b0816a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b0d872700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b080c81b0 0x7f8b0816cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b0d872700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0815a220 0x7f8b080c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b0d872700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b080c5160 con 0x7f8b080c81b0 2023-10-06T05:30:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b0d872700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b080c4e30 con 0x7f8b0815a220 2023-10-06T05:30:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b0d872700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0816d0e0 con 0x7f8b0806c6c0 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b067fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b080c81b0 0x7f8b0816cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b067fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b080c81b0 0x7f8b0816cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38152/0 (socket says 172.21.15.29:38152) 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b067fc700 1 -- 172.21.15.29:0/2028128140 learned_addr learned my addr 172.21.15.29:0/2028128140 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.791+0000 7f8b06ffd700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b0816a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b077fe700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0815a220 0x7f8b080c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b067fc700 1 -- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 msgr2=0x7f8b0816a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b067fc700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b0816a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b067fc700 1 -- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0815a220 msgr2=0x7f8b080c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b067fc700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0815a220 0x7f8b080c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b067fc700 1 -- 172.21.15.29:0/2028128140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00009ae0 con 0x7f8b080c81b0 2023-10-06T05:30:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b067fc700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b080c81b0 0x7f8b0816cba0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00c810 tx=0x7f8afc007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8aeeffd700 1 -- 172.21.15.29:0/2028128140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0062e0 con 0x7f8b080c81b0 2023-10-06T05:30:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8aeeffd700 1 -- 172.21.15.29:0/2028128140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc006460 con 0x7f8b080c81b0 2023-10-06T05:30:58.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0816d380 con 0x7f8b080c81b0 2023-10-06T05:30:58.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8aeeffd700 1 -- 172.21.15.29:0/2028128140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc004810 con 0x7f8b080c81b0 2023-10-06T05:30:58.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0816d940 con 0x7f8b080c81b0 2023-10-06T05:30:58.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b08071120 con 0x7f8b080c81b0 2023-10-06T05:30:58.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.795+0000 7f8aeeffd700 1 -- 172.21.15.29:0/2028128140 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8afc004be0 con 0x7f8b080c81b0 2023-10-06T05:30:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.799+0000 7f8aeeffd700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8af4060550 0x7f8af4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.799+0000 7f8aeeffd700 1 -- 172.21.15.29:0/2028128140 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8afc07b990 con 0x7f8b080c81b0 2023-10-06T05:30:58.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.799+0000 7f8b06ffd700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8af4060550 0x7f8af4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:58.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.799+0000 7f8b06ffd700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8af4060550 0x7f8af4062a00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009db0 tx=0x7f8af80091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:58.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.803+0000 7f8aeeffd700 1 -- 172.21.15.29:0/2028128140 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8afc04c070 con 0x7f8b080c81b0 2023-10-06T05:30:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.971+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b080b2230 con 0x7f8af4060550 2023-10-06T05:30:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.971+0000 7f8aeeffd700 1 -- 172.21.15.29:0/2028128140 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8b080b2230 con 0x7f8af4060550 2023-10-06T05:30:58.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8af4060550 msgr2=0x7f8af4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8af4060550 0x7f8af4062a00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009db0 tx=0x7f8af80091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b080c81b0 msgr2=0x7f8b0816cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:58.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b080c81b0 0x7f8b0816cba0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00c810 tx=0x7f8afc007c60 comp rx=0 tx=0).stop 2023-10-06T05:30:58.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 shutdown_connections 2023-10-06T05:30:58.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f8af4060550 0x7f8af4062a00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0815a220 0x7f8b080c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b080c81b0 0x7f8b0816cba0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 --2- 172.21.15.29:0/2028128140 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b0806c6c0 0x7f8b0816a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:58.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 >> 172.21.15.29:0/2028128140 conn(0x7f8b080ccef0 msgr2=0x7f8b080c1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:58.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 shutdown_connections 2023-10-06T05:30:58.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:58.975+0000 7f8b0d872700 1 -- 172.21.15.29:0/2028128140 wait complete. 2023-10-06T05:30:58.984 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T05:30:58.995 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T05:30:58.995 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T05:30:59.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.107+0000 7ff21b869700 1 Processor -- start 2023-10-06T05:30:59.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.107+0000 7ff21b869700 1 -- start start 2023-10-06T05:30:59.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff21406b1a0 0x7ff21406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2140ca1e0 0x7ff2140c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21406e040 con 0x7ff2140cb430 2023-10-06T05:30:59.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140ca8e0 con 0x7ff2140ca1e0 2023-10-06T05:30:59.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21415d000 con 0x7ff21406b1a0 2023-10-06T05:30:59.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff219e06700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2140ca1e0 0x7ff2140c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff219e06700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2140ca1e0 0x7ff2140c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38166/0 (socket says 172.21.15.29:38166) 2023-10-06T05:30:59.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff219e06700 1 -- 172.21.15.29:0/4042856067 learned_addr learned my addr 172.21.15.29:0/4042856067 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:59.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff219605700 1 --2- 172.21.15.29:0/4042856067 >> v2:172.21.15.173:3300/0 conn(0x7ff21406b1a0 0x7ff21406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff219e06700 1 -- 172.21.15.29:0/4042856067 >> v2:172.21.15.173:3300/0 conn(0x7ff21406b1a0 msgr2=0x7ff21406b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:59.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff219e06700 1 --2- 172.21.15.29:0/4042856067 >> v2:172.21.15.173:3300/0 conn(0x7ff21406b1a0 0x7ff21406b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff219e06700 1 -- 172.21.15.29:0/4042856067 >> v1:172.21.15.173:6789/0 conn(0x7ff2140cb430 legacy=0x7ff21415d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff213fff700 1 -- 172.21.15.29:0/4042856067 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255120023 0 0) 0x7ff21406e040 con 0x7ff2140cb430 2023-10-06T05:30:59.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff219e06700 1 -- 172.21.15.29:0/4042856067 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140ca640 con 0x7ff2140ca1e0 2023-10-06T05:30:59.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff219e06700 1 --2- 172.21.15.29:0/4042856067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2140ca1e0 0x7ff2140c73f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ff2140c3600 tx=0x7ff20c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f724fb53dd5071ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff213fff700 1 -- 172.21.15.29:0/4042856067 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00e070 con 0x7ff2140ca1e0 2023-10-06T05:30:59.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff213fff700 1 -- 172.21.15.29:0/4042856067 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00ba20 con 0x7ff2140ca1e0 2023-10-06T05:30:59.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff213fff700 1 -- 172.21.15.29:0/4042856067 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0092e0 con 0x7ff2140ca1e0 2023-10-06T05:30:59.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 -- 172.21.15.29:0/4042856067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2140ca1e0 msgr2=0x7ff2140c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 --2- 172.21.15.29:0/4042856067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2140ca1e0 0x7ff2140c73f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ff2140c3600 tx=0x7ff20c009840 comp rx=0 tx=0).stop 2023-10-06T05:30:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 -- 172.21.15.29:0/4042856067 shutdown_connections 2023-10-06T05:30:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 --2- 172.21.15.29:0/4042856067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2140ca1e0 0x7ff2140c73f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 --2- 172.21.15.29:0/4042856067 >> v2:172.21.15.173:3300/0 conn(0x7ff21406b1a0 0x7ff21406b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 -- 172.21.15.29:0/4042856067 >> 172.21.15.29:0/4042856067 conn(0x7ff2140cd0e0 msgr2=0x7ff2140c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 -- 172.21.15.29:0/4042856067 shutdown_connections 2023-10-06T05:30:59.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.111+0000 7ff21b869700 1 -- 172.21.15.29:0/4042856067 wait complete. 2023-10-06T05:30:59.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff21b869700 1 Processor -- start 2023-10-06T05:30:59.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff21b869700 1 -- start start 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff21b869700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff21406b1a0 0x7ff214169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff21b869700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2140ca1e0 0x7ff214144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff21b869700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2140cb430 0x7ff2140addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff21b869700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214144f50 con 0x7ff21406b1a0 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff21b869700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140b0890 con 0x7ff2140ca1e0 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff21b869700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140ae300 con 0x7ff2140cb430 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff219605700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff21406b1a0 0x7ff214169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff219605700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff21406b1a0 0x7ff214169e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38168/0 (socket says 172.21.15.29:38168) 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff219605700 1 -- 172.21.15.29:0/8578530 learned_addr learned my addr 172.21.15.29:0/8578530 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:59.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff219e06700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2140cb430 0x7ff2140addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff218e04700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2140ca1e0 0x7ff214144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff219605700 1 -- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2140cb430 msgr2=0x7ff2140addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff219605700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2140cb430 0x7ff2140addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff219605700 1 -- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2140ca1e0 msgr2=0x7ff214144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff219605700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2140ca1e0 0x7ff214144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.115+0000 7ff219605700 1 -- 172.21.15.29:0/8578530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c009ae0 con 0x7ff21406b1a0 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.119+0000 7ff219605700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff21406b1a0 0x7ff214169e60 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e960 tx=0x7ff2040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.119+0000 7ff2117fa700 1 -- 172.21.15.29:0/8578530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400c850 con 0x7ff21406b1a0 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.119+0000 7ff2117fa700 1 -- 172.21.15.29:0/8578530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20400c9b0 con 0x7ff21406b1a0 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.119+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140ae550 con 0x7ff21406b1a0 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.119+0000 7ff2117fa700 1 -- 172.21.15.29:0/8578530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400cd50 con 0x7ff21406b1a0 2023-10-06T05:30:59.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.119+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2140b0520 con 0x7ff21406b1a0 2023-10-06T05:30:59.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.119+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2140b0380 con 0x7ff21406b1a0 2023-10-06T05:30:59.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.119+0000 7ff2117fa700 1 -- 172.21.15.29:0/8578530 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff204013680 con 0x7ff21406b1a0 2023-10-06T05:30:59.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.119+0000 7ff2117fa700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff200060550 0x7ff200062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.123+0000 7ff2117fa700 1 -- 172.21.15.29:0/8578530 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff20407c900 con 0x7ff21406b1a0 2023-10-06T05:30:59.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.123+0000 7ff218e04700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff200060550 0x7ff200062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.123+0000 7ff2117fa700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7ff200066b00 0x7ff200068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.123+0000 7ff2117fa700 1 -- 172.21.15.29:0/8578530 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2000695c0 con 0x7ff200066b00 2023-10-06T05:30:59.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.123+0000 7ff2117fa700 1 -- 172.21.15.29:0/8578530 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff204081240 con 0x7ff21406b1a0 2023-10-06T05:30:59.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.123+0000 7ff219e06700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7ff200066b00 0x7ff200068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.123+0000 7ff218e04700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff200060550 0x7ff200062a00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff21414b840 tx=0x7ff208009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.123+0000 7ff219e06700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7ff200066b00 0x7ff200068f10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.123+0000 7ff2117fa700 1 -- 172.21.15.29:0/8578530 <== osd.2 v2:172.21.15.29:6824/33445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff2000695c0 con 0x7ff200066b00 2023-10-06T05:30:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.139+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 --> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff2140aea30 con 0x7ff200066b00 2023-10-06T05:30:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.139+0000 7ff2117fa700 1 -- 172.21.15.29:0/8578530 <== osd.2 v2:172.21.15.29:6824/33445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff2140aea30 con 0x7ff200066b00 2023-10-06T05:30:59.150 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:59.150 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T05:30:59.150 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7ff200066b00 msgr2=0x7ff200068f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.29:6824/33445,v1:172.21.15.29:6825/33445] conn(0x7ff200066b00 0x7ff200068f10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff200060550 msgr2=0x7ff200062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7ff200060550 0x7ff200062a00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff21414b840 tx=0x7ff208009040 comp rx=0 tx=0).stop 2023-10-06T05:30:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff21406b1a0 msgr2=0x7ff214169e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 --2- 172.21.15.29:0/8578530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff21406b1a0 0x7ff214169e60 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e960 tx=0x7ff2040091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff219e06700 1 -- 172.21.15.29:0/8578530 reap_dead start 2023-10-06T05:30:59.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 shutdown_connections 2023-10-06T05:30:59.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 >> 172.21.15.29:0/8578530 conn(0x7ff2140cd0e0 msgr2=0x7ff214068660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:59.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 shutdown_connections 2023-10-06T05:30:59.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.143+0000 7ff21b869700 1 -- 172.21.15.29:0/8578530 wait complete. 2023-10-06T05:30:59.161 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T05:30:59.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.267+0000 7f610f554700 1 Processor -- start 2023-10-06T05:30:59.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.267+0000 7f610f554700 1 -- start start 2023-10-06T05:30:59.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610f554700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f610806ccc0 0x7f6108158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610f554700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6108158fa0 0x7f61080ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610f554700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610806ab80 con 0x7f610806c8f0 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610f554700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61080cb4e0 con 0x7f6108158fa0 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610f554700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61080cb7c0 con 0x7f610806ccc0 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610d2f0700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f610806c8f0 0x7f61080afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56520/0 (socket says 172.21.15.29:56520) 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610d2f0700 1 -- 172.21.15.29:0/3159560466 learned_addr learned my addr 172.21.15.29:0/3159560466 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610caef700 1 --2- 172.21.15.29:0/3159560466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f610806ccc0 0x7f6108158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610daf1700 1 --2- 172.21.15.29:0/3159560466 >> v2:172.21.15.173:3300/0 conn(0x7f6108158fa0 0x7f61080ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f60fffff700 1 -- 172.21.15.29:0/3159560466 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405796515 0 0) 0x7f610806ab80 con 0x7f610806c8f0 2023-10-06T05:30:59.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f60fffff700 1 -- 172.21.15.29:0/3159560466 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f4003570 con 0x7f610806c8f0 2023-10-06T05:30:59.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610caef700 1 -- 172.21.15.29:0/3159560466 >> v2:172.21.15.173:3300/0 conn(0x7f6108158fa0 msgr2=0x7f61080ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:59.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f60fffff700 1 -- 172.21.15.29:0/3159560466 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509041862 0 0) 0x7f60f4003570 con 0x7f610806c8f0 2023-10-06T05:30:59.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610caef700 1 --2- 172.21.15.29:0/3159560466 >> v2:172.21.15.173:3300/0 conn(0x7f6108158fa0 0x7f61080ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610caef700 1 -- 172.21.15.29:0/3159560466 >> v1:172.21.15.29:6789/0 conn(0x7f610806c8f0 legacy=0x7f61080afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610caef700 1 -- 172.21.15.29:0/3159560466 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610806a810 con 0x7f610806ccc0 2023-10-06T05:30:59.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f610caef700 1 --2- 172.21.15.29:0/3159560466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f610806ccc0 0x7f6108158a60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f61040098e0 tx=0x7f61040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=130c12112ebc411a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f60fffff700 1 -- 172.21.15.29:0/3159560466 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100005260 con 0x7f610806ccc0 2023-10-06T05:30:59.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f60fffff700 1 -- 172.21.15.29:0/3159560466 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104011420 con 0x7f610806ccc0 2023-10-06T05:30:59.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.271+0000 7f60fffff700 1 -- 172.21.15.29:0/3159560466 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040117a0 con 0x7f610806ccc0 2023-10-06T05:30:59.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.275+0000 7f610f554700 1 -- 172.21.15.29:0/3159560466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f610806ccc0 msgr2=0x7f6108158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.275+0000 7f610f554700 1 --2- 172.21.15.29:0/3159560466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f610806ccc0 0x7f6108158a60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f61040098e0 tx=0x7f61040091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.275+0000 7f610f554700 1 -- 172.21.15.29:0/3159560466 shutdown_connections 2023-10-06T05:30:59.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.275+0000 7f610f554700 1 --2- 172.21.15.29:0/3159560466 >> v2:172.21.15.173:3300/0 conn(0x7f6108158fa0 0x7f61080ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.275+0000 7f610f554700 1 --2- 172.21.15.29:0/3159560466 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f610806ccc0 0x7f6108158a60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.275+0000 7f610f554700 1 -- 172.21.15.29:0/3159560466 >> 172.21.15.29:0/3159560466 conn(0x7f6108068510 msgr2=0x7f6108068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:59.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.275+0000 7f610f554700 1 -- 172.21.15.29:0/3159560466 shutdown_connections 2023-10-06T05:30:59.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.275+0000 7f610f554700 1 -- 172.21.15.29:0/3159560466 wait complete. 2023-10-06T05:30:59.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.275+0000 7f610f554700 1 Processor -- start 2023-10-06T05:30:59.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610f554700 1 -- start start 2023-10-06T05:30:59.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610f554700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610806c8f0 0x7f61080c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610f554700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610806ccc0 0x7f6108151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610f554700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6108158fa0 0x7f61080ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610f554700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610815a780 con 0x7f610806c8f0 2023-10-06T05:30:59.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610f554700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61080c3d20 con 0x7f610806ccc0 2023-10-06T05:30:59.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610f554700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61080c4000 con 0x7f6108158fa0 2023-10-06T05:30:59.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610d2f0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610806c8f0 0x7f61080c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610d2f0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610806c8f0 0x7f61080c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38182/0 (socket says 172.21.15.29:38182) 2023-10-06T05:30:59.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610d2f0700 1 -- 172.21.15.29:0/3473301551 learned_addr learned my addr 172.21.15.29:0/3473301551 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:59.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610daf1700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6108158fa0 0x7f61080ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610caef700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610806ccc0 0x7f6108151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610d2f0700 1 -- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6108158fa0 msgr2=0x7f61080ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610d2f0700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6108158fa0 0x7f61080ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610d2f0700 1 -- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610806ccc0 msgr2=0x7f6108151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610d2f0700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610806ccc0 0x7f6108151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610d2f0700 1 -- 172.21.15.29:0/3473301551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104009420 con 0x7f610806c8f0 2023-10-06T05:30:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610d2f0700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610806c8f0 0x7f61080c34f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f610000cbe0 tx=0x7f6100004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f60fd7fa700 1 -- 172.21.15.29:0/3473301551 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100007300 con 0x7f610806c8f0 2023-10-06T05:30:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f60fd7fa700 1 -- 172.21.15.29:0/3473301551 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6100007480 con 0x7f610806c8f0 2023-10-06T05:30:59.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61080c42e0 con 0x7f610806c8f0 2023-10-06T05:30:59.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f60fd7fa700 1 -- 172.21.15.29:0/3473301551 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100005800 con 0x7f610806c8f0 2023-10-06T05:30:59.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.279+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61080c3a30 con 0x7f610806c8f0 2023-10-06T05:30:59.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.283+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610815a8f0 con 0x7f610806c8f0 2023-10-06T05:30:59.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.283+0000 7f60fd7fa700 1 -- 172.21.15.29:0/3473301551 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6100005bb0 con 0x7f610806c8f0 2023-10-06T05:30:59.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.283+0000 7f60fd7fa700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f60ec060550 0x7f60ec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.283+0000 7f60fd7fa700 1 -- 172.21.15.29:0/3473301551 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f610007c630 con 0x7f610806c8f0 2023-10-06T05:30:59.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.283+0000 7f610caef700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f60ec060550 0x7f60ec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.283+0000 7f610caef700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f60ec060550 0x7f60ec062a00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f61040091e0 tx=0x7f6104016000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.291+0000 7f60fd7fa700 1 -- 172.21.15.29:0/3473301551 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f610815a8f0 con 0x7f610806c8f0 2023-10-06T05:30:59.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.455+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f610815a8c0 con 0x7f60ec060550 2023-10-06T05:30:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.455+0000 7f60fd7fa700 1 -- 172.21.15.29:0/3473301551 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f610815a8c0 con 0x7f60ec060550 2023-10-06T05:30:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f60ec060550 msgr2=0x7f60ec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f60ec060550 0x7f60ec062a00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f61040091e0 tx=0x7f6104016000 comp rx=0 tx=0).stop 2023-10-06T05:30:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610806c8f0 msgr2=0x7f61080c34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610806c8f0 0x7f61080c34f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f610000cbe0 tx=0x7f6100004f20 comp rx=0 tx=0).stop 2023-10-06T05:30:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 shutdown_connections 2023-10-06T05:30:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6108158fa0 0x7f61080ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f60ec060550 0x7f60ec062a00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f610806ccc0 0x7f6108151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 --2- 172.21.15.29:0/3473301551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610806c8f0 0x7f61080c34f0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 >> 172.21.15.29:0/3473301551 conn(0x7f6108068510 msgr2=0x7f61081535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 shutdown_connections 2023-10-06T05:30:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.459+0000 7f610f554700 1 -- 172.21.15.29:0/3473301551 wait complete. 2023-10-06T05:30:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T05:30:59.477 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T05:30:59.478 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T05:30:59.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.587+0000 7f45fe9a4700 1 Processor -- start 2023-10-06T05:30:59.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.587+0000 7f45fe9a4700 1 -- start start 2023-10-06T05:30:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f45f806c6c0 0x7f45f806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f45f80af940 0x7f45f80afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f806d070 con 0x7f45f8140640 2023-10-06T05:30:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f80cb420 con 0x7f45f80af940 2023-10-06T05:30:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f80ca810 con 0x7f45f806c6c0 2023-10-06T05:30:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe1a3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f45f80af940 0x7f45f80afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe1a3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f45f80af940 0x7f45f80afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38196/0 (socket says 172.21.15.29:38196) 2023-10-06T05:30:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe1a3700 1 -- 172.21.15.29:0/3770355990 learned_addr learned my addr 172.21.15.29:0/3770355990 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fd1a1700 1 --2- 172.21.15.29:0/3770355990 >> v2:172.21.15.173:3300/0 conn(0x7f45f806c6c0 0x7f45f806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe1a3700 1 -- 172.21.15.29:0/3770355990 >> v2:172.21.15.173:3300/0 conn(0x7f45f806c6c0 msgr2=0x7f45f806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:59.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe1a3700 1 --2- 172.21.15.29:0/3770355990 >> v2:172.21.15.173:3300/0 conn(0x7f45f806c6c0 0x7f45f806cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe1a3700 1 -- 172.21.15.29:0/3770355990 >> v1:172.21.15.173:6789/0 conn(0x7f45f8140640 legacy=0x7f45f80cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe1a3700 1 -- 172.21.15.29:0/3770355990 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80caaf0 con 0x7f45f80af940 2023-10-06T05:30:59.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe1a3700 1 --2- 172.21.15.29:0/3770355990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f80af940 0x7f45f80afdc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f45f80697e0 tx=0x7f45f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821d2725077790b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fc9a0700 1 -- 172.21.15.29:0/3770355990 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000e070 con 0x7f45f80af940 2023-10-06T05:30:59.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fc9a0700 1 -- 172.21.15.29:0/3770355990 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f000ba20 con 0x7f45f80af940 2023-10-06T05:30:59.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fc9a0700 1 -- 172.21.15.29:0/3770355990 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f00092e0 con 0x7f45f80af940 2023-10-06T05:30:59.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 -- 172.21.15.29:0/3770355990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f80af940 msgr2=0x7f45f80afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 --2- 172.21.15.29:0/3770355990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f80af940 0x7f45f80afdc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f45f80697e0 tx=0x7f45f0009840 comp rx=0 tx=0).stop 2023-10-06T05:30:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 -- 172.21.15.29:0/3770355990 shutdown_connections 2023-10-06T05:30:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 --2- 172.21.15.29:0/3770355990 >> v2:172.21.15.173:3300/0 conn(0x7f45f806c6c0 0x7f45f806cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 --2- 172.21.15.29:0/3770355990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f80af940 0x7f45f80afdc0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 -- 172.21.15.29:0/3770355990 >> 172.21.15.29:0/3770355990 conn(0x7f45f806ba30 msgr2=0x7f45f8095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 -- 172.21.15.29:0/3770355990 shutdown_connections 2023-10-06T05:30:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.591+0000 7f45fe9a4700 1 -- 172.21.15.29:0/3770355990 wait complete. 2023-10-06T05:30:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe9a4700 1 Processor -- start 2023-10-06T05:30:59.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe9a4700 1 -- start start 2023-10-06T05:30:59.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe9a4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45f806c6c0 0x7f45f815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe9a4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45f80af940 0x7f45f80b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe9a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f8140640 0x7f45f8155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe9a4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80c5690 con 0x7f45f8140640 2023-10-06T05:30:59.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe9a4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8168df0 con 0x7f45f80af940 2023-10-06T05:30:59.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe9a4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80c4870 con 0x7f45f806c6c0 2023-10-06T05:30:59.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe1a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f8140640 0x7f45f8155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fd9a2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45f806c6c0 0x7f45f815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe1a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f8140640 0x7f45f8155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38210/0 (socket says 172.21.15.29:38210) 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe1a3700 1 -- 172.21.15.29:0/745407707 learned_addr learned my addr 172.21.15.29:0/745407707 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fd1a1700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45f80af940 0x7f45f80b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe1a3700 1 -- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45f806c6c0 msgr2=0x7f45f815b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe1a3700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45f806c6c0 0x7f45f815b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe1a3700 1 -- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45f80af940 msgr2=0x7f45f80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe1a3700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45f80af940 0x7f45f80b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.595+0000 7f45fe1a3700 1 -- 172.21.15.29:0/745407707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f0009ae0 con 0x7f45f8140640 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45fe1a3700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f8140640 0x7f45f8155fc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009880 tx=0x7f45f0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45edffb700 1 -- 172.21.15.29:0/745407707 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0008a80 con 0x7f45f8140640 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45edffb700 1 -- 172.21.15.29:0/745407707 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0008c00 con 0x7f45f8140640 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f80c2c30 con 0x7f45f8140640 2023-10-06T05:30:59.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45edffb700 1 -- 172.21.15.29:0/745407707 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0026460 con 0x7f45f8140640 2023-10-06T05:30:59.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f80c4bc0 con 0x7f45f8140640 2023-10-06T05:30:59.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45f804be00 con 0x7f45f8140640 2023-10-06T05:30:59.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45edffb700 1 -- 172.21.15.29:0/745407707 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f45f0003040 con 0x7f45f8140640 2023-10-06T05:30:59.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45edffb700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f45dc060550 0x7f45dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45edffb700 1 -- 172.21.15.29:0/745407707 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f45f007e640 con 0x7f45f8140640 2023-10-06T05:30:59.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.599+0000 7f45fd9a2700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f45dc060550 0x7f45dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.603+0000 7f45edffb700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f45dc066b00 0x7f45dc068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.603+0000 7f45edffb700 1 -- 172.21.15.29:0/745407707 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45dc0695c0 con 0x7f45dc066b00 2023-10-06T05:30:59.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.603+0000 7f45edffb700 1 -- 172.21.15.29:0/745407707 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f007ea10 con 0x7f45f8140640 2023-10-06T05:30:59.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.603+0000 7f45fd1a1700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f45dc066b00 0x7f45dc068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.603+0000 7f45fd1a1700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f45dc066b00 0x7f45dc068f10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.603+0000 7f45fd9a2700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f45dc060550 0x7f45dc062a00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f45f4003a20 tx=0x7f45f4007f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.603+0000 7f45edffb700 1 -- 172.21.15.29:0/745407707 <== osd.3 v2:172.21.15.29:6800/33419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f45dc0695c0 con 0x7f45dc066b00 2023-10-06T05:30:59.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 --> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f45f80cadd0 con 0x7f45dc066b00 2023-10-06T05:30:59.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45edffb700 1 -- 172.21.15.29:0/745407707 <== osd.3 v2:172.21.15.29:6800/33419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f45f80cadd0 con 0x7f45dc066b00 2023-10-06T05:30:59.627 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:30:59.627 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T05:30:59.627 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:30:59.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f45dc066b00 msgr2=0x7f45dc068f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.29:6800/33419,v1:172.21.15.29:6801/33419] conn(0x7f45dc066b00 0x7f45dc068f10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f45dc060550 msgr2=0x7f45dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f45dc060550 0x7f45dc062a00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f45f4003a20 tx=0x7f45f4007f10 comp rx=0 tx=0).stop 2023-10-06T05:30:59.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f8140640 msgr2=0x7f45f8155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 --2- 172.21.15.29:0/745407707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45f8140640 0x7f45f8155fc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009880 tx=0x7f45f0018000 comp rx=0 tx=0).stop 2023-10-06T05:30:59.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe1a3700 1 -- 172.21.15.29:0/745407707 reap_dead start 2023-10-06T05:30:59.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 shutdown_connections 2023-10-06T05:30:59.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 >> 172.21.15.29:0/745407707 conn(0x7f45f806ba30 msgr2=0x7f45f8067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:59.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 shutdown_connections 2023-10-06T05:30:59.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.619+0000 7f45fe9a4700 1 -- 172.21.15.29:0/745407707 wait complete. 2023-10-06T05:30:59.640 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T05:30:59.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7face639b700 1 Processor -- start 2023-10-06T05:30:59.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7face639b700 1 -- start start 2023-10-06T05:30:59.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7face639b700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7face00ad940 0x7face00ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7face639b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face00add10 0x7face01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7face639b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face00af340 con 0x7face006cdd0 2023-10-06T05:30:59.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7face639b700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face015b1c0 con 0x7face00ad940 2023-10-06T05:30:59.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7face639b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face00aeee0 con 0x7face00add10 2023-10-06T05:30:59.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdf7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7face006cdd0 0x7face015aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56522/0 (socket says 172.21.15.29:56522) 2023-10-06T05:30:59.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdf7fe700 1 -- 172.21.15.29:0/4030366334 learned_addr learned my addr 172.21.15.29:0/4030366334 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:30:59.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7face4938700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face00add10 0x7face01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdffff700 1 --2- 172.21.15.29:0/4030366334 >> v2:172.21.15.173:3300/0 conn(0x7face00ad940 0x7face00ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226162045 0 0) 0x7face00af340 con 0x7face006cdd0 2023-10-06T05:30:59.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faccc003570 con 0x7face006cdd0 2023-10-06T05:30:59.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197335382 0 0) 0x7faccc003570 con 0x7face006cdd0 2023-10-06T05:30:59.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face00add10 msgr2=0x7face01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:59.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face00add10 0x7face01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 >> v2:172.21.15.173:3300/0 conn(0x7face00ad940 msgr2=0x7face00ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:59.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 --2- 172.21.15.29:0/4030366334 >> v2:172.21.15.173:3300/0 conn(0x7face00ad940 0x7face00ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face00af590 con 0x7face006cdd0 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7facc8001470 con 0x7face006cdd0 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 >> v1:172.21.15.29:6789/0 conn(0x7face006cdd0 legacy=0x7face015aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face00add10 0x7faccc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faccc003fe0 0x7faccc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 0x7faccc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face015b1c0 con 0x7faccc003fe0 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face00aeee0 con 0x7faccc004d50 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.743+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc00ba90 con 0x7face00add10 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7facdf7fe700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faccc003fe0 0x7faccc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face4938700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 0x7faccc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7facdffff700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face00add10 0x7faccc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face4938700 1 -- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face00add10 msgr2=0x7faccc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face4938700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face00add10 0x7faccc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face4938700 1 -- 172.21.15.29:0/4030366334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faccc003fe0 msgr2=0x7faccc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face4938700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faccc003fe0 0x7faccc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face4938700 1 -- 172.21.15.29:0/4030366334 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc003570 con 0x7faccc004d50 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7facdf7fe700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faccc003fe0 0x7faccc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7facdffff700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face00add10 0x7faccc003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face4938700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 0x7faccc0051c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7facd800e210 tx=0x7facd800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dd60867c62c16bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd800eac0 con 0x7faccc004d50 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd800f040 con 0x7faccc004d50 2023-10-06T05:30:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7facdeffd700 1 -- 172.21.15.29:0/4030366334 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd800ee70 con 0x7faccc004d50 2023-10-06T05:30:59.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face639b700 1 -- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 msgr2=0x7faccc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face639b700 1 --2- 172.21.15.29:0/4030366334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 0x7faccc0051c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7facd800e210 tx=0x7facd800b040 comp rx=0 tx=0).stop 2023-10-06T05:30:59.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face4938700 1 -- 172.21.15.29:0/4030366334 reap_dead start 2023-10-06T05:30:59.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face639b700 1 -- 172.21.15.29:0/4030366334 shutdown_connections 2023-10-06T05:30:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face639b700 1 -- 172.21.15.29:0/4030366334 >> 172.21.15.29:0/4030366334 conn(0x7face0067b70 msgr2=0x7face006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face639b700 1 -- 172.21.15.29:0/4030366334 shutdown_connections 2023-10-06T05:30:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.747+0000 7face639b700 1 -- 172.21.15.29:0/4030366334 wait complete. 2023-10-06T05:30:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7face639b700 1 Processor -- start 2023-10-06T05:30:59.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7face639b700 1 -- start start 2023-10-06T05:30:59.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7face639b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 0x7face01581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7face639b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7face0154000 0x7face0169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7face639b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face0154450 0x7face016a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7face639b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face01549a0 con 0x7face0154000 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7face639b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face0154c80 con 0x7faccc004d50 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7face639b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face0154f60 con 0x7face0154450 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7face0154000 0x7face0169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7face0154000 0x7face0169fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38222/0 (socket says 172.21.15.29:38222) 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdf7fe700 1 -- 172.21.15.29:0/641713295 learned_addr learned my addr 172.21.15.29:0/641713295 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdffff700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 0x7face01581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7face4938700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face0154450 0x7face016a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdf7fe700 1 -- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face0154450 msgr2=0x7face016a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdf7fe700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face0154450 0x7face016a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdf7fe700 1 -- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 msgr2=0x7face01581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdf7fe700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 0x7face01581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdf7fe700 1 -- 172.21.15.29:0/641713295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0155240 con 0x7face0154000 2023-10-06T05:30:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facdf7fe700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7face0154000 0x7face0169fd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7facc8007fd0 tx=0x7facc8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.751+0000 7facd7fff700 1 -- 172.21.15.29:0/641713295 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc800f970 con 0x7face0154000 2023-10-06T05:30:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.755+0000 7facd7fff700 1 -- 172.21.15.29:0/641713295 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc800fad0 con 0x7face0154000 2023-10-06T05:30:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.755+0000 7face639b700 1 -- 172.21.15.29:0/641713295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face0155520 con 0x7face0154000 2023-10-06T05:30:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.755+0000 7facd7fff700 1 -- 172.21.15.29:0/641713295 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc800fe50 con 0x7face0154000 2023-10-06T05:30:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.755+0000 7face639b700 1 -- 172.21.15.29:0/641713295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face01669d0 con 0x7face0154000 2023-10-06T05:30:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.755+0000 7face639b700 1 -- 172.21.15.29:0/641713295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face0071120 con 0x7face0154000 2023-10-06T05:30:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.755+0000 7facd7fff700 1 -- 172.21.15.29:0/641713295 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7facc8013600 con 0x7face0154000 2023-10-06T05:30:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.755+0000 7facd7fff700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facc0060580 0x7facc0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:30:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.759+0000 7facdffff700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facc0060580 0x7facc0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:30:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.759+0000 7facd7fff700 1 -- 172.21.15.29:0/641713295 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7facc807c990 con 0x7face0154000 2023-10-06T05:30:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.759+0000 7facdffff700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facc0060580 0x7facc0062a30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7facd0009720 tx=0x7facd00091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:30:59.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.767+0000 7facd7fff700 1 -- 172.21.15.29:0/641713295 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7facc804d070 con 0x7face0154000 2023-10-06T05:30:59.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.927+0000 7face639b700 1 -- 172.21.15.29:0/641713295 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7face0154df0 con 0x7facc0060580 2023-10-06T05:30:59.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.927+0000 7facd7fff700 1 -- 172.21.15.29:0/641713295 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7face0154df0 con 0x7facc0060580 2023-10-06T05:30:59.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 -- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facc0060580 msgr2=0x7facc0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facc0060580 0x7facc0062a30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7facd0009720 tx=0x7facd00091a0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 -- 172.21.15.29:0/641713295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7face0154000 msgr2=0x7face0169fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7face0154000 0x7face0169fd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7facc8007fd0 tx=0x7facc8001e90 comp rx=0 tx=0).stop 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 -- 172.21.15.29:0/641713295 shutdown_connections 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7face0154450 0x7face016a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7face0154000 0x7face0169fd0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7facc0060580 0x7facc0062a30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 --2- 172.21.15.29:0/641713295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faccc004d50 0x7face01581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 -- 172.21.15.29:0/641713295 >> 172.21.15.29:0/641713295 conn(0x7face0067b70 msgr2=0x7face0151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 -- 172.21.15.29:0/641713295 shutdown_connections 2023-10-06T05:30:59.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:30:59.931+0000 7face639b700 1 -- 172.21.15.29:0/641713295 wait complete. 2023-10-06T05:30:59.939 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T05:30:59.949 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T05:30:59.949 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T05:31:00.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.059+0000 7f6307fff700 1 Processor -- start 2023-10-06T05:31:00.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.059+0000 7f6307fff700 1 -- start start 2023-10-06T05:31:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6307fff700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6308158e30 0x7f6308068260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6307fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630806bf90 con 0x7f63080687a0 2023-10-06T05:31:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6307fff700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630806b6f0 con 0x7f6308159200 2023-10-06T05:31:00.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6307fff700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630806b9d0 con 0x7f6308158e30 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f63077fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f63080687a0 0x7f63080676f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56534/0 (socket says 172.21.15.29:56534) 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f63077fe700 1 -- 172.21.15.29:0/179841740 learned_addr learned my addr 172.21.15.29:0/179841740 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6306ffd700 1 --2- 172.21.15.29:0/179841740 >> v2:172.21.15.173:3300/0 conn(0x7f6308158e30 0x7f6308068260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152598657 0 0) 0x7f630806bf90 con 0x7f63080687a0 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f0003570 con 0x7f63080687a0 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738340498 0 0) 0x7f630806b6f0 con 0x7f6308159200 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f630806bf90 con 0x7f6308159200 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 627948533 0 0) 0x7f62f0003570 con 0x7f63080687a0 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 >> v2:172.21.15.173:3300/0 conn(0x7f6308158e30 msgr2=0x7f6308068260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 --2- 172.21.15.29:0/179841740 >> v2:172.21.15.173:3300/0 conn(0x7f6308158e30 0x7f6308068260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 >> v1:172.21.15.173:6789/0 conn(0x7f6308159200 legacy=0x7f63080c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630806bcb0 con 0x7f63080687a0 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f63000017f0 con 0x7f63080687a0 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 >> v1:172.21.15.29:6789/0 conn(0x7f63080687a0 legacy=0x7f63080676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f62f0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62f0004810 0x7f62f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62f00051c0 0x7f62f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630806b9d0 con 0x7f62f0003bf0 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f000c160 con 0x7f62f00051c0 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f000c320 con 0x7f62f0004810 2023-10-06T05:31:00.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6306ffd700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f62f0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f63067fc700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62f0004810 0x7f62f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f63077fe700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62f00051c0 0x7f62f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6306ffd700 1 -- 172.21.15.29:0/179841740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62f0004810 msgr2=0x7f62f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6306ffd700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f62f0004810 0x7f62f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6306ffd700 1 -- 172.21.15.29:0/179841740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62f00051c0 msgr2=0x7f62f000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6306ffd700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62f00051c0 0x7f62f000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f63077fe700 1 -- 172.21.15.29:0/179841740 reap_dead start 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6306ffd700 1 -- 172.21.15.29:0/179841740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0003570 con 0x7f62f0003bf0 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6306ffd700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f62f0003fe0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f62f8006f00 tx=0x7f62f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6f748f80dfee75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800e710 con 0x7f62f0003bf0 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f800e870 con 0x7f62f0003bf0 2023-10-06T05:31:00.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.063+0000 7f6305ffb700 1 -- 172.21.15.29:0/179841740 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800ec30 con 0x7f62f0003bf0 2023-10-06T05:31:00.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.067+0000 7f6307fff700 1 -- 172.21.15.29:0/179841740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 msgr2=0x7f62f0003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.067+0000 7f6307fff700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f62f0003fe0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f62f8006f00 tx=0x7f62f80091a0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.067+0000 7f6307fff700 1 -- 172.21.15.29:0/179841740 shutdown_connections 2023-10-06T05:31:00.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.067+0000 7f6307fff700 1 --2- 172.21.15.29:0/179841740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f62f0003fe0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.067+0000 7f6307fff700 1 -- 172.21.15.29:0/179841740 >> 172.21.15.29:0/179841740 conn(0x7f63080c9830 msgr2=0x7f630806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:00.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.067+0000 7f6307fff700 1 -- 172.21.15.29:0/179841740 shutdown_connections 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.067+0000 7f6307fff700 1 -- 172.21.15.29:0/179841740 wait complete. 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.067+0000 7f6307fff700 1 Processor -- start 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.067+0000 7f6307fff700 1 -- start start 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6307fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f63080a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6307fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63080af930 0x7f63080afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6307fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63080acb70 0x7f63080acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6307fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63080ad520 con 0x7f62f0003bf0 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6307fff700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63080aa300 con 0x7f63080af930 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6307fff700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63080a8b90 con 0x7f63080acb70 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6306ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f63080a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6306ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f63080a9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38242/0 (socket says 172.21.15.29:38242) 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6306ffd700 1 -- 172.21.15.29:0/4127691385 learned_addr learned my addr 172.21.15.29:0/4127691385 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f63067fc700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63080af930 0x7f63080afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f63077fe700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63080acb70 0x7f63080acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6306ffd700 1 -- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63080acb70 msgr2=0x7f63080acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6306ffd700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63080acb70 0x7f63080acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6306ffd700 1 -- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63080af930 msgr2=0x7f63080afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6306ffd700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63080af930 0x7f63080afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6306ffd700 1 -- 172.21.15.29:0/4127691385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63080a9fb0 con 0x7f62f0003bf0 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6306ffd700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f63080a9570 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f62f800e4b0 tx=0x7f62f801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f62eeffd700 1 -- 172.21.15.29:0/4127691385 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8022070 con 0x7f62f0003bf0 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f62eeffd700 1 -- 172.21.15.29:0/4127691385 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f800e9e0 con 0x7f62f0003bf0 2023-10-06T05:31:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63080b04a0 con 0x7f62f0003bf0 2023-10-06T05:31:00.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f62eeffd700 1 -- 172.21.15.29:0/4127691385 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800e710 con 0x7f62f0003bf0 2023-10-06T05:31:00.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63080b0a60 con 0x7f62f0003bf0 2023-10-06T05:31:00.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f62eeffd700 1 -- 172.21.15.29:0/4127691385 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f62f8027990 con 0x7f62f0003bf0 2023-10-06T05:31:00.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.071+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f630804be00 con 0x7f62f0003bf0 2023-10-06T05:31:00.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f62eeffd700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62f4060550 0x7f62f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f62eeffd700 1 -- 172.21.15.29:0/4127691385 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f62f807e0d0 con 0x7f62f0003bf0 2023-10-06T05:31:00.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f63067fc700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62f4060550 0x7f62f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f62eeffd700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f62f4066b00 0x7f62f4068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f62eeffd700 1 -- 172.21.15.29:0/4127691385 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62f40695c0 con 0x7f62f4066b00 2023-10-06T05:31:00.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f62eeffd700 1 -- 172.21.15.29:0/4127691385 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62f8080710 con 0x7f62f0003bf0 2023-10-06T05:31:00.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f63077fe700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f62f4066b00 0x7f62f4068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f63067fc700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62f4060550 0x7f62f4062a00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0010e0 tx=0x7f62fc007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f63077fe700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f62f4066b00 0x7f62f4068f10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.075+0000 7f62eeffd700 1 -- 172.21.15.29:0/4127691385 <== osd.4 v2:172.21.15.173:6800/33715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f62f40695c0 con 0x7f62f4066b00 2023-10-06T05:31:00.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 --> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f63080ad520 con 0x7f62f4066b00 2023-10-06T05:31:00.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f62eeffd700 1 -- 172.21.15.29:0/4127691385 <== osd.4 v2:172.21.15.173:6800/33715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f63080ad520 con 0x7f62f4066b00 2023-10-06T05:31:00.102 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:31:00.102 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T05:31:00.102 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:31:00.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f62f4066b00 msgr2=0x7f62f4068f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6800/33715,v1:172.21.15.173:6801/33715] conn(0x7f62f4066b00 0x7f62f4068f10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62f4060550 msgr2=0x7f62f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f62f4060550 0x7f62f4062a00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0010e0 tx=0x7f62fc007d30 comp rx=0 tx=0).stop 2023-10-06T05:31:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 msgr2=0x7f63080a9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 --2- 172.21.15.29:0/4127691385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f0003bf0 0x7f63080a9570 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f62f800e4b0 tx=0x7f62f801a000 comp rx=0 tx=0).stop 2023-10-06T05:31:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f63077fe700 1 -- 172.21.15.29:0/4127691385 reap_dead start 2023-10-06T05:31:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 shutdown_connections 2023-10-06T05:31:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 >> 172.21.15.29:0/4127691385 conn(0x7f63080c9830 msgr2=0x7f6308157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 shutdown_connections 2023-10-06T05:31:00.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.095+0000 7f6307fff700 1 -- 172.21.15.29:0/4127691385 wait complete. 2023-10-06T05:31:00.114 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T05:31:00.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c067c2700 1 Processor -- start 2023-10-06T05:31:00.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c067c2700 1 -- start start 2023-10-06T05:31:00.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c067c2700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1c0015ace0 0x7f1c0006b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c067c2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c000cc8b0 con 0x7f1c000c9ea0 2023-10-06T05:31:00.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c067c2700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0006b280 con 0x7f1c0015e490 2023-10-06T05:31:00.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c067c2700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0006bc50 con 0x7f1c0015ace0 2023-10-06T05:31:00.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c05fc1700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1c000c9ea0 0x7f1c000ca2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56540/0 (socket says 172.21.15.29:56540) 2023-10-06T05:31:00.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c05fc1700 1 -- 172.21.15.29:0/1238343180 learned_addr learned my addr 172.21.15.29:0/1238343180 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:31:00.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c057c0700 1 --2- 172.21.15.29:0/1238343180 >> v2:172.21.15.173:3300/0 conn(0x7f1c0015ace0 0x7f1c0006b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1bf7fff700 1 -- 172.21.15.29:0/1238343180 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040600824 0 0) 0x7f1c000cc8b0 con 0x7f1c000c9ea0 2023-10-06T05:31:00.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1bf7fff700 1 -- 172.21.15.29:0/1238343180 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bec003570 con 0x7f1c000c9ea0 2023-10-06T05:31:00.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c057c0700 1 -- 172.21.15.29:0/1238343180 >> v1:172.21.15.173:6789/0 conn(0x7f1c0015e490 legacy=0x7f1c000cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c057c0700 1 -- 172.21.15.29:0/1238343180 >> v1:172.21.15.29:6789/0 conn(0x7f1c000c9ea0 legacy=0x7f1c000ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c057c0700 1 -- 172.21.15.29:0/1238343180 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0006a670 con 0x7f1c0015ace0 2023-10-06T05:31:00.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1c057c0700 1 --2- 172.21.15.29:0/1238343180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c0015ace0 0x7f1c0006b710 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0098e0 tx=0x7f1bfc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5386be089832a43b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1bf7fff700 1 -- 172.21.15.29:0/1238343180 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00b640 con 0x7f1c0015ace0 2023-10-06T05:31:00.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1bf7fff700 1 -- 172.21.15.29:0/1238343180 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00b7a0 con 0x7f1c0015ace0 2023-10-06T05:31:00.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.215+0000 7f1bf7fff700 1 -- 172.21.15.29:0/1238343180 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00bb40 con 0x7f1c0015ace0 2023-10-06T05:31:00.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.219+0000 7f1c067c2700 1 -- 172.21.15.29:0/1238343180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c0015ace0 msgr2=0x7f1c0006b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.219+0000 7f1c067c2700 1 --2- 172.21.15.29:0/1238343180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c0015ace0 0x7f1c0006b710 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0098e0 tx=0x7f1bfc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.219+0000 7f1c067c2700 1 -- 172.21.15.29:0/1238343180 shutdown_connections 2023-10-06T05:31:00.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.219+0000 7f1c067c2700 1 --2- 172.21.15.29:0/1238343180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c0015ace0 0x7f1c0006b710 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.219+0000 7f1c067c2700 1 -- 172.21.15.29:0/1238343180 >> 172.21.15.29:0/1238343180 conn(0x7f1c000670a0 msgr2=0x7f1c00067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:00.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.219+0000 7f1c067c2700 1 -- 172.21.15.29:0/1238343180 shutdown_connections 2023-10-06T05:31:00.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.219+0000 7f1c067c2700 1 -- 172.21.15.29:0/1238343180 wait complete. 2023-10-06T05:31:00.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.219+0000 7f1c067c2700 1 Processor -- start 2023-10-06T05:31:00.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.219+0000 7f1c067c2700 1 -- start start 2023-10-06T05:31:00.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c067c2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c000c9ea0 0x7f1c0015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c067c2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c0015ace0 0x7f1c000af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c067c2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c0015e490 0x7f1c0014a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c067c2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00161200 con 0x7f1c000c9ea0 2023-10-06T05:31:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c067c2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0015c3c0 con 0x7f1c0015ace0 2023-10-06T05:31:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c067c2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0015c6a0 con 0x7f1c0015e490 2023-10-06T05:31:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c057c0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c000c9ea0 0x7f1c0015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c057c0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c000c9ea0 0x7f1c0015ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38250/0 (socket says 172.21.15.29:38250) 2023-10-06T05:31:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c057c0700 1 -- 172.21.15.29:0/3675362707 learned_addr learned my addr 172.21.15.29:0/3675362707 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c04fbf700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c0015ace0 0x7f1c000af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c05fc1700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c0015e490 0x7f1c0014a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c057c0700 1 -- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c0015e490 msgr2=0x7f1c0014a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c057c0700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c0015e490 0x7f1c0014a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c057c0700 1 -- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c0015ace0 msgr2=0x7f1c000af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c057c0700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c0015ace0 0x7f1c000af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c057c0700 1 -- 172.21.15.29:0/3675362707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc009420 con 0x7f1c000c9ea0 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c057c0700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c000c9ea0 0x7f1c0015ba70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1c000697b0 tx=0x7f1bfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1bf57fa700 1 -- 172.21.15.29:0/3675362707 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc000d10 con 0x7f1c000c9ea0 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1bf57fa700 1 -- 172.21.15.29:0/3675362707 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00bb20 con 0x7f1c000c9ea0 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c001614a0 con 0x7f1c000c9ea0 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1bf57fa700 1 -- 172.21.15.29:0/3675362707 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc011670 con 0x7f1c000c9ea0 2023-10-06T05:31:00.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.223+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0015bfb0 con 0x7f1c000c9ea0 2023-10-06T05:31:00.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.227+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0015c140 con 0x7f1c000c9ea0 2023-10-06T05:31:00.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.227+0000 7f1bf57fa700 1 -- 172.21.15.29:0/3675362707 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1bfc0119e0 con 0x7f1c000c9ea0 2023-10-06T05:31:00.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.227+0000 7f1bf57fa700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1be4060580 0x7f1be4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.227+0000 7f1bf57fa700 1 -- 172.21.15.29:0/3675362707 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1bfc07dd30 con 0x7f1c000c9ea0 2023-10-06T05:31:00.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.227+0000 7f1c04fbf700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1be4060580 0x7f1be4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.227+0000 7f1c04fbf700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1be4060580 0x7f1be4062a30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1c0015ce00 tx=0x7f1bf0007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.231+0000 7f1bf57fa700 1 -- 172.21.15.29:0/3675362707 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1bfc04e370 con 0x7f1c000c9ea0 2023-10-06T05:31:00.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.391+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c0004be00 con 0x7f1be4060580 2023-10-06T05:31:00.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1bf57fa700 1 -- 172.21.15.29:0/3675362707 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c0004be00 con 0x7f1be4060580 2023-10-06T05:31:00.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1be4060580 msgr2=0x7f1be4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1be4060580 0x7f1be4062a30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1c0015ce00 tx=0x7f1bf0007ec0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c000c9ea0 msgr2=0x7f1c0015ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c000c9ea0 0x7f1c0015ba70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1c000697b0 tx=0x7f1bfc017000 comp rx=0 tx=0).stop 2023-10-06T05:31:00.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 shutdown_connections 2023-10-06T05:31:00.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c0015e490 0x7f1c0014a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f1be4060580 0x7f1be4062a30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c0015ace0 0x7f1c000af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 --2- 172.21.15.29:0/3675362707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c000c9ea0 0x7f1c0015ba70 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 >> 172.21.15.29:0/3675362707 conn(0x7f1c000670a0 msgr2=0x7f1c00158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:00.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.395+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 shutdown_connections 2023-10-06T05:31:00.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.399+0000 7f1c067c2700 1 -- 172.21.15.29:0/3675362707 wait complete. 2023-10-06T05:31:00.407 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T05:31:00.420 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T05:31:00.420 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T05:31:00.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.527+0000 7f93acec4700 1 Processor -- start 2023-10-06T05:31:00.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.527+0000 7f93acec4700 1 -- start start 2023-10-06T05:31:00.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93acec4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8159200 0x7f93a80c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93acec4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a806bf90 con 0x7f93a80c72f0 2023-10-06T05:31:00.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93acec4700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a806b6f0 con 0x7f93a8158e30 2023-10-06T05:31:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93acec4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a806b9d0 con 0x7f93a8159200 2023-10-06T05:31:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93a7fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f93a80c72f0 0x7f93a80676f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56546/0 (socket says 172.21.15.29:56546) 2023-10-06T05:31:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93a7fff700 1 -- 172.21.15.29:0/1235608712 learned_addr learned my addr 172.21.15.29:0/1235608712 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:31:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f939ffff700 1 --2- 172.21.15.29:0/1235608712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8159200 0x7f93a80c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93a6ffd700 1 -- 172.21.15.29:0/1235608712 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664377669 0 0) 0x7f93a806bf90 con 0x7f93a80c72f0 2023-10-06T05:31:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93a6ffd700 1 -- 172.21.15.29:0/1235608712 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9394003570 con 0x7f93a80c72f0 2023-10-06T05:31:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93a6ffd700 1 -- 172.21.15.29:0/1235608712 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170327953 0 0) 0x7f93a806b6f0 con 0x7f93a8158e30 2023-10-06T05:31:00.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93a6ffd700 1 -- 172.21.15.29:0/1235608712 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93a806bf90 con 0x7f93a8158e30 2023-10-06T05:31:00.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f939ffff700 1 -- 172.21.15.29:0/1235608712 >> v1:172.21.15.173:6789/0 conn(0x7f93a8158e30 legacy=0x7f93a8068260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f939ffff700 1 -- 172.21.15.29:0/1235608712 >> v1:172.21.15.29:6789/0 conn(0x7f93a80c72f0 legacy=0x7f93a80676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f939ffff700 1 -- 172.21.15.29:0/1235608712 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a806bcb0 con 0x7f93a8159200 2023-10-06T05:31:00.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f939ffff700 1 --2- 172.21.15.29:0/1235608712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8159200 0x7f93a80c6db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9390009910 tx=0x7f93900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e066be1ef10048a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93a6ffd700 1 -- 172.21.15.29:0/1235608712 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390011630 con 0x7f93a8159200 2023-10-06T05:31:00.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93a6ffd700 1 -- 172.21.15.29:0/1235608712 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9390011790 con 0x7f93a8159200 2023-10-06T05:31:00.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.531+0000 7f93a6ffd700 1 -- 172.21.15.29:0/1235608712 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390011b30 con 0x7f93a8159200 2023-10-06T05:31:00.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 -- 172.21.15.29:0/1235608712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8159200 msgr2=0x7f93a80c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 --2- 172.21.15.29:0/1235608712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8159200 0x7f93a80c6db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9390009910 tx=0x7f93900091a0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 -- 172.21.15.29:0/1235608712 shutdown_connections 2023-10-06T05:31:00.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 --2- 172.21.15.29:0/1235608712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8159200 0x7f93a80c6db0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 -- 172.21.15.29:0/1235608712 >> 172.21.15.29:0/1235608712 conn(0x7f93a80c9830 msgr2=0x7f93a806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:00.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 -- 172.21.15.29:0/1235608712 shutdown_connections 2023-10-06T05:31:00.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 -- 172.21.15.29:0/1235608712 wait complete. 2023-10-06T05:31:00.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 Processor -- start 2023-10-06T05:31:00.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 -- start start 2023-10-06T05:31:00.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93a80c72f0 0x7f93a80af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8158e30 0x7f93a80ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93a8159200 0x7f93a8156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80aca90 con 0x7f93a80c72f0 2023-10-06T05:31:00.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80aea60 con 0x7f93a8159200 2023-10-06T05:31:00.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93acec4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80abba0 con 0x7f93a8158e30 2023-10-06T05:31:00.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.535+0000 7f93a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93a80c72f0 0x7f93a80af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f939ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8158e30 0x7f93a80ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93a80c72f0 0x7f93a80af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38266/0 (socket says 172.21.15.29:38266) 2023-10-06T05:31:00.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93a77fe700 1 -- 172.21.15.29:0/331161345 learned_addr learned my addr 172.21.15.29:0/331161345 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:00.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93a7fff700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93a8159200 0x7f93a8156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93a77fe700 1 -- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8158e30 msgr2=0x7f93a80ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93a77fe700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93a8158e30 0x7f93a80ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93a77fe700 1 -- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93a8159200 msgr2=0x7f93a8156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93a77fe700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93a8159200 0x7f93a8156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93a77fe700 1 -- 172.21.15.29:0/331161345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390009420 con 0x7f93a80c72f0 2023-10-06T05:31:00.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93a77fe700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93a80c72f0 0x7f93a80af330 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f939800c580 tx=0x7f9398007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f939f7fe700 1 -- 172.21.15.29:0/331161345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398010510 con 0x7f93a80c72f0 2023-10-06T05:31:00.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f939f7fe700 1 -- 172.21.15.29:0/331161345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9398010670 con 0x7f93a80c72f0 2023-10-06T05:31:00.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a80abe80 con 0x7f93a80c72f0 2023-10-06T05:31:00.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f939f7fe700 1 -- 172.21.15.29:0/331161345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398010a30 con 0x7f93a80c72f0 2023-10-06T05:31:00.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a80ac440 con 0x7f93a80c72f0 2023-10-06T05:31:00.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93a804be00 con 0x7f93a80c72f0 2023-10-06T05:31:00.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.539+0000 7f939f7fe700 1 -- 172.21.15.29:0/331161345 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9398025430 con 0x7f93a80c72f0 2023-10-06T05:31:00.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f939f7fe700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9388060550 0x7f9388062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f939f7fe700 1 -- 172.21.15.29:0/331161345 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f939807cd40 con 0x7f93a80c72f0 2023-10-06T05:31:00.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f939ffff700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9388060550 0x7f9388062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f939f7fe700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f9388066b00 0x7f9388068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f939f7fe700 1 -- 172.21.15.29:0/331161345 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93880695c0 con 0x7f9388066b00 2023-10-06T05:31:00.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f939f7fe700 1 -- 172.21.15.29:0/331161345 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f939807d110 con 0x7f93a80c72f0 2023-10-06T05:31:00.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f93a7fff700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f9388066b00 0x7f9388068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f939ffff700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9388060550 0x7f9388062a00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9390009860 tx=0x7f9390017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f93a7fff700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f9388066b00 0x7f9388068f10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.543+0000 7f939f7fe700 1 -- 172.21.15.29:0/331161345 <== osd.5 v2:172.21.15.173:6808/33716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f93880695c0 con 0x7f9388066b00 2023-10-06T05:31:00.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.559+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 --> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f93a80ca5d0 con 0x7f9388066b00 2023-10-06T05:31:00.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.559+0000 7f939f7fe700 1 -- 172.21.15.29:0/331161345 <== osd.5 v2:172.21.15.173:6808/33716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f93a80ca5d0 con 0x7f9388066b00 2023-10-06T05:31:00.569 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:31:00.569 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T05:31:00.569 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:31:00.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f9388066b00 msgr2=0x7f9388068f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6808/33716,v1:172.21.15.173:6809/33716] conn(0x7f9388066b00 0x7f9388068f10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9388060550 msgr2=0x7f9388062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9388060550 0x7f9388062a00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9390009860 tx=0x7f9390017000 comp rx=0 tx=0).stop 2023-10-06T05:31:00.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93a80c72f0 msgr2=0x7f93a80af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 --2- 172.21.15.29:0/331161345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93a80c72f0 0x7f93a80af330 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f939800c580 tx=0x7f9398007e10 comp rx=0 tx=0).stop 2023-10-06T05:31:00.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93a7fff700 1 -- 172.21.15.29:0/331161345 reap_dead start 2023-10-06T05:31:00.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 shutdown_connections 2023-10-06T05:31:00.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 >> 172.21.15.29:0/331161345 conn(0x7f93a80c9830 msgr2=0x7f93a8157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:00.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 shutdown_connections 2023-10-06T05:31:00.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.563+0000 7f93acec4700 1 -- 172.21.15.29:0/331161345 wait complete. 2023-10-06T05:31:00.581 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T05:31:00.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.687+0000 7f59141db700 1 Processor -- start 2023-10-06T05:31:00.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.687+0000 7f59141db700 1 -- start start 2023-10-06T05:31:00.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f590c158fd0 0x7f590c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c06ee40 0x7f590c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c0afbe0 con 0x7f590c15cb00 2023-10-06T05:31:00.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c1598e0 con 0x7f590c158fd0 2023-10-06T05:31:00.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c15d350 con 0x7f590c06ee40 2023-10-06T05:31:00.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5911f77700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f590c158fd0 0x7f590c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5911776700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f590c15cb00 0x7f590c06e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56548/0 (socket says 172.21.15.29:56548) 2023-10-06T05:31:00.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5911776700 1 -- 172.21.15.29:0/98605719 learned_addr learned my addr 172.21.15.29:0/98605719 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:31:00.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5912778700 1 --2- 172.21.15.29:0/98605719 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c06ee40 0x7f590c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5912778700 1 -- 172.21.15.29:0/98605719 >> v2:172.21.15.29:3300/0 conn(0x7f590c158fd0 msgr2=0x7f590c1593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:00.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5912778700 1 --2- 172.21.15.29:0/98605719 >> v2:172.21.15.29:3300/0 conn(0x7f590c158fd0 0x7f590c1593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5912778700 1 -- 172.21.15.29:0/98605719 >> v1:172.21.15.29:6789/0 conn(0x7f590c15cb00 legacy=0x7f590c06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5912778700 1 -- 172.21.15.29:0/98605719 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c15d630 con 0x7f590c06ee40 2023-10-06T05:31:00.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5911f77700 1 --2- 172.21.15.29:0/98605719 >> v2:172.21.15.29:3300/0 conn(0x7f590c158fd0 0x7f590c1593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:31:00.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5912778700 1 --2- 172.21.15.29:0/98605719 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c06ee40 0x7f590c0b0370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0098e0 tx=0x7f58fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c08ef2e94fa2c85b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5910f75700 1 -- 172.21.15.29:0/98605719 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00b640 con 0x7f590c06ee40 2023-10-06T05:31:00.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5910f75700 1 -- 172.21.15.29:0/98605719 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc00b7a0 con 0x7f590c06ee40 2023-10-06T05:31:00.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f5910f75700 1 -- 172.21.15.29:0/98605719 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00bb40 con 0x7f590c06ee40 2023-10-06T05:31:00.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 -- 172.21.15.29:0/98605719 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c06ee40 msgr2=0x7f590c0b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 --2- 172.21.15.29:0/98605719 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c06ee40 0x7f590c0b0370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0098e0 tx=0x7f58fc0091a0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 -- 172.21.15.29:0/98605719 shutdown_connections 2023-10-06T05:31:00.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 --2- 172.21.15.29:0/98605719 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c06ee40 0x7f590c0b0370 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 --2- 172.21.15.29:0/98605719 >> v2:172.21.15.29:3300/0 conn(0x7f590c158fd0 0x7f590c1593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 -- 172.21.15.29:0/98605719 >> 172.21.15.29:0/98605719 conn(0x7f590c067b70 msgr2=0x7f590c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:00.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 -- 172.21.15.29:0/98605719 shutdown_connections 2023-10-06T05:31:00.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.691+0000 7f59141db700 1 -- 172.21.15.29:0/98605719 wait complete. 2023-10-06T05:31:00.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f59141db700 1 Processor -- start 2023-10-06T05:31:00.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f59141db700 1 -- start start 2023-10-06T05:31:00.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f59141db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06ee40 0x7f590c152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f59141db700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590c158fd0 0x7f590c0aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f59141db700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c15cb00 0x7f590c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f59141db700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0ae790 con 0x7f590c06ee40 2023-10-06T05:31:00.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f59141db700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0adea0 con 0x7f590c158fd0 2023-10-06T05:31:00.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f59141db700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c1528b0 con 0x7f590c15cb00 2023-10-06T05:31:00.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f5911f77700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06ee40 0x7f590c152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f5911f77700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06ee40 0x7f590c152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38284/0 (socket says 172.21.15.29:38284) 2023-10-06T05:31:00.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f5911f77700 1 -- 172.21.15.29:0/3214339350 learned_addr learned my addr 172.21.15.29:0/3214339350 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:00.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f5911776700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590c158fd0 0x7f590c0aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.695+0000 7f5912778700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c15cb00 0x7f590c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5911776700 1 -- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c15cb00 msgr2=0x7f590c15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5911776700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c15cb00 0x7f590c15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5911776700 1 -- 172.21.15.29:0/3214339350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06ee40 msgr2=0x7f590c152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5911776700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06ee40 0x7f590c152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5911776700 1 -- 172.21.15.29:0/3214339350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904009a20 con 0x7f590c158fd0 2023-10-06T05:31:00.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5911f77700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06ee40 0x7f590c152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:31:00.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5911776700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590c158fd0 0x7f590c0aec20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f590000c4c0 tx=0x7f5900007ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5909ffb700 1 -- 172.21.15.29:0/3214339350 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000ce10 con 0x7f590c158fd0 2023-10-06T05:31:00.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5909ffb700 1 -- 172.21.15.29:0/3214339350 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5900005b30 con 0x7f590c158fd0 2023-10-06T05:31:00.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc009420 con 0x7f590c158fd0 2023-10-06T05:31:00.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f5909ffb700 1 -- 172.21.15.29:0/3214339350 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59000070d0 con 0x7f590c158fd0 2023-10-06T05:31:00.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c0ae140 con 0x7f590c158fd0 2023-10-06T05:31:00.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.699+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c071120 con 0x7f590c158fd0 2023-10-06T05:31:00.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.703+0000 7f5909ffb700 1 -- 172.21.15.29:0/3214339350 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5900007480 con 0x7f590c158fd0 2023-10-06T05:31:00.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.703+0000 7f5909ffb700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58f8060550 0x7f58f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:00.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.703+0000 7f5909ffb700 1 -- 172.21.15.29:0/3214339350 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f590007b8f0 con 0x7f590c158fd0 2023-10-06T05:31:00.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.703+0000 7f5911f77700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58f8060550 0x7f58f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:00.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.703+0000 7f5911f77700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58f8060550 0x7f58f8062a00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f590400ebf0 tx=0x7f590400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:00.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.711+0000 7f5909ffb700 1 -- 172.21.15.29:0/3214339350 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f590004bfd0 con 0x7f590c158fd0 2023-10-06T05:31:00.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f590c0aac00 con 0x7f58f8060550 2023-10-06T05:31:00.885 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f5909ffb700 1 -- 172.21.15.29:0/3214339350 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f590c0aac00 con 0x7f58f8060550 2023-10-06T05:31:00.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58f8060550 msgr2=0x7f58f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58f8060550 0x7f58f8062a00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f590400ebf0 tx=0x7f590400b040 comp rx=0 tx=0).stop 2023-10-06T05:31:00.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590c158fd0 msgr2=0x7f590c0aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:00.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590c158fd0 0x7f590c0aec20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f590000c4c0 tx=0x7f5900007ed0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 shutdown_connections 2023-10-06T05:31:00.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f590c15cb00 0x7f590c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f58f8060550 0x7f58f8062a00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590c158fd0 0x7f590c0aec20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 --2- 172.21.15.29:0/3214339350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06ee40 0x7f590c152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:00.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 >> 172.21.15.29:0/3214339350 conn(0x7f590c067b70 msgr2=0x7f590c06e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:00.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 shutdown_connections 2023-10-06T05:31:00.889 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:00.879+0000 7f59141db700 1 -- 172.21.15.29:0/3214339350 wait complete. 2023-10-06T05:31:00.890 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T05:31:00.900 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T05:31:00.900 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T05:31:01.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.011+0000 7f5e7095d700 1 Processor -- start 2023-10-06T05:31:01.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.011+0000 7f5e7095d700 1 -- start start 2023-10-06T05:31:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e7095d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c158f10 0x7f5e6c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e7095d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c0cacd0 con 0x7f5e6c06cdd0 2023-10-06T05:31:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e7095d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c0cafb0 con 0x7f5e6c15d730 2023-10-06T05:31:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e7095d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c06a600 con 0x7f5e6c158f10 2023-10-06T05:31:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6b59e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5e6c06cdd0 0x7f5e6c06aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56554/0 (socket says 172.21.15.29:56554) 2023-10-06T05:31:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6b59e700 1 -- 172.21.15.29:0/2937868075 learned_addr learned my addr 172.21.15.29:0/2937868075 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:31:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6ad9d700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c158f10 0x7f5e6c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411515761 0 0) 0x7f5e6c0cacd0 con 0x7f5e6c06cdd0 2023-10-06T05:31:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e58003570 con 0x7f5e6c06cdd0 2023-10-06T05:31:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302953149 0 0) 0x7f5e6c0cafb0 con 0x7f5e6c15d730 2023-10-06T05:31:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e6c0cacd0 con 0x7f5e6c15d730 2023-10-06T05:31:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3488977625 0 0) 0x7f5e58003570 con 0x7f5e6c06cdd0 2023-10-06T05:31:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c158f10 msgr2=0x7f5e6c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c158f10 0x7f5e6c0ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 >> v1:172.21.15.173:6789/0 conn(0x7f5e6c15d730 legacy=0x7f5e6c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0cb290 con 0x7f5e6c06cdd0 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f5e640017f0 con 0x7f5e6c06cdd0 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 >> v1:172.21.15.29:6789/0 conn(0x7f5e6c06cdd0 legacy=0x7f5e6c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c158f10 0x7f5e58003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e58004180 0x7f5e58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58004d50 0x7f5e580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5800bb70 con 0x7f5e58004d50 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5800bce0 con 0x7f5e58004180 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5800bea0 con 0x7f5e6c158f10 2023-10-06T05:31:01.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6b59e700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58004d50 0x7f5e580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6ad9d700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c158f10 0x7f5e58003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6a59c700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e58004180 0x7f5e58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6b59e700 1 -- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c158f10 msgr2=0x7f5e58003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6b59e700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c158f10 0x7f5e58003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6b59e700 1 -- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e58004180 msgr2=0x7f5e58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6b59e700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e58004180 0x7f5e58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6b59e700 1 -- 172.21.15.29:0/2937868075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58003570 con 0x7f5e58004d50 2023-10-06T05:31:01.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e6b59e700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58004d50 0x7f5e580051c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c06a1e0 tx=0x7f5e64002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08a44b6a923f21e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640070d0 con 0x7f5e58004d50 2023-10-06T05:31:01.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64007230 con 0x7f5e58004d50 2023-10-06T05:31:01.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.015+0000 7f5e69d9b700 1 -- 172.21.15.29:0/2937868075 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640075f0 con 0x7f5e58004d50 2023-10-06T05:31:01.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.019+0000 7f5e7095d700 1 -- 172.21.15.29:0/2937868075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58004d50 msgr2=0x7f5e580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.019+0000 7f5e7095d700 1 --2- 172.21.15.29:0/2937868075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58004d50 0x7f5e580051c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c06a1e0 tx=0x7f5e64002190 comp rx=0 tx=0).stop 2023-10-06T05:31:01.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.019+0000 7f5e6b59e700 1 -- 172.21.15.29:0/2937868075 reap_dead start 2023-10-06T05:31:01.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.019+0000 7f5e7095d700 1 -- 172.21.15.29:0/2937868075 shutdown_connections 2023-10-06T05:31:01.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.019+0000 7f5e7095d700 1 -- 172.21.15.29:0/2937868075 >> 172.21.15.29:0/2937868075 conn(0x7f5e6c062b60 msgr2=0x7f5e6c062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:01.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.019+0000 7f5e7095d700 1 -- 172.21.15.29:0/2937868075 shutdown_connections 2023-10-06T05:31:01.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.019+0000 7f5e7095d700 1 -- 172.21.15.29:0/2937868075 wait complete. 2023-10-06T05:31:01.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 Processor -- start 2023-10-06T05:31:01.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 -- start start 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e6c1574f0 0x7f5e6c0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c1578c0 0x7f5e6c06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e6c06ae90 0x7f5e6c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c06b310 con 0x7f5e6c1574f0 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c0b3960 con 0x7f5e6c06ae90 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c0b2d90 con 0x7f5e6c1578c0 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e6c1574f0 0x7f5e6c0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e6c1574f0 0x7f5e6c0b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38292/0 (socket says 172.21.15.29:38292) 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6ad9d700 1 -- 172.21.15.29:0/1504976329 learned_addr learned my addr 172.21.15.29:0/1504976329 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6a59c700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c1578c0 0x7f5e6c06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6b59e700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e6c06ae90 0x7f5e6c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6ad9d700 1 -- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c1578c0 msgr2=0x7f5e6c06a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6ad9d700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5e6c1578c0 0x7f5e6c06a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6ad9d700 1 -- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e6c06ae90 msgr2=0x7f5e6c0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6ad9d700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e6c06ae90 0x7f5e6c0b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6ad9d700 1 -- 172.21.15.29:0/1504976329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0b3030 con 0x7f5e6c1574f0 2023-10-06T05:31:01.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e6ad9d700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e6c1574f0 0x7f5e6c0b3df0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c006ac0 tx=0x7f5e5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e62ffd700 1 -- 172.21.15.29:0/1504976329 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c00f940 con 0x7f5e6c1574f0 2023-10-06T05:31:01.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e62ffd700 1 -- 172.21.15.29:0/1504976329 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c00faa0 con 0x7f5e6c1574f0 2023-10-06T05:31:01.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6c0b3310 con 0x7f5e6c1574f0 2023-10-06T05:31:01.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e62ffd700 1 -- 172.21.15.29:0/1504976329 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c00fe20 con 0x7f5e6c1574f0 2023-10-06T05:31:01.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.023+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c0b4980 con 0x7f5e6c1574f0 2023-10-06T05:31:01.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.027+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e6c04be00 con 0x7f5e6c1574f0 2023-10-06T05:31:01.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.027+0000 7f5e62ffd700 1 -- 172.21.15.29:0/1504976329 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5e5c014650 con 0x7f5e6c1574f0 2023-10-06T05:31:01.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.027+0000 7f5e62ffd700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e4c060550 0x7f5e4c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.027+0000 7f5e62ffd700 1 -- 172.21.15.29:0/1504976329 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5e5c018030 con 0x7f5e6c1574f0 2023-10-06T05:31:01.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.027+0000 7f5e62ffd700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f5e4c066b00 0x7f5e4c068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.027+0000 7f5e62ffd700 1 -- 172.21.15.29:0/1504976329 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e4c0695c0 con 0x7f5e4c066b00 2023-10-06T05:31:01.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.027+0000 7f5e62ffd700 1 -- 172.21.15.29:0/1504976329 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e5c07f410 con 0x7f5e6c1574f0 2023-10-06T05:31:01.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.027+0000 7f5e6a59c700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e4c060550 0x7f5e4c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.027+0000 7f5e6b59e700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f5e4c066b00 0x7f5e4c068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.031+0000 7f5e6a59c700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e4c060550 0x7f5e4c062a00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c159590 tx=0x7f5e5400c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.031+0000 7f5e6b59e700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f5e4c066b00 0x7f5e4c068f10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.031+0000 7f5e62ffd700 1 -- 172.21.15.29:0/1504976329 <== osd.6 v2:172.21.15.173:6816/33717 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5e4c0695c0 con 0x7f5e4c066b00 2023-10-06T05:31:01.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 --> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5e6c0d09f0 con 0x7f5e4c066b00 2023-10-06T05:31:01.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e62ffd700 1 -- 172.21.15.29:0/1504976329 <== osd.6 v2:172.21.15.173:6816/33717 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5e6c0d09f0 con 0x7f5e4c066b00 2023-10-06T05:31:01.058 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:31:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T05:31:01.059 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:31:01.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f5e4c066b00 msgr2=0x7f5e4c068f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6816/33717,v1:172.21.15.173:6817/33717] conn(0x7f5e4c066b00 0x7f5e4c068f10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e4c060550 msgr2=0x7f5e4c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f5e4c060550 0x7f5e4c062a00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c159590 tx=0x7f5e5400c040 comp rx=0 tx=0).stop 2023-10-06T05:31:01.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e6c1574f0 msgr2=0x7f5e6c0b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 --2- 172.21.15.29:0/1504976329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e6c1574f0 0x7f5e6c0b3df0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c006ac0 tx=0x7f5e5c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e6b59e700 1 -- 172.21.15.29:0/1504976329 reap_dead start 2023-10-06T05:31:01.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 shutdown_connections 2023-10-06T05:31:01.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 >> 172.21.15.29:0/1504976329 conn(0x7f5e6c062b60 msgr2=0x7f5e6c062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:01.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 shutdown_connections 2023-10-06T05:31:01.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.051+0000 7f5e7095d700 1 -- 172.21.15.29:0/1504976329 wait complete. 2023-10-06T05:31:01.071 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T05:31:01.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3759e700 1 Processor -- start 2023-10-06T05:31:01.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3759e700 1 -- start start 2023-10-06T05:31:01.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbc38156af0 0x7fbc380cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc38158080 con 0x7fbc380c7070 2023-10-06T05:31:01.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3759e700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc380cc480 con 0x7fbc38156ec0 2023-10-06T05:31:01.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc38157470 con 0x7fbc38156af0 2023-10-06T05:31:01.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc36d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbc380c7070 0x7fbc3806a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56560/0 (socket says 172.21.15.29:56560) 2023-10-06T05:31:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc36d9d700 1 -- 172.21.15.29:0/1159451143 learned_addr learned my addr 172.21.15.29:0/1159451143 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:31:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3659c700 1 --2- 172.21.15.29:0/1159451143 >> v2:172.21.15.29:3300/0 conn(0x7fbc38156af0 0x7fbc380cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3559a700 1 -- 172.21.15.29:0/1159451143 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443105652 0 0) 0x7fbc38158080 con 0x7fbc380c7070 2023-10-06T05:31:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3559a700 1 -- 172.21.15.29:0/1159451143 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc20003570 con 0x7fbc380c7070 2023-10-06T05:31:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3559a700 1 -- 172.21.15.29:0/1159451143 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242658750 0 0) 0x7fbc380cc480 con 0x7fbc38156ec0 2023-10-06T05:31:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3659c700 1 -- 172.21.15.29:0/1159451143 >> v1:172.21.15.173:6789/0 conn(0x7fbc38156ec0 legacy=0x7fbc380c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3659c700 1 -- 172.21.15.29:0/1159451143 >> v1:172.21.15.29:6789/0 conn(0x7fbc380c7070 legacy=0x7fbc3806a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.179+0000 7fbc3659c700 1 -- 172.21.15.29:0/1159451143 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38157750 con 0x7fbc38156af0 2023-10-06T05:31:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3659c700 1 --2- 172.21.15.29:0/1159451143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156af0 0x7fbc380cbf40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fbc280098e0 tx=0x7fbc280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c33d8930ed91b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3559a700 1 -- 172.21.15.29:0/1159451143 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300017f0 con 0x7fbc38156af0 2023-10-06T05:31:01.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3559a700 1 -- 172.21.15.29:0/1159451143 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28011420 con 0x7fbc38156af0 2023-10-06T05:31:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3559a700 1 -- 172.21.15.29:0/1159451143 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280117a0 con 0x7fbc38156af0 2023-10-06T05:31:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3759e700 1 -- 172.21.15.29:0/1159451143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156af0 msgr2=0x7fbc380cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3759e700 1 --2- 172.21.15.29:0/1159451143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156af0 0x7fbc380cbf40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fbc280098e0 tx=0x7fbc280091a0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3759e700 1 -- 172.21.15.29:0/1159451143 shutdown_connections 2023-10-06T05:31:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3759e700 1 --2- 172.21.15.29:0/1159451143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156af0 0x7fbc380cbf40 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3759e700 1 -- 172.21.15.29:0/1159451143 >> 172.21.15.29:0/1159451143 conn(0x7fbc380670a0 msgr2=0x7fbc38067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3759e700 1 -- 172.21.15.29:0/1159451143 shutdown_connections 2023-10-06T05:31:01.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3759e700 1 -- 172.21.15.29:0/1159451143 wait complete. 2023-10-06T05:31:01.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3759e700 1 Processor -- start 2023-10-06T05:31:01.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.183+0000 7fbc3759e700 1 -- start start 2023-10-06T05:31:01.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3759e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc380c7070 0x7fbc38158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3759e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc38156af0 0x7fbc380af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156ec0 0x7fbc381527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380ab4b0 con 0x7fbc38156ec0 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3759e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380c9850 con 0x7fbc38156af0 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3759e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380c9b30 con 0x7fbc380c7070 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc36d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156ec0 0x7fbc381527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc36d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156ec0 0x7fbc381527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38316/0 (socket says 172.21.15.29:38316) 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc36d9d700 1 -- 172.21.15.29:0/449035778 learned_addr learned my addr 172.21.15.29:0/449035778 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3659c700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc380c7070 0x7fbc38158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc35d9b700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc38156af0 0x7fbc380af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc36d9d700 1 -- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc380c7070 msgr2=0x7fbc38158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc36d9d700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc380c7070 0x7fbc38158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc36d9d700 1 -- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc38156af0 msgr2=0x7fbc380af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc36d9d700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc38156af0 0x7fbc380af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc36d9d700 1 -- 172.21.15.29:0/449035778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc28009420 con 0x7fbc38156ec0 2023-10-06T05:31:01.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3659c700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc380c7070 0x7fbc38158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:31:01.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc36d9d700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156ec0 0x7fbc381527e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000cc90 tx=0x7fbc30007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc267fc700 1 -- 172.21.15.29:0/449035778 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000cea0 con 0x7fbc38156ec0 2023-10-06T05:31:01.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc267fc700 1 -- 172.21.15.29:0/449035778 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30004dc0 con 0x7fbc38156ec0 2023-10-06T05:31:01.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc380c9e10 con 0x7fbc38156ec0 2023-10-06T05:31:01.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc267fc700 1 -- 172.21.15.29:0/449035778 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000ab10 con 0x7fbc38156ec0 2023-10-06T05:31:01.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.187+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc381588a0 con 0x7fbc38156ec0 2023-10-06T05:31:01.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.191+0000 7fbc267fc700 1 -- 172.21.15.29:0/449035778 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbc30007150 con 0x7fbc38156ec0 2023-10-06T05:31:01.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.191+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc380ab5f0 con 0x7fbc38156ec0 2023-10-06T05:31:01.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.191+0000 7fbc267fc700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbc18060620 0x7fbc18062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.191+0000 7fbc267fc700 1 -- 172.21.15.29:0/449035778 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbc3007c2a0 con 0x7fbc38156ec0 2023-10-06T05:31:01.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.191+0000 7fbc3659c700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbc18060620 0x7fbc18062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.191+0000 7fbc3659c700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbc18060620 0x7fbc18062ad0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbc280093f0 tx=0x7fbc28017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.199+0000 7fbc267fc700 1 -- 172.21.15.29:0/449035778 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbc3004cae0 con 0x7fbc38156ec0 2023-10-06T05:31:01.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.359+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc380ca2f0 con 0x7fbc18060620 2023-10-06T05:31:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc267fc700 1 -- 172.21.15.29:0/449035778 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbc380ca2f0 con 0x7fbc18060620 2023-10-06T05:31:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbc18060620 msgr2=0x7fbc18062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbc18060620 0x7fbc18062ad0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbc280093f0 tx=0x7fbc28017000 comp rx=0 tx=0).stop 2023-10-06T05:31:01.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156ec0 msgr2=0x7fbc381527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156ec0 0x7fbc381527e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000cc90 tx=0x7fbc30007e10 comp rx=0 tx=0).stop 2023-10-06T05:31:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 shutdown_connections 2023-10-06T05:31:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc38156ec0 0x7fbc381527e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fbc18060620 0x7fbc18062ad0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc38156af0 0x7fbc380af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 --2- 172.21.15.29:0/449035778 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbc380c7070 0x7fbc38158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 >> 172.21.15.29:0/449035778 conn(0x7fbc380670a0 msgr2=0x7fbc38067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 shutdown_connections 2023-10-06T05:31:01.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.363+0000 7fbc3759e700 1 -- 172.21.15.29:0/449035778 wait complete. 2023-10-06T05:31:01.373 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T05:31:01.384 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T05:31:01.384 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T05:31:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.487+0000 7f92677e4700 1 Processor -- start 2023-10-06T05:31:01.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.487+0000 7f92677e4700 1 -- start start 2023-10-06T05:31:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f92677e4700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f926006b570 0x7f92600cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f92677e4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92600ca1e0 0x7f92600c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f92677e4700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926006e040 con 0x7f926006b1a0 2023-10-06T05:31:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f92677e4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92600ca8e0 con 0x7f92600ca1e0 2023-10-06T05:31:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f92677e4700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926015d000 con 0x7f926006b570 2023-10-06T05:31:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9265d81700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92600ca1e0 0x7f92600c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9265d81700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92600ca1e0 0x7f92600c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38328/0 (socket says 172.21.15.29:38328) 2023-10-06T05:31:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9265d81700 1 -- 172.21.15.29:0/2266044417 learned_addr learned my addr 172.21.15.29:0/2266044417 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9264d7f700 1 --2- 172.21.15.29:0/2266044417 >> v2:172.21.15.173:3300/0 conn(0x7f926006b570 0x7f92600cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9265d81700 1 -- 172.21.15.29:0/2266044417 >> v2:172.21.15.173:3300/0 conn(0x7f926006b570 msgr2=0x7f92600cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9265d81700 1 --2- 172.21.15.29:0/2266044417 >> v2:172.21.15.173:3300/0 conn(0x7f926006b570 0x7f92600cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9265d81700 1 -- 172.21.15.29:0/2266044417 >> v1:172.21.15.173:6789/0 conn(0x7f926006b1a0 legacy=0x7f926015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9265d81700 1 -- 172.21.15.29:0/2266044417 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600ca680 con 0x7f92600ca1e0 2023-10-06T05:31:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9264d7f700 1 --2- 172.21.15.29:0/2266044417 >> v2:172.21.15.173:3300/0 conn(0x7f926006b570 0x7f92600cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:31:01.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9265d81700 1 --2- 172.21.15.29:0/2266044417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92600ca1e0 0x7f92600c73f0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f926015cda0 tx=0x7f9258009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef920b9cfc6088f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9257fff700 1 -- 172.21.15.29:0/2266044417 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800e070 con 0x7f92600ca1e0 2023-10-06T05:31:01.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9257fff700 1 -- 172.21.15.29:0/2266044417 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925800ba50 con 0x7f92600ca1e0 2023-10-06T05:31:01.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.491+0000 7f9257fff700 1 -- 172.21.15.29:0/2266044417 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580092e0 con 0x7f92600ca1e0 2023-10-06T05:31:01.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 -- 172.21.15.29:0/2266044417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92600ca1e0 msgr2=0x7f92600c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 --2- 172.21.15.29:0/2266044417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92600ca1e0 0x7f92600c73f0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f926015cda0 tx=0x7f9258009840 comp rx=0 tx=0).stop 2023-10-06T05:31:01.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 -- 172.21.15.29:0/2266044417 shutdown_connections 2023-10-06T05:31:01.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 --2- 172.21.15.29:0/2266044417 >> v2:172.21.15.173:3300/0 conn(0x7f926006b570 0x7f92600cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 --2- 172.21.15.29:0/2266044417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92600ca1e0 0x7f92600c73f0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 -- 172.21.15.29:0/2266044417 >> 172.21.15.29:0/2266044417 conn(0x7f92600cd0e0 msgr2=0x7f92600c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:01.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 -- 172.21.15.29:0/2266044417 shutdown_connections 2023-10-06T05:31:01.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 -- 172.21.15.29:0/2266044417 wait complete. 2023-10-06T05:31:01.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 Processor -- start 2023-10-06T05:31:01.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.495+0000 7f92677e4700 1 -- start start 2023-10-06T05:31:01.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92677e4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926006b1a0 0x7f92600c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92677e4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926006b570 0x7f926014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92677e4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92600ca1e0 0x7f926015e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92677e4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600c55e0 con 0x7f926006b570 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92677e4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926015ea60 con 0x7f926006b1a0 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92677e4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600c4cb0 con 0x7f92600ca1e0 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9264d7f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926006b570 0x7f926014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9264d7f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926006b570 0x7f926014de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38342/0 (socket says 172.21.15.29:38342) 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9265580700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926006b1a0 0x7f92600c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9264d7f700 1 -- 172.21.15.29:0/2791853036 learned_addr learned my addr 172.21.15.29:0/2791853036 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:01.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9265d81700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92600ca1e0 0x7f926015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9264d7f700 1 -- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92600ca1e0 msgr2=0x7f926015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9264d7f700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92600ca1e0 0x7f926015e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9264d7f700 1 -- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926006b1a0 msgr2=0x7f92600c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9264d7f700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f926006b1a0 0x7f92600c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9264d7f700 1 -- 172.21.15.29:0/2791853036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258009ae0 con 0x7f926006b570 2023-10-06T05:31:01.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f9264d7f700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926006b570 0x7f926014de10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f925000e8d0 tx=0x7f9250008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92557fa700 1 -- 172.21.15.29:0/2791853036 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250013410 con 0x7f926006b570 2023-10-06T05:31:01.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92557fa700 1 -- 172.21.15.29:0/2791853036 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250013570 con 0x7f926006b570 2023-10-06T05:31:01.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92600c4f90 con 0x7f926006b570 2023-10-06T05:31:01.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92557fa700 1 -- 172.21.15.29:0/2791853036 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250013910 con 0x7f926006b570 2023-10-06T05:31:01.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926015e770 con 0x7f926006b570 2023-10-06T05:31:01.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.499+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9260071120 con 0x7f926006b570 2023-10-06T05:31:01.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f92557fa700 1 -- 172.21.15.29:0/2791853036 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9250013d00 con 0x7f926006b570 2023-10-06T05:31:01.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f92557fa700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9244060550 0x7f9244062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f92557fa700 1 -- 172.21.15.29:0/2791853036 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f925007c8c0 con 0x7f926006b570 2023-10-06T05:31:01.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f92557fa700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7f9244066b00 0x7f9244068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f92557fa700 1 -- 172.21.15.29:0/2791853036 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92440695c0 con 0x7f9244066b00 2023-10-06T05:31:01.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f92557fa700 1 -- 172.21.15.29:0/2791853036 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f925007cbb0 con 0x7f926006b570 2023-10-06T05:31:01.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f9265580700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9244060550 0x7f9244062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f9265d81700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7f9244066b00 0x7f9244068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f9265d81700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7f9244066b00 0x7f9244068f10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f9265580700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9244060550 0x7f9244062a00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f925c0039e0 tx=0x7f925c007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.503+0000 7f92557fa700 1 -- 172.21.15.29:0/2791853036 <== osd.7 v2:172.21.15.173:6824/33718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f92440695c0 con 0x7f9244066b00 2023-10-06T05:31:01.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 --> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f92600c9aa0 con 0x7f9244066b00 2023-10-06T05:31:01.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92557fa700 1 -- 172.21.15.29:0/2791853036 <== osd.7 v2:172.21.15.173:6824/33718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f92600c9aa0 con 0x7f9244066b00 2023-10-06T05:31:01.529 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-06T05:31:01.529 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T05:31:01.530 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-06T05:31:01.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7f9244066b00 msgr2=0x7f9244068f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6824/33718,v1:172.21.15.173:6825/33718] conn(0x7f9244066b00 0x7f9244068f10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9244060550 msgr2=0x7f9244062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9244060550 0x7f9244062a00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f925c0039e0 tx=0x7f925c007ec0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926006b570 msgr2=0x7f926014de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 --2- 172.21.15.29:0/2791853036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926006b570 0x7f926014de10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f925000e8d0 tx=0x7f9250008040 comp rx=0 tx=0).stop 2023-10-06T05:31:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f9265d81700 1 -- 172.21.15.29:0/2791853036 reap_dead start 2023-10-06T05:31:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 shutdown_connections 2023-10-06T05:31:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 >> 172.21.15.29:0/2791853036 conn(0x7f92600cd0e0 msgr2=0x7f92600c13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 shutdown_connections 2023-10-06T05:31:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.523+0000 7f92677e4700 1 -- 172.21.15.29:0/2791853036 wait complete. 2023-10-06T05:31:01.543 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T05:31:01.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bb35d700 1 Processor -- start 2023-10-06T05:31:01.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bb35d700 1 -- start start 2023-10-06T05:31:01.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bb35d700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f63b40ca5b0 0x7f63b406b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bb35d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40cc8b0 con 0x7f63b415e490 2023-10-06T05:31:01.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bb35d700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b406b280 con 0x7f63b415ace0 2023-10-06T05:31:01.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bb35d700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b406bc50 con 0x7f63b40ca5b0 2023-10-06T05:31:01.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63b9b5a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f63b415e490 0x7f63b40c9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56574/0 (socket says 172.21.15.29:56574) 2023-10-06T05:31:01.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63b9b5a700 1 -- 172.21.15.29:0/1781400831 learned_addr learned my addr 172.21.15.29:0/1781400831 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:31:01.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bab5c700 1 --2- 172.21.15.29:0/1781400831 >> v2:172.21.15.173:3300/0 conn(0x7f63b40ca5b0 0x7f63b406b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63b9359700 1 -- 172.21.15.29:0/1781400831 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534599139 0 0) 0x7f63b40cc8b0 con 0x7f63b415e490 2023-10-06T05:31:01.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63b9359700 1 -- 172.21.15.29:0/1781400831 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a0003570 con 0x7f63b415e490 2023-10-06T05:31:01.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63b9359700 1 -- 172.21.15.29:0/1781400831 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430641712 0 0) 0x7f63b406b280 con 0x7f63b415ace0 2023-10-06T05:31:01.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63b9359700 1 -- 172.21.15.29:0/1781400831 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b40cc8b0 con 0x7f63b415ace0 2023-10-06T05:31:01.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bab5c700 1 -- 172.21.15.29:0/1781400831 >> v1:172.21.15.173:6789/0 conn(0x7f63b415ace0 legacy=0x7f63b40cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bab5c700 1 -- 172.21.15.29:0/1781400831 >> v1:172.21.15.29:6789/0 conn(0x7f63b415e490 legacy=0x7f63b40c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bab5c700 1 -- 172.21.15.29:0/1781400831 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b406a670 con 0x7f63b40ca5b0 2023-10-06T05:31:01.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63bab5c700 1 --2- 172.21.15.29:0/1781400831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b40ca5b0 0x7f63b406b710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f63b00098e0 tx=0x7f63b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e0e147c64a0371 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63b9359700 1 -- 172.21.15.29:0/1781400831 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0011630 con 0x7f63b40ca5b0 2023-10-06T05:31:01.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63b9359700 1 -- 172.21.15.29:0/1781400831 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0011790 con 0x7f63b40ca5b0 2023-10-06T05:31:01.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.647+0000 7f63b9359700 1 -- 172.21.15.29:0/1781400831 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0011b30 con 0x7f63b40ca5b0 2023-10-06T05:31:01.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 -- 172.21.15.29:0/1781400831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b40ca5b0 msgr2=0x7f63b406b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 --2- 172.21.15.29:0/1781400831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b40ca5b0 0x7f63b406b710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f63b00098e0 tx=0x7f63b00091a0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 -- 172.21.15.29:0/1781400831 shutdown_connections 2023-10-06T05:31:01.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 --2- 172.21.15.29:0/1781400831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b40ca5b0 0x7f63b406b710 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 -- 172.21.15.29:0/1781400831 >> 172.21.15.29:0/1781400831 conn(0x7f63b40670a0 msgr2=0x7f63b4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:01.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 -- 172.21.15.29:0/1781400831 shutdown_connections 2023-10-06T05:31:01.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 -- 172.21.15.29:0/1781400831 wait complete. 2023-10-06T05:31:01.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 Processor -- start 2023-10-06T05:31:01.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 -- start start 2023-10-06T05:31:01.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b40ca5b0 0x7f63b4155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b415ace0 0x7f63b40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b415e490 0x7f63b40c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40b0ea0 con 0x7f63b40ca5b0 2023-10-06T05:31:01.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40b0bc0 con 0x7f63b415ace0 2023-10-06T05:31:01.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63bb35d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4157a30 con 0x7f63b415e490 2023-10-06T05:31:01.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63ba35b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b40ca5b0 0x7f63b4155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.651+0000 7f63ba35b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b40ca5b0 0x7f63b4155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38346/0 (socket says 172.21.15.29:38346) 2023-10-06T05:31:01.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63ba35b700 1 -- 172.21.15.29:0/3434769036 learned_addr learned my addr 172.21.15.29:0/3434769036 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:01.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63bab5c700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b415e490 0x7f63b40c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63b9b5a700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b415ace0 0x7f63b40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63ba35b700 1 -- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b415e490 msgr2=0x7f63b40c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63ba35b700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b415e490 0x7f63b40c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63ba35b700 1 -- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b415ace0 msgr2=0x7f63b40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63ba35b700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b415ace0 0x7f63b40b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63ba35b700 1 -- 172.21.15.29:0/3434769036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0009420 con 0x7f63b40ca5b0 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63b9b5a700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b415ace0 0x7f63b40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63ba35b700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b40ca5b0 0x7f63b4155580 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c790 tx=0x7f63a4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63aa7fc700 1 -- 172.21.15.29:0/3434769036 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4010510 con 0x7f63b40ca5b0 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63aa7fc700 1 -- 172.21.15.29:0/3434769036 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4010670 con 0x7f63b40ca5b0 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b4157d10 con 0x7f63b40ca5b0 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63aa7fc700 1 -- 172.21.15.29:0/3434769036 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4010a30 con 0x7f63b40ca5b0 2023-10-06T05:31:01.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b4156010 con 0x7f63b40ca5b0 2023-10-06T05:31:01.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.655+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b404be00 con 0x7f63b40ca5b0 2023-10-06T05:31:01.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.659+0000 7f63aa7fc700 1 -- 172.21.15.29:0/3434769036 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f63a401b3b0 con 0x7f63b40ca5b0 2023-10-06T05:31:01.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.659+0000 7f63aa7fc700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6398060550 0x7f6398062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.659+0000 7f63aa7fc700 1 -- 172.21.15.29:0/3434769036 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f63a407c000 con 0x7f63b40ca5b0 2023-10-06T05:31:01.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.659+0000 7f63b9b5a700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6398060550 0x7f6398062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.659+0000 7f63b9b5a700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6398060550 0x7f6398062a00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f63b415e9c0 tx=0x7f63ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.663+0000 7f63aa7fc700 1 -- 172.21.15.29:0/3434769036 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f63a404c6e0 con 0x7f63b40ca5b0 2023-10-06T05:31:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.823+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f63b406a950 con 0x7f6398060550 2023-10-06T05:31:01.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.823+0000 7f63aa7fc700 1 -- 172.21.15.29:0/3434769036 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f63b406a950 con 0x7f6398060550 2023-10-06T05:31:01.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6398060550 msgr2=0x7f6398062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6398060550 0x7f6398062a00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f63b415e9c0 tx=0x7f63ac009040 comp rx=0 tx=0).stop 2023-10-06T05:31:01.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b40ca5b0 msgr2=0x7f63b4155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b40ca5b0 0x7f63b4155580 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c790 tx=0x7f63a4007e10 comp rx=0 tx=0).stop 2023-10-06T05:31:01.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 shutdown_connections 2023-10-06T05:31:01.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b415e490 0x7f63b40c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f6398060550 0x7f6398062a00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b415ace0 0x7f63b40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 --2- 172.21.15.29:0/3434769036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63b40ca5b0 0x7f63b4155580 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 >> 172.21.15.29:0/3434769036 conn(0x7f63b40670a0 msgr2=0x7f63b40c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 shutdown_connections 2023-10-06T05:31:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.827+0000 7f63bb35d700 1 -- 172.21.15.29:0/3434769036 wait complete. 2023-10-06T05:31:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T05:31:01.847 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:31:01.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c7d354700 1 Processor -- start 2023-10-06T05:31:01.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c7d354700 1 -- start start 2023-10-06T05:31:01.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c7d354700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781605e0 0x7f9c780c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c7d354700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9c780ca3c0 0x7f9c780c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c7d354700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c780c2980 con 0x7f9c7806b320 2023-10-06T05:31:01.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c7d354700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c780c6bb0 con 0x7f9c780ca3c0 2023-10-06T05:31:01.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c7d354700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780c6e90 con 0x7f9c781605e0 2023-10-06T05:31:01.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c6ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9c7806b320 0x7f9c780c9cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56586/0 (socket says 172.21.15.29:56586) 2023-10-06T05:31:01.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c6ffff700 1 -- 172.21.15.29:0/2491847824 learned_addr learned my addr 172.21.15.29:0/2491847824 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:31:01.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c7cb53700 1 --2- 172.21.15.29:0/2491847824 >> v2:172.21.15.173:3300/0 conn(0x7f9c780ca3c0 0x7f9c780c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c77fff700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781605e0 0x7f9c780c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447516107 0 0) 0x7f9c780c2980 con 0x7f9c7806b320 2023-10-06T05:31:01.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.947+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c64003570 con 0x7f9c7806b320 2023-10-06T05:31:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 809517055 0 0) 0x7f9c64003570 con 0x7f9c7806b320 2023-10-06T05:31:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781605e0 msgr2=0x7f9c780c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781605e0 0x7f9c780c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 >> v2:172.21.15.173:3300/0 conn(0x7f9c780ca3c0 msgr2=0x7f9c780c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 --2- 172.21.15.29:0/2491847824 >> v2:172.21.15.173:3300/0 conn(0x7f9c780ca3c0 0x7f9c780c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c780c7170 con 0x7f9c7806b320 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3245109730 0 0) 0x7f9c60001470 con 0x7f9c7806b320 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 >> v1:172.21.15.29:6789/0 conn(0x7f9c7806b320 legacy=0x7f9c780c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781605e0 0x7f9c64003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64003fe0 0x7f9c64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c64004d50 0x7f9c640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780c6bb0 con 0x7f9c64004d50 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780c6e90 con 0x7f9c64003fe0 2023-10-06T05:31:01.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6400ba90 con 0x7f9c781605e0 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7cb53700 1 --2- 172.21.15.29:0/2491847824 >> v2:172.21.15.173:3300/0 conn(0x7f9c780ca3c0 0x7f9c780c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c6ffff700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64003fe0 0x7f9c64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7cb53700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c64004d50 0x7f9c640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c77fff700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781605e0 0x7f9c64003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7cb53700 1 -- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781605e0 msgr2=0x7f9c64003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7cb53700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781605e0 0x7f9c64003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7cb53700 1 -- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64003fe0 msgr2=0x7f9c64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7cb53700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64003fe0 0x7f9c64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7cb53700 1 -- 172.21.15.29:0/2491847824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c64003570 con 0x7f9c64004d50 2023-10-06T05:31:01.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c77fff700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c781605e0 0x7f9c64003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:31:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c6ffff700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64003fe0 0x7f9c64004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:31:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7cb53700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c64004d50 0x7f9c640051c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000e3c0 tx=0x7f9c7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c576335490f0dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000ec10 con 0x7f9c64004d50 2023-10-06T05:31:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7000f040 con 0x7f9c64004d50 2023-10-06T05:31:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c777fe700 1 -- 172.21.15.29:0/2491847824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70014480 con 0x7f9c64004d50 2023-10-06T05:31:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7d354700 1 -- 172.21.15.29:0/2491847824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c64004d50 msgr2=0x7f9c640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7d354700 1 --2- 172.21.15.29:0/2491847824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c64004d50 0x7f9c640051c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000e3c0 tx=0x7f9c7000b040 comp rx=0 tx=0).stop 2023-10-06T05:31:01.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7cb53700 1 -- 172.21.15.29:0/2491847824 reap_dead start 2023-10-06T05:31:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7d354700 1 -- 172.21.15.29:0/2491847824 shutdown_connections 2023-10-06T05:31:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7d354700 1 -- 172.21.15.29:0/2491847824 >> 172.21.15.29:0/2491847824 conn(0x7f9c780670a0 msgr2=0x7f9c780674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7d354700 1 -- 172.21.15.29:0/2491847824 shutdown_connections 2023-10-06T05:31:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.951+0000 7f9c7d354700 1 -- 172.21.15.29:0/2491847824 wait complete. 2023-10-06T05:31:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7d354700 1 Processor -- start 2023-10-06T05:31:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7d354700 1 -- start start 2023-10-06T05:31:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7d354700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64004d50 0x7f9c78152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7d354700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7815b730 0x7f9c780af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7d354700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7815bb80 0x7f9c780b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7d354700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7815a440 con 0x7f9c7815bb80 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7d354700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780c4ad0 con 0x7f9c64004d50 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7d354700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7815a690 con 0x7f9c7815b730 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7cb53700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7815bb80 0x7f9c780b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c77fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64004d50 0x7f9c78152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c6ffff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7815b730 0x7f9c780af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7cb53700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7815bb80 0x7f9c780b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38366/0 (socket says 172.21.15.29:38366) 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7cb53700 1 -- 172.21.15.29:0/823700974 learned_addr learned my addr 172.21.15.29:0/823700974 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7cb53700 1 -- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7815b730 msgr2=0x7f9c780af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7cb53700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7815b730 0x7f9c780af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7cb53700 1 -- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64004d50 msgr2=0x7f9c78152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7cb53700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64004d50 0x7f9c78152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.955+0000 7f9c7cb53700 1 -- 172.21.15.29:0/823700974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7815a970 con 0x7f9c7815bb80 2023-10-06T05:31:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c7cb53700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7815bb80 0x7f9c780b0d70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9c70003000 tx=0x7f9c70019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c74ff9700 1 -- 172.21.15.29:0/823700974 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70014480 con 0x7f9c7815bb80 2023-10-06T05:31:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c74ff9700 1 -- 172.21.15.29:0/823700974 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c70028470 con 0x7f9c7815bb80 2023-10-06T05:31:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7815ac50 con 0x7f9c7815bb80 2023-10-06T05:31:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c74ff9700 1 -- 172.21.15.29:0/823700974 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70028870 con 0x7f9c7815bb80 2023-10-06T05:31:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7815b210 con 0x7f9c7815bb80 2023-10-06T05:31:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7815b430 con 0x7f9c7815bb80 2023-10-06T05:31:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c74ff9700 1 -- 172.21.15.29:0/823700974 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9c70025070 con 0x7f9c7815bb80 2023-10-06T05:31:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c74ff9700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9c58060580 0x7f9c58062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c74ff9700 1 -- 172.21.15.29:0/823700974 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9c7007e5c0 con 0x7f9c7815bb80 2023-10-06T05:31:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.959+0000 7f9c77fff700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9c58060580 0x7f9c58062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.963+0000 7f9c77fff700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9c58060580 0x7f9c58062a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006eb0 tx=0x7f9c680091a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:01.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:01.967+0000 7f9c74ff9700 1 -- 172.21.15.29:0/823700974 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9c7004ec00 con 0x7f9c7815bb80 2023-10-06T05:31:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.127+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c7815a440 con 0x7f9c58060580 2023-10-06T05:31:02.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.135+0000 7f9c74ff9700 1 -- 172.21.15.29:0/823700974 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71013 (secure 0 0 0) 0x7f9c7815a440 con 0x7f9c58060580 2023-10-06T05:31:02.144 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:31:02.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.135+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9c58060580 msgr2=0x7f9c58062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:02.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.135+0000 7f9c7d354700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9c58060580 0x7f9c58062a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006eb0 tx=0x7f9c680091a0 comp rx=0 tx=0).stop 2023-10-06T05:31:02.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.135+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7815bb80 msgr2=0x7f9c780b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:02.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.139+0000 7f9c7d354700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7815bb80 0x7f9c780b0d70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9c70003000 tx=0x7f9c70019000 comp rx=0 tx=0).stop 2023-10-06T05:31:02.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.139+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 shutdown_connections 2023-10-06T05:31:02.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.139+0000 7f9c7d354700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7815bb80 0x7f9c780b0d70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:02.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.139+0000 7f9c7d354700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7815b730 0x7f9c780af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:02.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.139+0000 7f9c7d354700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f9c58060580 0x7f9c58062a30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:02.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.139+0000 7f9c7d354700 1 --2- 172.21.15.29:0/823700974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c64004d50 0x7f9c78152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:02.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.139+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 >> 172.21.15.29:0/823700974 conn(0x7f9c780670a0 msgr2=0x7f9c7815e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:02.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.139+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 shutdown_connections 2023-10-06T05:31:02.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:02.139+0000 7f9c7d354700 1 -- 172.21.15.29:0/823700974 wait complete. 2023-10-06T05:31:02.147 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:31:02.158 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-10-06T05:31:00.764440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2420104,"kb_used_data":9032,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752554616,"statfs":{"total":773094113280,"available":770615926784,"internally_reserved":0,"allocated":9248768,"data_stored":4780000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8392284,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-198,"num_read_kb":-192,"num_write":-169,"num_write_kb":-8289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002628"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T05:30:51.516439+0000","last_change":"2023-10-06T05:25:30.806386+0000","last_active":"2023-10-06T05:30:51.516439+0000","last_peered":"2023-10-06T05:30:51.516439+0000","last_clean":"2023-10-06T05:30:51.516439+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:30:51.516439+0000","last_undegraded":"2023-10-06T05:30:51.516439+0000","last_fullsized":"2023-10-06T05:30:51.516439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:29.378303+0000","last_clean_scrub_stamp":"2023-10-06T05:25:29.378303+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:27.109852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T05:30:53.003486+0000","last_change":"2023-10-06T05:25:35.491605+0000","last_active":"2023-10-06T05:30:53.003486+0000","last_peered":"2023-10-06T05:30:53.003486+0000","last_clean":"2023-10-06T05:30:53.003486+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:30:53.003486+0000","last_undegraded":"2023-10-06T05:30:53.003486+0000","last_fullsized":"2023-10-06T05:30:53.003486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T05:30:51.516411+0000","last_change":"2023-10-06T05:25:35.492276+0000","last_active":"2023-10-06T05:30:51.516411+0000","last_peered":"2023-10-06T05:30:51.516411+0000","last_clean":"2023-10-06T05:30:51.516411+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:30:51.516411+0000","last_undegraded":"2023-10-06T05:30:51.516411+0000","last_fullsized":"2023-10-06T05:30:51.516411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:09.393923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T05:30:54.624787+0000","last_change":"2023-10-06T05:25:35.637064+0000","last_active":"2023-10-06T05:30:54.624787+0000","last_peered":"2023-10-06T05:30:54.624787+0000","last_clean":"2023-10-06T05:30:54.624787+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:30:54.624787+0000","last_undegraded":"2023-10-06T05:30:54.624787+0000","last_fullsized":"2023-10-06T05:30:54.624787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T05:30:53.002651+0000","last_change":"2023-10-06T05:25:35.493324+0000","last_active":"2023-10-06T05:30:53.002651+0000","last_peered":"2023-10-06T05:30:53.002651+0000","last_clean":"2023-10-06T05:30:53.002651+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:30:53.002651+0000","last_undegraded":"2023-10-06T05:30:53.002651+0000","last_fullsized":"2023-10-06T05:30:53.002651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:47.397178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T05:30:53.000452+0000","last_change":"2023-10-06T05:25:35.706141+0000","last_active":"2023-10-06T05:30:53.000452+0000","last_peered":"2023-10-06T05:30:53.000452+0000","last_clean":"2023-10-06T05:30:53.000452+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:30:53.000452+0000","last_undegraded":"2023-10-06T05:30:53.000452+0000","last_fullsized":"2023-10-06T05:30:53.000452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:42.168389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T05:30:51.516992+0000","last_change":"2023-10-06T05:25:35.707140+0000","last_active":"2023-10-06T05:30:51.516992+0000","last_peered":"2023-10-06T05:30:51.516992+0000","last_clean":"2023-10-06T05:30:51.516992+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:30:51.516992+0000","last_undegraded":"2023-10-06T05:30:51.516992+0000","last_fullsized":"2023-10-06T05:30:51.516992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:42.913538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T05:30:52.998943+0000","last_change":"2023-10-06T05:25:35.494073+0000","last_active":"2023-10-06T05:30:52.998943+0000","last_peered":"2023-10-06T05:30:52.998943+0000","last_clean":"2023-10-06T05:30:52.998943+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:30:52.998943+0000","last_undegraded":"2023-10-06T05:30:52.998943+0000","last_fullsized":"2023-10-06T05:30:52.998943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:07.669189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-06T05:30:51.519132+0000","last_change":"2023-10-06T05:25:35.496632+0000","last_active":"2023-10-06T05:30:51.519132+0000","last_peered":"2023-10-06T05:30:51.519132+0000","last_clean":"2023-10-06T05:30:51.519132+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:30:51.519132+0000","last_undegraded":"2023-10-06T05:30:51.519132+0000","last_fullsized":"2023-10-06T05:30:51.519132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:25:34.471282+0000","last_clean_scrub_stamp":"2023-10-06T05:25:34.471282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:45.312774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302948,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068892,"statfs":{"total":96636764160,"available":96326545408,"internally_reserved":0,"allocated":1601536,"data_stored":1040276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88200000000000001,"15min":0.85199999999999998},"min":{"1min":0.51200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.872},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.92100000000000004},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.131,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0509999999999999}]},{"osd":1,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90700000000000003,"15min":0.90600000000000003},"min":{"1min":0.621,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.1379999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.65400000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.175},{"interface":"front","average":{"1min":1.01,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.626,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.228}]},{"osd":3,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.77600000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.109},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.387}]},{"osd":4,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.113,"15min":1.113},"min":{"1min":0.94699999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.012}]},{"osd":5,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0229999999999999,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5660000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.325},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.179,"15min":1.2010000000000001},"min":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.2889999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.119,"15min":1.141},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0129999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.262}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85799999999999998,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.2330000000000001,"5min":1.623,"15min":1.623},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65500000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.048,"5min":1.403,"15min":1.403},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.23,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.022,"5min":0.99399999999999999,"15min":0.97099999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3640000000000001,"5min":1.679,"15min":1.679},"last":0.81699999999999995}]},{"osd":2,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.88100000000000001,"15min":0.83299999999999996},"min":{"1min":0.61899999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.111,"5min":1.643,"15min":1.643},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97399999999999998,"15min":0.89400000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.202,"5min":1.784,"15min":1.784},"last":0.91900000000000004}]},{"osd":3,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.92500000000000004,"15min":0.92100000000000004},"min":{"1min":0.73499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1819999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.109,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.278,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.04}]},{"osd":4,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96299999999999997,"15min":0.95899999999999996},"min":{"1min":0.60499999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.292,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.071},"min":{"1min":0.73499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.262,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.96199999999999997}]},{"osd":5,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.69499999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3380000000000001,"5min":1.583,"15min":1.583},"last":1.089},{"interface":"front","average":{"1min":1.155,"5min":1.117,"15min":1.0760000000000001},"min":{"1min":0.77300000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4430000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0149999999999999,"15min":1.0089999999999999},"min":{"1min":0.75900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1919999999999999,"5min":1.833,"15min":1.833},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.1220000000000001},"min":{"1min":0.88,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.409,"5min":1.899,"15min":1.899},"last":0.99399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.91100000000000003,"15min":0.86599999999999999},"min":{"1min":0.61399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3100000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.4990000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.55600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.095,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90500000000000003,"15min":0.91500000000000004},"min":{"1min":0.58699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2310000000000001,"5min":1.409,"15min":1.409},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.93799999999999994},"min":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.411,"15min":1.411},"last":1.4079999999999999}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91900000000000004,"15min":0.93899999999999995},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.98199999999999998,"15min":0.96399999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1559999999999999,"5min":1.54,"15min":1.54},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98599999999999999,"15min":0.95599999999999996},"min":{"1min":0.66500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2669999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.76200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3089999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.999},"min":{"1min":0.69399999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1299999999999999,"5min":1.419,"15min":1.419},"last":1.004},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1259999999999999,"15min":1.173},"min":{"1min":0.90700000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.347,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.6140000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.022,"15min":1.0940000000000001},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.264,"5min":1.508,"15min":1.508},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0389999999999999,"15min":1.079},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.363}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.093,"15min":1.1339999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.399,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.173,"15min":1.2270000000000001},"min":{"1min":0.96999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3340000000000001,"5min":1.732,"15min":1.732},"last":1.5189999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.873,"15min":0.80500000000000005},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2010000000000001,"5min":1.329,"15min":1.329},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.236,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.996}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88600000000000001,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0920000000000001,"5min":1.266,"15min":1.266},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.98299999999999998},"min":{"1min":0.62,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.82799999999999996}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.458,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.1060000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97599999999999998},"min":{"1min":0.64700000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1539999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1,"5min":0.97799999999999998,"15min":0.97399999999999998},"min":{"1min":0.76200000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2490000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":1.0389999999999999},"min":{"1min":0.66400000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.028},{"interface":"front","average":{"1min":1.022,"5min":1.02,"15min":1.038},"min":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3640000000000001,"5min":1.458,"15min":1.458},"last":1.0800000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.323,"5min":1.429,"15min":1.429},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.1359999999999999,"15min":1.167},"min":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.542,"5min":1.548,"15min":1.548},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.415,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.79000000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.425,"5min":1.75,"15min":1.75},"last":1.3109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.071,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.111,"5min":1.379,"15min":1.379},"last":0.82499999999999996}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.72999999999999998,"15min":0.71499999999999997},"min":{"1min":0.55200000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":1.389,"15min":1.389},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81200000000000006,"15min":0.77100000000000002},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1279999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.47499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2110000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90300000000000002,"15min":0.86399999999999999},"min":{"1min":0.72199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.26,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.80500000000000005}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96499999999999997,"15min":0.99099999999999999},"min":{"1min":0.66300000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3340000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.448},{"interface":"front","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.81599999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4099999999999999,"5min":1.861,"15min":1.861},"last":1.2609999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.117,"15min":1.1240000000000001},"min":{"1min":0.93000000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.607,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.1359999999999999,"15min":1.105},"min":{"1min":0.876,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.51,"5min":1.732,"15min":1.732},"last":1.611}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0900000000000001,"15min":1.0860000000000001},"min":{"1min":0.89500000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4330000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.351},{"interface":"front","average":{"1min":1.26,"5min":1.2030000000000001,"15min":1.2},"min":{"1min":1.01,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.55,"5min":1.968,"15min":1.968},"last":1.48}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.194,"15min":1.171},"min":{"1min":0.79900000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.587,"5min":1.762,"15min":1.762},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.93899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5009999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.5109999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.51300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.107,"5min":1.29,"15min":1.29},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.93300000000000005},"min":{"1min":0.59699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.383,"15min":1.383},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.754}]},{"osd":3,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.335,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.79800000000000004,"15min":0.84299999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":1.0920000000000001},"min":{"1min":0.66600000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9119999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.145,"15min":1.2210000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4219999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1000000000000001,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.752,"5min":1.829,"15min":1.829},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.111,"15min":1.175},"min":{"1min":0.80100000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8109999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.1910000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2190000000000001,"15min":1.2669999999999999},"min":{"1min":0.69399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.135},{"interface":"front","average":{"1min":1.173,"5min":1.1679999999999999,"15min":1.22},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.3080000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1819999999999999,"15min":1.2589999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.6100000000000001,"5min":1.972,"15min":1.972},"last":1.117},{"interface":"front","average":{"1min":1.22,"5min":1.2969999999999999,"15min":1.365},"min":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.859,"5min":2.04,"15min":2.04},"last":1.26}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0580000000000001,"5min":1.468,"15min":1.468},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.73799999999999999},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0469999999999999,"5min":1.294,"15min":1.294},"last":1.306}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.61799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81000000000000005,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89200000000000002}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.167,"5min":1.419,"15min":1.419},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.1399999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.87,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.6890000000000001,"5min":3.6890000000000001,"15min":3.6890000000000001},"last":1.014},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.133,"15min":1.165},"min":{"1min":0.94099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.4019999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.127,"15min":1.1890000000000001},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.1659999999999999,"15min":1.2230000000000001},"min":{"1min":0.92600000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.464,"5min":2.02,"15min":2.02},"last":1.3320000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1399999999999999,"15min":1.1299999999999999},"min":{"1min":0.90600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.222,"15min":1.23},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":1.851}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.2889999999999999},"min":{"1min":0.96499999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.4119999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.45},{"interface":"front","average":{"1min":1.353,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.2709999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.107}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302948,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068892,"statfs":{"total":96636764160,"available":96326545408,"internally_reserved":0,"allocated":1601536,"data_stored":1040276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.077,"5min":1.208,"15min":1.208},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.71299999999999997},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89800000000000002,"15min":0.89300000000000002},"min":{"1min":0.63800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.008,"15min":1.0129999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2929999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.004,"15min":1.016},"min":{"1min":0.74399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.169,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1759999999999999,"5min":1.49,"15min":1.49},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.155,"15min":1.157},"min":{"1min":0.877,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.403,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.2549999999999999}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.236},"min":{"1min":1,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4870000000000001,"5min":1.696,"15min":1.696},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1679999999999999,"15min":1.202},"min":{"1min":0.83699999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3919999999999999,"5min":1.738,"15min":1.738},"last":0.89100000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.202,"15min":1.252},"min":{"1min":0.88500000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.347,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1799999999999999,"15min":1.2270000000000001},"min":{"1min":0.81999999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2649999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.1160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:31:02.163 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T05:25:29.378303+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=25, tm_sec=29, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=30, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T05:31:02.163 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T05:25:34.471282+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=25, tm_sec=34, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=30, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T05:31:02.163 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T05:25:34.471282+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=25, tm_sec=34, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=30, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T05:31:02.163 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-06T05:25:34.471282+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=25, tm_sec=34, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=30, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T05:31:02.163 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T05:25:34.471282+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=25, tm_sec=34, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=30, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T05:31:02.163 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T05:25:34.471282+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=25, tm_sec=34, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=30, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T05:31:02.163 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T05:25:34.471282+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=25, tm_sec=34, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=30, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T05:31:02.164 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T05:25:34.471282+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=25, tm_sec=34, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=30, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T05:31:02.164 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T05:25:34.471282+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=25, tm_sec=34, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=5, tm_min=30, tm_sec=57, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T05:31:02.164 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T05:31:10.602 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:31:10.605 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:31:22.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T05:31:22.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72ad5b8700 1 Processor -- start 2023-10-06T05:31:22.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72ad5b8700 1 -- start start 2023-10-06T05:31:22.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72ad5b8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72a814f980 0x7f72a8156470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72ad5b8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 0x7f72a80c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72ad5b8700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a8069030 con 0x7f72a8067fb0 2023-10-06T05:31:22.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72ad5b8700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a81569b0 con 0x7f72a814f980 2023-10-06T05:31:22.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72ad5b8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8068420 con 0x7f72a806b8c0 2023-10-06T05:31:22.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a6ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72a814f980 0x7f72a8156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a6ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72a814f980 0x7f72a8156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58172/0 (socket says 172.21.15.29:58172) 2023-10-06T05:31:22.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a6ffd700 1 -- 172.21.15.29:0/1143362532 learned_addr learned my addr 172.21.15.29:0/1143362532 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:22.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a77fe700 1 --2- 172.21.15.29:0/1143362532 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 0x7f72a80c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a6ffd700 1 -- 172.21.15.29:0/1143362532 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 msgr2=0x7f72a80c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:22.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a6ffd700 1 --2- 172.21.15.29:0/1143362532 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 0x7f72a80c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a6ffd700 1 -- 172.21.15.29:0/1143362532 >> v1:172.21.15.29:6789/0 conn(0x7f72a8067fb0 legacy=0x7f72a806b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a6ffd700 1 -- 172.21.15.29:0/1143362532 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8068700 con 0x7f72a814f980 2023-10-06T05:31:22.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a6ffd700 1 --2- 172.21.15.29:0/1143362532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 0x7f72a8156470 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f72980099b0 tx=0x7f7298009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673574e5b046ecf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:22.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a67fc700 1 -- 172.21.15.29:0/1143362532 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298009ea0 con 0x7f72a814f980 2023-10-06T05:31:22.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a67fc700 1 -- 172.21.15.29:0/1143362532 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729800b860 con 0x7f72a814f980 2023-10-06T05:31:22.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.274+0000 7f72a67fc700 1 -- 172.21.15.29:0/1143362532 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729800bc00 con 0x7f72a814f980 2023-10-06T05:31:22.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.278+0000 7f72ad5b8700 1 -- 172.21.15.29:0/1143362532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 msgr2=0x7f72a8156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.278+0000 7f72ad5b8700 1 --2- 172.21.15.29:0/1143362532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 0x7f72a8156470 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f72980099b0 tx=0x7f7298009250 comp rx=0 tx=0).stop 2023-10-06T05:31:22.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.278+0000 7f72ad5b8700 1 -- 172.21.15.29:0/1143362532 shutdown_connections 2023-10-06T05:31:22.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.278+0000 7f72ad5b8700 1 --2- 172.21.15.29:0/1143362532 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 0x7f72a80c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.278+0000 7f72ad5b8700 1 --2- 172.21.15.29:0/1143362532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 0x7f72a8156470 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.278+0000 7f72ad5b8700 1 -- 172.21.15.29:0/1143362532 >> 172.21.15.29:0/1143362532 conn(0x7f72a80c8a10 msgr2=0x7f72a80c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:22.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.278+0000 7f72ad5b8700 1 -- 172.21.15.29:0/1143362532 shutdown_connections 2023-10-06T05:31:22.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.278+0000 7f72ad5b8700 1 -- 172.21.15.29:0/1143362532 wait complete. 2023-10-06T05:31:22.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72ad5b8700 1 Processor -- start 2023-10-06T05:31:22.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72ad5b8700 1 -- start start 2023-10-06T05:31:22.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72ad5b8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8067fb0 0x7f72a80c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72ad5b8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 0x7f72a80c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72ad5b8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 0x7f72a80c1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72ad5b8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8168110 con 0x7f72a814f980 2023-10-06T05:31:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72ad5b8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a81672d0 con 0x7f72a8067fb0 2023-10-06T05:31:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72ad5b8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a81674d0 con 0x7f72a806b8c0 2023-10-06T05:31:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 0x7f72a80c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 0x7f72a80c1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58176/0 (socket says 172.21.15.29:58176) 2023-10-06T05:31:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a77fe700 1 -- 172.21.15.29:0/2135613081 learned_addr learned my addr 172.21.15.29:0/2135613081 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a6ffd700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8067fb0 0x7f72a80c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f729e7fc700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 0x7f72a80c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a77fe700 1 -- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 msgr2=0x7f72a80c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a77fe700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 0x7f72a80c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a77fe700 1 -- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8067fb0 msgr2=0x7f72a80c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a77fe700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8067fb0 0x7f72a80c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a77fe700 1 -- 172.21.15.29:0/2135613081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980094f0 con 0x7f72a814f980 2023-10-06T05:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f729e7fc700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 0x7f72a80c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a6ffd700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8067fb0 0x7f72a80c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T05:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72a77fe700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 0x7f72a80c1280 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009f20 tx=0x7f72a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f729f7fe700 1 -- 172.21.15.29:0/2135613081 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a000cc80 con 0x7f72a814f980 2023-10-06T05:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f729f7fe700 1 -- 172.21.15.29:0/2135613081 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a000f040 con 0x7f72a814f980 2023-10-06T05:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a8167770 con 0x7f72a814f980 2023-10-06T05:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.282+0000 7f729f7fe700 1 -- 172.21.15.29:0/2135613081 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0014480 con 0x7f72a814f980 2023-10-06T05:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.286+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a8167d30 con 0x7f72a814f980 2023-10-06T05:31:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.286+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a8168250 con 0x7f72a814f980 2023-10-06T05:31:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.286+0000 7f729f7fe700 1 -- 172.21.15.29:0/2135613081 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f72a0014830 con 0x7f72a814f980 2023-10-06T05:31:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.286+0000 7f729f7fe700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7288060550 0x7f7288062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.286+0000 7f729f7fe700 1 -- 172.21.15.29:0/2135613081 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f72a007d0c0 con 0x7f72a814f980 2023-10-06T05:31:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.290+0000 7f72a6ffd700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7288060550 0x7f7288062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.290+0000 7f72a6ffd700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7288060550 0x7f7288062a00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f72980099b0 tx=0x7f7298017000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:22.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.298+0000 7f729f7fe700 1 -- 172.21.15.29:0/2135613081 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f72a8168250 con 0x7f72a814f980 2023-10-06T05:31:22.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.458+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 --> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72a8168250 con 0x7f7288060550 2023-10-06T05:31:22.472 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.462+0000 7f729f7fe700 1 -- 172.21.15.29:0/2135613081 <== mgr.4108 v2:172.21.15.173:6832/33379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71013 (secure 0 0 0) 0x7f72a8168250 con 0x7f7288060550 2023-10-06T05:31:22.473 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7288060550 msgr2=0x7f7288062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7288060550 0x7f7288062a00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f72980099b0 tx=0x7f7298017000 comp rx=0 tx=0).stop 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 msgr2=0x7f72a80c1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 0x7f72a80c1280 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009f20 tx=0x7f72a000b040 comp rx=0 tx=0).stop 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 shutdown_connections 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72a814f980 0x7f72a80c1280 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a806b8c0 0x7f72a80c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f7288060550 0x7f7288062a00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 --2- 172.21.15.29:0/2135613081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8067fb0 0x7f72a80c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 >> 172.21.15.29:0/2135613081 conn(0x7f72a80c8a10 msgr2=0x7f72a80ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 shutdown_connections 2023-10-06T05:31:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.466+0000 7f72ad5b8700 1 -- 172.21.15.29:0/2135613081 wait complete. 2023-10-06T05:31:22.476 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-06T05:31:22.488 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2023-10-06T05:31:20.770734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2420104,"kb_used_data":9032,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752554616,"statfs":{"total":773094113280,"available":770615926784,"internally_reserved":0,"allocated":9248768,"data_stored":4780000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003846"},"pg_stats":[{"pgid":"1.0","version":"82'119","reported_seq":229,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-06T05:31:02.116514+0000","last_change":"2023-10-06T05:31:02.116418+0000","last_active":"2023-10-06T05:31:02.116514+0000","last_peered":"2023-10-06T05:31:02.116514+0000","last_clean":"2023-10-06T05:31:02.116514+0000","last_became_active":"2023-10-06T05:25:30.803247+0000","last_became_peered":"2023-10-06T05:25:30.803247+0000","last_unstale":"2023-10-06T05:31:02.116514+0000","last_undegraded":"2023-10-06T05:31:02.116514+0000","last_fullsized":"2023-10-06T05:31:02.116514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'119","last_scrub_stamp":"2023-10-06T05:31:02.115981+0000","last_deep_scrub":"82'119","last_deep_scrub_stamp":"2023-10-06T05:31:02.115981+0000","last_clean_scrub_stamp":"2023-10-06T05:31:02.115981+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:26.410343+0000","scrub_duration":0.010871511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-06T05:31:06.080240+0000","last_change":"2023-10-06T05:31:06.080172+0000","last_active":"2023-10-06T05:31:06.080240+0000","last_peered":"2023-10-06T05:31:06.080240+0000","last_clean":"2023-10-06T05:31:06.080240+0000","last_became_active":"2023-10-06T05:25:35.491165+0000","last_became_peered":"2023-10-06T05:25:35.491165+0000","last_unstale":"2023-10-06T05:31:06.080240+0000","last_undegraded":"2023-10-06T05:31:06.080240+0000","last_fullsized":"2023-10-06T05:31:06.080240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:31:06.079920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:31:06.079920+0000","last_clean_scrub_stamp":"2023-10-06T05:31:06.079920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:51.490203+0000","scrub_duration":0.0048215829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-06T05:31:07.062838+0000","last_change":"2023-10-06T05:31:07.062769+0000","last_active":"2023-10-06T05:31:07.062838+0000","last_peered":"2023-10-06T05:31:07.062838+0000","last_clean":"2023-10-06T05:31:07.062838+0000","last_became_active":"2023-10-06T05:25:35.491926+0000","last_became_peered":"2023-10-06T05:25:35.491926+0000","last_unstale":"2023-10-06T05:31:07.062838+0000","last_undegraded":"2023-10-06T05:31:07.062838+0000","last_fullsized":"2023-10-06T05:31:07.062838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:31:07.062514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:31:07.062514+0000","last_clean_scrub_stamp":"2023-10-06T05:31:07.062514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:40.724598+0000","scrub_duration":0.0048200980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-06T05:31:03.007229+0000","last_change":"2023-10-06T05:31:03.007168+0000","last_active":"2023-10-06T05:31:03.007229+0000","last_peered":"2023-10-06T05:31:03.007229+0000","last_clean":"2023-10-06T05:31:03.007229+0000","last_became_active":"2023-10-06T05:25:35.636531+0000","last_became_peered":"2023-10-06T05:25:35.636531+0000","last_unstale":"2023-10-06T05:31:03.007229+0000","last_undegraded":"2023-10-06T05:31:03.007229+0000","last_fullsized":"2023-10-06T05:31:03.007229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:31:03.006890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:31:03.006890+0000","last_clean_scrub_stamp":"2023-10-06T05:31:03.006890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:57:43.958581+0000","scrub_duration":0.0053523629999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-06T05:31:02.119277+0000","last_change":"2023-10-06T05:31:02.119161+0000","last_active":"2023-10-06T05:31:02.119277+0000","last_peered":"2023-10-06T05:31:02.119277+0000","last_clean":"2023-10-06T05:31:02.119277+0000","last_became_active":"2023-10-06T05:25:35.493030+0000","last_became_peered":"2023-10-06T05:25:35.493030+0000","last_unstale":"2023-10-06T05:31:02.119277+0000","last_undegraded":"2023-10-06T05:31:02.119277+0000","last_fullsized":"2023-10-06T05:31:02.119277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:31:02.118898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:31:02.118898+0000","last_clean_scrub_stamp":"2023-10-06T05:31:02.118898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:26.413260+0000","scrub_duration":0.0049635189999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-06T05:31:02.293146+0000","last_change":"2023-10-06T05:31:02.293074+0000","last_active":"2023-10-06T05:31:02.293146+0000","last_peered":"2023-10-06T05:31:02.293146+0000","last_clean":"2023-10-06T05:31:02.293146+0000","last_became_active":"2023-10-06T05:25:35.705310+0000","last_became_peered":"2023-10-06T05:25:35.705310+0000","last_unstale":"2023-10-06T05:31:02.293146+0000","last_undegraded":"2023-10-06T05:31:02.293146+0000","last_fullsized":"2023-10-06T05:31:02.293146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:31:02.292821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:31:02.292821+0000","last_clean_scrub_stamp":"2023-10-06T05:31:02.292821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:14.772719+0000","scrub_duration":0.0043062370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-06T05:31:06.052012+0000","last_change":"2023-10-06T05:31:06.051903+0000","last_active":"2023-10-06T05:31:06.052012+0000","last_peered":"2023-10-06T05:31:06.052012+0000","last_clean":"2023-10-06T05:31:06.052012+0000","last_became_active":"2023-10-06T05:25:35.706445+0000","last_became_peered":"2023-10-06T05:25:35.706445+0000","last_unstale":"2023-10-06T05:31:06.052012+0000","last_undegraded":"2023-10-06T05:31:06.052012+0000","last_fullsized":"2023-10-06T05:31:06.052012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:31:06.051598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:31:06.051598+0000","last_clean_scrub_stamp":"2023-10-06T05:31:06.051598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:51.461881+0000","scrub_duration":0.0049969350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-06T05:30:59.276155+0000","last_change":"2023-10-06T05:30:59.276097+0000","last_active":"2023-10-06T05:30:59.276155+0000","last_peered":"2023-10-06T05:30:59.276155+0000","last_clean":"2023-10-06T05:30:59.276155+0000","last_became_active":"2023-10-06T05:25:35.493318+0000","last_became_peered":"2023-10-06T05:25:35.493318+0000","last_unstale":"2023-10-06T05:30:59.276155+0000","last_undegraded":"2023-10-06T05:30:59.276155+0000","last_fullsized":"2023-10-06T05:30:59.276155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:30:59.275963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:30:59.275963+0000","last_clean_scrub_stamp":"2023-10-06T05:30:59.275963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:50.760850+0000","scrub_duration":0.003743447,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-06T05:31:04.234159+0000","last_change":"2023-10-06T05:31:04.234076+0000","last_active":"2023-10-06T05:31:04.234159+0000","last_peered":"2023-10-06T05:31:04.234159+0000","last_clean":"2023-10-06T05:31:04.234159+0000","last_became_active":"2023-10-06T05:25:35.496304+0000","last_became_peered":"2023-10-06T05:25:35.496304+0000","last_unstale":"2023-10-06T05:31:04.234159+0000","last_undegraded":"2023-10-06T05:31:04.234159+0000","last_fullsized":"2023-10-06T05:31:04.234159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T05:31:04.233803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T05:31:04.233803+0000","last_clean_scrub_stamp":"2023-10-06T05:31:04.233803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:15.496806+0000","scrub_duration":0.0046242660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302948,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068892,"statfs":{"total":96636764160,"available":96326545408,"internally_reserved":0,"allocated":1601536,"data_stored":1040276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88200000000000001,"15min":0.85199999999999998},"min":{"1min":0.51200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.92100000000000004},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.131,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90700000000000003,"15min":0.90600000000000003},"min":{"1min":0.621,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.054}]},{"osd":2,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.65400000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.01,"5min":0.95499999999999996,"15min":0.91300000000000003},"min":{"1min":0.626,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.2110000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.77600000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.74299999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.268}]},{"osd":4,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.113,"15min":1.113},"min":{"1min":0.94699999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.0800000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0229999999999999,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5660000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.008},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.179,"15min":1.2010000000000001},"min":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.153}]},{"osd":6,"last update":"Fri Oct 6 05:30:33 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.119,"15min":1.141},"min":{"1min":0.83399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.24},{"interface":"front","average":{"1min":1.24,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0129999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.96599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85799999999999998,"15min":0.82099999999999995},"min":{"1min":0.56699999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.2330000000000001,"5min":1.623,"15min":1.623},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65500000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.048,"5min":1.403,"15min":1.403},"last":0.84499999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.23,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.196},{"interface":"front","average":{"1min":1.022,"5min":0.99399999999999999,"15min":0.97099999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3640000000000001,"5min":1.679,"15min":1.679},"last":0.90800000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.88100000000000001,"15min":0.83299999999999996},"min":{"1min":0.61899999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.111,"5min":1.643,"15min":1.643},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97399999999999998,"15min":0.89400000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.202,"5min":1.784,"15min":1.784},"last":1.0009999999999999}]},{"osd":3,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.92500000000000004,"15min":0.92100000000000004},"min":{"1min":0.73499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1819999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.109,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.278,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.2490000000000001}]},{"osd":4,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96299999999999997,"15min":0.95899999999999996},"min":{"1min":0.60499999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.292,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.071},"min":{"1min":0.73499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.262,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.089}]},{"osd":5,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.96799999999999997,"15min":0.97299999999999998},"min":{"1min":0.69499999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3380000000000001,"5min":1.583,"15min":1.583},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.155,"5min":1.117,"15min":1.0760000000000001},"min":{"1min":0.77300000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4430000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.137}]},{"osd":7,"last update":"Fri Oct 6 05:30:38 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0149999999999999,"15min":1.0089999999999999},"min":{"1min":0.75900000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1919999999999999,"5min":1.833,"15min":1.833},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.1220000000000001},"min":{"1min":0.88,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.409,"5min":1.899,"15min":1.899},"last":1.0669999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.91100000000000003,"15min":0.86599999999999999},"min":{"1min":0.61399999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3100000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.55600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.095,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.753}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90500000000000003,"15min":0.91500000000000004},"min":{"1min":0.58699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2310000000000001,"5min":1.409,"15min":1.409},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.93799999999999994},"min":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0409999999999999,"5min":1.411,"15min":1.411},"last":1.0900000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91900000000000004,"15min":0.93899999999999995},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.367,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.98199999999999998,"15min":0.96399999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1559999999999999,"5min":1.54,"15min":1.54},"last":1.141}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":0.98599999999999999,"15min":0.95599999999999996},"min":{"1min":0.66500000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2669999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.075,"15min":1.0940000000000001},"min":{"1min":0.76200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0389999999999999}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.999},"min":{"1min":0.69399999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1299999999999999,"5min":1.419,"15min":1.419},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1259999999999999,"15min":1.173},"min":{"1min":0.90700000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.347,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.94499999999999995}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.022,"15min":1.0940000000000001},"min":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.264,"5min":1.508,"15min":1.508},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0389999999999999,"15min":1.079},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.391}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.093,"15min":1.1339999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.399,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.173,"15min":1.2270000000000001},"min":{"1min":0.96999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3340000000000001,"5min":1.732,"15min":1.732},"last":1.3460000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.873,"15min":0.80500000000000005},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2010000000000001,"5min":1.329,"15min":1.329},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.236,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88600000000000001,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0920000000000001,"5min":1.266,"15min":1.266},"last":1.095},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.93000000000000005,"15min":0.98299999999999998},"min":{"1min":0.62,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95999999999999996,"15min":0.96999999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.458,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.70199999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.874}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96399999999999997,"15min":0.97599999999999998},"min":{"1min":0.64700000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1539999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":1,"5min":0.97799999999999998,"15min":0.97399999999999998},"min":{"1min":0.76200000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2490000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.91100000000000003}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":1.0389999999999999},"min":{"1min":0.66400000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.02,"15min":1.038},"min":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3640000000000001,"5min":1.458,"15min":1.458},"last":1.1200000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.323,"5min":1.429,"15min":1.429},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.105,"5min":1.1359999999999999,"15min":1.167},"min":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.542,"5min":1.548,"15min":1.548},"last":1.0680000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.415,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.177},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.145,"15min":1.1299999999999999},"min":{"1min":0.79000000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.425,"5min":1.75,"15min":1.75},"last":1.0349999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.071,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.111,"5min":1.379,"15min":1.379},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.72999999999999998,"15min":0.71499999999999997},"min":{"1min":0.55200000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":1.389,"15min":1.389},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81200000000000006,"15min":0.77100000000000002},"min":{"1min":0.59999999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1279999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.47499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2110000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90300000000000002,"15min":0.86399999999999999},"min":{"1min":0.72199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.26,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.016}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96499999999999997,"15min":0.99099999999999999},"min":{"1min":0.66300000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3340000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.81599999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4099999999999999,"5min":1.861,"15min":1.861},"last":1.0620000000000001}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.117,"15min":1.1240000000000001},"min":{"1min":0.93000000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.607,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.22,"5min":1.1359999999999999,"15min":1.105},"min":{"1min":0.876,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.51,"5min":1.732,"15min":1.732},"last":1.28}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0900000000000001,"15min":1.0860000000000001},"min":{"1min":0.89500000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4330000000000001,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.258},{"interface":"front","average":{"1min":1.26,"5min":1.2030000000000001,"15min":1.2},"min":{"1min":1.01,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.55,"5min":1.968,"15min":1.968},"last":1.3180000000000001}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.194,"15min":1.171},"min":{"1min":0.79900000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.587,"5min":1.762,"15min":1.762},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.93899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5009999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.466}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.51300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.107,"5min":1.29,"15min":1.29},"last":0.81299999999999994}]},{"osd":1,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90800000000000003,"15min":0.93300000000000005},"min":{"1min":0.59699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.383,"15min":1.383},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.86699999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.88500000000000001}]},{"osd":3,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.335,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.79800000000000004,"15min":0.84299999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":1.0920000000000001},"min":{"1min":0.66600000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.9119999999999999,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.747},{"interface":"front","average":{"1min":1.04,"5min":1.145,"15min":1.2210000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4219999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1000000000000001,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.752,"5min":1.829,"15min":1.829},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.111,"15min":1.175},"min":{"1min":0.80100000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8109999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.98099999999999998}]},{"osd":6,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.2190000000000001,"15min":1.2669999999999999},"min":{"1min":0.69399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1679999999999999,"15min":1.22},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.206}]},{"osd":7,"last update":"Fri Oct 6 05:30:35 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1819999999999999,"15min":1.2589999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.6100000000000001,"5min":1.972,"15min":1.972},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.2969999999999999,"15min":1.365},"min":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.859,"5min":2.04,"15min":2.04},"last":1.115}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":449908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71499999999999997,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0580000000000001,"5min":1.468,"15min":1.468},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.754,"15min":0.73799999999999999},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0469999999999999,"5min":1.294,"15min":1.294},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.61799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81000000000000005,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.83399999999999996,"15min":0.79300000000000004},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.167,"5min":1.419,"15min":1.419},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.86499999999999999,"15min":0.90500000000000003},"min":{"1min":0.54100000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.87,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.6890000000000001,"5min":3.6890000000000001,"15min":3.6890000000000001},"last":0.997},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.133,"15min":1.165},"min":{"1min":0.94099999999999995,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":1.034}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.127,"15min":1.1890000000000001},"min":{"1min":0.81100000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.1659999999999999,"15min":1.2230000000000001},"min":{"1min":0.92600000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.464,"5min":2.02,"15min":2.02},"last":1.3140000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1399999999999999,"15min":1.1299999999999999},"min":{"1min":0.90600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.222,"15min":1.23},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":1.381}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.238,"15min":1.2889999999999999},"min":{"1min":0.96499999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.4119999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.2370000000000001,"15min":1.2150000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.2709999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.1930000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302948,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068892,"statfs":{"total":96636764160,"available":96326545408,"internally_reserved":0,"allocated":1601536,"data_stored":1040276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.748},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.077,"5min":1.208,"15min":1.208},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.71299999999999997},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89800000000000002,"15min":0.89300000000000002},"min":{"1min":0.63800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.95599999999999996}]},{"osd":4,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.008,"15min":1.0129999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2929999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.004,"15min":1.016},"min":{"1min":0.74399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.169,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1759999999999999,"5min":1.49,"15min":1.49},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.159,"5min":1.155,"15min":1.157},"min":{"1min":0.877,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.403,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.1200000000000001}]},{"osd":6,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.236},"min":{"1min":1,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4870000000000001,"5min":1.696,"15min":1.696},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1679999999999999,"15min":1.202},"min":{"1min":0.83699999999999997,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3919999999999999,"5min":1.738,"15min":1.738},"last":1.145}]},{"osd":7,"last update":"Fri Oct 6 05:30:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.202,"15min":1.252},"min":{"1min":0.88500000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.347,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.26},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1799999999999999,"15min":1.2270000000000001},"min":{"1min":0.81999999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2649999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.212}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T05:31:22.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T05:31:22.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7db4c700 1 Processor -- start 2023-10-06T05:31:22.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7db4c700 1 -- start start 2023-10-06T05:31:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7db4c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf7815d730 0x7fcf7806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7db4c700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcf7806cc00 0x7fcf7806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7db4c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780cacd0 con 0x7fcf78158f10 2023-10-06T05:31:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7db4c700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7806a600 con 0x7fcf7806cc00 2023-10-06T05:31:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7db4c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7806d080 con 0x7fcf7815d730 2023-10-06T05:31:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7cb4a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcf78158f10 0x7fcf780ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52218/0 (socket says 172.21.15.29:52218) 2023-10-06T05:31:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7cb4a700 1 -- 172.21.15.29:0/855251712 learned_addr learned my addr 172.21.15.29:0/855251712 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-06T05:31:22.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf6ffff700 1 --2- 172.21.15.29:0/855251712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf7815d730 0x7fcf7806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7d34b700 1 --2- 172.21.15.29:0/855251712 >> v2:172.21.15.173:3300/0 conn(0x7fcf7806cc00 0x7fcf7806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf6f7fe700 1 -- 172.21.15.29:0/855251712 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856233270 0 0) 0x7fcf780cacd0 con 0x7fcf78158f10 2023-10-06T05:31:22.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf6f7fe700 1 -- 172.21.15.29:0/855251712 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf60003570 con 0x7fcf78158f10 2023-10-06T05:31:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf6f7fe700 1 -- 172.21.15.29:0/855251712 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134542339 0 0) 0x7fcf60003570 con 0x7fcf78158f10 2023-10-06T05:31:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7d34b700 1 -- 172.21.15.29:0/855251712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf7815d730 msgr2=0x7fcf7806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.598+0000 7fcf7d34b700 1 --2- 172.21.15.29:0/855251712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf7815d730 0x7fcf7806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7d34b700 1 -- 172.21.15.29:0/855251712 >> v1:172.21.15.29:6789/0 conn(0x7fcf78158f10 legacy=0x7fcf780ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7d34b700 1 -- 172.21.15.29:0/855251712 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780cafb0 con 0x7fcf7806cc00 2023-10-06T05:31:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf6ffff700 1 --2- 172.21.15.29:0/855251712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf7815d730 0x7fcf7806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T05:31:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7d34b700 1 --2- 172.21.15.29:0/855251712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf7806cc00 0x7fcf7806aa50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009e90 tx=0x7fcf70009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f58752a7388583e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:22.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf6f7fe700 1 -- 172.21.15.29:0/855251712 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7000e070 con 0x7fcf7806cc00 2023-10-06T05:31:22.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf6f7fe700 1 -- 172.21.15.29:0/855251712 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7000b870 con 0x7fcf7806cc00 2023-10-06T05:31:22.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf6f7fe700 1 -- 172.21.15.29:0/855251712 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74001470 con 0x7fcf7806cc00 2023-10-06T05:31:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7db4c700 1 -- 172.21.15.29:0/855251712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf7806cc00 msgr2=0x7fcf7806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7db4c700 1 --2- 172.21.15.29:0/855251712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf7806cc00 0x7fcf7806aa50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009e90 tx=0x7fcf70009780 comp rx=0 tx=0).stop 2023-10-06T05:31:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7db4c700 1 -- 172.21.15.29:0/855251712 shutdown_connections 2023-10-06T05:31:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7db4c700 1 --2- 172.21.15.29:0/855251712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf7806cc00 0x7fcf7806aa50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7db4c700 1 --2- 172.21.15.29:0/855251712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf7815d730 0x7fcf7806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7db4c700 1 -- 172.21.15.29:0/855251712 >> 172.21.15.29:0/855251712 conn(0x7fcf78062b60 msgr2=0x7fcf78062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7db4c700 1 -- 172.21.15.29:0/855251712 shutdown_connections 2023-10-06T05:31:22.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.602+0000 7fcf7db4c700 1 -- 172.21.15.29:0/855251712 wait complete. 2023-10-06T05:31:22.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7db4c700 1 Processor -- start 2023-10-06T05:31:22.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7db4c700 1 -- start start 2023-10-06T05:31:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7db4c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf7806cc00 0x7fcf781572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7db4c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf78158f10 0x7fcf7815b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7db4c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf7815d730 0x7fcf780b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7db4c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780b33e0 con 0x7fcf7815d730 2023-10-06T05:31:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7db4c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7815bd10 con 0x7fcf7806cc00 2023-10-06T05:31:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7db4c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7815bff0 con 0x7fcf78158f10 2023-10-06T05:31:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7d34b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf7815d730 0x7fcf780b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7d34b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf7815d730 0x7fcf780b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58180/0 (socket says 172.21.15.29:58180) 2023-10-06T05:31:22.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7d34b700 1 -- 172.21.15.29:0/1820122414 learned_addr learned my addr 172.21.15.29:0/1820122414 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:22.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf6ffff700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf78158f10 0x7fcf7815b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.606+0000 7fcf7cb4a700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf7806cc00 0x7fcf781572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf7d34b700 1 -- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf78158f10 msgr2=0x7fcf7815b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf7d34b700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf78158f10 0x7fcf7815b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf7d34b700 1 -- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf7806cc00 msgr2=0x7fcf781572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf7d34b700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf7806cc00 0x7fcf781572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf7d34b700 1 -- 172.21.15.29:0/1820122414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68009420 con 0x7fcf7815d730 2023-10-06T05:31:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf7d34b700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf7815d730 0x7fcf780b3b50 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fcf700097c0 tx=0x7fcf70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:22.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf6cff9700 1 -- 172.21.15.29:0/1820122414 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70012bb0 con 0x7fcf7815d730 2023-10-06T05:31:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf6cff9700 1 -- 172.21.15.29:0/1820122414 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf70012d30 con 0x7fcf7815d730 2023-10-06T05:31:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf6cff9700 1 -- 172.21.15.29:0/1820122414 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70012ea0 con 0x7fcf7815d730 2023-10-06T05:31:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf7db4c700 1 -- 172.21.15.29:0/1820122414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf70009a20 con 0x7fcf7815d730 2023-10-06T05:31:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf7db4c700 1 -- 172.21.15.29:0/1820122414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf780b3630 con 0x7fcf7815d730 2023-10-06T05:31:22.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf5e7fc700 1 -- 172.21.15.29:0/1820122414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf500052b0 con 0x7fcf7815d730 2023-10-06T05:31:22.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.610+0000 7fcf6cff9700 1 -- 172.21.15.29:0/1820122414 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcf7001d440 con 0x7fcf7815d730 2023-10-06T05:31:22.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.614+0000 7fcf6cff9700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcf64060550 0x7fcf64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.614+0000 7fcf6cff9700 1 -- 172.21.15.29:0/1820122414 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcf7007e260 con 0x7fcf7815d730 2023-10-06T05:31:22.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.614+0000 7fcf7cb4a700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcf64060550 0x7fcf64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.614+0000 7fcf7cb4a700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcf64060550 0x7fcf64062a00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcf74004e40 tx=0x7fcf74001aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:22.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.622+0000 7fcf6cff9700 1 -- 172.21.15.29:0/1820122414 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcf7004ea00 con 0x7fcf7815d730 2023-10-06T05:31:22.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.782+0000 7fcf5e7fc700 1 -- 172.21.15.29:0/1820122414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fcf50005830 con 0x7fcf7815d730 2023-10-06T05:31:22.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.790+0000 7fcf6cff9700 1 -- 172.21.15.29:0/1820122414 <== mon.0 v2:172.21.15.29:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcf7004ea00 con 0x7fcf7815d730 2023-10-06T05:31:22.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.794+0000 7fcf6cff9700 1 -- 172.21.15.29:0/1820122414 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v18)=0 v18) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcf70052020 con 0x7fcf7815d730 2023-10-06T05:31:22.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 -- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcf64060550 msgr2=0x7fcf64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcf64060550 0x7fcf64062a00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcf74004e40 tx=0x7fcf74001aa0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 -- 172.21.15.29:0/1820122414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf7815d730 msgr2=0x7fcf780b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf7815d730 0x7fcf780b3b50 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fcf700097c0 tx=0x7fcf70017000 comp rx=0 tx=0).stop 2023-10-06T05:31:22.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 -- 172.21.15.29:0/1820122414 shutdown_connections 2023-10-06T05:31:22.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf7815d730 0x7fcf780b3b50 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf78158f10 0x7fcf7815b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7fcf64060550 0x7fcf64062a00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 --2- 172.21.15.29:0/1820122414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf7806cc00 0x7fcf781572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 -- 172.21.15.29:0/1820122414 >> 172.21.15.29:0/1820122414 conn(0x7fcf78062b60 msgr2=0x7fcf78157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:22.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 -- 172.21.15.29:0/1820122414 shutdown_connections 2023-10-06T05:31:22.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.798+0000 7fcf5e7fc700 1 -- 172.21.15.29:0/1820122414 wait complete. 2023-10-06T05:31:22.820 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T05:31:22.820 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T05:31:22.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f2028934700 1 Processor -- start 2023-10-06T05:31:22.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f2028934700 1 -- start start 2023-10-06T05:31:22.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f2028934700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20240c8b50 0x7f202406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f2028934700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2024155cb0 0x7f202406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f2028934700 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202406b9e0 con 0x7f202406c8f0 2023-10-06T05:31:22.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f2028934700 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240cb7e0 con 0x7f2024155cb0 2023-10-06T05:31:22.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f2028934700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20240caf80 con 0x7f20240c8b50 2023-10-06T05:31:22.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f202359e700 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2024155cb0 0x7f202406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f202259c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20240c8b50 0x7f202406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f202259c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20240c8b50 0x7f202406ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.29:57258/0 (socket says 172.21.15.29:57258) 2023-10-06T05:31:22.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f202259c700 1 -- 172.21.15.29:0/1430138464 learned_addr learned my addr 172.21.15.29:0/1430138464 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:22.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f2022d9d700 1 --1- 172.21.15.29:0/1430138464 >> v1:172.21.15.173:6789/0 conn(0x7f202406c8f0 0x7f20241555a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.29:58348/0 (socket says 172.21.15.29:58348) 2023-10-06T05:31:22.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f202259c700 1 -- 172.21.15.29:0/1430138464 >> v2:172.21.15.173:3300/0 conn(0x7f2024155cb0 msgr2=0x7f202406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T05:31:22.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f202259c700 1 --2- 172.21.15.29:0/1430138464 >> v2:172.21.15.173:3300/0 conn(0x7f2024155cb0 0x7f202406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f202259c700 1 -- 172.21.15.29:0/1430138464 >> v1:172.21.15.173:6789/0 conn(0x7f202406c8f0 legacy=0x7f20241555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f202259c700 1 -- 172.21.15.29:0/1430138464 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240c7660 con 0x7f20240c8b50 2023-10-06T05:31:22.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.918+0000 7f202259c700 1 --2- 172.21.15.29:0/1430138464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20240c8b50 0x7f202406ccc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f200c009f20 tx=0x7f200c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df4cfb4a70db3893 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2021d9b700 1 -- 172.21.15.29:0/1430138464 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00e070 con 0x7f20240c8b50 2023-10-06T05:31:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2021d9b700 1 -- 172.21.15.29:0/1430138464 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f200c00b9d0 con 0x7f20240c8b50 2023-10-06T05:31:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2021d9b700 1 -- 172.21.15.29:0/1430138464 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0092e0 con 0x7f20240c8b50 2023-10-06T05:31:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 -- 172.21.15.29:0/1430138464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20240c8b50 msgr2=0x7f202406ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 --2- 172.21.15.29:0/1430138464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20240c8b50 0x7f202406ccc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f200c009f20 tx=0x7f200c009840 comp rx=0 tx=0).stop 2023-10-06T05:31:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 -- 172.21.15.29:0/1430138464 shutdown_connections 2023-10-06T05:31:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 --2- 172.21.15.29:0/1430138464 >> v2:172.21.15.173:3300/0 conn(0x7f2024155cb0 0x7f202406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 --2- 172.21.15.29:0/1430138464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20240c8b50 0x7f202406ccc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 -- 172.21.15.29:0/1430138464 >> 172.21.15.29:0/1430138464 conn(0x7f20240670a0 msgr2=0x7f20240674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:22.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 -- 172.21.15.29:0/1430138464 shutdown_connections 2023-10-06T05:31:22.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 -- 172.21.15.29:0/1430138464 wait complete. 2023-10-06T05:31:22.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 Processor -- start 2023-10-06T05:31:22.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 -- start start 2023-10-06T05:31:22.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f202406c8f0 0x7f2024152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2024155cb0 0x7f202413bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20241534d0 0x7f202413c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2024137050 con 0x7f20241534d0 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202413dee0 con 0x7f202406c8f0 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2028934700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202413e460 con 0x7f2024155cb0 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f202359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20241534d0 0x7f202413c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f202359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20241534d0 0x7f202413c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58188/0 (socket says 172.21.15.29:58188) 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f202359e700 1 -- 172.21.15.29:0/3958118104 learned_addr learned my addr 172.21.15.29:0/3958118104 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f202259c700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2024155cb0 0x7f202413bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f2022d9d700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f202406c8f0 0x7f2024152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f202359e700 1 -- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2024155cb0 msgr2=0x7f202413bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f202359e700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2024155cb0 0x7f202413bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f202359e700 1 -- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f202406c8f0 msgr2=0x7f2024152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f202359e700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f202406c8f0 0x7f2024152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:22.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.922+0000 7f202359e700 1 -- 172.21.15.29:0/3958118104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c009ae0 con 0x7f20241534d0 2023-10-06T05:31:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f202359e700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20241534d0 0x7f202413c490 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f201c00ea50 tx=0x7f201c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f201affd700 1 -- 172.21.15.29:0/3958118104 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00ee90 con 0x7f20241534d0 2023-10-06T05:31:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202413e180 con 0x7f20241534d0 2023-10-06T05:31:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f201affd700 1 -- 172.21.15.29:0/3958118104 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f201c00c850 con 0x7f20241534d0 2023-10-06T05:31:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f201affd700 1 -- 172.21.15.29:0/3958118104 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00cc30 con 0x7f20241534d0 2023-10-06T05:31:22.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2024136ce0 con 0x7f20241534d0 2023-10-06T05:31:22.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20241371c0 con 0x7f20241534d0 2023-10-06T05:31:22.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f201affd700 1 -- 172.21.15.29:0/3958118104 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f201c013470 con 0x7f20241534d0 2023-10-06T05:31:22.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f201affd700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2004060580 0x7f2004062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T05:31:22.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f201affd700 1 -- 172.21.15.29:0/3958118104 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f201c07c920 con 0x7f20241534d0 2023-10-06T05:31:22.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.926+0000 7f2022d9d700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2004060580 0x7f2004062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T05:31:22.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.930+0000 7f2022d9d700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2004060580 0x7f2004062a30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f20240c9bd0 tx=0x7f2014000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T05:31:22.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:22.938+0000 7f201affd700 1 -- 172.21.15.29:0/3958118104 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f201c04d000 con 0x7f20241534d0 2023-10-06T05:31:23.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.138+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f202404be00 con 0x7f20241534d0 2023-10-06T05:31:23.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.138+0000 7f201affd700 1 -- 172.21.15.29:0/3958118104 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f201c017de0 con 0x7f20241534d0 2023-10-06T05:31:23.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-06T05:31:23.147 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6836/3892742658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3892742658},{"type":"v1","addr":"172.21.15.173:6836","nonce":3892742658}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3702615451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3702615451},{"type":"v1","addr":"172.21.15.29:6833","nonce":3702615451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3665883211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6835","nonce":3665883211},{"type":"v1","addr":"172.21.15.173:6837","nonce":3665883211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":7012,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2165058706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":2165058706},{"type":"v1","addr":"172.21.15.29:6835","nonce":2165058706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[]} 2023-10-06T05:31:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2004060580 msgr2=0x7f2004062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2004060580 0x7f2004062a30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f20240c9bd0 tx=0x7f2014000bc0 comp rx=0 tx=0).stop 2023-10-06T05:31:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20241534d0 msgr2=0x7f202413c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T05:31:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20241534d0 0x7f202413c490 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f201c00ea50 tx=0x7f201c0091a0 comp rx=0 tx=0).stop 2023-10-06T05:31:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 shutdown_connections 2023-10-06T05:31:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20241534d0 0x7f202413c490 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2024155cb0 0x7f202413bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:23.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:6832/33379,v1:172.21.15.173:6833/33379] conn(0x7f2004060580 0x7f2004062a30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 --2- 172.21.15.29:0/3958118104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f202406c8f0 0x7f2024152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T05:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 >> 172.21.15.29:0/3958118104 conn(0x7f20240670a0 msgr2=0x7f202406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T05:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 shutdown_connections 2023-10-06T05:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-06T05:31:23.142+0000 7f2028934700 1 -- 172.21.15.29:0/3958118104 wait complete. 2023-10-06T05:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 56 2023-10-06T05:31:23.161 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T05:31:23.162 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T05:31:23.162 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T05:31:23.162 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.176 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T05:31:23.177 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T05:31:23.177 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.191 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T05:31:23.191 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T05:31:23.191 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.207 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T05:31:23.208 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T05:31:23.208 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.219 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T05:31:23.219 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T05:31:23.219 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T05:31:23.219 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.296 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T05:31:23.297 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T05:31:23.297 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.380 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T05:31:23.380 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T05:31:23.380 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.465 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T05:31:23.465 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T05:31:23.465 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.534 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T05:31:23.534 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T05:31:23.534 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.594 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T05:31:23.594 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T05:31:23.594 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.670 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T05:31:23.670 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T05:31:23.670 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.741 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T05:31:23.741 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T05:31:23.742 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.804 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T05:31:23.804 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T05:31:23.805 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T05:31:23.805 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.830 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T05:31:23.830 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T05:31:23.830 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.859 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T05:31:23.859 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T05:31:23.859 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T05:31:23.859 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.876 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T05:31:23.876 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T05:31:23.877 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.897 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T05:31:23.897 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T05:31:23.897 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T05:31:23.961 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T05:31:23.961 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T05:31:23.962 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-10-06T05:31:23.983 INFO:teuthology.orchestra.run.smithi029.stdout:1696569935.4875236 mon.a (mon.0) 125 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T05:31:23.984 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T05:31:23.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-10-06T05:31:24.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-10-06T05:31:24.065 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-10-06T05:31:24.078 INFO:teuthology.orchestra.run.smithi029.stdout:1696569935.4875236 mon.a (mon.0) 125 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T05:31:24.079 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:31:24.079 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T05:31:24.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:31:24.441 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T05:31:24.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:31:24.745 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T05:31:24.985 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:31:24.986 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T05:31:25.218 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:31:25.219 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T05:31:25.554 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:31:25.554 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T05:31:25.773 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:31:25.774 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T05:31:26.010 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:31:26.010 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T05:31:26.223 INFO:tasks.ceph:Archiving mon data... 2023-10-06T05:31:26.224 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/data/mon.a.tgz 2023-10-06T05:31:26.225 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2023-10-06T05:31:26.232 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.JnRw9aoRBq 2023-10-06T05:31:26.232 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JnRw9aoRBq 2023-10-06T05:31:26.383 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.JnRw9aoRBq 2023-10-06T05:31:26.410 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.JnRw9aoRBq is 447KB 2023-10-06T05:31:26.471 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.JnRw9aoRBq 2023-10-06T05:31:26.478 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/data/mon.b.tgz 2023-10-06T05:31:26.478 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2023-10-06T05:31:26.485 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.JxAjbSm01p 2023-10-06T05:31:26.485 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.JxAjbSm01p 2023-10-06T05:31:26.624 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.JxAjbSm01p 2023-10-06T05:31:26.648 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.JxAjbSm01p is 575KB 2023-10-06T05:31:26.715 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.JxAjbSm01p 2023-10-06T05:31:26.722 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/data/mon.c.tgz 2023-10-06T05:31:26.722 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2023-10-06T05:31:26.728 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.uBeJRrJw3y 2023-10-06T05:31:26.728 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uBeJRrJw3y 2023-10-06T05:31:26.866 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.uBeJRrJw3y 2023-10-06T05:31:26.889 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.uBeJRrJw3y is 575KB 2023-10-06T05:31:26.955 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.uBeJRrJw3y 2023-10-06T05:31:26.961 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T05:31:26.962 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T05:31:26.964 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T05:31:26.979 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T05:31:26.979 DEBUG:teuthology.orchestra.run.smithi029:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T05:31:27.022 DEBUG:teuthology.orchestra.run.smithi173:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T05:31:27.047 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T05:31:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T05:31:27.062 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T05:31:27.063 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/remote/smithi029/crash 2023-10-06T05:31:27.064 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T05:31:27.079 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/remote/smithi173/crash 2023-10-06T05:31:27.079 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T05:31:27.111 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T05:31:27.111 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:31:27.114 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T05:31:27.191 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T05:31:27.215 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T05:31:27.231 INFO:tasks.ceph:Compressing logs... 2023-10-06T05:31:27.231 DEBUG:teuthology.orchestra.run.smithi029:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T05:31:27.233 DEBUG:teuthology.orchestra.run.smithi173:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T05:31:29.456 INFO:tasks.ceph:Archiving logs... 2023-10-06T05:31:29.456 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/remote/smithi029/log 2023-10-06T05:31:29.457 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T05:31:30.018 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/remote/smithi173/log 2023-10-06T05:31:30.019 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T05:31:30.262 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T05:31:30.274 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T05:31:30.274 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T05:31:30.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T05:31:30.356 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T05:31:30.365 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T05:31:30.366 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T05:31:30.368 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T05:31:30.391 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T05:31:30.391 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2023-10-06T05:31:30.391 INFO:teuthology.orchestra.run.smithi029.stdout:*hv01.front.sepi 44.4.53.2 2 u 52 64 377 0.067 0.894 0.410 2023-10-06T05:31:30.392 INFO:teuthology.orchestra.run.smithi029.stdout:+hv02.front.sepi 63.231.80.2 3 u 46 64 377 0.064 1.124 0.362 2023-10-06T05:31:30.392 INFO:teuthology.orchestra.run.smithi029.stdout:+hv03.front.sepi 74.6.168.72 3 u 46 64 377 0.068 0.400 0.405 2023-10-06T05:31:30.392 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:31:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T05:31:30.393 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2023-10-06T05:31:30.393 INFO:teuthology.orchestra.run.smithi173.stdout:*hv01.front.sepi 44.4.53.2 2 u 52 64 377 0.098 -0.340 0.338 2023-10-06T05:31:30.393 INFO:teuthology.orchestra.run.smithi173.stdout:+hv02.front.sepi 63.231.80.2 3 u 56 64 377 0.083 0.117 0.391 2023-10-06T05:31:30.394 INFO:teuthology.orchestra.run.smithi173.stdout:+hv03.front.sepi 74.6.168.72 3 u 55 64 377 0.083 -0.443 0.327 2023-10-06T05:31:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T05:31:30.395 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T05:31:30.404 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T05:31:30.405 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T05:31:30.434 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T05:31:30.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T05:31:30.517 INFO:teuthology.task.internal:Duration was 938.563712 seconds 2023-10-06T05:31:30.517 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T05:31:30.559 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T05:31:30.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T05:31:30.561 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T05:31:30.612 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T05:31:30.613 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2023-10-06T05:31:30.613 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T05:31:30.626 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2023-10-06T05:31:30.626 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T05:31:30.637 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T05:31:30.637 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T05:31:30.670 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T05:31:30.707 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T05:31:30.708 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T05:31:30.710 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T05:31:30.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T05:31:30.821 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T05:31:30.821 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T05:31:30.837 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T05:31:30.852 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T05:31:30.866 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T05:31:30.882 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T05:31:30.895 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2023-10-06T05:31:30.896 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2023-10-06T05:31:30.913 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T05:31:30.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:31:30.919 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T05:31:30.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T05:31:30.962 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T05:31:30.974 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T05:31:30.974 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/remote/smithi029 2023-10-06T05:31:30.974 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T05:31:30.998 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332/remote/smithi173 2023-10-06T05:31:30.998 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T05:31:31.021 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T05:31:31.021 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T05:31:31.038 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T05:31:31.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T05:31:31.079 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T05:31:31.079 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T05:31:31.110 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T05:31:31.110 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T05:31:31.113 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T05:31:31.118 INFO:teuthology.orchestra.run.smithi029.stdout: 924113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 05:31 /home/ubuntu/cephtest 2023-10-06T05:31:31.121 INFO:teuthology.orchestra.run.smithi173.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 05:31 /home/ubuntu/cephtest 2023-10-06T05:31:31.123 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T05:31:31.153 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T05:31:31.236 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T05:31:31.259 DEBUG:teuthology.nuke:shortname: smithi029 2023-10-06T05:31:31.259 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T05:31:31.283 DEBUG:teuthology.nuke:shortname: smithi173 2023-10-06T05:31:31.283 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T05:31:31.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 05:04:17.514767', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T05:31:31.309 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 05:04:17.513396', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T05:31:31.339 INFO:teuthology.orchestra.console.smithi029:Power off 2023-10-06T05:31:31.339 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T05:31:31.362 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-10-06T05:31:31.362 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:31:31.381 INFO:teuthology.orchestra.console.smithi173:Power off 2023-10-06T05:31:31.381 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T05:31:31.393 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-06T05:31:31.403 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-10-06T05:31:31.403 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:31:31.427 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-10-06T05:31:35.395 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:31:35.428 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:31:35.504 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-06T05:31:35.537 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-10-06T05:31:39.507 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:31:39.538 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T05:31:39.618 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-10-06T05:31:39.647 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-10-06T05:31:39.719 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-10-06T05:31:39.748 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-10-06T05:31:39.852 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} duration: 938.5637123584747 failure_reason: '"1696569935.4875236 mon.a (mon.0) 125 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T05:31:39.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T05:31:39.924 INFO:teuthology.run:FAIL